2023-10-08T12:41:24.432 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T12:41:24.432 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960 --owner scheduled_pdonnell@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/orig.config.yaml 2023-10-08T12:41:24.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T12:41:24.607 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960 branch: wip-batrick-testing-20231007.154158 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7417960' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T12:41:24.608 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T12:41:24.609 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T12:41:24.609 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T12:41:24.610 INFO:teuthology.task.internal:Checking packages... 2023-10-08T12:41:24.633 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T12:41:24.633 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T12:41:24.633 INFO:teuthology.packaging:ref: None 2023-10-08T12:41:24.633 INFO:teuthology.packaging:tag: None 2023-10-08T12:41:24.634 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T12:41:24.634 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:41:24.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T12:41:24.787 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639.g7b3143ba 2023-10-08T12:41:24.788 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T12:41:24.794 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T12:41:24.794 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T12:41:24.810 INFO:teuthology.task.internal:Saving configuration 2023-10-08T12:41:24.833 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T12:41:24.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T12:41:24.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:35:30.818106', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:41:24.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:35:30.816818', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:41:24.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:35:30.814754', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:41:24.909 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T12:41:24.915 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-08T12:41:24.915 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-08T12:41:24.915 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-08T12:41:24.915 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T12:41:25.017 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2cd493eb80>, signals=[15]) 2023-10-08T12:41:25.017 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T12:41:25.023 INFO:teuthology.task.internal:Opening connections... 2023-10-08T12:41:25.023 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T12:41:25.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:41:25.093 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T12:41:25.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:41:25.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-10-08T12:41:25.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:41:25.234 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T12:41:25.241 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-10-08T12:41:25.263 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-10-08T12:41:25.263 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-10-08T12:41:25.323 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:41:25.323 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:41:25.323 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-10-08T12:41:25.323 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:41:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:41:25.325 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:41:25.325 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:41:25.325 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-10-08T12:41:25.355 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-10-08T12:41:25.376 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-10-08T12:41:25.377 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:41:25.437 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:41:25.438 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:41:25.439 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-10-08T12:41:25.464 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-10-08T12:41:25.484 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-10-08T12:41:25.484 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-10-08T12:41:25.548 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:41:25.548 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:41:25.548 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-10-08T12:41:25.548 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:41:25.549 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:41:25.550 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:41:25.550 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:41:25.550 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-10-08T12:41:25.572 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T12:41:25.582 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T12:41:25.588 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T12:41:25.588 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:41:25.590 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:41:25.593 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:41:25.612 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T12:41:25.618 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T12:41:25.618 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:41:25.651 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:41:25.653 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:41:25.696 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T12:41:25.773 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T12:41:25.787 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T12:41:25.788 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-08T12:41:25.788 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-08T12:41:25.788 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:41:25.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:25.808 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-10-08T12:41:25.868 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:41:25.868 INFO:teuthology.task.kernel:Running kernel on smithi005: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:41:25.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2023-10-08T12:41:27.093 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:41:27.093 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-08T12:41:28.674 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-10-08T12:41:29.416 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-08T12:41:33.116 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 637 kB/s | 24 kB 00:00 2023-10-08T12:41:33.844 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T12:41:33.903 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-08T12:41:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-10-08T12:41:33.904 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-08T12:41:34.051 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2023-10-08T12:41:34.402 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:41:34.402 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-08T12:41:34.690 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 12:41:33 PM UTC. 2023-10-08T12:41:34.739 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:41:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-10-08T12:41:34.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2023-10-08T12:41:35.169 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:41:35.170 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-10-08T12:41:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:41:33 PM UTC. 2023-10-08T12:41:35.498 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:41:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-10-08T12:41:35.576 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T12:41:35.658 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T12:41:35.658 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:41:35.659 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T12:41:35.659 DEBUG:teuthology.parallel:result is None 2023-10-08T12:41:35.659 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T12:41:35.666 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T12:41:35.666 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:41:35.669 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:41:35.672 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:41:35.694 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T12:41:35.702 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T12:41:35.708 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T12:41:35.708 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:41:35.725 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:41:35.731 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:41:35.784 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T12:41:35.791 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T12:41:35.791 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:41:35.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:35.819 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:41:35.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:35.838 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:41:35.840 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:41:35.862 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:41:35.879 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:41:35.897 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:41:35.921 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:41:35.934 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:41:35.951 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:41:35.953 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:41:35.955 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T12:41:35.962 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T12:41:35.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:41:35.964 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:41:35.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:41:35.996 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T12:41:36.005 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T12:41:36.005 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:41:36.032 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:41:36.036 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:41:36.054 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:41:36.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:41:36.191 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:41:36.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:41:36.317 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:41:36.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:41:36.385 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:41:36.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:41:36.500 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:41:36.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:41:36.592 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:41:36.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:41:36.662 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:41:36.708 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:41:36.767 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:41:36.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:41:36.903 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:41:36.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:41:36.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-10-08T12:41:36.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-10-08T12:41:36.980 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-10-08T12:41:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:41:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:41:37.084 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:41:37.532 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T12:41:37.542 INFO:teuthology.task.internal:Starting timer... 2023-10-08T12:41:37.542 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T12:41:37.568 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T12:41:37.577 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T12:41:37.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2023-10-08T12:41:37.639 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2023-10-08T12:41:37.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2023-10-08T12:41:37.703 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2023-10-08T12:41:37.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-10-08T12:41:37.781 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2023-10-08T12:41:37.783 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T12:41:37.783 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2023-10-08T12:41:37.806 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2023-10-08T12:41:37.806 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2023-10-08T12:41:37.832 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2023-10-08T12:41:37.832 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-10-08T12:41:37.851 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-10-08T12:41:37.851 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2023-10-08T12:41:37.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:41:37.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:37.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:41:37.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:37.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:41:37.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:41:37.938 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T12:41:37.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:41:37.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:41:38.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:41:38.027 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T12:41:38.037 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T12:41:38.041 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T12:41:38.182 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T12:41:38.202 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T12:41:38.203 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi060.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T12:52:29.171 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2023-10-08T12:52:29.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-08T12:52:29.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:52:29.242 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-10-08T12:52:29.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-08T12:52:29.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T12:52:29.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:52:29.380 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-08T12:52:29.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-08T12:52:29.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-08T12:52:29.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:52:29.517 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-08T12:52:29.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-08T12:52:29.591 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T12:52:29.604 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T12:52:29.605 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:52:29.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:52:29.608 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:52:29.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:52:29.610 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:52:29.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:52:29.641 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:52:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:52:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:52:29.658 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:52:29.663 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:52:29.678 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:52:29.728 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2023-10-08T12:52:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2023-10-08T12:52:29.741 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2023-10-08T12:52:29.741 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2023-10-08T12:52:29.746 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-10-08T12:52:29.755 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:52:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:52:29.758 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-10-08T12:52:29.770 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:52:29.772 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:52:29.773 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:52:29.788 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:52:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-08T12:52:29.838 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:52:29.838 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-08T12:52:29.838 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.838 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.838 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.838 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.844 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-10-08T12:52:29.847 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:52:29.847 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-10-08T12:52:29.847 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.848 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.848 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.848 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.858 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-10-08T12:52:29.861 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:52:29.861 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-10-08T12:52:29.861 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.861 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.861 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.861 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:52:29.862 INFO:teuthology.run_tasks:Running task pexec... 2023-10-08T12:52:29.872 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-08T12:52:29.872 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T12:52:29.872 DEBUG:teuthology.orchestra.run.smithi005:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:52:29.872 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T12:52:29.873 DEBUG:teuthology.orchestra.run.smithi060:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:52:29.873 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi118.front.sepia.ceph.com 2023-10-08T12:52:29.873 DEBUG:teuthology.orchestra.run.smithi118:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:52:30.268 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T12:52:30.271 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-08T12:52:30.280 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:52:31.848 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:02:08 ago on Sun 08 Oct 2023 12:50:23 PM UTC. 2023-10-08T12:52:31.859 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:48 ago on Sun 08 Oct 2023 12:50:43 PM UTC. 2023-10-08T12:52:31.923 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:58 ago on Sun 08 Oct 2023 12:50:33 PM UTC. 2023-10-08T12:52:33.594 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout:Resetting modules: 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout: container-tools 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-10-08T12:52:33.595 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:52:33.832 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout:Resetting modules: 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2023-10-08T12:52:33.834 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:52:33.914 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-08T12:52:33.915 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-10-08T12:52:33.915 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout:Resetting modules: 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2023-10-08T12:52:33.916 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:52:34.555 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:02:11 ago on Sun 08 Oct 2023 12:50:23 PM UTC. 2023-10-08T12:52:34.849 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:51 ago on Sun 08 Oct 2023 12:50:43 PM UTC. 2023-10-08T12:52:34.925 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:01 ago on Sun 08 Oct 2023 12:50:33 PM UTC. 2023-10-08T12:52:43.124 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-08T12:52:43.230 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-08T12:52:43.251 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-08T12:52:43.669 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T12:52:43.707 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-08T12:52:43.720 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:52:45.319 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:11 ago on Sun 08 Oct 2023 12:50:33 PM UTC. 2023-10-08T12:52:45.322 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:01 ago on Sun 08 Oct 2023 12:50:43 PM UTC. 2023-10-08T12:52:45.342 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:02:21 ago on Sun 08 Oct 2023 12:50:23 PM UTC. 2023-10-08T12:52:47.064 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-08T12:52:47.155 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================================ 2023-10-08T12:52:47.155 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-10-08T12:52:47.155 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================================ 2023-10-08T12:52:47.155 INFO:teuthology.orchestra.run.smithi118.stdout:Installing group/module packages: 2023-10-08T12:52:47.155 INFO:teuthology.orchestra.run.smithi118.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:52:47.156 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout:Installing module profiles: 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout: container-tools/common 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling module streams: 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout: container-tools rhel8 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================================ 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout:Install 10 Packages 2023-10-08T12:52:47.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:52:47.158 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 18 M 2023-10-08T12:52:47.158 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 65 M 2023-10-08T12:52:47.158 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-10-08T12:52:47.250 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-08T12:52:47.264 INFO:teuthology.orchestra.run.smithi118.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 878 kB/s | 94 kB 00:00 2023-10-08T12:52:47.282 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-08T12:52:47.290 INFO:teuthology.orchestra.run.smithi118.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 309 kB/s | 41 kB 00:00 2023-10-08T12:52:47.352 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================================================ 2023-10-08T12:52:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-08T12:52:47.352 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================================================ 2023-10-08T12:52:47.352 INFO:teuthology.orchestra.run.smithi060.stdout:Installing group/module packages: 2023-10-08T12:52:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:52:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout:Installing module profiles: 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools/common 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: container-tools rhel8 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================================================ 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout:Install 10 Packages 2023-10-08T12:52:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:52:47.355 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 18 M 2023-10-08T12:52:47.355 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 65 M 2023-10-08T12:52:47.355 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-08T12:52:47.382 INFO:teuthology.orchestra.run.smithi118.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 111 kB/s | 25 kB 00:00 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================================ 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================================ 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:Installing group/module packages: 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:52:47.383 INFO:teuthology.orchestra.run.smithi005.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:52:47.384 INFO:teuthology.orchestra.run.smithi005.stdout:Installing module profiles: 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools/common 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools rhel8 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================================ 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout:Install 10 Packages 2023-10-08T12:52:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:52:47.386 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 18 M 2023-10-08T12:52:47.386 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 65 M 2023-10-08T12:52:47.386 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-10-08T12:52:47.423 INFO:teuthology.orchestra.run.smithi118.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-10-08T12:52:47.460 INFO:teuthology.orchestra.run.smithi118.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.1 MB/s | 524 kB 00:00 2023-10-08T12:52:47.531 INFO:teuthology.orchestra.run.smithi005.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 645 kB/s | 94 kB 00:00 2023-10-08T12:52:47.537 INFO:teuthology.orchestra.run.smithi060.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 516 kB/s | 94 kB 00:00 2023-10-08T12:52:47.583 INFO:teuthology.orchestra.run.smithi118.stdout:(6/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.7 MB/s | 213 kB 00:00 2023-10-08T12:52:47.596 INFO:teuthology.orchestra.run.smithi060.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 103 kB/s | 25 kB 00:00 2023-10-08T12:52:47.607 INFO:teuthology.orchestra.run.smithi005.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 185 kB/s | 41 kB 00:00 2023-10-08T12:52:47.612 INFO:teuthology.orchestra.run.smithi060.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 158 kB/s | 41 kB 00:00 2023-10-08T12:52:47.616 INFO:teuthology.orchestra.run.smithi118.stdout:(7/10): python3-podman-4.0.1-1.module+el8.6.0+1 777 kB/s | 149 kB 00:00 2023-10-08T12:52:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 89 kB/s | 25 kB 00:00 2023-10-08T12:52:47.691 INFO:teuthology.orchestra.run.smithi005.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-10-08T12:52:47.721 INFO:teuthology.orchestra.run.smithi060.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 269 kB/s | 49 kB 00:00 2023-10-08T12:52:47.750 INFO:teuthology.orchestra.run.smithi118.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 22 MB/s | 8.0 MB 00:00 2023-10-08T12:52:47.825 INFO:teuthology.orchestra.run.smithi118.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 10 MB/s | 2.2 MB 00:00 2023-10-08T12:52:47.866 INFO:teuthology.orchestra.run.smithi005.stdout:(5/10): python3-podman-4.0.1-1.module+el8.6.0+1 855 kB/s | 149 kB 00:00 2023-10-08T12:52:47.913 INFO:teuthology.orchestra.run.smithi060.stdout:(5/10): buildah-1.26.2-1.module+el8.6.0+16771+2 27 MB/s | 8.0 MB 00:00 2023-10-08T12:52:47.916 INFO:teuthology.orchestra.run.smithi005.stdout:(6/10): cockpit-podman-49.1-1.module+el8.6.0+16 1.7 MB/s | 524 kB 00:00 2023-10-08T12:52:47.933 INFO:teuthology.orchestra.run.smithi118.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 20 MB/s | 7.0 MB 00:00 2023-10-08T12:52:47.934 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:52:47.934 INFO:teuthology.orchestra.run.smithi118.stdout:Total 23 MB/s | 18 MB 00:00 2023-10-08T12:52:47.938 INFO:teuthology.orchestra.run.smithi060.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 688 kB/s | 149 kB 00:00 2023-10-08T12:52:47.980 INFO:teuthology.orchestra.run.smithi060.stdout:(7/10): cockpit-podman-49.1-1.module+el8.6.0+16 1.3 MB/s | 524 kB 00:00 2023-10-08T12:52:48.033 INFO:teuthology.orchestra.run.smithi005.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 22 MB/s | 8.0 MB 00:00 2023-10-08T12:52:48.058 INFO:teuthology.orchestra.run.smithi005.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.1 MB/s | 213 kB 00:00 2023-10-08T12:52:48.067 INFO:teuthology.orchestra.run.smithi060.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.4 MB/s | 213 kB 00:00 2023-10-08T12:52:48.135 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-10-08T12:52:48.147 INFO:teuthology.orchestra.run.smithi060.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 13 MB/s | 2.2 MB 00:00 2023-10-08T12:52:48.154 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-10-08T12:52:48.154 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-10-08T12:52:48.192 INFO:teuthology.orchestra.run.smithi005.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 25 MB/s | 7.0 MB 00:00 2023-10-08T12:52:48.250 INFO:teuthology.orchestra.run.smithi005.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 10 MB/s | 2.2 MB 00:00 2023-10-08T12:52:48.251 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:52:48.251 INFO:teuthology.orchestra.run.smithi005.stdout:Total 21 MB/s | 18 MB 00:00 2023-10-08T12:52:48.256 INFO:teuthology.orchestra.run.smithi060.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 22 MB/s | 7.0 MB 00:00 2023-10-08T12:52:48.256 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:52:48.256 INFO:teuthology.orchestra.run.smithi060.stdout:Total 20 MB/s | 18 MB 00:00 2023-10-08T12:52:48.337 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-10-08T12:52:48.341 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-10-08T12:52:48.459 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-10-08T12:52:48.464 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-08T12:52:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-10-08T12:52:48.480 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-10-08T12:52:48.484 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-08T12:52:48.484 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-08T12:52:48.674 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-10-08T12:52:48.677 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-08T12:52:48.678 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-10-08T12:52:48.682 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-08T12:52:48.936 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-10-08T12:52:49.154 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:52:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-08T12:52:49.202 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-10-08T12:52:49.341 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:52:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:52:49.386 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:52:49.558 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:52:49.560 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:52:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:52:49.771 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:52:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:52:49.776 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:52:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:52:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:52:50.203 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:52:50.347 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:52:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:52:50.974 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:52:51.161 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:52:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:52:51.950 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:52:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:52:52.146 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:52:52.180 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:52:52.323 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:52:52.372 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:52:52.378 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:52:52.541 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:52:52.547 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:52:52.563 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:52:52.723 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:52:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:52:52.793 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:52:52.794 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:52:52.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:52:52.993 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:52:52.993 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:52:52.993 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:52:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:52:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:52:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:52:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:52:53.034 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:52:53.035 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:52:53.035 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:52:53.035 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:52:53.035 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:52:53.035 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:52:54.165 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:52:54.165 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:10 ago on Sun 08 Oct 2023 12:50:43 PM UTC. 2023-10-08T12:52:54.178 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:52:54.178 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:02:30 ago on Sun 08 Oct 2023 12:50:23 PM UTC. 2023-10-08T12:52:54.204 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:52:54.204 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:20 ago on Sun 08 Oct 2023 12:50:33 PM UTC. 2023-10-08T12:53:02.222 INFO:teuthology.orchestra.run.smithi118.stdout:Installed products updated. 2023-10-08T12:53:02.425 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:53:02.425 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-10-08T12:53:02.425 INFO:teuthology.orchestra.run.smithi118.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:02.425 INFO:teuthology.orchestra.run.smithi118.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:53:02.426 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-08T12:53:02.556 DEBUG:teuthology.parallel:result is None 2023-10-08T12:53:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-10-08T12:53:03.993 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-08T12:53:04.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:53:04.104 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:53:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-08T12:53:04.201 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:53:04.202 INFO:teuthology.orchestra.run.smithi060.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:53:04.203 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:53:04.203 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-08T12:53:04.256 DEBUG:teuthology.parallel:result is None 2023-10-08T12:53:04.486 DEBUG:teuthology.parallel:result is None 2023-10-08T12:53:04.486 INFO:teuthology.run_tasks:Running task install... 2023-10-08T12:53:04.733 DEBUG:teuthology.task.install:project ceph 2023-10-08T12:53:04.733 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T12:53:04.733 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T12:53:04.733 INFO:teuthology.task.install:Using flavor: default 2023-10-08T12:53:04.739 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T12:53:04.739 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T12:53:04.739 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:53:04.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:53:04.742 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:53:04.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:53:04.743 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:53:04.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:53:04.912 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:53:04.913 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:53:04.958 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:53:04.958 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:53:04.963 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:53:04.963 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:53:05.025 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:53:05.026 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:53:05.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:53:05.057 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:53:05.057 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:53:05.124 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:53:05.124 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:53:05.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:53:05.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:53:05.132 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:53:05.133 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:53:05.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:53:05.155 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:53:05.156 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:53:05.166 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:53:05.166 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:53:05.210 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:53:05.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:53:05.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:53:05.278 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2023-10-08T12:53:05.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2023-10-08T12:53:05.308 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:53:05.324 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:53:05.376 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2023-10-08T12:53:05.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2023-10-08T12:53:05.392 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-10-08T12:53:05.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-10-08T12:53:05.675 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:53:05.771 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-08T12:53:05.772 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T12:53:06.697 INFO:teuthology.orchestra.run.smithi118.stdout:44 files removed 2023-10-08T12:53:06.714 INFO:teuthology.orchestra.run.smithi060.stdout:44 files removed 2023-10-08T12:53:06.748 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:53:06.749 INFO:teuthology.orchestra.run.smithi005.stdout:44 files removed 2023-10-08T12:53:06.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:53:06.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:53:07.081 INFO:teuthology.orchestra.run.smithi118.stdout:Updating Subscription Management repositories. 2023-10-08T12:53:07.120 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-08T12:53:07.158 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-10-08T12:53:08.425 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 290 kB/s | 81 kB 00:00 2023-10-08T12:53:08.542 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 266 kB/s | 81 kB 00:00 2023-10-08T12:53:08.610 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 207 kB/s | 81 kB 00:00 2023-10-08T12:53:08.734 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-10-08T12:53:08.809 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-10-08T12:53:08.869 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 42 kB/s | 9.4 kB 00:00 2023-10-08T12:53:09.110 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-10-08T12:53:09.145 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 5.9 kB/s | 1.5 kB 00:00 2023-10-08T12:53:09.194 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-08T12:53:09.252 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-08T12:53:09.303 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-08T12:53:09.335 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-08T12:53:10.003 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-08T12:53:10.180 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-08T12:53:11.831 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 16 MB 00:02 2023-10-08T12:53:13.545 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 363 kB/s | 24 kB 00:00 2023-10-08T12:53:13.930 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 261 kB/s | 24 kB 00:00 2023-10-08T12:53:15.097 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 MB/s | 47 MB 00:01 2023-10-08T12:53:15.113 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-10-08T12:53:15.537 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 518 kB/s | 24 kB 00:00 2023-10-08T12:53:16.814 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 53 MB 00:01 2023-10-08T12:53:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-10-08T12:53:23.774 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 53 MB 00:01 2023-10-08T12:53:25.699 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-10-08T12:53:34.571 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:53:34.572 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:53:34.586 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:53:34.588 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:53:34.589 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:53:34.590 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:53:34.592 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:53:34.596 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:53:34.597 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:53:34.730 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-10-08T12:53:34.742 INFO:teuthology.orchestra.run.smithi118.stdout:=========================================================================================================================== 2023-10-08T12:53:34.742 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-10-08T12:53:34.742 INFO:teuthology.orchestra.run.smithi118.stdout:=========================================================================================================================== 2023-10-08T12:53:34.742 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-10-08T12:53:34.742 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:53:34.742 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:53:34.743 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:53:34.744 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:53:34.745 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:53:34.746 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:53:34.747 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:53:34.748 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:53:34.749 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:53:34.750 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:53:34.751 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:53:34.752 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:53:34.753 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:53:34.754 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:53:34.755 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling module streams: 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql 10 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-10-08T12:53:34.756 INFO:teuthology.orchestra.run.smithi118.stdout:=========================================================================================================================== 2023-10-08T12:53:34.757 INFO:teuthology.orchestra.run.smithi118.stdout:Install 128 Packages 2023-10-08T12:53:34.757 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 3 Packages 2023-10-08T12:53:34.757 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:53:34.757 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 209 M 2023-10-08T12:53:34.757 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-10-08T12:53:35.239 INFO:teuthology.orchestra.run.smithi118.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2023-10-08T12:53:35.448 INFO:teuthology.orchestra.run.smithi118.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 4.3 MB/s | 918 kB 00:00 2023-10-08T12:53:35.498 INFO:teuthology.orchestra.run.smithi118.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 3.3 MB/s | 167 kB 00:00 2023-10-08T12:53:35.624 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:53:35.625 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:53:35.641 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:53:35.642 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:53:35.643 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:53:35.644 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:53:35.646 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:53:35.650 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:53:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:53:35.749 INFO:teuthology.orchestra.run.smithi118.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 9.3 MB/s | 2.3 MB 00:00 2023-10-08T12:53:35.794 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:53:35.807 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:53:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:53:35.809 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:53:35.810 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:53:35.811 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:53:35.812 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:53:35.813 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:53:35.814 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:53:35.815 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:53:35.816 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:53:35.817 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:53:35.818 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql 10 2023-10-08T12:53:35.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:53:35.820 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-10-08T12:53:35.820 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-10-08T12:53:35.820 INFO:teuthology.orchestra.run.smithi005.stdout:Install 128 Packages 2023-10-08T12:53:35.820 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 3 Packages 2023-10-08T12:53:35.820 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:53:35.820 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 209 M 2023-10-08T12:53:35.821 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-10-08T12:53:35.907 INFO:teuthology.orchestra.run.smithi118.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 10 MB/s | 1.6 MB 00:00 2023-10-08T12:53:36.191 INFO:teuthology.orchestra.run.smithi005.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-10-08T12:53:36.274 INFO:teuthology.orchestra.run.smithi118.stdout:(6/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 4.6 MB/s | 5.4 MB 00:01 2023-10-08T12:53:36.341 INFO:teuthology.orchestra.run.smithi118.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 11 MB/s | 4.6 MB 00:00 2023-10-08T12:53:36.717 INFO:teuthology.orchestra.run.smithi005.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.7 MB/s | 918 kB 00:00 2023-10-08T12:53:37.267 INFO:teuthology.orchestra.run.smithi005.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 304 kB/s | 167 kB 00:00 2023-10-08T12:53:37.349 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:53:37.350 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:53:37.366 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:53:37.367 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:53:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:53:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:53:37.372 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:53:37.375 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:53:37.376 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:53:37.524 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-08T12:53:37.537 INFO:teuthology.orchestra.run.smithi060.stdout:=========================================================================================================================== 2023-10-08T12:53:37.537 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-08T12:53:37.538 INFO:teuthology.orchestra.run.smithi060.stdout:=========================================================================================================================== 2023-10-08T12:53:37.538 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-08T12:53:37.538 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:53:37.538 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:53:37.538 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:53:37.539 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:53:37.540 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:53:37.540 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:53:37.540 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:53:37.540 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:53:37.540 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:53:37.540 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:53:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:53:37.542 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:53:37.542 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:53:37.542 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:53:37.542 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:53:37.542 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:53:37.542 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-08T12:53:37.543 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:53:37.544 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:53:37.545 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:53:37.546 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:53:37.547 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:53:37.548 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:53:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:53:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:53:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:53:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql 10 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:=========================================================================================================================== 2023-10-08T12:53:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:Install 128 Packages 2023-10-08T12:53:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 3 Packages 2023-10-08T12:53:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:53:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 209 M 2023-10-08T12:53:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-08T12:53:37.851 INFO:teuthology.orchestra.run.smithi005.stdout:(4/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 2.9 MB/s | 5.4 MB 00:01 2023-10-08T12:53:37.908 INFO:teuthology.orchestra.run.smithi060.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-08T12:53:37.950 INFO:teuthology.orchestra.run.smithi118.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 8.6 MB/s | 14 MB 00:01 2023-10-08T12:53:38.058 INFO:teuthology.orchestra.run.smithi118.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 225 kB/s | 24 kB 00:00 2023-10-08T12:53:38.134 INFO:teuthology.orchestra.run.smithi005.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 5.7 MB/s | 1.6 MB 00:00 2023-10-08T12:53:38.426 INFO:teuthology.orchestra.run.smithi005.stdout:(6/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-10-08T12:53:39.125 INFO:teuthology.orchestra.run.smithi060.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 755 kB/s | 918 kB 00:01 2023-10-08T12:53:39.133 INFO:teuthology.orchestra.run.smithi118.stdout:(10/131): ceph-common-18.0.0-6639.g7b3143ba.el8 5.6 MB/s | 23 MB 00:04 2023-10-08T12:53:39.259 INFO:teuthology.orchestra.run.smithi060.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.2 MB/s | 167 kB 00:00 2023-10-08T12:53:39.308 INFO:teuthology.orchestra.run.smithi118.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 1.5 MB/s | 261 kB 00:00 2023-10-08T12:53:39.409 INFO:teuthology.orchestra.run.smithi118.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 310 kB/s | 31 kB 00:00 2023-10-08T12:53:39.584 INFO:teuthology.orchestra.run.smithi118.stdout:(13/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 5.4 MB/s | 18 MB 00:03 2023-10-08T12:53:39.685 INFO:teuthology.orchestra.run.smithi005.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 3.0 MB/s | 4.6 MB 00:01 2023-10-08T12:53:39.699 INFO:teuthology.orchestra.run.smithi118.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 1.6 MB/s | 184 kB 00:00 2023-10-08T12:53:39.735 INFO:teuthology.orchestra.run.smithi118.stdout:(15/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 2.5 MB/s | 840 kB 00:00 2023-10-08T12:53:39.777 INFO:teuthology.orchestra.run.smithi118.stdout:(16/131): librados-devel-18.0.0-6639.g7b3143ba. 1.8 MB/s | 139 kB 00:00 2023-10-08T12:53:40.002 INFO:teuthology.orchestra.run.smithi118.stdout:(17/131): libradosstriper1-18.0.0-6639.g7b3143b 1.9 MB/s | 518 kB 00:00 2023-10-08T12:53:40.103 INFO:teuthology.orchestra.run.smithi118.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 447 kB/s | 45 kB 00:00 2023-10-08T12:53:40.203 INFO:teuthology.orchestra.run.smithi118.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.2 MB/s | 125 kB 00:00 2023-10-08T12:53:40.303 INFO:teuthology.orchestra.run.smithi118.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.9 MB/s | 197 kB 00:00 2023-10-08T12:53:40.318 INFO:teuthology.orchestra.run.smithi060.stdout:(4/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 2.0 MB/s | 5.4 MB 00:02 2023-10-08T12:53:40.398 INFO:teuthology.orchestra.run.smithi060.stdout:(5/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-10-08T12:53:40.470 INFO:teuthology.orchestra.run.smithi118.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.2 MB/s | 371 kB 00:00 2023-10-08T12:53:40.687 INFO:teuthology.orchestra.run.smithi118.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 1.6 MB/s | 365 kB 00:00 2023-10-08T12:53:40.804 INFO:teuthology.orchestra.run.smithi118.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 915 kB/s | 107 kB 00:00 2023-10-08T12:53:40.937 INFO:teuthology.orchestra.run.smithi118.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 707 kB/s | 94 kB 00:00 2023-10-08T12:53:41.134 INFO:teuthology.orchestra.run.smithi060.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 2.0 MB/s | 1.6 MB 00:00 2023-10-08T12:53:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:(25/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 4.8 MB/s | 6.9 MB 00:01 2023-10-08T12:53:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.5 MB/s | 179 kB 00:00 2023-10-08T12:53:41.413 INFO:teuthology.orchestra.run.smithi118.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 252 kB/s | 23 kB 00:00 2023-10-08T12:53:41.522 INFO:teuthology.orchestra.run.smithi118.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.2 MB/s | 132 kB 00:00 2023-10-08T12:53:41.651 INFO:teuthology.orchestra.run.smithi060.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 3.7 MB/s | 4.6 MB 00:01 2023-10-08T12:53:41.980 INFO:teuthology.orchestra.run.smithi118.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 3.8 MB/s | 1.8 MB 00:00 2023-10-08T12:53:42.089 INFO:teuthology.orchestra.run.smithi118.stdout:(30/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.1 MB/s | 3.6 MB 00:01 2023-10-08T12:53:42.198 INFO:teuthology.orchestra.run.smithi118.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 2.2 MB/s | 242 kB 00:00 2023-10-08T12:53:42.314 INFO:teuthology.orchestra.run.smithi118.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 407 kB/s | 47 kB 00:00 2023-10-08T12:53:42.432 INFO:teuthology.orchestra.run.smithi118.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 124 kB/s | 15 kB 00:00 2023-10-08T12:53:42.548 INFO:teuthology.orchestra.run.smithi118.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 2.2 MB/s | 261 kB 00:00 2023-10-08T12:53:42.665 INFO:teuthology.orchestra.run.smithi118.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.6 MB/s | 190 kB 00:00 2023-10-08T12:53:42.766 INFO:teuthology.orchestra.run.smithi118.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 181 kB/s | 18 kB 00:00 2023-10-08T12:53:42.924 INFO:teuthology.orchestra.run.smithi118.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2023-10-08T12:53:42.966 INFO:teuthology.orchestra.run.smithi118.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-08T12:53:43.008 INFO:teuthology.orchestra.run.smithi118.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-10-08T12:53:43.075 INFO:teuthology.orchestra.run.smithi118.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-10-08T12:53:43.117 INFO:teuthology.orchestra.run.smithi118.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-10-08T12:53:43.159 INFO:teuthology.orchestra.run.smithi118.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-10-08T12:53:43.226 INFO:teuthology.orchestra.run.smithi118.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 496 kB/s | 33 kB 00:00 2023-10-08T12:53:43.268 INFO:teuthology.orchestra.run.smithi118.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 392 kB/s | 16 kB 00:00 2023-10-08T12:53:43.318 INFO:teuthology.orchestra.run.smithi118.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-10-08T12:53:43.369 INFO:teuthology.orchestra.run.smithi118.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2023-10-08T12:53:43.411 INFO:teuthology.orchestra.run.smithi118.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-10-08T12:53:43.453 INFO:teuthology.orchestra.run.smithi118.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-10-08T12:53:43.495 INFO:teuthology.orchestra.run.smithi118.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2023-10-08T12:53:43.543 INFO:teuthology.orchestra.run.smithi060.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 7.3 MB/s | 14 MB 00:01 2023-10-08T12:53:43.602 INFO:teuthology.orchestra.run.smithi060.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 419 kB/s | 24 kB 00:00 2023-10-08T12:53:43.620 INFO:teuthology.orchestra.run.smithi118.stdout:(50/131): ceph-mgr-diskprediction-local-18.0.0- 4.5 MB/s | 7.4 MB 00:01 2023-10-08T12:53:43.654 INFO:teuthology.orchestra.run.smithi118.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 7.4 MB/s | 1.2 MB 00:00 2023-10-08T12:53:43.687 INFO:teuthology.orchestra.run.smithi118.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2023-10-08T12:53:43.721 INFO:teuthology.orchestra.run.smithi118.stdout:(53/131): python3-logutils-0.3.5-11.el8.noarch. 486 kB/s | 49 kB 00:00 2023-10-08T12:53:43.738 INFO:teuthology.orchestra.run.smithi118.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-08T12:53:43.805 INFO:teuthology.orchestra.run.smithi118.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-10-08T12:53:43.838 INFO:teuthology.orchestra.run.smithi118.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-08T12:53:43.863 INFO:teuthology.orchestra.run.smithi118.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 575 kB/s | 34 kB 00:00 2023-10-08T12:53:43.889 INFO:teuthology.orchestra.run.smithi118.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-10-08T12:53:43.906 INFO:teuthology.orchestra.run.smithi118.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2023-10-08T12:53:43.931 INFO:teuthology.orchestra.run.smithi118.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 448 kB/s | 19 kB 00:00 2023-10-08T12:53:43.948 INFO:teuthology.orchestra.run.smithi118.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 571 kB/s | 24 kB 00:00 2023-10-08T12:53:43.973 INFO:teuthology.orchestra.run.smithi118.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 700 kB/s | 29 kB 00:00 2023-10-08T12:53:43.990 INFO:teuthology.orchestra.run.smithi118.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 656 kB/s | 27 kB 00:00 2023-10-08T12:53:44.024 INFO:teuthology.orchestra.run.smithi118.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-10-08T12:53:44.043 INFO:teuthology.orchestra.run.smithi005.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 3.2 MB/s | 14 MB 00:04 2023-10-08T12:53:44.049 INFO:teuthology.orchestra.run.smithi118.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-10-08T12:53:44.074 INFO:teuthology.orchestra.run.smithi118.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-08T12:53:44.091 INFO:teuthology.orchestra.run.smithi118.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2023-10-08T12:53:44.116 INFO:teuthology.orchestra.run.smithi118.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 550 kB/s | 23 kB 00:00 2023-10-08T12:53:44.164 INFO:teuthology.orchestra.run.smithi005.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 201 kB/s | 24 kB 00:00 2023-10-08T12:53:44.167 INFO:teuthology.orchestra.run.smithi118.stdout:(69/131): thrift-0.13.0-2.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2023-10-08T12:53:44.192 INFO:teuthology.orchestra.run.smithi118.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 925 kB/s | 70 kB 00:00 2023-10-08T12:53:44.384 INFO:teuthology.orchestra.run.smithi118.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 574 kB/s | 110 kB 00:00 2023-10-08T12:53:44.510 INFO:teuthology.orchestra.run.smithi118.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 434 kB/s | 54 kB 00:00 2023-10-08T12:53:44.727 INFO:teuthology.orchestra.run.smithi118.stdout:(73/131): python3-scipy-1.0.0-21.module+el8.5.0 24 MB/s | 14 MB 00:00 2023-10-08T12:53:44.760 INFO:teuthology.orchestra.run.smithi118.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2023-10-08T12:53:44.910 INFO:teuthology.orchestra.run.smithi118.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.7 MB/s | 323 kB 00:00 2023-10-08T12:53:44.936 INFO:teuthology.orchestra.run.smithi118.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 221 kB/s | 39 kB 00:00 2023-10-08T12:53:45.044 INFO:teuthology.orchestra.run.smithi118.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-10-08T12:53:45.078 INFO:teuthology.orchestra.run.smithi118.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2023-10-08T12:53:45.110 INFO:teuthology.orchestra.run.smithi060.stdout:(10/131): ceph-common-18.0.0-6639.g7b3143ba.el8 3.0 MB/s | 23 MB 00:07 2023-10-08T12:53:45.220 INFO:teuthology.orchestra.run.smithi118.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 896 kB/s | 157 kB 00:00 2023-10-08T12:53:45.235 INFO:teuthology.orchestra.run.smithi060.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 2.0 MB/s | 261 kB 00:00 2023-10-08T12:53:45.245 INFO:teuthology.orchestra.run.smithi118.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-10-08T12:53:45.319 INFO:teuthology.orchestra.run.smithi060.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 373 kB/s | 31 kB 00:00 2023-10-08T12:53:45.437 INFO:teuthology.orchestra.run.smithi118.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-10-08T12:53:45.471 INFO:teuthology.orchestra.run.smithi118.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 2.8 MB/s | 713 kB 00:00 2023-10-08T12:53:45.610 INFO:teuthology.orchestra.run.smithi118.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 154 kB/s | 27 kB 00:00 2023-10-08T12:53:45.646 INFO:teuthology.orchestra.run.smithi118.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-08T12:53:45.678 INFO:teuthology.orchestra.run.smithi060.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 2.3 MB/s | 840 kB 00:00 2023-10-08T12:53:45.895 INFO:teuthology.orchestra.run.smithi060.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 852 kB/s | 184 kB 00:00 2023-10-08T12:53:45.900 INFO:teuthology.orchestra.run.smithi005.stdout:(10/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 2.4 MB/s | 18 MB 00:07 2023-10-08T12:53:45.962 INFO:teuthology.orchestra.run.smithi060.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 2.0 MB/s | 139 kB 00:00 2023-10-08T12:53:45.962 INFO:teuthology.orchestra.run.smithi118.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 125 kB/s | 44 kB 00:00 2023-10-08T12:53:46.080 INFO:teuthology.orchestra.run.smithi118.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2023-10-08T12:53:46.085 INFO:teuthology.orchestra.run.smithi005.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 1.4 MB/s | 261 kB 00:00 2023-10-08T12:53:46.139 INFO:teuthology.orchestra.run.smithi118.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 7.6 MB/s | 3.7 MB 00:00 2023-10-08T12:53:46.181 INFO:teuthology.orchestra.run.smithi118.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-10-08T12:53:46.187 INFO:teuthology.orchestra.run.smithi060.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 2.3 MB/s | 518 kB 00:00 2023-10-08T12:53:46.194 INFO:teuthology.orchestra.run.smithi005.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 286 kB/s | 31 kB 00:00 2023-10-08T12:53:46.239 INFO:teuthology.orchestra.run.smithi118.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 640 kB/s | 64 kB 00:00 2023-10-08T12:53:46.256 INFO:teuthology.orchestra.run.smithi118.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-10-08T12:53:46.340 INFO:teuthology.orchestra.run.smithi118.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2023-10-08T12:53:46.365 INFO:teuthology.orchestra.run.smithi118.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 955 kB/s | 103 kB 00:00 2023-10-08T12:53:46.441 INFO:teuthology.orchestra.run.smithi118.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-10-08T12:53:46.525 INFO:teuthology.orchestra.run.smithi118.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-10-08T12:53:46.599 INFO:teuthology.orchestra.run.smithi118.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-10-08T12:53:46.619 INFO:teuthology.orchestra.run.smithi005.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 1.9 MB/s | 840 kB 00:00 2023-10-08T12:53:46.728 INFO:teuthology.orchestra.run.smithi005.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 1.7 MB/s | 184 kB 00:00 2023-10-08T12:53:46.766 INFO:teuthology.orchestra.run.smithi118.stdout:(96/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-10-08T12:53:46.808 INFO:teuthology.orchestra.run.smithi118.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 969 kB/s | 202 kB 00:00 2023-10-08T12:53:46.828 INFO:teuthology.orchestra.run.smithi005.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.4 MB/s | 139 kB 00:00 2023-10-08T12:53:46.909 INFO:teuthology.orchestra.run.smithi118.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-10-08T12:53:47.009 INFO:teuthology.orchestra.run.smithi118.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 7.9 MB/s | 808 kB 00:00 2023-10-08T12:53:47.053 INFO:teuthology.orchestra.run.smithi005.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 2.3 MB/s | 518 kB 00:00 2023-10-08T12:53:47.084 INFO:teuthology.orchestra.run.smithi118.stdout:(100/131): postgresql-server-10.21-2.module+el8 18 MB/s | 5.1 MB 00:00 2023-10-08T12:53:47.201 INFO:teuthology.orchestra.run.smithi118.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 7.8 MB/s | 1.5 MB 00:00 2023-10-08T12:53:47.227 INFO:teuthology.orchestra.run.smithi118.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 330 kB/s | 47 kB 00:00 2023-10-08T12:53:47.362 INFO:teuthology.orchestra.run.smithi005.stdout:(17/131): ceph-common-18.0.0-6639.g7b3143ba.el8 2.0 MB/s | 23 MB 00:11 2023-10-08T12:53:47.395 INFO:teuthology.orchestra.run.smithi118.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.0 MB/s | 200 kB 00:00 2023-10-08T12:53:47.420 INFO:teuthology.orchestra.run.smithi005.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 770 kB/s | 45 kB 00:00 2023-10-08T12:53:47.427 INFO:teuthology.orchestra.run.smithi118.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 213 kB/s | 43 kB 00:00 2023-10-08T12:53:47.521 INFO:teuthology.orchestra.run.smithi005.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.2 MB/s | 125 kB 00:00 2023-10-08T12:53:47.552 INFO:teuthology.orchestra.run.smithi118.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-08T12:53:47.621 INFO:teuthology.orchestra.run.smithi005.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.9 MB/s | 197 kB 00:00 2023-10-08T12:53:47.763 INFO:teuthology.orchestra.run.smithi005.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.6 MB/s | 371 kB 00:00 2023-10-08T12:53:47.779 INFO:teuthology.orchestra.run.smithi060.stdout:(17/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 12 MB/s | 49 MB 00:04 2023-10-08T12:53:47.838 INFO:teuthology.orchestra.run.smithi060.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 772 kB/s | 45 kB 00:00 2023-10-08T12:53:47.904 INFO:teuthology.orchestra.run.smithi060.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.9 MB/s | 125 kB 00:00 2023-10-08T12:53:47.930 INFO:teuthology.orchestra.run.smithi005.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 2.1 MB/s | 365 kB 00:00 2023-10-08T12:53:47.980 INFO:teuthology.orchestra.run.smithi060.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 2.6 MB/s | 197 kB 00:00 2023-10-08T12:53:47.997 INFO:teuthology.orchestra.run.smithi005.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.6 MB/s | 107 kB 00:00 2023-10-08T12:53:48.055 INFO:teuthology.orchestra.run.smithi060.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 4.8 MB/s | 371 kB 00:00 2023-10-08T12:53:48.064 INFO:teuthology.orchestra.run.smithi005.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.4 MB/s | 94 kB 00:00 2023-10-08T12:53:48.139 INFO:teuthology.orchestra.run.smithi060.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 4.3 MB/s | 365 kB 00:00 2023-10-08T12:53:48.198 INFO:teuthology.orchestra.run.smithi060.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.8 MB/s | 107 kB 00:00 2023-10-08T12:53:48.265 INFO:teuthology.orchestra.run.smithi060.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.4 MB/s | 94 kB 00:00 2023-10-08T12:53:48.506 INFO:teuthology.orchestra.run.smithi005.stdout:(25/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 4.8 MB/s | 6.9 MB 00:01 2023-10-08T12:53:48.557 INFO:teuthology.orchestra.run.smithi060.stdout:(25/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 2.4 MB/s | 18 MB 00:07 2023-10-08T12:53:48.564 INFO:teuthology.orchestra.run.smithi005.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 3.0 MB/s | 179 kB 00:00 2023-10-08T12:53:48.615 INFO:teuthology.orchestra.run.smithi005.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 462 kB/s | 23 kB 00:00 2023-10-08T12:53:48.640 INFO:teuthology.orchestra.run.smithi060.stdout:(26/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 2.8 MB/s | 6.9 MB 00:02 2023-10-08T12:53:48.665 INFO:teuthology.orchestra.run.smithi060.stdout:(27/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.6 MB/s | 179 kB 00:00 2023-10-08T12:53:48.682 INFO:teuthology.orchestra.run.smithi005.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.9 MB/s | 132 kB 00:00 2023-10-08T12:53:48.691 INFO:teuthology.orchestra.run.smithi060.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6639.g 460 kB/s | 23 kB 00:00 2023-10-08T12:53:48.716 INFO:teuthology.orchestra.run.smithi060.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 2.6 MB/s | 132 kB 00:00 2023-10-08T12:53:48.791 INFO:teuthology.orchestra.run.smithi060.stdout:(30/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 6.8 MB/s | 3.6 MB 00:00 2023-10-08T12:53:48.858 INFO:teuthology.orchestra.run.smithi060.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 3.6 MB/s | 242 kB 00:00 2023-10-08T12:53:48.928 INFO:teuthology.orchestra.run.smithi118.stdout:(106/131): ceph-test-18.0.0-6639.g7b3143ba.el8. 4.5 MB/s | 49 MB 00:10 2023-10-08T12:53:48.942 INFO:teuthology.orchestra.run.smithi060.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 569 kB/s | 47 kB 00:00 2023-10-08T12:53:48.953 INFO:teuthology.orchestra.run.smithi118.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 32 kB/s | 48 kB 00:01 2023-10-08T12:53:48.986 INFO:teuthology.orchestra.run.smithi118.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 61 kB/s | 87 kB 00:01 2023-10-08T12:53:49.009 INFO:teuthology.orchestra.run.smithi060.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 218 kB/s | 15 kB 00:00 2023-10-08T12:53:49.024 INFO:teuthology.orchestra.run.smithi005.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 5.2 MB/s | 1.8 MB 00:00 2023-10-08T12:53:49.067 INFO:teuthology.orchestra.run.smithi060.stdout:(34/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 4.7 MB/s | 1.8 MB 00:00 2023-10-08T12:53:49.103 INFO:teuthology.orchestra.run.smithi118.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 754 kB/s | 109 kB 00:00 2023-10-08T12:53:49.109 INFO:teuthology.orchestra.run.smithi060.stdout:(35/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 2.5 MB/s | 261 kB 00:00 2023-10-08T12:53:49.128 INFO:teuthology.orchestra.run.smithi118.stdout:(110/131): python3-requests-oauthlib-1.0.0-1.el 213 kB/s | 43 kB 00:00 2023-10-08T12:53:49.151 INFO:teuthology.orchestra.run.smithi060.stdout:(36/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 2.2 MB/s | 190 kB 00:00 2023-10-08T12:53:49.177 INFO:teuthology.orchestra.run.smithi060.stdout:(37/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 271 kB/s | 18 kB 00:00 2023-10-08T12:53:49.179 INFO:teuthology.orchestra.run.smithi118.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2023-10-08T12:53:49.233 INFO:teuthology.orchestra.run.smithi005.stdout:(30/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.1 MB/s | 3.6 MB 00:01 2023-10-08T12:53:49.296 INFO:teuthology.orchestra.run.smithi118.stdout:(112/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-10-08T12:53:49.333 INFO:teuthology.orchestra.run.smithi005.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 2.4 MB/s | 242 kB 00:00 2023-10-08T12:53:49.346 INFO:teuthology.orchestra.run.smithi118.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.3 MB/s | 560 kB 00:00 2023-10-08T12:53:49.396 INFO:teuthology.orchestra.run.smithi118.stdout:(114/131): libaio-devel-0.3.112-1.el8.x86_64.rp 70 kB/s | 19 kB 00:00 2023-10-08T12:53:49.425 INFO:teuthology.orchestra.run.smithi005.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 517 kB/s | 47 kB 00:00 2023-10-08T12:53:49.492 INFO:teuthology.orchestra.run.smithi005.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 218 kB/s | 15 kB 00:00 2023-10-08T12:53:49.505 INFO:teuthology.orchestra.run.smithi118.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 2.6 MB/s | 559 kB 00:00 2023-10-08T12:53:49.530 INFO:teuthology.orchestra.run.smithi118.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 97 kB/s | 18 kB 00:00 2023-10-08T12:53:49.580 INFO:teuthology.orchestra.run.smithi118.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2023-10-08T12:53:49.592 INFO:teuthology.orchestra.run.smithi005.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 2.6 MB/s | 261 kB 00:00 2023-10-08T12:53:49.602 INFO:teuthology.orchestra.run.smithi060.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 138 kB/s | 59 kB 00:00 2023-10-08T12:53:49.689 INFO:teuthology.orchestra.run.smithi118.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.3 MB/s | 238 kB 00:00 2023-10-08T12:53:49.709 INFO:teuthology.orchestra.run.smithi005.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.6 MB/s | 190 kB 00:00 2023-10-08T12:53:49.752 INFO:teuthology.orchestra.run.smithi060.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 501 kB/s | 75 kB 00:00 2023-10-08T12:53:49.773 INFO:teuthology.orchestra.run.smithi118.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 9.6 MB/s | 2.3 MB 00:00 2023-10-08T12:53:49.776 INFO:teuthology.orchestra.run.smithi005.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 271 kB/s | 18 kB 00:00 2023-10-08T12:53:49.777 INFO:teuthology.orchestra.run.smithi060.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 489 kB/s | 306 kB 00:00 2023-10-08T12:53:49.798 INFO:teuthology.orchestra.run.smithi118.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 333 kB/s | 72 kB 00:00 2023-10-08T12:53:49.823 INFO:teuthology.orchestra.run.smithi118.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 618 kB/s | 83 kB 00:00 2023-10-08T12:53:49.870 INFO:teuthology.orchestra.run.smithi060.stdout:(41/131): ceph-mgr-diskprediction-local-18.0.0- 6.4 MB/s | 7.4 MB 00:01 2023-10-08T12:53:49.920 INFO:teuthology.orchestra.run.smithi060.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 307 kB/s | 44 kB 00:00 2023-10-08T12:53:49.932 INFO:teuthology.orchestra.run.smithi118.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 377 kB/s | 60 kB 00:00 2023-10-08T12:53:49.957 INFO:teuthology.orchestra.run.smithi118.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 619 kB/s | 98 kB 00:00 2023-10-08T12:53:49.982 INFO:teuthology.orchestra.run.smithi118.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 363 kB/s | 58 kB 00:00 2023-10-08T12:53:50.028 INFO:teuthology.orchestra.run.smithi060.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 305 kB/s | 33 kB 00:00 2023-10-08T12:53:50.082 INFO:teuthology.orchestra.run.smithi118.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 256 kB/s | 39 kB 00:00 2023-10-08T12:53:50.087 INFO:teuthology.orchestra.run.smithi060.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2023-10-08T12:53:50.116 INFO:teuthology.orchestra.run.smithi118.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.0 MB/s | 644 kB 00:00 2023-10-08T12:53:52.669 INFO:teuthology.orchestra.run.smithi118.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.1 MB/s | 171 kB 00:00 2023-10-08T12:53:52.669 INFO:teuthology.orchestra.run.smithi118.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-10-08T12:53:52.669 INFO:teuthology.orchestra.run.smithi118.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 6.7 MB/s | 798 kB 00:00 2023-10-08T12:53:52.670 INFO:teuthology.orchestra.run.smithi118.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 8.3 MB/s | 3.7 MB 00:00 2023-10-08T12:53:52.670 INFO:teuthology.orchestra.run.smithi118.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 5.3 MB/s | 3.7 MB 00:00 2023-10-08T12:53:52.670 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:53:52.671 INFO:teuthology.orchestra.run.smithi118.stdout:Total 13 MB/s | 209 MB 00:16 2023-10-08T12:53:52.671 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-10-08T12:53:52.671 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-10-08T12:53:52.671 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-10-08T12:53:52.676 INFO:teuthology.orchestra.run.smithi005.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 765 kB/s | 306 kB 00:00 2023-10-08T12:53:52.823 INFO:teuthology.orchestra.run.smithi005.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.8 MB/s | 7.4 MB 00:01 2023-10-08T12:53:52.823 INFO:teuthology.orchestra.run.smithi005.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2023-10-08T12:53:52.823 INFO:teuthology.orchestra.run.smithi005.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-10-08T12:53:52.823 INFO:teuthology.orchestra.run.smithi005.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 424 kB/s | 44 kB 00:00 2023-10-08T12:53:52.823 INFO:teuthology.orchestra.run.smithi005.stdout:(42/131): libunwind-1.3.1-3.el8.x86_64.rpm 250 kB/s | 75 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 651 kB/s | 49 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 625 kB/s | 59 kB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-10-08T12:53:52.824 INFO:teuthology.orchestra.run.smithi005.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 828 kB/s | 60 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 501 kB/s | 34 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 959 kB/s | 64 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 358 kB/s | 24 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 437 kB/s | 29 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 411 kB/s | 27 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-08T12:53:52.825 INFO:teuthology.orchestra.run.smithi005.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 914 kB/s | 61 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 9.9 MB/s | 1.7 MB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 695 kB/s | 110 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 26 MB/s | 14 MB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 176 kB/s | 54 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2023-10-08T12:53:52.826 INFO:teuthology.orchestra.run.smithi005.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 357 kB/s | 39 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 694 kB/s | 81 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(50/131): python3-beautifulsoup4-4.6.3-2.el8.1. 321 kB/s | 185 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 124 kB/s | 18 kB 00:00 2023-10-08T12:53:52.828 INFO:teuthology.orchestra.run.smithi060.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 450 kB/s | 60 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 309 kB/s | 34 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 759 kB/s | 196 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 80 kB/s | 19 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 233 kB/s | 64 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 259 kB/s | 24 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 317 kB/s | 29 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 298 kB/s | 27 kB 00:00 2023-10-08T12:53:52.829 INFO:teuthology.orchestra.run.smithi060.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 488 kB/s | 61 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 850 kB/s | 85 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 152 kB/s | 23 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 208 kB/s | 47 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 825 kB/s | 200 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(75/131): python3-jwt-1.6.1-2.el8.noarch.rpm 176 kB/s | 43 kB 00:00 2023-10-08T12:53:52.830 INFO:teuthology.orchestra.run.smithi060.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 205 kB/s | 48 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 548 kB/s | 87 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 364 kB/s | 43 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 766 kB/s | 109 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(84/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 80 kB/s | 19 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 113 kB/s | 18 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2023-10-08T12:53:52.831 INFO:teuthology.orchestra.run.smithi060.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 666 kB/s | 72 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi060.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 619 kB/s | 83 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi060.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 448 kB/s | 60 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi060.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 905 kB/s | 98 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi060.stdout:(92/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi060.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 492 kB/s | 58 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi060.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 329 kB/s | 39 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi005.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-10-08T12:53:52.832 INFO:teuthology.orchestra.run.smithi005.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.9 MB/s | 538 kB 00:00 2023-10-08T12:53:52.833 INFO:teuthology.orchestra.run.smithi005.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-08T12:53:52.852 INFO:teuthology.orchestra.run.smithi060.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.4 MB/s | 644 kB 00:00 2023-10-08T12:53:52.863 INFO:teuthology.orchestra.run.smithi005.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-10-08T12:53:52.902 INFO:teuthology.orchestra.run.smithi060.stdout:(96/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.2 MB/s | 171 kB 00:00 2023-10-08T12:53:52.936 INFO:teuthology.orchestra.run.smithi060.stdout:(97/131): NetworkManager-initscripts-updown-1.3 915 kB/s | 138 kB 00:00 2023-10-08T12:53:52.958 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-10-08T12:53:52.962 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-10-08T12:53:52.980 INFO:teuthology.orchestra.run.smithi005.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 4.6 MB/s | 713 kB 00:00 2023-10-08T12:53:53.078 INFO:teuthology.orchestra.run.smithi060.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 628 kB/s | 110 kB 00:00 2023-10-08T12:53:53.103 INFO:teuthology.orchestra.run.smithi060.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 325 kB/s | 54 kB 00:00 2023-10-08T12:53:53.106 INFO:teuthology.orchestra.run.smithi005.stdout:(82/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-08T12:53:53.156 INFO:teuthology.orchestra.run.smithi005.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 151 kB/s | 27 kB 00:00 2023-10-08T12:53:53.170 INFO:teuthology.orchestra.run.smithi060.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-10-08T12:53:53.198 INFO:teuthology.orchestra.run.smithi005.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-10-08T12:53:53.203 INFO:teuthology.orchestra.run.smithi060.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-10-08T12:53:53.421 INFO:teuthology.orchestra.run.smithi060.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 24 MB/s | 14 MB 00:00 2023-10-08T12:53:53.446 INFO:teuthology.orchestra.run.smithi060.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 141 kB/s | 39 kB 00:00 2023-10-08T12:53:53.480 INFO:teuthology.orchestra.run.smithi060.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2023-10-08T12:53:53.538 INFO:teuthology.orchestra.run.smithi060.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-10-08T12:53:53.580 INFO:teuthology.orchestra.run.smithi060.stdout:(106/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.3 MB/s | 538 kB 00:00 2023-10-08T12:53:53.639 INFO:teuthology.orchestra.run.smithi060.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-08T12:53:53.669 INFO:teuthology.orchestra.run.smithi005.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 86 kB/s | 44 kB 00:00 2023-10-08T12:53:53.673 INFO:teuthology.orchestra.run.smithi060.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-10-08T12:53:53.756 INFO:teuthology.orchestra.run.smithi060.stdout:(109/131): python3-jsonpatch-1.21-2.el8.noarch. 226 kB/s | 27 kB 00:00 2023-10-08T12:53:53.782 INFO:teuthology.orchestra.run.smithi005.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.4 MB/s | 3.7 MB 00:00 2023-10-08T12:53:53.790 INFO:teuthology.orchestra.run.smithi060.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2023-10-08T12:53:53.841 INFO:teuthology.orchestra.run.smithi005.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.6 MB/s | 457 kB 00:00 2023-10-08T12:53:53.907 INFO:teuthology.orchestra.run.smithi060.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-08T12:53:53.924 INFO:teuthology.orchestra.run.smithi060.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 263 kB/s | 44 kB 00:00 2023-10-08T12:53:53.941 INFO:teuthology.orchestra.run.smithi005.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.4 MB/s | 225 kB 00:00 2023-10-08T12:53:53.992 INFO:teuthology.orchestra.run.smithi005.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 426 kB/s | 64 kB 00:00 2023-10-08T12:53:54.032 INFO:teuthology.orchestra.run.smithi060.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-10-08T12:53:54.058 INFO:teuthology.orchestra.run.smithi060.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.6 MB/s | 225 kB 00:00 2023-10-08T12:53:54.075 INFO:teuthology.orchestra.run.smithi005.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 947 kB/s | 126 kB 00:00 2023-10-08T12:53:54.083 INFO:teuthology.orchestra.run.smithi060.stdout:(115/131): python3-werkzeug-0.12.2-4.el8.noarch 2.5 MB/s | 457 kB 00:00 2023-10-08T12:53:54.134 INFO:teuthology.orchestra.run.smithi005.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 141 kB/s | 20 kB 00:00 2023-10-08T12:53:54.158 INFO:teuthology.orchestra.run.smithi060.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 510 kB/s | 64 kB 00:00 2023-10-08T12:53:54.225 INFO:teuthology.orchestra.run.smithi060.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 756 kB/s | 126 kB 00:00 2023-10-08T12:53:54.234 INFO:teuthology.orchestra.run.smithi005.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 653 kB/s | 103 kB 00:00 2023-10-08T12:53:54.250 INFO:teuthology.orchestra.run.smithi060.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 120 kB/s | 20 kB 00:00 2023-10-08T12:53:54.276 INFO:teuthology.orchestra.run.smithi005.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-10-08T12:53:54.292 INFO:teuthology.orchestra.run.smithi060.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 772 kB/s | 103 kB 00:00 2023-10-08T12:53:54.393 INFO:teuthology.orchestra.run.smithi005.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-10-08T12:53:54.399 INFO:teuthology.orchestra.run.smithi060.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 4.0 MB/s | 709 kB 00:00 2023-10-08T12:53:54.443 INFO:teuthology.orchestra.run.smithi060.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2023-10-08T12:53:54.510 INFO:teuthology.orchestra.run.smithi005.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-10-08T12:53:54.526 INFO:teuthology.orchestra.run.smithi060.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-10-08T12:53:54.593 INFO:teuthology.orchestra.run.smithi060.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-10-08T12:53:54.627 INFO:teuthology.orchestra.run.smithi005.stdout:(96/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-10-08T12:53:54.652 INFO:teuthology.orchestra.run.smithi005.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-10-08T12:53:54.660 INFO:teuthology.orchestra.run.smithi060.stdout:(124/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-08T12:53:54.694 INFO:teuthology.orchestra.run.smithi060.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-10-08T12:53:54.744 INFO:teuthology.orchestra.run.smithi005.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-10-08T12:53:54.819 INFO:teuthology.orchestra.run.smithi060.stdout:(126/131): postgresql-server-10.21-2.module+el8 22 MB/s | 5.1 MB 00:00 2023-10-08T12:53:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:(99/131): postgresql-server-10.21-2.module+el8. 23 MB/s | 5.1 MB 00:00 2023-10-08T12:53:54.893 INFO:teuthology.orchestra.run.smithi060.stdout:(127/131): postgresql-contrib-10.21-2.module+el 3.4 MB/s | 808 kB 00:00 2023-10-08T12:53:54.911 INFO:teuthology.orchestra.run.smithi005.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.8 MB/s | 808 kB 00:00 2023-10-08T12:53:54.945 INFO:teuthology.orchestra.run.smithi060.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 6.0 MB/s | 1.5 MB 00:00 2023-10-08T12:53:55.036 INFO:teuthology.orchestra.run.smithi005.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 9.0 MB/s | 1.5 MB 00:00 2023-10-08T12:53:55.062 INFO:teuthology.orchestra.run.smithi005.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2023-10-08T12:53:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.7 MB/s | 798 kB 00:00 2023-10-08T12:53:55.170 INFO:teuthology.orchestra.run.smithi005.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-10-08T12:53:55.196 INFO:teuthology.orchestra.run.smithi005.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 319 kB/s | 43 kB 00:00 2023-10-08T12:53:55.296 INFO:teuthology.orchestra.run.smithi005.stdout:(105/131): keyutils-libs-devel-1.5.10-9.el8.x86 481 kB/s | 48 kB 00:00 2023-10-08T12:53:55.312 INFO:teuthology.orchestra.run.smithi060.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 7.6 MB/s | 3.7 MB 00:00 2023-10-08T12:53:55.321 INFO:teuthology.orchestra.run.smithi005.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-08T12:53:55.438 INFO:teuthology.orchestra.run.smithi005.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 613 kB/s | 87 kB 00:00 2023-10-08T12:53:55.496 INFO:teuthology.orchestra.run.smithi060.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 6.2 MB/s | 3.7 MB 00:00 2023-10-08T12:53:55.497 INFO:teuthology.orchestra.run.smithi005.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 244 kB/s | 43 kB 00:00 2023-10-08T12:53:55.500 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:53:55.501 INFO:teuthology.orchestra.run.smithi060.stdout:Total 12 MB/s | 209 MB 00:17 2023-10-08T12:53:55.540 INFO:teuthology.orchestra.run.smithi005.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.1 MB/s | 109 kB 00:00 2023-10-08T12:53:55.631 INFO:teuthology.orchestra.run.smithi005.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-10-08T12:53:55.739 INFO:teuthology.orchestra.run.smithi005.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.7 MB/s | 560 kB 00:00 2023-10-08T12:53:55.798 INFO:teuthology.orchestra.run.smithi005.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 112 kB/s | 19 kB 00:00 2023-10-08T12:53:56.232 INFO:teuthology.orchestra.run.smithi005.stdout:(113/131): ceph-test-18.0.0-6639.g7b3143ba.el8. 4.1 MB/s | 49 MB 00:12 2023-10-08T12:53:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 299 kB/s | 155 kB 00:00 2023-10-08T12:53:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 1.1 MB/s | 559 kB 00:00 2023-10-08T12:53:56.373 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-08T12:53:56.408 INFO:teuthology.orchestra.run.smithi005.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-10-08T12:53:56.433 INFO:teuthology.orchestra.run.smithi005.stdout:(117/131): libverto-devel-0.3.0-5.el8.x86_64.rp 89 kB/s | 18 kB 00:00 2023-10-08T12:53:56.475 INFO:teuthology.orchestra.run.smithi005.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.3 MB/s | 238 kB 00:00 2023-10-08T12:53:56.506 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-08T12:53:56.506 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-08T12:53:56.542 INFO:teuthology.orchestra.run.smithi005.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 666 kB/s | 72 kB 00:00 2023-10-08T12:53:56.625 INFO:teuthology.orchestra.run.smithi005.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 11 MB/s | 2.3 MB 00:00 2023-10-08T12:53:56.651 INFO:teuthology.orchestra.run.smithi005.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 471 kB/s | 83 kB 00:00 2023-10-08T12:53:56.668 INFO:teuthology.orchestra.run.smithi005.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 477 kB/s | 60 kB 00:00 2023-10-08T12:53:56.743 INFO:teuthology.orchestra.run.smithi005.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 838 kB/s | 98 kB 00:00 2023-10-08T12:53:56.768 INFO:teuthology.orchestra.run.smithi005.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 493 kB/s | 58 kB 00:00 2023-10-08T12:53:56.810 INFO:teuthology.orchestra.run.smithi005.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 272 kB/s | 39 kB 00:00 2023-10-08T12:53:56.894 INFO:teuthology.orchestra.run.smithi005.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.2 MB/s | 644 kB 00:00 2023-10-08T12:53:56.927 INFO:teuthology.orchestra.run.smithi005.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-10-08T12:53:56.961 INFO:teuthology.orchestra.run.smithi005.stdout:(128/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 890 kB/s | 171 kB 00:00 2023-10-08T12:53:57.094 INFO:teuthology.orchestra.run.smithi005.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.9 MB/s | 798 kB 00:00 2023-10-08T12:53:57.578 INFO:teuthology.orchestra.run.smithi005.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 5.5 MB/s | 3.7 MB 00:00 2023-10-08T12:53:57.701 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-08T12:53:57.703 INFO:teuthology.orchestra.run.smithi005.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 4.8 MB/s | 3.7 MB 00:00 2023-10-08T12:53:57.705 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-08T12:53:57.706 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:53:57.706 INFO:teuthology.orchestra.run.smithi005.stdout:Total 9.5 MB/s | 209 MB 00:21 2023-10-08T12:53:58.044 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-10-08T12:53:58.248 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:53:58.421 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:53:58.572 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-10-08T12:53:58.640 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:53:58.704 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-10-08T12:53:58.704 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-10-08T12:53:58.867 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:53:58.976 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:53:59.226 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:53:59.639 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:53:59.850 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:53:59.909 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-10-08T12:53:59.913 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-10-08T12:54:00.280 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:54:00.509 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:54:00.638 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:54:00.858 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:54:00.956 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:54:01.182 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:54:01.430 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:54:01.938 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:54:02.355 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:54:02.607 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:54:02.758 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:54:02.876 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:54:03.025 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:54:03.100 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:54:03.121 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-08T12:54:03.258 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:54:03.309 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:54:03.396 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:54:03.524 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:54:03.575 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:54:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:54:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:54:04.192 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:54:04.291 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:54:04.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:54:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:54:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-10-08T12:54:04.982 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:54:04.983 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:54:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:54:05.191 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:54:05.216 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:54:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:54:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:54:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:54:05.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:54:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:54:05.749 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:54:05.933 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:54:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:54:05.956 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:54:06.045 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:54:06.198 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:54:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:54:06.407 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:54:06.409 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T12:54:06.459 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:54:06.616 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:54:06.640 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:54:06.677 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:54:06.828 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:54:06.902 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:54:07.073 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:54:07.140 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:54:07.216 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:54:07.289 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:54:07.385 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:54:07.412 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:54:07.524 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:54:07.572 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:54:07.589 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:54:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:54:07.685 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:54:07.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:54:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:54:07.925 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:54:07.957 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:54:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:54:08.165 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:54:08.345 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T12:54:08.402 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:54:08.521 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T12:54:08.643 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:54:08.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T12:54:08.796 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:54:08.840 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:54:08.954 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:54:08.979 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:54:09.048 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:54:09.132 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:54:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:54:09.276 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:54:09.304 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:54:09.456 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:54:09.532 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:54:09.544 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:54:09.714 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:54:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:54:09.815 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:54:09.849 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:54:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:54:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:54:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:54:10.691 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:54:10.798 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:54:10.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:54:11.499 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:54:11.548 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:54:11.582 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:54:11.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:54:11.797 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T12:54:11.899 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:54:11.976 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T12:54:12.111 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:54:12.187 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:54:12.334 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:54:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:54:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:54:12.502 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:54:12.545 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:54:12.687 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:54:12.716 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:54:12.744 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:54:12.922 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:54:12.922 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:54:12.931 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:54:13.112 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:54:13.194 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:54:13.334 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:54:13.396 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:54:13.468 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:54:13.611 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:54:13.672 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:54:13.871 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:54:13.908 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:54:14.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:54:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:54:14.281 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:54:14.601 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:54:14.799 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:54:14.823 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:54:15.010 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:54:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:54:15.311 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:54:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:54:15.639 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:54:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:54:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T12:54:15.880 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:54:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:54:16.092 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:54:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T12:54:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:54:16.353 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:54:16.454 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T12:54:16.510 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:54:16.675 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:54:16.723 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T12:54:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:54:17.040 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:54:17.111 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:54:17.296 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:54:17.327 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:54:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:54:17.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T12:54:17.773 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T12:54:17.938 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:54:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:54:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:54:18.115 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:54:18.213 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:54:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T12:54:18.405 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:54:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:54:18.528 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T12:54:18.558 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:54:18.704 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:54:18.714 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:54:18.764 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:54:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:54:18.840 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:54:18.901 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:54:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T12:54:19.109 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:54:19.136 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:54:19.177 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T12:54:19.326 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:54:19.332 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T12:54:19.350 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:54:19.497 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:54:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T12:54:19.513 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:54:19.584 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:54:19.709 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T12:54:19.716 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:54:19.827 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:54:19.853 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T12:54:19.899 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:54:20.040 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:54:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T12:54:20.051 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:54:20.206 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:54:20.275 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T12:54:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:54:20.401 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:54:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:54:20.670 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T12:54:20.686 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:54:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:54:20.904 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:54:20.992 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T12:54:21.068 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:54:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:54:21.235 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T12:54:21.250 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:54:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:54:21.441 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:54:21.493 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T12:54:21.646 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:54:21.647 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:54:21.746 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T12:54:21.859 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:54:21.902 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:54:22.042 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:54:22.073 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T12:54:22.186 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:54:22.265 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:54:22.389 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T12:54:22.459 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:54:22.471 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:54:22.579 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T12:54:22.676 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:54:22.683 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:54:22.838 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T12:54:22.878 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:54:22.897 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:54:23.011 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T12:54:23.090 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:54:23.135 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:54:23.219 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T12:54:23.259 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:54:23.354 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:54:23.530 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T12:54:23.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:54:23.591 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:54:23.786 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:54:23.812 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T12:54:23.879 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:54:24.064 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T12:54:24.122 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:54:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T12:54:24.369 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:54:24.439 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:54:24.537 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:54:24.652 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:54:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:54:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:54:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:54:24.918 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:54:25.008 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:54:25.154 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:54:25.232 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:54:25.293 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:54:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:54:25.487 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:54:25.516 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:54:25.652 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:54:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:54:25.806 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:54:25.861 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:54:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:54:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:54:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:54:26.103 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:54:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:54:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:54:26.319 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:54:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:54:26.387 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:54:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:54:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:54:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:54:26.868 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:54:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:54:27.070 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:54:27.157 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:54:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:54:27.312 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:54:27.327 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:54:27.387 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:54:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:54:27.588 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:54:27.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:54:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:54:27.747 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:54:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:54:27.967 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:54:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:54:28.201 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:54:28.415 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:54:28.552 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:54:28.775 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:54:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:54:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:54:29.201 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:54:29.449 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:54:29.478 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:54:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:54:29.765 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:54:29.853 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:54:30.083 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:54:30.136 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:54:30.415 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:54:30.650 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:54:31.272 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:54:31.443 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:31.480 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:54:31.534 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:54:31.645 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:54:31.704 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:31.730 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:54:31.770 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:54:31.896 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:54:32.130 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:54:32.282 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:54:32.554 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:54:32.638 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:54:32.644 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:54:32.828 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:54:33.483 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:54:33.694 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:54:33.758 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:54:33.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:54:35.858 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:36.121 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:36.747 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:37.027 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:54:37.093 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:54:37.220 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:54:37.961 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:54:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:54:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:54:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:54:52.366 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:54:52.366 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-10-08T12:54:52.366 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-10-08T12:54:52.366 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-10-08T12:54:52.367 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:54:52.717 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:54:54.310 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:54:54.500 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:54:54.720 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:54:54.941 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:54:55.432 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:54:55.583 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:54:55.600 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /run 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2023-10-08T12:54:56.810 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2023-10-08T12:54:56.811 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2023-10-08T12:54:56.811 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-08T12:54:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:54:57.151 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:54:57.355 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:54:57.569 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:54:57.689 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:54:57.932 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:54:58.116 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:54:58.338 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:54:58.632 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:54:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:54:58.991 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2023-10-08T12:54:59.024 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2023-10-08T12:54:59.025 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-10-08T12:54:59.025 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:54:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:54:59.383 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:54:59.418 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:54:59.592 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:54:59.832 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:54:59.920 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:54:59.924 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:55:00.059 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:55:00.077 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:55:00.276 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:55:00.513 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:55:00.549 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:55:00.715 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:55:00.728 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:55:01.075 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:55:01.247 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:55:01.479 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:55:01.640 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:55:01.914 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:55:02.093 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:55:02.110 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:55:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:55:02.248 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:55:02.282 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:55:02.297 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:55:02.300 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:55:02.331 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:55:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:55:02.499 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:55:02.542 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:55:02.600 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:55:02.707 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:55:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:55:03.089 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:55:03.107 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:55:03.290 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:55:04.134 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:55:04.249 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:55:04.333 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:55:04.431 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:55:04.440 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:55:04.546 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:55:04.718 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:55:04.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:55:04.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:55:05.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:55:05.045 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:55:05.165 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:55:05.216 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:55:05.228 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:55:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:55:06.468 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:55:06.620 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:55:06.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:55:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:55:06.834 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:55:06.869 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:55:07.000 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:55:07.044 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:55:07.114 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:55:07.216 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:55:07.373 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:55:07.410 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:55:07.547 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:55:07.559 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:55:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:55:07.775 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:55:07.930 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:55:08.250 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:55:08.423 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:55:08.612 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:55:08.963 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:55:09.157 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:55:09.193 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:55:09.347 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:55:09.395 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:55:09.486 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:55:09.581 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:55:09.861 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:55:09.969 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:55:10.034 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:55:10.148 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:55:10.269 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:55:10.427 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:55:10.573 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:55:12.730 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:55:12.841 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:13.105 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:13.123 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:13.297 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:55:13.571 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:55:13.638 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:55:13.876 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:55:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T12:55:14.136 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T12:55:14.199 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:55:14.372 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:55:14.377 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T12:55:14.381 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:55:14.540 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:55:14.569 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:55:14.750 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:55:14.763 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:55:14.874 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:55:14.980 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T12:55:15.063 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:55:15.076 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:55:15.076 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:15.095 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:55:15.137 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:55:15.266 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:15.266 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:55:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:55:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:55:15.530 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:55:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:55:15.737 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:55:16.242 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:55:16.243 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:55:16.244 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:55:16.245 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:55:16.246 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:55:16.247 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:55:16.248 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:55:16.249 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:55:16.250 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:55:16.251 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:55:16.252 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:55:16.253 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:55:16.254 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:55:16.254 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:55:16.254 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:16.254 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:55:16.750 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:55:17.088 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:55:17.267 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:55:17.459 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:55:17.630 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:55:17.747 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:17.805 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:55:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:18.026 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:18.266 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:55:18.490 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:55:18.766 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:18.766 INFO:teuthology.orchestra.run.smithi118.stdout:Last metadata expiration check: 0:01:55 ago on Sun 08 Oct 2023 12:53:23 PM UTC. 2023-10-08T12:55:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:55:19.149 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:55:19.331 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:55:19.421 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:55:19.615 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:55:19.628 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:55:19.774 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:55:19.782 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:55:19.942 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T12:55:19.942 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:20.135 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:20.135 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:55:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:20.413 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:55:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:55:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:55:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:55:21.178 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:21.178 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:55:21.179 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:55:21.180 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:55:21.181 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:55:21.181 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:55:21.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:55:21.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:55:21.192 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:55:21.193 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T12:55:21.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T12:55:21.195 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T12:55:21.196 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T12:55:21.197 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:55:21.198 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:55:21.199 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:55:21.199 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:21.199 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:55:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:55:21.548 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:55:21.679 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:55:21.688 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:55:21.895 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:55:22.079 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:55:22.167 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:55:22.345 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:55:22.358 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:55:22.359 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:22.574 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:22.574 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:55:22.801 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:55:23.028 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:23.562 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:23.562 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:55:23.563 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:55:23.564 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:55:23.565 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:55:23.566 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:55:23.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:55:23.568 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:55:23.569 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:55:23.570 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:55:23.571 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:55:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:55:23.573 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:55:23.574 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:55:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:23.735 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:59 ago on Sun 08 Oct 2023 12:53:24 PM UTC. 2023-10-08T12:55:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:55:26.019 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:03 ago on Sun 08 Oct 2023 12:53:23 PM UTC. 2023-10-08T12:55:27.258 INFO:teuthology.orchestra.run.smithi118.stdout:Installed products updated. 2023-10-08T12:55:27.470 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:55:27.470 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-10-08T12:55:27.470 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:55:27.470 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.471 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.472 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:55:27.473 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:55:27.474 INFO:teuthology.orchestra.run.smithi118.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:55:27.475 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:27.476 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:55:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:55:27.478 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:55:27.479 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:55:27.480 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:55:27.481 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:55:27.482 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:55:27.482 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:55:27.482 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:55:27.482 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:55:27.482 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:55:27.482 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-10-08T12:55:27.637 DEBUG:teuthology.parallel:result is None 2023-10-08T12:55:32.289 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-10-08T12:55:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:55:32.524 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-10-08T12:55:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:55:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.524 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:55:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:55:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:55:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:55:32.531 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:32.532 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:32.532 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:32.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:55:32.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:55:32.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:55:32.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:55:32.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:55:32.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:55:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:55:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:55:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:55:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:55:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:55:32.535 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:55:32.536 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:55:32.537 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:55:32.537 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:55:32.537 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:55:32.537 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:55:32.537 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:55:32.537 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:55:32.538 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.538 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.538 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:55:32.538 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:55:32.538 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.538 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:55:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:55:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:55:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:55:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:55:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:55:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:55:32.540 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:55:32.541 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:55:32.542 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:55:32.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:55:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-10-08T12:55:32.721 DEBUG:teuthology.parallel:result is None 2023-10-08T12:55:33.583 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-08T12:55:33.825 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:55:33.825 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-10-08T12:55:33.825 INFO:teuthology.orchestra.run.smithi060.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:55:33.825 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.825 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.825 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.826 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:55:33.828 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:55:33.829 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:55:33.830 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:55:33.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:55:33.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:55:33.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:55:33.835 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.836 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:55:33.837 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:55:33.838 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:55:33.839 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:55:33.839 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-08T12:55:33.839 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-08T12:55:34.016 DEBUG:teuthology.parallel:result is None 2023-10-08T12:55:34.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:55:34.164 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:55:34.193 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:55:34.193 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:55:34.193 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:55:34.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:55:34.412 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:55:34.438 INFO:teuthology.orchestra.run.smithi060.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:55:34.438 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:55:34.439 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:55:34.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:55:34.580 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:55:34.608 INFO:teuthology.orchestra.run.smithi118.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:55:34.608 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:55:34.608 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:55:34.609 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T12:55:34.609 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:55:34.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:55:34.660 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:55:34.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:55:34.706 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:55:34.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:55:34.757 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T12:55:34.758 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:55:34.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:55:34.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:55:34.865 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:55:34.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:55:34.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:55:34.968 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:55:34.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:55:35.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:55:35.074 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T12:55:35.075 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:55:35.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:55:35.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:55:35.181 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:55:35.181 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:55:35.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:55:35.285 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:55:35.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:55:35.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:55:35.389 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T12:55:35.390 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:55:35.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:55:35.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:55:35.496 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:55:35.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:55:35.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:55:35.601 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:55:35.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:55:35.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:55:35.706 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-08T12:55:35.784 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-08T12:55:35.785 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:55:35.785 INFO:tasks.cephadm:Cluster fsid is f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:55:35.786 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-08T12:55:35.786 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.b': '172.21.15.60', 'mon.c': '172.21.15.118'} 2023-10-08T12:55:35.786 INFO:tasks.cephadm:First mon is mon.a on smithi005 2023-10-08T12:55:35.786 INFO:tasks.cephadm:First mgr is x 2023-10-08T12:55:35.786 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-08T12:55:35.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2023-10-08T12:55:35.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2023-10-08T12:55:35.854 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname $(hostname -s) 2023-10-08T12:55:35.887 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-08T12:55:35.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:55:36.030 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73096/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6639-g7b3143ba', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6639.g7b3143ba'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-07 17:16:01.199993', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231007.154158', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-08T12:55:36.243 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-batrick-testing-20231007.154158, sha1 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:55:36.243 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm 2023-10-08T12:55:36.244 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:36.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:55 /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:36.925 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:37.632 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:55 /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:37.632 DEBUG:teuthology.orchestra.run.smithi118:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:38.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:55 /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:38.225 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:38.248 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:38.271 DEBUG:teuthology.orchestra.run.smithi118:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:55:38.308 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de on all hosts... 2023-10-08T12:55:38.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:55:38.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:55:38.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:55:40.838 INFO:teuthology.orchestra.run.smithi118.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:55:42.439 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:55:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-08T12:56:14.523 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T12:56:18.128 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T12:56:18.128 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:56:18.128 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:56:18.128 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2023-10-08T12:56:18.128 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:56:18.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T12:56:18.129 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T12:56:19.544 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-08T12:56:19.545 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:56:19.545 INFO:teuthology.orchestra.run.smithi118.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:56:19.545 INFO:teuthology.orchestra.run.smithi118.stdout: "repo_digests": [ 2023-10-08T12:56:19.545 INFO:teuthology.orchestra.run.smithi118.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:56:19.545 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2023-10-08T12:56:19.545 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-08T12:56:19.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2023-10-08T12:56:19.604 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2023-10-08T12:56:19.643 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph 2023-10-08T12:56:19.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2023-10-08T12:56:19.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2023-10-08T12:56:19.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /etc/ceph 2023-10-08T12:56:19.761 INFO:tasks.cephadm:Writing seed config... 2023-10-08T12:56:19.762 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-08T12:56:19.762 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-08T12:56:19.762 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-08T12:56:19.763 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-08T12:56:19.764 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-08T12:56:19.764 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-08T12:56:19.764 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-08T12:56:19.764 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-08T12:56:19.764 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-08T12:56:19.764 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-10-08T12:56:19.765 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:56:19.765 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-08T12:56:19.783 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f92d23c2-65d9-11ee-8db5-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2023-10-08T12:56:19.784 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-08T12:56:19.826 DEBUG:teuthology.orchestra.run.smithi005:mgr.x> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-08T12:56:19.857 INFO:journalctl@ceph.mon.a.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T12:56:19.858 INFO:tasks.cephadm:Bootstrapping... 2023-10-08T12:56:19.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de -v bootstrap --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:56:19.886 INFO:journalctl@ceph.mgr.x.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T12:56:20.035 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:56:20.035 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', '-v', 'bootstrap', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2023-10-08T12:56:20.192 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:56:20.192 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-08T12:56:20.193 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2023-10-08T12:56:20.337 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:56:20.337 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2023-10-08T12:56:20.337 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2023-10-08T12:56:20.344 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T12:56:20.344 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T12:56:20.350 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T12:56:20.350 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-08T12:56:20.356 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2023-10-08T12:56:20.362 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2023-10-08T12:56:20.362 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2023-10-08T12:56:20.362 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2023-10-08T12:56:20.505 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:56:20.505 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-08T12:56:20.506 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2023-10-08T12:56:20.506 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2023-10-08T12:56:20.511 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T12:56:20.511 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T12:56:20.517 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T12:56:20.517 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-08T12:56:20.523 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2023-10-08T12:56:20.529 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2023-10-08T12:56:20.529 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2023-10-08T12:56:20.529 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2023-10-08T12:56:20.529 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:20.529 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 140379732711912 on /run/cephadm/f92d23c2-65d9-11ee-8db5-212e2dc638e7.lock 2023-10-08T12:56:20.529 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 140379732711912 acquired on /run/cephadm/f92d23c2-65d9-11ee-8db5-212e2dc638e7.lock 2023-10-08T12:56:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2023-10-08T12:56:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2023-10-08T12:56:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2023-10-08T12:56:20.534 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-08T12:56:20.534 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2023-10-08T12:56:20.536 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-08T12:56:20.536 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-08T12:56:20.536 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1778sec hoplimit 64 pref medium 2023-10-08T12:56:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-08T12:56:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-08T12:56:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T12:56:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2023-10-08T12:56:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-08T12:56:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T12:56:20.540 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2023-10-08T12:56:20.540 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2023-10-08T12:56:20.540 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-08T12:56:20.541 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-08T12:56:20.541 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:1016a809630cb60ade9603521911a0725a35bac1f67b6518836ae2dd33bb1dad 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-08T12:56:20.984 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Storing signatures 2023-10-08T12:56:21.842 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T12:56:21.842 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T12:56:21.842 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2023-10-08T12:56:23.991 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2023-10-08T12:56:23.992 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2023-10-08T12:56:25.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQD5piJlBD7KFBAAh6iWpljPzdfyzW+kV8NKuw== 2023-10-08T12:56:26.510 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQD6piJlFFa6BxAApTEtiqrWMyi4Y6fuApEQJA== 2023-10-08T12:56:27.264 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQD6piJlTAprNRAApDS2GsNvD4sXOjbQfx3nDQ== 2023-10-08T12:56:27.265 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2023-10-08T12:56:28.113 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:28.114 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T12:56:28.115 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:56:28.115 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2023-10-08T12:56:28.871 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.a on 2023-10-08T12:56:29.001 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-08T12:56:29.094 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-08T12:56:29.217 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7.target. 2023-10-08T12:56:29.218 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7.target. 2023-10-08T12:56:29.397 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T12:56:29.397 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-08T12:56:29.488 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7.target.wants/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@.service. 2023-10-08T12:56:29.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:29 smithi005 systemd[1]: Starting Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:56:29.996 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:56:29.996 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-08T12:56:30.003 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:56:30.003 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-08T12:56:30.003 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-08T12:56:30.003 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T12:56:30.004 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2023-10-08T12:56:30.004 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2023-10-08T12:56:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:29 smithi005 podman[98959]: 2023-10-08T12:56:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:29 smithi005 bash[98959]: be0adc81202d98f65819e6ed1319b5b45a4950cd886f895b6177b35e67901fb3 2023-10-08T12:56:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:29 smithi005 systemd[1]: Started Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:56:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:30 smithi005 ceph-mon[98999]: mkfs f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:30 smithi005 ceph-mon[98999]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.62378s) 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-08T12:56:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2023-10-08T12:56:31.057 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2023-10-08T12:56:31.269 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:31 smithi005 ceph-mon[98999]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:56:31.270 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:31 smithi005 ceph-mon[98999]: monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} 2023-10-08T12:56:31.270 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:31 smithi005 ceph-mon[98999]: fsmap 2023-10-08T12:56:31.270 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:31 smithi005 ceph-mon[98999]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T12:56:31.270 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:31 smithi005 ceph-mon[98999]: mgrmap e1: no daemons active 2023-10-08T12:56:31.270 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:31 smithi005 ceph-mon[98999]: from='client.? 172.21.15.5:0/3685928088' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-08T12:56:32.100 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:32.100 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T12:56:32.101 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T12:56:32.102 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2023-10-08T12:56:32.277 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:32 smithi005 ceph-mon[98999]: from='client.? 172.21.15.5:0/3844067544' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T12:56:32.277 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:32 smithi005 ceph-mon[98999]: from='client.? 172.21.15.5:0/3844067544' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-08T12:56:33.041 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2023-10-08T12:56:33.389 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 ceph-mon[98999]: from='client.? 172.21.15.5:0/4016021806' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:33.390 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 systemd[1]: Stopping Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:56:33.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a[98975]: 2023-10-08T12:56:33.388+0000 7fdd5067a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:56:33.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a[98975]: 2023-10-08T12:56:33.388+0000 7fdd5067a700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-08T12:56:33.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 bash[99331]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T12:56:34.222 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 systemd[1]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-08T12:56:34.222 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 systemd[1]: Stopped Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:56:34.223 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:33 smithi005 systemd[1]: Starting Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:56:34.506 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 podman[99456]: 2023-10-08T12:56:34.506 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 bash[99456]: 0736b69d4152ed71cf48d60373c057d24efa58c0b8a8443db26d8cf1a90b47bc 2023-10-08T12:56:34.506 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:56:34.506 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:56:34.506 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: pidfile_write: ignore empty --pid-file 2023-10-08T12:56:34.506 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: load: jerasure load: lrc 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Git sha 0 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: DB SUMMARY 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: DB Session ID: 0ZIZAYGEXWL4P56V89WS 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88076 ; 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:56:34.507 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.env: 0x555737360da0 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.info_log: 0x5557395ed640 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.statistics: (nil) 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.use_fsync: 0 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:56:34.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.db_log_dir: 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.wal_dir: 2023-10-08T12:56:34.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.write_buffer_manager: 0x5557395a5360 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:56:34.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.unordered_write: 0 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:56:34.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.row_cache: None 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.wal_filter: None 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.wal_compression: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:56:34.512 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:56:34.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_open_files: -1 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:56:34.514 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Compression algorithms supported: 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kZSTD supported: 0 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:56:34.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.merge_operator: 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_filter: None 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5557395ed740) 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:56:34.516 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_type: 0 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_index_type: 0 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_shortening: 1 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: checksum: 4 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: no_block_cache: 0 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache: 0x5557396431f0 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:56:34.517 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_options: 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: capacity : 536870912 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_shard_bits : 4 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: strict_capacity_limit : 0 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_compressed: (nil) 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: persistent_cache: (nil) 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size: 4096 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size_deviation: 10 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_restart_interval: 16 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_block_restart_interval: 1 2023-10-08T12:56:34.518 INFO:journalctl@ceph.mon.a.smithi005.stdout: metadata_block_size: 4096 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: partition_filters: 0 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: use_delta_encoding: 1 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: filter_policy: bloomfilter 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: whole_key_filtering: 1 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: verify_compression: 0 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: format_version: 5 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_index_compression: 1 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_align: 0 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: max_auto_readahead_size: 262144 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: prepopulate_block_cache: 0 2023-10-08T12:56:34.519 INFO:journalctl@ceph.mon.a.smithi005.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression: NoCompression 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.num_levels: 7 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:56:34.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:56:34.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:56:34.522 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:56:34.523 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:56:34.524 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:56:34.525 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:56:34.525 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:56:34.525 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:56:34.525 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:56:34.526 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.ttl: 2592000 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:56:34.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e5e57406-8406-482f-91b2-d2a800544838 2023-10-08T12:56:34.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769794434898, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769794435807, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 84336, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 268, "table_properties": {"data_size": 82504, "index_size": 242, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10967, "raw_average_key_size": 48, "raw_value_size": 76337, "raw_average_value_size": 336, "num_data_blocks": 10, "num_entries": 227, "num_filter_entries": 227, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696769794, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e5e57406-8406-482f-91b2-d2a800544838", "db_session_id": "0ZIZAYGEXWL4P56V89WS", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769794435877, "job": 1, "event": "recovery_finished"} 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5557396e0000 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: DB pointer 0x5557396cc000 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** DB Stats ** 2023-10-08T12:56:34.529 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: L0 2/0 84.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:56:34.530 INFO:journalctl@ceph.mon.a.smithi005.stdout: Sum 2/0 84.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:56:34.531 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative compaction: 0.00 GB write, 26.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval compaction: 0.00 GB write, 26.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache BinnedLRUCache@0x5557396431f0#7 capacity: 512.00 MB usage: 1.20 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 7e-06 secs_since: 0 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:34.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???) e1 preinit fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).mds e1 new map 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).mds e1 print_map 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout: e1 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout: legacy client fscid: -1 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout: No filesystems configured 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:56:34.533 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:56:34.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-08T12:56:34.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:56:34.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} 2023-10-08T12:56:34.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: fsmap 2023-10-08T12:56:34.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T12:56:34.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 ceph-mon[99496]: mgrmap e1: no daemons active 2023-10-08T12:56:34.534 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-08T12:56:34.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:34 smithi005 systemd[1]: Started Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:56:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-08T12:56:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:56:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2023-10-08T12:56:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-08T12:56:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-08T12:56:35.715 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T12:56:35.716 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-08T12:56:35.814 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7.target.wants/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@.service. 2023-10-08T12:56:36.096 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:35 smithi005 systemd[1]: Starting Ceph mgr.x for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:56:36.395 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2770478157' entity='client.admin' 2023-10-08T12:56:36.395 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 podman[99723]: 2023-10-08T12:56:36.419 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:56:36.419 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-08T12:56:36.427 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:56:36.427 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-08T12:56:36.427 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-08T12:56:36.427 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T12:56:36.436 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:56:36.436 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-08T12:56:36.443 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:56:36.443 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-08T12:56:36.444 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-08T12:56:36.444 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-08T12:56:36.444 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2023-10-08T12:56:36.444 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2023-10-08T12:56:36.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 bash[99723]: e84a512ca00288e51d75c8a88de472895d973d798b21de018d2f6a6a6c882e17 2023-10-08T12:56:36.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 systemd[1]: Started Ceph mgr.x for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:56:36.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:36.544+0000 7f072a718200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:56:36.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:36.642+0000 7f072a718200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:56:37.083 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:36.757+0000 7f072a718200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:56:37.083 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:36.871+0000 7f072a718200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:56:37.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:37 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1579674338' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:56:37.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:37.083+0000 7f072a718200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:56:37.489 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:37.491 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:56:37.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:56:37.493 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:56:37.494 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:56:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:56:37.500 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:56:30.007338+0000", 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:56:37.501 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:56:37.502 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2023-10-08T12:56:37.728 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:37.575+0000 7f072a718200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:56:38.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:37.728+0000 7f072a718200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:56:38.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:37.837+0000 7f072a718200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:56:38.172 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:37.953+0000 7f072a718200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:56:38.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:38.468+0000 7f072a718200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:56:39.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:39.265+0000 7f072a718200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:56:39.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:39.364+0000 7f072a718200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:56:40.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:40.373+0000 7f072a718200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:56:40.443 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:40.443 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:56:40.443 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T12:56:40.443 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:56:40.443 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:56:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:56:40.446 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:56:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:40.448 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:56:30.007338+0000", 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:56:40.449 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (2/15)... 2023-10-08T12:56:40.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:40 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/980038483' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:56:40.710 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:40.486+0000 7f072a718200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:56:41.317 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:40.709+0000 7f072a718200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:56:41.317 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:41.062+0000 7f072a718200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:56:41.317 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:41.316+0000 7f072a718200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:56:41.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:41.500+0000 7f072a718200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:56:42.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:41.833+0000 7f072a718200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:56:42.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:42.667+0000 7f072a718200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:56:42.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:42.825+0000 7f072a718200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:56:43.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:43.073+0000 7f072a718200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:56:43.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:43.210+0000 7f072a718200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:56:43.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:43.488+0000 7f072a718200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:56:44.881 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:44.570+0000 7f072a718200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: Activating manager daemon x 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: mgrmap e2: x(active, starting, since 0.00304245s) 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: Manager daemon x is now available 2023-10-08T12:56:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:56:45.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:56:45.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' 2023-10-08T12:56:45.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' 2023-10-08T12:56:45.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:45 smithi005 ceph-mon[99496]: from='mgr.14100 172.21.15.5:0/313759425' entity='mgr.x' 2023-10-08T12:56:46.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:46 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3019607813' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:56:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:46 smithi005 ceph-mon[99496]: mgrmap e3: x(active, since 1.00802s) 2023-10-08T12:56:47.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:56:47.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:56:47.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:56:47.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:56:47.704 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:56:47.705 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.706 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:56:30.007338+0000", 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:56:47.707 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (3/15)... 2023-10-08T12:56:48.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:48 smithi005 ceph-mon[99496]: mgrmap e4: x(active, since 2s) 2023-10-08T12:56:51.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1581157108' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:56:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:56:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T12:56:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:56:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:56:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:56:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:56:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:56:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:56:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:56:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:56:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:56:30.007338+0000", 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:56:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2023-10-08T12:56:52.310 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:52 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1030724226' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T12:56:52.502 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:52.502 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T12:56:52.502 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:56:52.502 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T12:56:52.503 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T12:56:52.504 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T12:56:52.504 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T12:56:52.504 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T12:56:52.504 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2023-10-08T12:56:53.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:53 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/184552461' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-08T12:56:53.830 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: ignoring --setuser ceph since I am not root 2023-10-08T12:56:53.830 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: ignoring --setgroup ceph since I am not root 2023-10-08T12:56:53.830 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:53.731+0000 7fc2ce54c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:56:54.135 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:53.828+0000 7fc2ce54c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:56:54.135 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:53.939+0000 7fc2ce54c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:56:54.135 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:54.063+0000 7fc2ce54c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:56:54.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:54.280+0000 7fc2ce54c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:56:54.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:54 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/184552461' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-08T12:56:54.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:54 smithi005 ceph-mon[99496]: mgrmap e5: x(active, since 8s) 2023-10-08T12:56:54.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:54.772+0000 7fc2ce54c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2023-10-08T12:56:55.291 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2023-10-08T12:56:55.294 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:54.925+0000 7fc2ce54c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:56:55.294 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:55.046+0000 7fc2ce54c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:56:55.295 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:55.164+0000 7fc2ce54c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:56:55.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:56:55 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3803866515' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T12:56:55.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:55.687+0000 7fc2ce54c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:56:56.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:56.478+0000 7fc2ce54c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:56:56.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:56.577+0000 7fc2ce54c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:56:57.888 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:57.553+0000 7fc2ce54c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:56:57.888 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:57.665+0000 7fc2ce54c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:56:58.494 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:57.887+0000 7fc2ce54c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:56:58.495 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:58.239+0000 7fc2ce54c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:56:58.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:58.493+0000 7fc2ce54c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:56:58.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:58.676+0000 7fc2ce54c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:56:59.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:59.007+0000 7fc2ce54c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:57:00.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:59.837+0000 7fc2ce54c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:57:00.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:56:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:56:59.996+0000 7fc2ce54c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:57:00.659 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:00.245+0000 7fc2ce54c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:57:00.660 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:00.383+0000 7fc2ce54c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:57:02.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:00.658+0000 7fc2ce54c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:01.748+0000 7fc2ce54c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: Active manager daemon x restarted 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: Activating manager daemon x 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: osdmap e2: 0 total, 0 up, 0 in 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: mgrmap e6: x(active, starting, since 0.00355841s) 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:57:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: Manager daemon x is now available 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:02.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:01 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: Found migration_current of "None". Setting to last migration. 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:03.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:02] ENGINE Bus STARTING 2023-10-08T12:57:03.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: mgrmap e7: x(active, since 1.00543s) 2023-10-08T12:57:03.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:02 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:03.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:57:03.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-08T12:57:03.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T12:57:03.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:57:03.147 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2023-10-08T12:57:03.147 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2023-10-08T12:57:04.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:03 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:02] ENGINE Serving on https://172.21.15.5:7150 2023-10-08T12:57:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:03 smithi005 ceph-mon[99496]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T12:57:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:03 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:02] ENGINE Serving on http://172.21.15.5:8765 2023-10-08T12:57:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:03 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:02] ENGINE Bus STARTED 2023-10-08T12:57:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:03 smithi005 ceph-mon[99496]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T12:57:04.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:04 smithi005 ceph-mon[99496]: mgrmap e8: x(active, since 2s) 2023-10-08T12:57:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:04 smithi005 ceph-mon[99496]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:04 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:04 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:05.629 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-08T12:57:05.630 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2023-10-08T12:57:05.892 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:05 smithi005 ceph-mon[99496]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:07.107 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-mon[99496]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-mon[99496]: Generating ssh key... 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: Generating public/private rsa key pair. 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: Your identification has been saved in /tmp/tmpjaelrjvi/key. 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: Your public key has been saved in /tmp/tmpjaelrjvi/key.pub. 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: The key fingerprint is: 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: SHA256:2Ogup7hy4kbL+SBVC/bijMZaVBnEgbvxf5ZVZSpWfg8 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: The key's randomart image is: 2023-10-08T12:57:07.108 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: +---[RSA 3072]----+ 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: | ++. | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: | . .o . o | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: | o.+ o + | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: | .o= . + o + E | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: | ++o o S. o . o | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: |.B.... . .| 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: |=+* .. o | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: |**o...o + | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: |+=+o.+.o | 2023-10-08T12:57:07.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: +----[SHA256]-----+ 2023-10-08T12:57:08.222 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:07 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:08.222 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:07 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:08.610 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:57:08.610 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-08T12:57:08.611 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2023-10-08T12:57:08.612 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2023-10-08T12:57:09.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:08 smithi005 ceph-mon[99496]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:10.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:10 smithi005 ceph-mon[99496]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:11.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:11 smithi005 ceph-mon[99496]: Deploying cephadm binary to smithi005 2023-10-08T12:57:12.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2023-10-08T12:57:12.761 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mon service... 2023-10-08T12:57:13.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:13 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:13.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:13 smithi005 ceph-mon[99496]: Added host smithi005 2023-10-08T12:57:13.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:13 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-08T12:57:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mgr service... 2023-10-08T12:57:14.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:14 smithi005 ceph-mon[99496]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:14.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:14 smithi005 ceph-mon[99496]: Saving service mon spec with placement count:5 2023-10-08T12:57:14.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:14 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:14.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:14 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:15.858 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-08T12:57:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:15 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:15 smithi005 ceph-mon[99496]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:15 smithi005 ceph-mon[99496]: Saving service mgr spec with placement count:2 2023-10-08T12:57:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:15 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:17.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:17 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:17.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:17 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1587800899' entity='client.admin' 2023-10-08T12:57:17.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:17 smithi005 ceph-mon[99496]: from='mgr.14120 172.21.15.5:0/3486845776' entity='mgr.x' 2023-10-08T12:57:18.541 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2023-10-08T12:57:19.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:19 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2077857025' entity='client.admin' 2023-10-08T12:57:20.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/823590627' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-08T12:57:20.757 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: ignoring --setuser ceph since I am not root 2023-10-08T12:57:20.757 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: ignoring --setgroup ceph since I am not root 2023-10-08T12:57:20.757 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:20.660+0000 7fd642adb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:57:20.758 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:20.756+0000 7fd642adb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:57:21.124 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:20.866+0000 7fd642adb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:57:21.124 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:20 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:20.981+0000 7fd642adb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:57:21.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:21 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:21.201+0000 7fd642adb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:57:21.838 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:21 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:21.678+0000 7fd642adb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:57:21.838 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:21 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/823590627' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-08T12:57:21.838 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:21 smithi005 ceph-mon[99496]: mgrmap e9: x(active, since 18s) 2023-10-08T12:57:22.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:21 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:21.838+0000 7fd642adb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:57:22.172 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:21 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:21.947+0000 7fd642adb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:57:22.172 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:22 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:22.076+0000 7fd642adb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:57:22.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2023-10-08T12:57:22.334 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2023-10-08T12:57:22.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:22 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3676318972' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T12:57:22.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:22 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:22.608+0000 7fd642adb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:57:23.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:23 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:23.395+0000 7fd642adb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:57:23.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:23 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:23.494+0000 7fd642adb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:57:24.797 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:24 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:24.465+0000 7fd642adb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:57:24.798 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:24 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:24.576+0000 7fd642adb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:57:25.150 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:24 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:24.797+0000 7fd642adb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:57:25.403 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:25 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:25.150+0000 7fd642adb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:57:25.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:25 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:25.403+0000 7fd642adb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:57:25.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:25 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:25.585+0000 7fd642adb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:57:26.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:25 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:25.917+0000 7fd642adb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:57:27.146 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:26 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:26.740+0000 7fd642adb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:57:27.147 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:26 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:26.898+0000 7fd642adb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:57:27.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:27 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:27.145+0000 7fd642adb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:57:27.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:27 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:27.282+0000 7fd642adb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:57:27.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:27 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:27.557+0000 7fd642adb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:57:28.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:57:28.601+0000 7fd642adb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: Active manager daemon x restarted 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: Activating manager daemon x 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: osdmap e3: 0 total, 0 up, 0 in 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: mgrmap e10: x(active, starting, since 0.00314635s) 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:57:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:57:28.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: Manager daemon x is now available 2023-10-08T12:57:28.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:28.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:29.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:29 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:57:29.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:29 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:57:29.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:29 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:29] ENGINE Bus STARTING 2023-10-08T12:57:29.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:29 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:29] ENGINE Serving on https://172.21.15.5:7150 2023-10-08T12:57:29.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:29 smithi005 ceph-mon[99496]: mgrmap e11: x(active, since 1.00591s) 2023-10-08T12:57:30.097 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:57:30.098 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-08T12:57:30.098 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T12:57:30.098 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:57:30.098 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2023-10-08T12:57:30.098 INFO:teuthology.orchestra.run.smithi005.stdout:Generating a dashboard self-signed certificate... 2023-10-08T12:57:30.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:30 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:29] ENGINE Serving on http://172.21.15.5:8765 2023-10-08T12:57:30.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:30 smithi005 ceph-mon[99496]: [08/Oct/2023:12:57:29] ENGINE Bus STARTED 2023-10-08T12:57:30.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:30 smithi005 ceph-mon[99496]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T12:57:30.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:30 smithi005 ceph-mon[99496]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T12:57:30.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:30 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:31.645 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-08T12:57:31.645 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2023-10-08T12:57:32.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:32 smithi005 ceph-mon[99496]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:32.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:32 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:32.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:32 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:32.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:32 smithi005 ceph-mon[99496]: mgrmap e12: x(active, since 2s) 2023-10-08T12:57:32.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:32 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:33.492 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$owndEr6xaAS67DfVYXh9yOQ5Rxibd8jU80moLQNAyXIci.U3a.I.u", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696769852, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-08T12:57:33.493 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2023-10-08T12:57:34.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:33 smithi005 ceph-mon[99496]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:33 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:34.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2023-10-08T12:57:34.743 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:57:34.743 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2023-10-08T12:57:34.750 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:57:34.750 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2023-10-08T12:57:34.750 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2023-10-08T12:57:34.750 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-08T12:57:34.752 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2023-10-08T12:57:34.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:34.752 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005:8443/ 2023-10-08T12:57:34.752 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2023-10-08T12:57:34.752 INFO:teuthology.orchestra.run.smithi005.stdout: Password: qyml1s3thu 2023-10-08T12:57:34.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:34.753 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config directory 2023-10-08T12:57:34.753 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling autotune for osd_memory_target 2023-10-08T12:57:34.960 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:34 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1732215988' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-08T12:57:36.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:36 smithi005 ceph-mon[99496]: mgrmap e13: x(active, since 6s) 2023-10-08T12:57:37.538 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-08T12:57:37.538 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-08T12:57:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:57:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-08T12:57:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:37.540 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2023-10-08T12:57:37.579 INFO:tasks.cephadm:Fetching config... 2023-10-08T12:57:37.579 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:57:37.579 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-08T12:57:37.596 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-08T12:57:37.596 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:57:37.596 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-08T12:57:37.655 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-08T12:57:37.655 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:57:37.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-08T12:57:37.724 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-08T12:57:37.725 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:57:37.725 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-08T12:57:37.782 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-08T12:57:37.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:57:37.861 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:57:37.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:57:37.920 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:57:37.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:57:37.980 INFO:teuthology.orchestra.run.smithi118.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3by0G/rFmZT1KUdsE939bBW36xKmoVqcWEXwoN9WjK5LEnAmdRUlNw2WNGKP3EAN1GWrQBuuj+2yW8TI7hcUs3XOlv0vcYM226a4GvEeYQ3/sMnHLyFw88SbwVzxLfNCuJYbHMHKQuqsSgrF3DAwyUZriSgI1YytsIZc2hmroJFiOSNFK/xN0BJxDo5KRxDErv0pQOCPqTfey5DE3f/zPrpZokN0Htia+XO9V/2DbZn3JV6abX5BKkrwIA+etSJbn4UN9I3f3A8f+EyXs4xAW8ExyEg35AYx+yM+A9OVHyDFObNYc+fCOnMSwi2f25xcvtnWut2NXHjzrgrxeUCTfhGeLUWCRum8u56vd07iKkAcNwSymqHjMBH1W0dv4dvlPSOmkv20afiGPTtZP0mQxsHPwvYRTIsMXg4j2we8gL0iq097+YPHNwiQYQpuLsMCewgPL9f1lO+mOD/oiLcaY2ovuRgyDJgRGyRXCc6qFh82J3IZkAmVPU8Hl6n+cnyc= ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:57:37.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-08T12:57:38.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:38 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2968946362' entity='client.admin' 2023-10-08T12:57:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:40.838 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-08T12:57:40.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-08T12:57:41.320 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:41.622 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:41 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/292479451' entity='client.admin' 2023-10-08T12:57:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:42 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:42.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:42 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:42.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:42 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:42.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:42 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:42.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:42 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:42.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:42 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:43.403 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi060 2023-10-08T12:57:43.404 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:57:43.404 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.conf 2023-10-08T12:57:43.425 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:57:43.425 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:57:43.485 INFO:tasks.cephadm:Adding host smithi060 to orchestrator... 2023-10-08T12:57:43.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi060 2023-10-08T12:57:44.061 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:44.275 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:44.275 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:44.275 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:44.276 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:44.276 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:44.276 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:57:44.276 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:43 smithi005 ceph-mon[99496]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:57:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:45 smithi005 ceph-mon[99496]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:57:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:45 smithi005 ceph-mon[99496]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:57:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:45 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:45 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:45 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:46.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:46 smithi005 ceph-mon[99496]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:47.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:47 smithi005 ceph-mon[99496]: Deploying cephadm binary to smithi060 2023-10-08T12:57:48.447 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi060' with addr '172.21.15.60' 2023-10-08T12:57:48.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T12:57:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:49.785 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:49 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:49.785 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:49 smithi005 ceph-mon[99496]: Added host smithi060 2023-10-08T12:57:49.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:49 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:49.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:49 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:50.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:50 smithi005 ceph-mon[99496]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:57:50.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:50 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:50.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:50.816 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}] 2023-10-08T12:57:51.155 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi118 2023-10-08T12:57:51.156 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:57:51.156 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/etc/ceph/ceph.conf 2023-10-08T12:57:51.177 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:57:51.177 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:57:51.237 INFO:tasks.cephadm:Adding host smithi118 to orchestrator... 2023-10-08T12:57:51.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi118 2023-10-08T12:57:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:52.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:51 smithi005 ceph-mon[99496]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:57:52.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:51 smithi005 ceph-mon[99496]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:57:52.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:51 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:54.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:54.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:53 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:55.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:55 smithi005 ceph-mon[99496]: Deploying cephadm binary to smithi118 2023-10-08T12:57:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:55 smithi005 ceph-mon[99496]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:57:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:55 smithi005 ceph-mon[99496]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:57:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi118' with addr '172.21.15.118' 2023-10-08T12:57:56.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:56 smithi005 ceph-mon[99496]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:57:56.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:56 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:56.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:56 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:56.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:56 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:56.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:56 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:56.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:56 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:56.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T12:57:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:57.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:57 smithi005 ceph-mon[99496]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:57:57.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:57 smithi005 ceph-mon[99496]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:57:57.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:57 smithi005 ceph-mon[99496]: Added host smithi118 2023-10-08T12:57:57.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:57 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:57.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:57 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:57:58.641 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T12:57:58.641 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.118", "hostname": "smithi118", "labels": [], "status": ""}] 2023-10-08T12:57:58.664 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:58 smithi005 ceph-mon[99496]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:57:59.084 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-08T12:57:59.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-08T12:57:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:57:59.913 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:59 smithi005 ceph-mon[99496]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:57:59.913 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:59 smithi005 ceph-mon[99496]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:57:59.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:57:59 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:01.660 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-10-08T12:58:01.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:01 smithi005 ceph-mon[99496]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:01.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:01 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1185986493' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:58:02.107 INFO:tasks.cephadm:Adding mon.a on smithi005 2023-10-08T12:58:02.107 INFO:tasks.cephadm:Adding mon.b on smithi060 2023-10-08T12:58:02.107 INFO:tasks.cephadm:Adding mon.c on smithi118 2023-10-08T12:58:02.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c' 2023-10-08T12:58:02.702 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1185986493' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:02.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:02.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:02.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:02.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:02.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:02 smithi005 ceph-mon[99496]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:04.093 INFO:teuthology.orchestra.run.smithi118.stdout:Scheduled mon update... 2023-10-08T12:58:04.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:03 smithi005 ceph-mon[99496]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:03 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:03 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:04.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:03 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:04.467 DEBUG:teuthology.orchestra.run.smithi060:mon.b> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-08T12:58:04.470 DEBUG:teuthology.orchestra.run.smithi118:mon.c> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-08T12:58:04.472 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:58:04.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:58:04.501 INFO:journalctl@ceph.mon.c.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T12:58:04.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T12:58:05.388 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:05.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c;count:3 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:05.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:05 smithi005 ceph-mon[99496]: Deploying daemon mon.c on smithi118 2023-10-08T12:58:06.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:06 smithi005 ceph-mon[99496]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:07.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 systemd[1]: Starting Ceph mon.c for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:58:07.453 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:58:07.453 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":1,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:56:27.686030Z","created":"2023-10-08T12:56:27.686030Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-08T12:58:07.454 INFO:teuthology.orchestra.run.smithi118.stderr:dumped monmap epoch 1 2023-10-08T12:58:07.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 podman[104170]: 2023-10-08T12:58:07.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:07 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/2228994479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:08.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 bash[104170]: d48c66e43778523ac060be82316f8efee66665c43d89c490bdbfdb7252ed085e 2023-10-08T12:58:08.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:58:08.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: pidfile_write: ignore empty --pid-file 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: load: jerasure load: lrc 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Git sha 0 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: DB SUMMARY 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: DB Session ID: 0M2DOQ8SRJ97ZX0ASG9T 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-08T12:58:08.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.env: 0x562867573da0 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.info_log: 0x562868635640 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:58:08.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.statistics: (nil) 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.use_fsync: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:58:08.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.db_log_dir: 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.wal_dir: 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.write_buffer_manager: 0x5628685ed360 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:58:08.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.unordered_write: 0 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:58:08.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.row_cache: None 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.wal_filter: None 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.wal_compression: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:58:08.276 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:58:08.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:58:08.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:58:08.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:58:08.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:58:08.278 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:58:08.278 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:58:08.278 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:58:08.278 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_open_files: -1 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:58:08.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Compression algorithms supported: 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kZSTD supported: 0 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:58:08.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.merge_operator: 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_filter: None 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:58:08.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562868635740) 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: index_type: 0 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: data_block_index_type: 0 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: index_shortening: 1 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: checksum: 4 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: no_block_cache: 0 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_cache: 0x56286868b1f0 2023-10-08T12:58:08.282 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_cache_options: 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: capacity : 536870912 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: num_shard_bits : 4 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: strict_capacity_limit : 0 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_cache_compressed: (nil) 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: persistent_cache: (nil) 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_size: 4096 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_size_deviation: 10 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_restart_interval: 16 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: index_block_restart_interval: 1 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: metadata_block_size: 4096 2023-10-08T12:58:08.283 INFO:journalctl@ceph.mon.c.smithi118.stdout: partition_filters: 0 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: use_delta_encoding: 1 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: filter_policy: bloomfilter 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: whole_key_filtering: 1 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: verify_compression: 0 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: format_version: 5 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: enable_index_compression: 1 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: block_align: 0 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: max_auto_readahead_size: 262144 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: prepopulate_block_cache: 0 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:58:08.284 INFO:journalctl@ceph.mon.c.smithi118.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression: NoCompression 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.num_levels: 7 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:58:08.285 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:58:08.286 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:58:08.287 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:58:08.288 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:58:08.289 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.ttl: 2592000 2023-10-08T12:58:08.290 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:58:08.291 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6b758bac-3479-424d-8889-14791750531f 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769887999076, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769887999485, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696769887, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6b758bac-3479-424d-8889-14791750531f", "db_session_id": "0M2DOQ8SRJ97ZX0ASG9T", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769887999551, "job": 1, "event": "recovery_finished"} 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:07 smithi118 ceph-mon[104234]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562868728000 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: rocksdb: DB pointer 0x562868714000 2023-10-08T12:58:08.292 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: ** DB Stats ** 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: ** Compaction Stats [default] ** 2023-10-08T12:58:08.293 INFO:journalctl@ceph.mon.c.smithi118.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: ** Compaction Stats [default] ** 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:58:08.294 INFO:journalctl@ceph.mon.c.smithi118.stdout: 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Block cache BinnedLRUCache@0x56286868b1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:58:08.295 INFO:journalctl@ceph.mon.c.smithi118.stdout: 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: using public_addr v2:172.21.15.118:0/0 -> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: starting mon.c rank -1 at public addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] at bind addrs [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(???) e0 preinit fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).mds e1 new map 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout: e1 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout: legacy client fscid: -1 2023-10-08T12:58:08.296 INFO:journalctl@ceph.mon.c.smithi118.stdout: 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout: No filesystems configured 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:58:08.297 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:08.298 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Deploying cephadm binary to smithi118 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Added host smithi118 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.299 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1185986493' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1185986493' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.300 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c;count:3 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: Deploying daemon mon.c on smithi118 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/2228994479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 ceph-mon[104234]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T12:58:08.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:08 smithi118 systemd[1]: Started Ceph mon.c for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:58:09.103 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:58:09.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:58:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: mon.a calling monitor election 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: mon.c calling monitor election 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: fsmap 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:13.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: mgrmap e13: x(active, since 44s) 2023-10-08T12:58:13.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: overall HEALTH_OK 2023-10-08T12:58:13.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:13.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:13 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: mon.a calling monitor election 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: mon.c calling monitor election 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: fsmap 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:13.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: mgrmap e13: x(active, since 44s) 2023-10-08T12:58:13.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: overall HEALTH_OK 2023-10-08T12:58:13.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:13.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:13 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:14.232 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:58:14.232 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":2,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:58:08.021143Z","created":"2023-10-08T12:56:27.686030Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T12:58:14.235 INFO:teuthology.orchestra.run.smithi118.stderr:dumped monmap epoch 2 2023-10-08T12:58:14.392 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:14 smithi118 ceph-mon[104234]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:14.392 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:14 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:14.392 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:14 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:14.392 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:14 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:14.392 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:14 smithi118 ceph-mon[104234]: Deploying daemon mon.b on smithi060 2023-10-08T12:58:14.392 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:14 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:14.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:14 smithi005 ceph-mon[99496]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:14 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:14 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:14 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:14 smithi005 ceph-mon[99496]: Deploying daemon mon.b on smithi060 2023-10-08T12:58:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:14 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:15.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:15 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/3527552213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:15.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:15 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:15.020+0000 7fd5fc163700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T12:58:15.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:15 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/3527552213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:15.618 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:58:15.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:58:16.079 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:15 smithi060 systemd[1]: Starting Ceph mon.b for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:58:16.186 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 podman[103149]: 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pidfile_write: ignore empty --pid-file 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: load: jerasure load: lrc 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Git sha 0 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:58:16.340 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: DB SUMMARY 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: DB Session ID: ZGK4OYJGAR01XR7T0SB3 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:58:16.341 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.env: 0x55fa6688ada0 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.info_log: 0x55fa6778d640 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.statistics: (nil) 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.use_fsync: 0 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:58:16.342 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.db_log_dir: 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.wal_dir: 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:58:16.343 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.write_buffer_manager: 0x55fa67745360 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:58:16.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 bash[103149]: b8460296f8a18bcc6ac0e3655d663eec9aa5313388fde5f4c6188f2bc3b03caf 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.unordered_write: 0 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.row_cache: None 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.wal_filter: None 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:58:16.345 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.wal_compression: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:58:16.346 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:58:16.348 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_open_files: -1 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:58:16.349 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Compression algorithms supported: 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kZSTD supported: 0 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:58:16.350 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.merge_operator: 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_filter: None 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fa6778d740) 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:58:16.351 INFO:journalctl@ceph.mon.b.smithi060.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_type: 0 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: data_block_index_type: 0 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_shortening: 1 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: checksum: 4 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: no_block_cache: 0 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache: 0x55fa677e31f0 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_options: 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: capacity : 536870912 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: num_shard_bits : 4 2023-10-08T12:58:16.352 INFO:journalctl@ceph.mon.b.smithi060.stdout: strict_capacity_limit : 0 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_compressed: (nil) 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: persistent_cache: (nil) 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_size: 4096 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_size_deviation: 10 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_restart_interval: 16 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_block_restart_interval: 1 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: metadata_block_size: 4096 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: partition_filters: 0 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: use_delta_encoding: 1 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: filter_policy: bloomfilter 2023-10-08T12:58:16.353 INFO:journalctl@ceph.mon.b.smithi060.stdout: whole_key_filtering: 1 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: verify_compression: 0 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: format_version: 5 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_index_compression: 1 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_align: 0 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: max_auto_readahead_size: 262144 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: prepopulate_block_cache: 0 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:58:16.354 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression: NoCompression 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.num_levels: 7 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:58:16.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:58:16.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:58:16.357 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:58:16.358 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:58:16.359 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.ttl: 2592000 2023-10-08T12:58:16.360 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:58:16.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 65546e16-e26d-4e3e-b266-9bf90f54b256 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769896284564, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769896285156, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696769896, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "65546e16-e26d-4e3e-b266-9bf90f54b256", "db_session_id": "ZGK4OYJGAR01XR7T0SB3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696769896285256, "job": 1, "event": "recovery_finished"} 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fa67880000 2023-10-08T12:58:16.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: DB pointer 0x55fa6786c000 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** DB Stats ** 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2023-10-08T12:58:16.363 INFO:journalctl@ceph.mon.b.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:58:16.364 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache BinnedLRUCache@0x55fa677e31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:58:16.365 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: using public_addr v2:172.21.15.60:0/0 -> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: starting mon.b rank -1 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(???) e0 preinit fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).mds e1 new map 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout: e1 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:58:16.366 INFO:journalctl@ceph.mon.b.smithi060.stdout: legacy client fscid: -1 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout: No filesystems configured 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:58:16.367 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi118", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:16.368 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Deploying cephadm binary to smithi118 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:16.369 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Added host smithi118 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1185986493' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1185986493' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.370 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c;count:3 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:16.372 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Deploying daemon mon.c on smithi118 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/2228994479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.a calling monitor election 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.c calling monitor election 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.373 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: fsmap 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mgrmap e13: x(active, since 44s) 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: overall HEALTH_OK 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:16.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:16.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:16.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: Deploying daemon mon.b on smithi060 2023-10-08T12:58:16.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:16.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/3527552213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:16.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 ceph-mon[103190]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T12:58:16.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:16 smithi060 systemd[1]: Started Ceph mon.b for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:58:21.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: mon.c calling monitor election 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: mon.a calling monitor election 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: fsmap 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: mgrmap e13: x(active, since 52s) 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: mon.b (rank 2) addr [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] is down (out of quorum) 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:21 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: mon.c calling monitor election 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: mon.a calling monitor election 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: fsmap 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: mgrmap e13: x(active, since 52s) 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:58:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: mon.b (rank 2) addr [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] is down (out of quorum) 2023-10-08T12:58:21.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:21.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:21 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:22.175 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-08T12:58:22.176 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:58:16.309651Z","created":"2023-10-08T12:56:27.686030Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T12:58:22.178 INFO:teuthology.orchestra.run.smithi118.stderr:dumped monmap epoch 3 2023-10-08T12:58:22.518 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:22 smithi118 ceph-mon[104234]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:22.518 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:22 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.518 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:22 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/2632981060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.518 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:22 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:22.541 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-08T12:58:22.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-08T12:58:22.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:22 smithi005 ceph-mon[99496]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:22.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:22 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:22 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/2632981060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:22.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:22 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:23.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:23.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: mon.c calling monitor election 2023-10-08T12:58:23.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: mon.a calling monitor election 2023-10-08T12:58:23.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:23.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: fsmap 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: mgrmap e13: x(active, since 52s) 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: mon.b (rank 2) addr [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] is down (out of quorum) 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:23.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:23.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:23.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:23.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/2632981060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:58:23.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:23 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: mon.b calling monitor election 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: mon.b calling monitor election 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: mon.c calling monitor election 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: mon.a calling monitor election 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:58:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: fsmap 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: mgrmap e13: x(active, since 54s) 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: overall HEALTH_OK 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:24.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:24 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: mon.b calling monitor election 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: mon.b calling monitor election 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: mon.c calling monitor election 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: mon.a calling monitor election 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:58:24.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: fsmap 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: mgrmap e13: x(active, since 54s) 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: overall HEALTH_OK 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:24.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:24 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:24.541 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:58:24.541 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-10-08T12:58:24.541 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T12:58:24.541 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] 2023-10-08T12:58:24.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: mon.b calling monitor election 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: mon.b calling monitor election 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: mon.c calling monitor election 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: mon.a calling monitor election 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],c=[v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0]} removed_ranks: {} 2023-10-08T12:58:24.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: fsmap 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: mgrmap e13: x(active, since 54s) 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: overall HEALTH_OK 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:24.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:24 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:25.459 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:25 smithi005 ceph-mon[99496]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:58:25.459 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:25 smithi005 ceph-mon[99496]: Reconfiguring daemon mon.a on smithi005 2023-10-08T12:58:25.459 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:25 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:25.459 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2034405111' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:25.474 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-08T12:58:25.474 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:58:25.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:58:25.505 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:58:25.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:25 smithi118 ceph-mon[104234]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:58:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:25 smithi118 ceph-mon[104234]: Reconfiguring daemon mon.a on smithi005 2023-10-08T12:58:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:25 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2034405111' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:25.572 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:58:25.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:58:25.598 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:25 smithi060 ceph-mon[103190]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:58:25.598 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:25 smithi060 ceph-mon[103190]: Reconfiguring daemon mon.a on smithi005 2023-10-08T12:58:25.598 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:25 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:25.598 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2034405111' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:25.602 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:58:25.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:25.672 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:58:25.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:58:25.708 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:58:25.709 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:25.782 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-08T12:58:25.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T12:58:26.345 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:26.553 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:26.553 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:26.553 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:26.554 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:58:26.554 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:26.554 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:26.554 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:26.554 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:26 smithi005 ceph-mon[99496]: Reconfiguring daemon mon.b on smithi060 2023-10-08T12:58:26.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:26 smithi060 ceph-mon[103190]: Reconfiguring daemon mon.b on smithi060 2023-10-08T12:58:26.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:58:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:26.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:26.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:26 smithi118 ceph-mon[104234]: Reconfiguring daemon mon.b on smithi060 2023-10-08T12:58:27.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: Reconfiguring daemon mon.c on smithi118 2023-10-08T12:58:27.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:27 smithi118 ceph-mon[104234]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:27.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: Reconfiguring daemon mon.c on smithi118 2023-10-08T12:58:27.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:27 smithi060 ceph-mon[103190]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:27.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: Reconfiguring daemon mon.c on smithi118 2023-10-08T12:58:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:27 smithi005 ceph-mon[99496]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:29.113 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: ignoring --setuser ceph since I am not root 2023-10-08T12:58:29.113 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: ignoring --setgroup ceph since I am not root 2023-10-08T12:58:29.113 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:29.051+0000 7f1d38e08200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:58:29.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:29.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:29.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:29.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.114 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3798578197' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:58:29.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3798578197' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:58:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:29.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:29.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:29.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='mgr.14152 172.21.15.5:0/747760867' entity='mgr.x' 2023-10-08T12:58:29.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3798578197' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:58:29.373 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:29.148+0000 7f1d38e08200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:58:29.374 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:29.257+0000 7f1d38e08200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:58:29.396 INFO:tasks.cephadm:Adding mgr.x on smithi005 2023-10-08T12:58:29.396 INFO:tasks.cephadm:Adding mgr.y on smithi060 2023-10-08T12:58:29.396 INFO:tasks.cephadm:Adding mgr.z on smithi118 2023-10-08T12:58:29.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi005=x;smithi060=y;smithi118=z' 2023-10-08T12:58:29.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:29.372+0000 7f1d38e08200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:58:29.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:29.583+0000 7f1d38e08200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:58:29.966 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:58:30.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:29 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3798578197' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:58:30.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:29 smithi060 ceph-mon[103190]: mgrmap e14: x(active, since 60s) 2023-10-08T12:58:30.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:30.058+0000 7f1d38e08200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:58:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3798578197' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:58:30.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:29 smithi005 ceph-mon[99496]: mgrmap e14: x(active, since 60s) 2023-10-08T12:58:30.203 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:29 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3798578197' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:58:30.204 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:29 smithi118 ceph-mon[104234]: mgrmap e14: x(active, since 60s) 2023-10-08T12:58:30.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:30.213+0000 7f1d38e08200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:58:30.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:30.322+0000 7f1d38e08200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:58:30.672 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:30.439+0000 7f1d38e08200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:58:31.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:30.951+0000 7f1d38e08200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:58:32.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:31 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:31.735+0000 7f1d38e08200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:58:32.172 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:31 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:31.835+0000 7f1d38e08200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:58:33.154 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:32.815+0000 7f1d38e08200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:58:33.154 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:32.928+0000 7f1d38e08200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:58:33.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:33.153+0000 7f1d38e08200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:58:33.767 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:33.512+0000 7f1d38e08200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:58:34.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:33.766+0000 7f1d38e08200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:58:34.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:33.950+0000 7f1d38e08200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:58:34.671 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:34 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:34.286+0000 7f1d38e08200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:58:35.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:35.115+0000 7f1d38e08200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:58:35.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:35.275+0000 7f1d38e08200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:58:35.921 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:35.528+0000 7f1d38e08200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:58:35.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:35.667+0000 7f1d38e08200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:58:36.421 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:35.947+0000 7f1d38e08200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:58:37.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: Active manager daemon x restarted 2023-10-08T12:58:37.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: Activating manager daemon x 2023-10-08T12:58:37.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:58:37.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: mgrmap e15: x(active, starting, since 0.00426074s) 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: Manager daemon x is now available 2023-10-08T12:58:37.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:37.383 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 12:58:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T12:58:36.996+0000 7f1d38e08200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:58:37.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: Active manager daemon x restarted 2023-10-08T12:58:37.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: Activating manager daemon x 2023-10-08T12:58:37.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: mgrmap e15: x(active, starting, since 0.00426074s) 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: Manager daemon x is now available 2023-10-08T12:58:37.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: Active manager daemon x restarted 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: Activating manager daemon x 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: mgrmap e15: x(active, starting, since 0.00426074s) 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:58:37.431 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:58:37.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: Manager daemon x is now available 2023-10-08T12:58:37.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:38.026 INFO:teuthology.orchestra.run.smithi118.stdout:Scheduled mgr update... 2023-10-08T12:58:38.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:38.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: [08/Oct/2023:12:58:37] ENGINE Bus STARTING 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: [08/Oct/2023:12:58:37] ENGINE Serving on https://172.21.15.5:7150 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: [08/Oct/2023:12:58:37] ENGINE Serving on http://172.21.15.5:8765 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: [08/Oct/2023:12:58:37] ENGINE Bus STARTED 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: mgrmap e16: x(active, since 1.00758s) 2023-10-08T12:58:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:38.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:38.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: [08/Oct/2023:12:58:37] ENGINE Bus STARTING 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: [08/Oct/2023:12:58:37] ENGINE Serving on https://172.21.15.5:7150 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: [08/Oct/2023:12:58:37] ENGINE Serving on http://172.21.15.5:8765 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: [08/Oct/2023:12:58:37] ENGINE Bus STARTED 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: mgrmap e16: x(active, since 1.00758s) 2023-10-08T12:58:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:38.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:38.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:58:38.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:58:38.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: [08/Oct/2023:12:58:37] ENGINE Bus STARTING 2023-10-08T12:58:38.432 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: [08/Oct/2023:12:58:37] ENGINE Serving on https://172.21.15.5:7150 2023-10-08T12:58:38.433 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: [08/Oct/2023:12:58:37] ENGINE Serving on http://172.21.15.5:8765 2023-10-08T12:58:38.433 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: [08/Oct/2023:12:58:37] ENGINE Bus STARTED 2023-10-08T12:58:38.433 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: mgrmap e16: x(active, since 1.00758s) 2023-10-08T12:58:38.433 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:38.434 DEBUG:teuthology.orchestra.run.smithi060:mgr.y> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-08T12:58:38.436 DEBUG:teuthology.orchestra.run.smithi118:mgr.z> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-08T12:58:38.438 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-08T12:58:38.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-08T12:58:38.440 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-08T12:58:38.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-08T12:58:38.465 INFO:journalctl@ceph.mgr.y.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T12:58:38.466 INFO:journalctl@ceph.mgr.z.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T12:58:38.483 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-08T12:58:38.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-08T12:58:38.526 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-08T12:58:38.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-08T12:58:38.569 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-08T12:58:38.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-08T12:58:38.614 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-08T12:58:38.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-08T12:58:38.759 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-08T12:58:38.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-08T12:58:38.802 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-08T12:58:38.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-08T12:58:38.845 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T12:58:38.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T12:58:38.888 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-08T12:58:38.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-08T12:58:38.946 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-08T12:58:38.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-08T12:58:39.014 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-08T12:58:39.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-08T12:58:39.062 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-08T12:58:39.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-08T12:58:39.109 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-08T12:58:39.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-08T12:58:39.153 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-08T12:58:39.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-08T12:58:39.198 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-08T12:58:39.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-08T12:58:39.240 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:39.245 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-08T12:58:39.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-08T12:58:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:39.301 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T12:58:39.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-08T12:58:39.387 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T12:58:39.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-08T12:58:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:39.402 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-08T12:58:39.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-08T12:58:39.415 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:39.437 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-08T12:58:39.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T12:58:39.494 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-08T12:58:39.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T12:58:39.552 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-08T12:58:39.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-08T12:58:39.566 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:39.577 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-08T12:58:39.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-08T12:58:39.650 DEBUG:tasks.cephadm:set 24 configs 2023-10-08T12:58:39.650 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi005') 2023-10-08T12:58:39.700 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:40.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi060=y;smithi118=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: Saving service mgr spec with placement smithi005=x;smithi060=y;smithi118=z;count:3 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi060=y;smithi118=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:40.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: Saving service mgr spec with placement smithi005=x;smithi060=y;smithi118=z;count:3 2023-10-08T12:58:40.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi060=y;smithi118=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: Saving service mgr spec with placement smithi005=x;smithi060=y;smithi118=z;count:3 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:40.354 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:40.357 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:41.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:41.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:41.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:40 smithi005 ceph-mon[99496]: mgrmap e17: x(active, since 3s) 2023-10-08T12:58:41.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:40 smithi060 ceph-mon[103190]: mgrmap e17: x(active, since 3s) 2023-10-08T12:58:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi118", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:40 smithi118 ceph-mon[104234]: mgrmap e17: x(active, since 3s) 2023-10-08T12:58:43.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:43.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:43.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:42 smithi005 ceph-mon[99496]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:42 smithi118 ceph-mon[104234]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi005:/etc/ceph/ceph.conf 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi060:/etc/ceph/ceph.conf 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi118:/etc/ceph/ceph.conf 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:58:43.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi118:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:58:43.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:43.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:42 smithi060 ceph-mon[103190]: Updating smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:58:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:44.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: Deploying daemon mgr.z on smithi118 2023-10-08T12:58:44.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:44 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/453223228' entity='client.admin' 2023-10-08T12:58:44.470 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: Deploying daemon mgr.z on smithi118 2023-10-08T12:58:44.471 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:44 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/453223228' entity='client.admin' 2023-10-08T12:58:44.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: Deploying daemon mgr.z on smithi118 2023-10-08T12:58:44.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:44 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/453223228' entity='client.admin' 2023-10-08T12:58:44.741 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:44 smithi118 systemd[1]: Starting Ceph mgr.z for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:58:45.187 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:45.230 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:45.325 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 podman[107264]: 2023-10-08T12:58:45.370 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.403+0000 7f751ffff700 1 -- 172.21.15.5:0/2745432283 <== mon.1 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v11)=0 v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f753001db90 con 0x7f75381089c0 2023-10-08T12:58:45.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 -- 172.21.15.5:0/2745432283 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7520038b40 msgr2=0x7f752003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 --2- 172.21.15.5:0/2745432283 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7520038b40 0x7f752003b000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f752800b5c0 tx=0x7f7528005bc0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 -- 172.21.15.5:0/2745432283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75381089c0 msgr2=0x7f753819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 --2- 172.21.15.5:0/2745432283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75381089c0 0x7f753819cba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7530007f10 tx=0x7f753000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 -- 172.21.15.5:0/2745432283 shutdown_connections 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 --2- 172.21.15.5:0/2745432283 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7520038b40 0x7f752003b000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 --2- 172.21.15.5:0/2745432283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75381089c0 0x7f753819cba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 --2- 172.21.15.5:0/2745432283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75381029c0 0x7f75381982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 --2- 172.21.15.5:0/2745432283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7538103380 0x7f75381987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.405+0000 7f753d0f9700 1 -- 172.21.15.5:0/2745432283 >> 172.21.15.5:0/2745432283 conn(0x7f75380fe470 msgr2=0x7f75380fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.406+0000 7f753d0f9700 1 -- 172.21.15.5:0/2745432283 shutdown_connections 2023-10-08T12:58:45.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.406+0000 7f753d0f9700 1 -- 172.21.15.5:0/2745432283 wait complete. 2023-10-08T12:58:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.540+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7fa41c101ee0 con 0x7fa41c068b30 2023-10-08T12:58:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.543+0000 7fa4127fc700 1 -- 172.21.15.5:0/3846464094 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa40c027030 con 0x7fa41c068b30 2023-10-08T12:58:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.544+0000 7fa4127fc700 1 -- 172.21.15.5:0/3846464094 <== mon.0 v2:172.21.15.5:3300/0 9 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7fa40c02ce50 con 0x7fa41c068b30 2023-10-08T12:58:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa408038b40 msgr2=0x7fa40803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 --2- 172.21.15.5:0/3846464094 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa408038b40 0x7fa40803b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa418009be0 tx=0x7fa418009260 comp rx=0 tx=0).stop 2023-10-08T12:58:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c068b30 msgr2=0x7fa41c1965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 --2- 172.21.15.5:0/3846464094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c068b30 0x7fa41c1965d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa40c000c00 tx=0x7fa40c0039f0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 shutdown_connections 2023-10-08T12:58:45.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 --2- 172.21.15.5:0/3846464094 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa408038b40 0x7fa40803b000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 --2- 172.21.15.5:0/3846464094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa41c1067a0 0x7fa41c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 --2- 172.21.15.5:0/3846464094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa41c068190 0x7fa41c196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 --2- 172.21.15.5:0/3846464094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c068b30 0x7fa41c1965d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 >> 172.21.15.5:0/3846464094 conn(0x7fa41c075790 msgr2=0x7fa41c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 shutdown_connections 2023-10-08T12:58:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:45.546+0000 7fa42326d700 1 -- 172.21.15.5:0/3846464094 wait complete. 2023-10-08T12:58:45.622 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 ceph-mgr[107304]: -- 172.21.15.118:0/3025944148 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d8edf251e0 con 0x55d8edefa800 2023-10-08T12:58:45.622 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 bash[107264]: f5bf1b1f44d3b302ec5c2c94bb2513b12c68775e989207111a35008c1c637ce9 2023-10-08T12:58:45.622 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 systemd[1]: Started Ceph mgr.z for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:58:45.622 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:45.444+0000 7f37efee3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:58:45.622 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:45.531+0000 7f37efee3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:58:45.622 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:45.620+0000 7f37efee3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:58:45.882 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:45.713+0000 7f37efee3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:58:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:46.242 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:45.881+0000 7f37efee3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='client.? ' entity='client.admin' 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3846464094' entity='client.admin' 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:46.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:46.484 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:46 smithi060 ceph-mon[103190]: Deploying daemon mgr.y on smithi060 2023-10-08T12:58:46.519 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:46.241+0000 7f37efee3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:58:46.519 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:46.372+0000 7f37efee3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:58:46.519 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:46.461+0000 7f37efee3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='client.? ' entity='client.admin' 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3846464094' entity='client.admin' 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-mon[104234]: Deploying daemon mgr.y on smithi060 2023-10-08T12:58:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 -- 172.21.15.5:0/749406156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 msgr2=0x7fe6f40ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/749406156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f40ffb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009990 tx=0x7fe6e4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 -- 172.21.15.5:0/749406156 shutdown_connections 2023-10-08T12:58:46.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/749406156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41000a0 0x7fe6f410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/749406156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41045b0 0x7fe6f4104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/749406156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f40ffb60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 -- 172.21.15.5:0/749406156 >> 172.21.15.5:0/749406156 conn(0x7fe6f40766c0 msgr2=0x7fe6f4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 -- 172.21.15.5:0/749406156 shutdown_connections 2023-10-08T12:58:46.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.630+0000 7fe6fa54d700 1 -- 172.21.15.5:0/749406156 wait complete. 2023-10-08T12:58:46.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 Processor -- start 2023-10-08T12:58:46.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 -- start start 2023-10-08T12:58:46.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41000a0 0x7fe6f419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41045b0 0x7fe6f4198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41990e0 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4199250 con 0x7fe6f41000a0 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6fa54d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4199410 con 0x7fe6f41045b0 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59432/0 (socket says 172.21.15.5:59432) 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 -- 172.21.15.5:0/2536811113 learned_addr learned my addr 172.21.15.5:0/2536811113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f8aea700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41045b0 0x7fe6f4198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f37fe700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41000a0 0x7fe6f419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 -- 172.21.15.5:0/2536811113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41045b0 msgr2=0x7fe6f4198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41045b0 0x7fe6f4198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 -- 172.21.15.5:0/2536811113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41000a0 msgr2=0x7fe6f419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41000a0 0x7fe6f419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f3fff700 1 -- 172.21.15.5:0/2536811113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40095f0 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f37fe700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41000a0 0x7fe6f419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.631+0000 7fe6f8aea700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41045b0 0x7fe6f4198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.632+0000 7fe6f3fff700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f419e940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c9b0 tx=0x7fe6dc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.632+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc007b00 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.632+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7fe6dc007c60 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.632+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f41996f0 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.632+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc018660 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.632+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f41a5930 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.633+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f4100dd0 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.633+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7fe6dc00f450 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.633+0000 7fe6f17fa700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6e0038b40 0x7fe6e003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.633+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe6dc04b510 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.633+0000 7fe6f37fe700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6e0038b40 0x7fe6e003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.634+0000 7fe6f37fe700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6e0038b40 0x7fe6e003b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4199c40 tx=0x7fe6e4005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.638+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe6dc007dd0 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.660 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='client.? ' entity='client.admin' 2023-10-08T12:58:46.660 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.660 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.660 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3846464094' entity='client.admin' 2023-10-08T12:58:46.660 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:46.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:46.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:58:46.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:46.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:46.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:46 smithi005 ceph-mon[99496]: Deploying daemon mgr.y on smithi060 2023-10-08T12:58:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.846+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fe6f4199f40 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.849+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe6dc00eba0 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.849+0000 7fe6f17fa700 1 -- 172.21.15.5:0/2536811113 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6dc00de90 con 0x7fe6f40ff6e0 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6e0038b40 msgr2=0x7fe6e003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6e0038b40 0x7fe6e003b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4199c40 tx=0x7fe6e4005fb0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 msgr2=0x7fe6f419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f419e940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c9b0 tx=0x7fe6dc00cd70 comp rx=0 tx=0).stop 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 shutdown_connections 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6e0038b40 0x7fe6e003b000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe6f41045b0 0x7fe6f4198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f40ff6e0 0x7fe6f419e940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 --2- 172.21.15.5:0/2536811113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f41000a0 0x7fe6f419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 >> 172.21.15.5:0/2536811113 conn(0x7fe6f40766c0 msgr2=0x7fe6f40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 shutdown_connections 2023-10-08T12:58:46.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:46.851+0000 7fe6fa54d700 1 -- 172.21.15.5:0/2536811113 wait complete. 2023-10-08T12:58:46.972 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:46.556+0000 7f37efee3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:58:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:47.106 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:47.159 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 systemd[1]: Starting Ceph mgr.y for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T12:58:47.269 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:46.971+0000 7f37efee3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.325+0000 7ff874cfe700 1 -- 172.21.15.5:0/3207200722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8701045b0 msgr2=0x7ff870104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.325+0000 7ff874cfe700 1 --2- 172.21.15.5:0/3207200722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8701045b0 0x7ff870104990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff860009990 tx=0x7ff860009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 -- 172.21.15.5:0/3207200722 shutdown_connections 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 --2- 172.21.15.5:0/3207200722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 0x7ff87010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 --2- 172.21.15.5:0/3207200722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8701045b0 0x7ff870104990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 --2- 172.21.15.5:0/3207200722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8700ff6e0 0x7ff8700ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 -- 172.21.15.5:0/3207200722 >> 172.21.15.5:0/3207200722 conn(0x7ff8700766c0 msgr2=0x7ff870076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 -- 172.21.15.5:0/3207200722 shutdown_connections 2023-10-08T12:58:47.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.326+0000 7ff874cfe700 1 -- 172.21.15.5:0/3207200722 wait complete. 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 Processor -- start 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 -- start start 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 0x7ff87019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 0x7ff87019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8701045b0 0x7ff8701958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff870195f30 con 0x7ff8700ff6e0 2023-10-08T12:58:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8701960a0 con 0x7ff8701000a0 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff874cfe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff870196260 con 0x7ff8701045b0 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff86e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 0x7ff87019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff86dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 0x7ff87019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff86e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 0x7ff87019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59446/0 (socket says 172.21.15.5:59446) 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff86e59c700 1 -- 172.21.15.5:0/671042863 learned_addr learned my addr 172.21.15.5:0/671042863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.327+0000 7ff86ed9d700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8701045b0 0x7ff8701958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86dd9b700 1 -- 172.21.15.5:0/671042863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8701045b0 msgr2=0x7ff8701958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86dd9b700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8701045b0 0x7ff8701958d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86dd9b700 1 -- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 msgr2=0x7ff87019b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86dd9b700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 0x7ff87019b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86dd9b700 1 -- 172.21.15.5:0/671042863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600095f0 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86e59c700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 0x7ff87019b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff86dd9b700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 0x7ff87019bcd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff86400d750 tx=0x7ff86400da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864004020 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff864004830 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864005440 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff870196540 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.328+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870068bf0 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.329+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7ff8640055a0 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.329+0000 7ff85f7fe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff858038b40 0x7ff85803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.329+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff86404ae80 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.329+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff870196730 con 0x7ff8701000a0 2023-10-08T12:58:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.329+0000 7ff86e59c700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff858038b40 0x7ff85803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.329+0000 7ff86e59c700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff858038b40 0x7ff85803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff860003760 tx=0x7ff860009ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.334+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff864014030 con 0x7ff8701000a0 2023-10-08T12:58:47.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.549+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7ff870196d90 con 0x7ff8701000a0 2023-10-08T12:58:47.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.554+0000 7ff85f7fe700 1 -- 172.21.15.5:0/671042863 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) v1 ==== 117+0+0 (secure 0 0 0) 0x7ff86403d0b0 con 0x7ff8701000a0 2023-10-08T12:58:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff858038b40 msgr2=0x7ff85803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff858038b40 0x7ff85803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff860003760 tx=0x7ff860009ee0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 msgr2=0x7ff87019bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 0x7ff87019bcd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff86400d750 tx=0x7ff86400da60 comp rx=0 tx=0).stop 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 shutdown_connections 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff858038b40 0x7ff85803b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8701045b0 0x7ff8701958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8700ff6e0 0x7ff87019b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 --2- 172.21.15.5:0/671042863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8701000a0 0x7ff87019bcd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 >> 172.21.15.5:0/671042863 conn(0x7ff8700766c0 msgr2=0x7ff8700fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 shutdown_connections 2023-10-08T12:58:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.556+0000 7ff874cfe700 1 -- 172.21.15.5:0/671042863 wait complete. 2023-10-08T12:58:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 -- 172.21.15.5:0/3028014623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52201057c0 msgr2=0x7f5220105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 --2- 172.21.15.5:0/3028014623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52201057c0 0x7f5220105ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f521c009990 tx=0x7f521c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 -- 172.21.15.5:0/3028014623 shutdown_connections 2023-10-08T12:58:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 --2- 172.21.15.5:0/3028014623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5220101260 0x7f522010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 --2- 172.21.15.5:0/3028014623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52201057c0 0x7f5220105ba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 --2- 172.21.15.5:0/3028014623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201008a0 0x7f5220100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 -- 172.21.15.5:0/3028014623 >> 172.21.15.5:0/3028014623 conn(0x7f52200779e0 msgr2=0x7f5220077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 -- 172.21.15.5:0/3028014623 shutdown_connections 2023-10-08T12:58:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.572+0000 7f5228458700 1 -- 172.21.15.5:0/3028014623 wait complete. 2023-10-08T12:58:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 Processor -- start 2023-10-08T12:58:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 -- start start 2023-10-08T12:58:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52201008a0 0x7f522019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 0x7f522019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201057c0 0x7f5220194760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220194dd0 con 0x7f5220101260 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220194f40 con 0x7f52201057c0 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f5228458700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220195100 con 0x7f52201008a0 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.573+0000 7f52259f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 0x7f522019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 0x7f522019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59462/0 (socket says 172.21.15.5:59462) 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 -- 172.21.15.5:0/669964273 learned_addr learned my addr 172.21.15.5:0/669964273 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52261f4700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52201008a0 0x7f522019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52269f5700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201057c0 0x7f5220194760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 -- 172.21.15.5:0/669964273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52201008a0 msgr2=0x7f522019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52201008a0 0x7f522019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 -- 172.21.15.5:0/669964273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201057c0 msgr2=0x7f5220194760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201057c0 0x7f5220194760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 -- 172.21.15.5:0/669964273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0095f0 con 0x7f5220101260 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52261f4700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52201008a0 0x7f522019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52269f5700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201057c0 0x7f5220194760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52259f3700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 0x7f522019ab60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5210011b60 tx=0x7f5210011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000fa10 con 0x7f5220101260 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5210013040 con 0x7f5220101260 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100183a0 con 0x7f5220101260 2023-10-08T12:58:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52201953e0 con 0x7f5220101260 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.574+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52201a1610 con 0x7f5220101260 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.575+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f5210019400 con 0x7f5220101260 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.575+0000 7f52177fe700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f520c038b40 0x7f520c03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.575+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220108d80 con 0x7f5220101260 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.575+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f521004ebf0 con 0x7f5220101260 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.575+0000 7f52261f4700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f520c038b40 0x7f520c03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.576+0000 7f52261f4700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f520c038b40 0x7f520c03b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f521c006010 tx=0x7f521c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.580+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f521001e070 con 0x7f5220101260 2023-10-08T12:58:47.606 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 podman[105554]: 2023-10-08T12:58:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.806+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7f5220101f30 con 0x7f5220101260 2023-10-08T12:58:47.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.809+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5210018500 con 0x7f5220101260 2023-10-08T12:58:47.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.810+0000 7f52177fe700 1 -- 172.21.15.5:0/669964273 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5210018500 con 0x7f5220101260 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.811+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f520c038b40 msgr2=0x7f520c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.811+0000 7f5228458700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f520c038b40 0x7f520c03b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f521c006010 tx=0x7f521c005960 comp rx=0 tx=0).stop 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.811+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 msgr2=0x7f522019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.811+0000 7f5228458700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 0x7f522019ab60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5210011b60 tx=0x7f5210011e70 comp rx=0 tx=0).stop 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 shutdown_connections 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f520c038b40 0x7f520c03b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52201057c0 0x7f5220194760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52201008a0 0x7f522019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 --2- 172.21.15.5:0/669964273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5220101260 0x7f522019ab60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 >> 172.21.15.5:0/669964273 conn(0x7f52200779e0 msgr2=0x7f52200fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 shutdown_connections 2023-10-08T12:58:47.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:47.812+0000 7f5228458700 1 -- 172.21.15.5:0/669964273 wait complete. 2023-10-08T12:58:47.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2536811113' entity='client.admin' 2023-10-08T12:58:47.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='client.? ' entity='client.admin' 2023-10-08T12:58:47.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/669964273' entity='client.admin' 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 bash[105554]: 1b41d49321f524d773745e68e50543a6c5018c19233070b1d9d4979f82b477f1 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-mgr[105594]: -- 172.21.15.60:0/4026034362 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55652461d1e0 con 0x5565245f2c00 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 systemd[1]: Started Ceph mgr.y for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T12:58:47.909 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:47.756+0000 7fab01394200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:58:47.910 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:47.853+0000 7fab01394200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2536811113' entity='client.admin' 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='client.? ' entity='client.admin' 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:47 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/669964273' entity='client.admin' 2023-10-08T12:58:48.019 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:47.629+0000 7f37efee3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:58:48.019 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:47.711+0000 7f37efee3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:58:48.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2536811113' entity='client.admin' 2023-10-08T12:58:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='client.? ' entity='client.admin' 2023-10-08T12:58:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:47 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/669964273' entity='client.admin' 2023-10-08T12:58:48.293 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:47.962+0000 7fab01394200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:58:48.293 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:48.079+0000 7fab01394200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:58:48.294 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:48.292+0000 7fab01394200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:58:48.769 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:48.515+0000 7f37efee3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:58:48.769 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:48.613+0000 7f37efee3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 -- 172.21.15.5:0/3909698106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 msgr2=0x7f77e0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 --2- 172.21.15.5:0/3909698106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0105a90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009990 tx=0x7f77d4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 -- 172.21.15.5:0/3909698106 shutdown_connections 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 --2- 172.21.15.5:0/3909698106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e0100110 0x7f77e010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 --2- 172.21.15.5:0/3909698106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0105a90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 --2- 172.21.15.5:0/3909698106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e00ff750 0x7f77e00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 -- 172.21.15.5:0/3909698106 >> 172.21.15.5:0/3909698106 conn(0x7f77e0075790 msgr2=0x7f77e0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 -- 172.21.15.5:0/3909698106 shutdown_connections 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.235+0000 7f77e606a700 1 -- 172.21.15.5:0/3909698106 wait complete. 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 Processor -- start 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 -- start start 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00ff750 0x7f77e019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0100110 0x7f77e019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0194ea0 con 0x7f77e01056b0 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0195010 con 0x7f77e0100110 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77e606a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01951d0 con 0x7f77e00ff750 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.236+0000 7f77dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0194830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59478/0 (socket says 172.21.15.5:59478) 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 -- 172.21.15.5:0/2152159376 learned_addr learned my addr 172.21.15.5:0/2152159376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77deffd700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0100110 0x7f77e019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77df7fe700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00ff750 0x7f77e019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 -- 172.21.15.5:0/2152159376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00ff750 msgr2=0x7f77e019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00ff750 0x7f77e019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 -- 172.21.15.5:0/2152159376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0100110 msgr2=0x7f77e019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0100110 0x7f77e019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 -- 172.21.15.5:0/2152159376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40095f0 con 0x7f77e01056b0 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77deffd700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0100110 0x7f77e019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dffff700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0194830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77d800b5e0 tx=0x7f77d80086b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8010070 con 0x7f77e01056b0 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77d800be00 con 0x7f77e01056b0 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e01954b0 con 0x7f77e01056b0 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004420 con 0x7f77e01056b0 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.237+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e01a16e0 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.238+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e0107cb0 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.239+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f77d8014070 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.239+0000 7f77dcff9700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c8038b40 0x7f77c803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.239+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f77d804b510 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.239+0000 7f77df7fe700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c8038b40 0x7f77c803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.239+0000 7f77df7fe700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c8038b40 0x7f77c803b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77d40098e0 tx=0x7f77d4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.243+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f77d8008c10 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.452+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f77e0100df0 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.455+0000 7f77dcff9700 1 -- 172.21.15.5:0/2152159376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) v1 ==== 106+0+0 (secure 0 0 0) 0x7f77d801a030 con 0x7f77e01056b0 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c8038b40 msgr2=0x7f77c803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c8038b40 0x7f77c803b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77d40098e0 tx=0x7f77d4005960 comp rx=0 tx=0).stop 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 msgr2=0x7f77e0194830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0194830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77d800b5e0 tx=0x7f77d80086b0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 shutdown_connections 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c8038b40 0x7f77c803b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e01056b0 0x7f77e0194830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00ff750 0x7f77e019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 --2- 172.21.15.5:0/2152159376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0100110 0x7f77e019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 >> 172.21.15.5:0/2152159376 conn(0x7f77e0075790 msgr2=0x7f77e00fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 shutdown_connections 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:48.458+0000 7f77e606a700 1 -- 172.21.15.5:0/2152159376 wait complete. 2023-10-08T12:58:48.952 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:48.952 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:48 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2152159376' entity='client.admin' 2023-10-08T12:58:49.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:49.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:48 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2152159376' entity='client.admin' 2023-10-08T12:58:49.062 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:48.785+0000 7fab01394200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:58:49.062 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:48.947+0000 7fab01394200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:58:49.087 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:48.791+0000 7f37efee3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:58:49.088 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:49.088 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:48 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2152159376' entity='client.admin' 2023-10-08T12:58:49.408 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:49.060+0000 7fab01394200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:58:49.409 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:49.181+0000 7fab01394200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:58:49.481 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:49.086+0000 7f37efee3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:58:49.481 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:49.328+0000 7f37efee3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:58:49.747 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:49.480+0000 7f37efee3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:58:49.957 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:50.019 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:49.746+0000 7f37efee3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:58:50.158 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:49.702+0000 7fab01394200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:58:50.764 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:50.441+0000 7f37efee3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:58:50.764 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:50.571+0000 7f37efee3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:50.763+0000 7f37efee3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.765 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:58:50.766 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:50.766 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:50.766 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:50.766 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: Reconfiguring daemon mgr.x on smithi005 2023-10-08T12:58:50.766 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='client.? ' entity='client.admin' 2023-10-08T12:58:50.766 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-mon[104234]: from='client.? ' entity='client.admin' 2023-10-08T12:58:50.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:50.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: Reconfiguring daemon mgr.x on smithi005 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='client.? ' entity='client.admin' 2023-10-08T12:58:50.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:50 smithi005 ceph-mon[99496]: from='client.? ' entity='client.admin' 2023-10-08T12:58:50.908 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:50.498+0000 7fab01394200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:58:50.908 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:50.596+0000 7fab01394200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:58:50.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: Reconfiguring daemon mgr.x on smithi005 2023-10-08T12:58:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='client.? ' entity='client.admin' 2023-10-08T12:58:50.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:50 smithi060 ceph-mon[103190]: from='client.? ' entity='client.admin' 2023-10-08T12:58:50.946 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:50.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi005') 2023-10-08T12:58:50.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi005') 2023-10-08T12:58:50.984 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi005') 2023-10-08T12:58:50.984 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi005') 2023-10-08T12:58:50.984 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi005') 2023-10-08T12:58:51.019 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:50.876+0000 7f37efee3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:58:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 -- 172.21.15.5:0/2526382992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 msgr2=0x7f462810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 --2- 172.21.15.5:0/2526382992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 0x7f462810d650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f462000b0a0 tx=0x7f462000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 -- 172.21.15.5:0/2526382992 shutdown_connections 2023-10-08T12:58:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 --2- 172.21.15.5:0/2526382992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 0x7f462810d650 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 --2- 172.21.15.5:0/2526382992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281057c0 0x7f4628105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 --2- 172.21.15.5:0/2526382992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46281008a0 0x7f4628100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 -- 172.21.15.5:0/2526382992 >> 172.21.15.5:0/2526382992 conn(0x7f46280779e0 msgr2=0x7f4628077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 -- 172.21.15.5:0/2526382992 shutdown_connections 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.134+0000 7f462ed5a700 1 -- 172.21.15.5:0/2526382992 wait complete. 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 Processor -- start 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 -- start start 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 0x7f4628196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 0x7f4628197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46281057c0 0x7f462819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462819ab40 con 0x7f4628101260 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462819acb0 con 0x7f46281008a0 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462ed5a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462819ae70 con 0x7f46281057c0 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462caf6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 0x7f4628196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f4627fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 0x7f4628197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462caf6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 0x7f4628196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:54452/0 (socket says 172.21.15.5:54452) 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.135+0000 7f462caf6700 1 -- 172.21.15.5:0/928766936 learned_addr learned my addr 172.21.15.5:0/928766936 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462d2f7700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46281057c0 0x7f462819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462caf6700 1 -- 172.21.15.5:0/928766936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46281057c0 msgr2=0x7f462819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462caf6700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46281057c0 0x7f462819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462caf6700 1 -- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 msgr2=0x7f4628197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462caf6700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 0x7f4628197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462caf6700 1 -- 172.21.15.5:0/928766936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009d00 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462caf6700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 0x7f4628196d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f461c00e970 tx=0x7f461c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c009790 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f461c00c7e0 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462819b150 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c003c70 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.136+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46281a3aa0 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.137+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f461c018430 con 0x7f46281008a0 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.137+0000 7f4625ffb700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4618038b40 0x7f461803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.137+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f461c014070 con 0x7f46281008a0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.137+0000 7f4627fff700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4618038b40 0x7f461803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.137+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4628108da0 con 0x7f46281008a0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.138+0000 7f4627fff700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4618038b40 0x7f461803b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4628198220 tx=0x7f4614009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.142+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f461c00f990 con 0x7f46281008a0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.356+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f4628197fd0 con 0x7f46281008a0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.360+0000 7f4625ffb700 1 -- 172.21.15.5:0/928766936 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v18)=0 v18) v1 ==== 108+0+0 (secure 0 0 0) 0x7f461c00f3c0 con 0x7f46281008a0 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4618038b40 msgr2=0x7f461803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4618038b40 0x7f461803b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4628198220 tx=0x7f4614009260 comp rx=0 tx=0).stop 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 msgr2=0x7f4628196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 0x7f4628196d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f461c00e970 tx=0x7f461c00ec80 comp rx=0 tx=0).stop 2023-10-08T12:58:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 shutdown_connections 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4618038b40 0x7f461803b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46281057c0 0x7f462819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46281008a0 0x7f4628196d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 --2- 172.21.15.5:0/928766936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4628101260 0x7f4628197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 >> 172.21.15.5:0/928766936 conn(0x7f46280779e0 msgr2=0x7f46280fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 shutdown_connections 2023-10-08T12:58:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.362+0000 7f462ed5a700 1 -- 172.21.15.5:0/928766936 wait complete. 2023-10-08T12:58:51.519 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:51.091+0000 7f37efee3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:58:51.900 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:51.567+0000 7fab01394200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:58:51.900 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:51.679+0000 7fab01394200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:58:52.158 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:51.899+0000 7fab01394200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:58:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-mon[103190]: Standby manager daemon z started 2023-10-08T12:58:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:58:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:58:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:58:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:58:52.269 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 12:58:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z[107280]: 2023-10-08T12:58:51.943+0000 7f37efee3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:58:52.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:52 smithi118 ceph-mon[104234]: Standby manager daemon z started 2023-10-08T12:58:52.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:52 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:58:52.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:52 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:58:52.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:52 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:58:52.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:52 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:58:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.964+0000 7f9291a30700 1 -- 172.21.15.5:0/1957559830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c1058d0 msgr2=0x7f928c105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:52.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.964+0000 7f9291a30700 1 --2- 172.21.15.5:0/1957559830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c1058d0 0x7f928c105cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f927c009990 tx=0x7f927c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.964+0000 7f9291a30700 1 -- 172.21.15.5:0/1957559830 shutdown_connections 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.964+0000 7f9291a30700 1 --2- 172.21.15.5:0/1957559830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ffb30 0x7f928c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.964+0000 7f9291a30700 1 --2- 172.21.15.5:0/1957559830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c1058d0 0x7f928c105cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.964+0000 7f9291a30700 1 --2- 172.21.15.5:0/1957559830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c0ff190 0x7f928c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.965+0000 7f9291a30700 1 -- 172.21.15.5:0/1957559830 >> 172.21.15.5:0/1957559830 conn(0x7f928c074a10 msgr2=0x7f928c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.965+0000 7f9291a30700 1 -- 172.21.15.5:0/1957559830 shutdown_connections 2023-10-08T12:58:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.965+0000 7f9291a30700 1 -- 172.21.15.5:0/1957559830 wait complete. 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.965+0000 7f9291a30700 1 Processor -- start 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 -- start start 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ff190 0x7f928c100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c0ffb30 0x7f928c1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c1058d0 0x7f928c100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1a4f90 con 0x7f928c0ffb30 2023-10-08T12:58:52.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1a5100 con 0x7f928c0ff190 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f9291a30700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c1a52c0 con 0x7f928c1058d0 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f928a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c0ffb30 0x7f928c1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f928affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ff190 0x7f928c100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f928a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c0ffb30 0x7f928c1008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59490/0 (socket says 172.21.15.5:59490) 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f928a7fc700 1 -- 172.21.15.5:0/3188433321 learned_addr learned my addr 172.21.15.5:0/3188433321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.966+0000 7f928b7fe700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c1058d0 0x7f928c100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f928affd700 1 -- 172.21.15.5:0/3188433321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c1058d0 msgr2=0x7f928c100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f928affd700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c1058d0 0x7f928c100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f928affd700 1 -- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c0ffb30 msgr2=0x7f928c1008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f928affd700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c0ffb30 0x7f928c1008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f928affd700 1 -- 172.21.15.5:0/3188433321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0095f0 con 0x7f928c0ff190 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f928affd700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ff190 0x7f928c100370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f927c0059d0 tx=0x7f927c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c01d070 con 0x7f928c0ff190 2023-10-08T12:58:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f927c022470 con 0x7f928c0ff190 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c1a5540 con 0x7f928c0ff190 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c017650 con 0x7f928c0ff190 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.967+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c1a59b0 con 0x7f928c0ff190 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.968+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f927c0177b0 con 0x7f928c0ff190 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.968+0000 7f9290a2e700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9274038b40 0x7f927403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.968+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c108d30 con 0x7f928c0ff190 2023-10-08T12:58:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.968+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f927c04d7f0 con 0x7f928c0ff190 2023-10-08T12:58:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.968+0000 7f928a7fc700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9274038b40 0x7f927403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.969+0000 7f928a7fc700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9274038b40 0x7f927403b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f928c101aa0 tx=0x7f9280007480 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:49.973+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f927c027070 con 0x7f928c0ff190 2023-10-08T12:58:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.181+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f928c101850 con 0x7f928c0ff190 2023-10-08T12:58:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.188+0000 7f9290a2e700 1 -- 172.21.15.5:0/3188433321 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) v1 ==== 127+0+0 (secure 0 0 0) 0x7f927c02a950 con 0x7f928c0ff190 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.190+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9274038b40 msgr2=0x7f927403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.190+0000 7f9291a30700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9274038b40 0x7f927403b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f928c101aa0 tx=0x7f9280007480 comp rx=0 tx=0).stop 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ff190 msgr2=0x7f928c100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ff190 0x7f928c100370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f927c0059d0 tx=0x7f927c005740 comp rx=0 tx=0).stop 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 shutdown_connections 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9274038b40 0x7f927403b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f928c1058d0 0x7f928c100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928c0ff190 0x7f928c100370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 --2- 172.21.15.5:0/3188433321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f928c0ffb30 0x7f928c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 >> 172.21.15.5:0/3188433321 conn(0x7f928c074a10 msgr2=0x7f928c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 shutdown_connections 2023-10-08T12:58:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:50.191+0000 7f9291a30700 1 -- 172.21.15.5:0/3188433321 wait complete. 2023-10-08T12:58:52.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:52 smithi005 ceph-mon[99496]: Standby manager daemon z started 2023-10-08T12:58:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:52 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:58:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:52 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:58:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:52 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:58:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:52 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.118:0/3970423971' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:58:52.505 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:52.251+0000 7fab01394200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:58:52.721 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:52.908 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:52.504+0000 7fab01394200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:58:52.908 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:52.685+0000 7fab01394200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:58:53.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:53 smithi118 ceph-mon[104234]: mgrmap e18: x(active, since 15s), standbys: z 2023-10-08T12:58:53.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:58:53.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:53.388 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:53 smithi005 ceph-mon[99496]: mgrmap e18: x(active, since 15s), standbys: z 2023-10-08T12:58:53.388 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:58:53.388 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:53.408 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:53.013+0000 7fab01394200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:58:53.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:53 smithi060 ceph-mon[103190]: mgrmap e18: x(active, since 15s), standbys: z 2023-10-08T12:58:53.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:58:53.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:53.534 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi005') 2023-10-08T12:58:53.534 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi005') 2023-10-08T12:58:53.534 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi005') 2023-10-08T12:58:53.579 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi005') 2023-10-08T12:58:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 -- 172.21.15.5:0/2390255455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0ffb30 msgr2=0x7f38bc10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:53.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 --2- 172.21.15.5:0/2390255455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0ffb30 0x7f38bc10d5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b0a0 tx=0x7f38b400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 -- 172.21.15.5:0/2390255455 shutdown_connections 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 --2- 172.21.15.5:0/2390255455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0ffb30 0x7f38bc10d5c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 --2- 172.21.15.5:0/2390255455 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc1058d0 0x7f38bc105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 --2- 172.21.15.5:0/2390255455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0ff190 0x7f38bc0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 -- 172.21.15.5:0/2390255455 >> 172.21.15.5:0/2390255455 conn(0x7f38bc074a10 msgr2=0x7f38bc074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 -- 172.21.15.5:0/2390255455 shutdown_connections 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.824+0000 7f38c1b30700 1 -- 172.21.15.5:0/2390255455 wait complete. 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 Processor -- start 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 -- start start 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0ff190 0x7f38bc100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc0ffb30 0x7f38bc1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:53.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 0x7f38bc100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1a5100 con 0x7f38bc1058d0 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1a5270 con 0x7f38bc0ff190 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38c1b30700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1a5430 con 0x7f38bc0ffb30 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 0x7f38bc100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38bbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 0x7f38bc100df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59518/0 (socket says 172.21.15.5:59518) 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38bbfff700 1 -- 172.21.15.5:0/4015001822 learned_addr learned my addr 172.21.15.5:0/4015001822 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.825+0000 7f38bb7fe700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0ff190 0x7f38bc100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38baffd700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc0ffb30 0x7f38bc1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38bbfff700 1 -- 172.21.15.5:0/4015001822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc0ffb30 msgr2=0x7f38bc1008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38bbfff700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc0ffb30 0x7f38bc1008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38bbfff700 1 -- 172.21.15.5:0/4015001822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0ff190 msgr2=0x7f38bc100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:53.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38bbfff700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0ff190 0x7f38bc100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38bbfff700 1 -- 172.21.15.5:0/4015001822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4009d00 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38baffd700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc0ffb30 0x7f38bc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38bbfff700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 0x7f38bc100df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f38b4006070 tx=0x7f38b4007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400e040 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38b400be40 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc1a56b0 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b401b6c0 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.826+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc1a5b20 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.827+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc108d30 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.828+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7f38b401d470 con 0x7f38bc1058d0 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.828+0000 7f38b8ff9700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f38a406cfc0 0x7f38a406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:53.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.828+0000 7f38bb7fe700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f38a406cfc0 0x7f38a406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:53.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.828+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f38b408c1e0 con 0x7f38bc1058d0 2023-10-08T12:58:53.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.829+0000 7f38bb7fe700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f38a406cfc0 0x7f38a406f480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f38bc068160 tx=0x7f38ac007400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:53.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:53.833+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38b40576a0 con 0x7f38bc1058d0 2023-10-08T12:58:54.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.042+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f38bc101850 con 0x7f38bc1058d0 2023-10-08T12:58:54.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.047+0000 7f38b8ff9700 1 -- 172.21.15.5:0/4015001822 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f38b4003c00 con 0x7f38bc1058d0 2023-10-08T12:58:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f38a406cfc0 msgr2=0x7f38a406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f38a406cfc0 0x7f38a406f480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f38bc068160 tx=0x7f38ac007400 comp rx=0 tx=0).stop 2023-10-08T12:58:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 msgr2=0x7f38bc100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 0x7f38bc100df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f38b4006070 tx=0x7f38b4007930 comp rx=0 tx=0).stop 2023-10-08T12:58:54.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 shutdown_connections 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f38a406cfc0 0x7f38a406f480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc1058d0 0x7f38bc100df0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0ff190 0x7f38bc100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 --2- 172.21.15.5:0/4015001822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38bc0ffb30 0x7f38bc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 >> 172.21.15.5:0/4015001822 conn(0x7f38bc074a10 msgr2=0x7f38bc0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 shutdown_connections 2023-10-08T12:58:54.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.049+0000 7f38c1b30700 1 -- 172.21.15.5:0/4015001822 wait complete. 2023-10-08T12:58:54.158 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:53.835+0000 7fab01394200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:58:54.158 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:53.991+0000 7fab01394200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:58:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:54.646 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:54.237+0000 7fab01394200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:58:54.647 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:54.374+0000 7fab01394200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:58:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.938+0000 7f1891f6c700 1 -- 172.21.15.5:0/327056061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c0ff6e0 msgr2=0x7f188c0ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.938+0000 7f1891f6c700 1 --2- 172.21.15.5:0/327056061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c0ff6e0 0x7f188c0ffb60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f187c00b9b0 tx=0x7f187c009260 comp rx=0 tx=0).stop 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 -- 172.21.15.5:0/327056061 shutdown_connections 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 --2- 172.21.15.5:0/327056061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f188c1000a0 0x7f188c10c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 --2- 172.21.15.5:0/327056061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c105690 0x7f188c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 --2- 172.21.15.5:0/327056061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c0ff6e0 0x7f188c0ffb60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 -- 172.21.15.5:0/327056061 >> 172.21.15.5:0/327056061 conn(0x7f188c0766c0 msgr2=0x7f188c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 -- 172.21.15.5:0/327056061 shutdown_connections 2023-10-08T12:58:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.939+0000 7f1891f6c700 1 -- 172.21.15.5:0/327056061 wait complete. 2023-10-08T12:58:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.940+0000 7f1891f6c700 1 Processor -- start 2023-10-08T12:58:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.940+0000 7f1891f6c700 1 -- start start 2023-10-08T12:58:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1891f6c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c0ff6e0 0x7f188c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1891f6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 0x7f188c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1891f6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f188c105690 0x7f188c194850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1891f6c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c194eb0 con 0x7f188c1000a0 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1891f6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c194ff0 con 0x7f188c105690 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1891f6c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1951b0 con 0x7f188c0ff6e0 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 0x7f188c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 0x7f188c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59530/0 (socket says 172.21.15.5:59530) 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 -- 172.21.15.5:0/1768070429 learned_addr learned my addr 172.21.15.5:0/1768070429 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188bfff700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f188c105690 0x7f188c194850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188b7fe700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c0ff6e0 0x7f188c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 -- 172.21.15.5:0/1768070429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c0ff6e0 msgr2=0x7f188c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c0ff6e0 0x7f188c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 -- 172.21.15.5:0/1768070429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f188c105690 msgr2=0x7f188c194850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f188c105690 0x7f188c194850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 -- 172.21.15.5:0/1768070429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c00b610 con 0x7f188c1000a0 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f188affd700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 0x7f188c19abf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f187c004760 tx=0x7f187c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.941+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c004a30 con 0x7f188c1000a0 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.942+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f187c0054e0 con 0x7f188c1000a0 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.942+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c195430 con 0x7f188c1000a0 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.942+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c013cb0 con 0x7f188c1000a0 2023-10-08T12:58:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.942+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c1a1750 con 0x7f188c1000a0 2023-10-08T12:58:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.943+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c107c20 con 0x7f188c1000a0 2023-10-08T12:58:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.943+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7f187c01a050 con 0x7f188c1000a0 2023-10-08T12:58:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.944+0000 7f1888ff9700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f187407dfd0 0x7f1874080490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.944+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f187c08c110 con 0x7f188c1000a0 2023-10-08T12:58:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.944+0000 7f188b7fe700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f187407dfd0 0x7f1874080490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:54.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.944+0000 7f188b7fe700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f187407dfd0 0x7f1874080490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f188c104bf0 tx=0x7f1880009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:54.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:54.949+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f187c057510 con 0x7f188c1000a0 2023-10-08T12:58:55.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.152+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7f188c04e4c0 con 0x7f188c1000a0 2023-10-08T12:58:55.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.156+0000 7f1888ff9700 1 -- 172.21.15.5:0/1768070429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v20)=0 v20) v1 ==== 116+0+0 (secure 0 0 0) 0x7f187c05ab30 con 0x7f188c1000a0 2023-10-08T12:58:55.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f187407dfd0 msgr2=0x7f1874080490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f187407dfd0 0x7f1874080490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f188c104bf0 tx=0x7f1880009260 comp rx=0 tx=0).stop 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 msgr2=0x7f188c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 0x7f188c19abf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f187c004760 tx=0x7f187c004790 comp rx=0 tx=0).stop 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 shutdown_connections 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f187407dfd0 0x7f1874080490 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f188c105690 0x7f188c194850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f188c0ff6e0 0x7f188c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 --2- 172.21.15.5:0/1768070429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f188c1000a0 0x7f188c19abf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.158+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 >> 172.21.15.5:0/1768070429 conn(0x7f188c0766c0 msgr2=0x7f188c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.159+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 shutdown_connections 2023-10-08T12:58:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.159+0000 7f1891f6c700 1 -- 172.21.15.5:0/1768070429 wait complete. 2023-10-08T12:58:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:55 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4015001822' entity='client.admin' 2023-10-08T12:58:55.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:55 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4015001822' entity='client.admin' 2023-10-08T12:58:55.408 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:54.646+0000 7fab01394200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:58:55.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:55 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4015001822' entity='client.admin' 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 -- 172.21.15.5:0/4059399973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 msgr2=0x7faf3010c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 --2- 172.21.15.5:0/4059399973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3010c5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b0a0 tx=0x7faf2800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 -- 172.21.15.5:0/4059399973 shutdown_connections 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 --2- 172.21.15.5:0/4059399973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3010c5c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 --2- 172.21.15.5:0/4059399973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30104720 0x7faf30104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 --2- 172.21.15.5:0/4059399973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 0x7faf30100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 -- 172.21.15.5:0/4059399973 >> 172.21.15.5:0/4059399973 conn(0x7faf30074a10 msgr2=0x7faf30074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 -- 172.21.15.5:0/4059399973 shutdown_connections 2023-10-08T12:58:55.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 -- 172.21.15.5:0/4059399973 wait complete. 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 Processor -- start 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.965+0000 7faf37001700 1 -- start start 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf37001700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 0x7faf3019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf37001700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf37001700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30104720 0x7faf30196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf37001700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30197190 con 0x7faf30100c60 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf37001700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30197300 con 0x7faf30104720 2023-10-08T12:58:55.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf37001700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf301974c0 con 0x7faf301002a0 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3019cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59544/0 (socket says 172.21.15.5:59544) 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 -- 172.21.15.5:0/918025712 learned_addr learned my addr 172.21.15.5:0/918025712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf34d9d700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 0x7faf3019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf3559e700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30104720 0x7faf30196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 -- 172.21.15.5:0/918025712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 msgr2=0x7faf3019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 0x7faf3019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 -- 172.21.15.5:0/918025712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30104720 msgr2=0x7faf30196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30104720 0x7faf30196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 -- 172.21.15.5:0/918025712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28009d00 con 0x7faf30100c60 2023-10-08T12:58:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf34d9d700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 0x7faf3019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2ffff700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3019cf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c920 tx=0x7faf1c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c007b00 con 0x7faf30100c60 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.966+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf1c004cf0 con 0x7faf30100c60 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.967+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf301977a0 con 0x7faf30100c60 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.967+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c005610 con 0x7faf30100c60 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.967+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf301a39e0 con 0x7faf30100c60 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.968+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf30108d20 con 0x7faf30100c60 2023-10-08T12:58:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.968+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7faf1c004750 con 0x7faf30100c60 2023-10-08T12:58:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.968+0000 7faf2dffb700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faf2006cfc0 0x7faf2006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.969+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7faf1c08b250 con 0x7faf30100c60 2023-10-08T12:58:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.969+0000 7faf34d9d700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faf2006cfc0 0x7faf2006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.969+0000 7faf34d9d700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faf2006cfc0 0x7faf2006f480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faf24005fd0 tx=0x7faf2400a5e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:55.973+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf1c056650 con 0x7faf30100c60 2023-10-08T12:58:56.156 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 12:58:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y[105570]: 2023-10-08T12:58:55.687+0000 7fab01394200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:58:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.167+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7faf1c004a00 con 0x7faf30100c60 2023-10-08T12:58:56.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.217+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7faf3004e4c0 con 0x7faf30100c60 2023-10-08T12:58:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.221+0000 7faf2dffb700 1 -- 172.21.15.5:0/918025712 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7faf1c09de40 con 0x7faf30100c60 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 -- 172.21.15.5:0/3655357862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8068ec0 msgr2=0x7fd1a8069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 --2- 172.21.15.5:0/3655357862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8068ec0 0x7fd1a8069320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009990 tx=0x7fd19c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 -- 172.21.15.5:0/3655357862 shutdown_connections 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 --2- 172.21.15.5:0/3655357862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a8069860 0x7fd1a810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 --2- 172.21.15.5:0/3655357862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1a81067a0 0x7fd1a8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 --2- 172.21.15.5:0/3655357862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8068ec0 0x7fd1a8069320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 -- 172.21.15.5:0/3655357862 >> 172.21.15.5:0/3655357862 conn(0x7fd1a80766c0 msgr2=0x7fd1a8076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faf2006cfc0 msgr2=0x7faf2006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7faf37001700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faf2006cfc0 0x7faf2006f480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faf24005fd0 tx=0x7faf2400a5e0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 msgr2=0x7faf3019cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7faf37001700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3019cf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c920 tx=0x7faf1c00cce0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 -- 172.21.15.5:0/3655357862 shutdown_connections 2023-10-08T12:58:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.224+0000 7fd1ae015700 1 -- 172.21.15.5:0/3655357862 wait complete. 2023-10-08T12:58:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 Processor -- start 2023-10-08T12:58:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 shutdown_connections 2023-10-08T12:58:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faf2006cfc0 0x7faf2006f480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30104720 0x7faf30196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf301002a0 0x7faf3019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 --2- 172.21.15.5:0/918025712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf30100c60 0x7faf3019cf30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 >> 172.21.15.5:0/918025712 conn(0x7faf30074a10 msgr2=0x7faf300ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 shutdown_connections 2023-10-08T12:58:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7faf37001700 1 -- 172.21.15.5:0/918025712 wait complete. 2023-10-08T12:58:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 -- start start 2023-10-08T12:58:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1a8068ec0 0x7fd1a819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 0x7fd1a819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a81067a0 0x7fd1a8196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8197090 con 0x7fd1a8069860 2023-10-08T12:58:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8197200 con 0x7fd1a81067a0 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1ae015700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a81973c0 con 0x7fd1a8068ec0 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 0x7fd1a819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 0x7fd1a819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59558/0 (socket says 172.21.15.5:59558) 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1a6ffd700 1 -- 172.21.15.5:0/21078040 learned_addr learned my addr 172.21.15.5:0/21078040 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.225+0000 7fd1a7fff700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a81067a0 0x7fd1a8196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a77fe700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1a8068ec0 0x7fd1a819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a6ffd700 1 -- 172.21.15.5:0/21078040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1a8068ec0 msgr2=0x7fd1a819c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a6ffd700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1a8068ec0 0x7fd1a819c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a6ffd700 1 -- 172.21.15.5:0/21078040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a81067a0 msgr2=0x7fd1a8196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a6ffd700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a81067a0 0x7fd1a8196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a6ffd700 1 -- 172.21.15.5:0/21078040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0095f0 con 0x7fd1a8069860 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a6ffd700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 0x7fd1a819ce30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd19c000c00 tx=0x7fd19c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c01d070 con 0x7fd1a8069860 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19c022470 con 0x7fd1a8069860 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c017650 con 0x7fd1a8069860 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a8197640 con 0x7fd1a8069860 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.226+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a80ff8b0 con 0x7fd1a8069860 2023-10-08T12:58:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.227+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a8108d50 con 0x7fd1a8069860 2023-10-08T12:58:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.230+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fd19c0225e0 con 0x7fd1a8069860 2023-10-08T12:58:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.231+0000 7fd1a4ff9700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1900a1440 0x7fd1900a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.231+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd19c0cc9e0 con 0x7fd1a8069860 2023-10-08T12:58:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.231+0000 7fd1a77fe700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1900a1440 0x7fd1900a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.231+0000 7fd1a77fe700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1900a1440 0x7fd1900a3900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd19800dad0 tx=0x7fd19800d4b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.237+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd19c097cd0 con 0x7fd1a8069860 2023-10-08T12:58:56.256 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1768070429' entity='client.admin' 2023-10-08T12:58:56.256 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: Standby manager daemon y started 2023-10-08T12:58:56.256 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:58:56.256 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:58:56.256 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:58:56.256 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:58:56.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:56.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:56.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:56.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.362+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/594629075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c98068190 msgr2=0x7f5c98068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.362+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/594629075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c98068190 0x7f5c98068570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009990 tx=0x7f5c88009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/594629075 shutdown_connections 2023-10-08T12:58:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/594629075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c9810d300 0x7f5c9810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/594629075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c98068190 0x7f5c98068570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/594629075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 0x7f5c9810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/594629075 >> 172.21.15.5:0/594629075 conn(0x7f5c98075790 msgr2=0x7f5c98075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/594629075 shutdown_connections 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/594629075 wait complete. 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 Processor -- start 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.363+0000 7f5c9cf7d700 1 -- start start 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9cf7d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c98068190 0x7f5c98198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9cf7d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 0x7f5c98199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9cf7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 0x7f5c9819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9cf7d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9819dd50 con 0x7f5c9810d300 2023-10-08T12:58:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9cf7d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9819dec0 con 0x7f5c98068ab0 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9cf7d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9819e080 con 0x7f5c98068190 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 0x7f5c9819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 0x7f5c9819d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59574/0 (socket says 172.21.15.5:59574) 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 -- 172.21.15.5:0/2233246291 learned_addr learned my addr 172.21.15.5:0/2233246291 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c9659c700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c98068190 0x7f5c98198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c95d9b700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 0x7f5c98199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 -- 172.21.15.5:0/2233246291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c98068190 msgr2=0x7f5c98198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c98068190 0x7f5c98198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 -- 172.21.15.5:0/2233246291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 msgr2=0x7f5c98199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 0x7f5c98199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 -- 172.21.15.5:0/2233246291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880095f0 con 0x7f5c9810d300 2023-10-08T12:58:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c95d9b700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 0x7f5c98199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c96d9d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 0x7f5c9819d740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007ee0 tx=0x7f5c9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.364+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90017070 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.365+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c9000f040 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.365+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90005740 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.365+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9819e360 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.365+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c981a5bc0 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.366+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c98108520 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.367+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f5c9000dc60 con 0x7f5c9810d300 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.368+0000 7f5c877fe700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5c800a14c0 0x7f5c800a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.368+0000 7f5c9659c700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5c800a14c0 0x7f5c800a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:56.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.368+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f5c900ca890 con 0x7f5c9810d300 2023-10-08T12:58:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.368+0000 7f5c9659c700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5c800a14c0 0x7f5c800a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800b2e0 tx=0x7f5c88005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.372+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c90095af0 con 0x7f5c9810d300 2023-10-08T12:58:56.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1768070429' entity='client.admin' 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: Standby manager daemon y started 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:56.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:56.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:56.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.468+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7fd1a8101ee0 con 0x7fd1a8069860 2023-10-08T12:58:56.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.472+0000 7fd1a4ff9700 1 -- 172.21.15.5:0/21078040 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) v1 ==== 119+0+0 (secure 0 0 0) 0x7fd19c09b2f0 con 0x7fd1a8069860 2023-10-08T12:58:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1900a1440 msgr2=0x7fd1900a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1900a1440 0x7fd1900a3900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd19800dad0 tx=0x7fd19800d4b0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 msgr2=0x7fd1a819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 0x7fd1a819ce30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd19c000c00 tx=0x7fd19c004730 comp rx=0 tx=0).stop 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 shutdown_connections 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1900a1440 0x7fd1900a3900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a81067a0 0x7fd1a8196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1a8068ec0 0x7fd1a819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 --2- 172.21.15.5:0/21078040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a8069860 0x7fd1a819ce30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 >> 172.21.15.5:0/21078040 conn(0x7fd1a80766c0 msgr2=0x7fd1a80fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 shutdown_connections 2023-10-08T12:58:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.474+0000 7fd1ae015700 1 -- 172.21.15.5:0/21078040 wait complete. 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1768070429' entity='client.admin' 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: Standby manager daemon y started 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.? 172.21.15.60:0/2148490981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:56.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:56.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:58:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.584+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f5c980ffcf0 con 0x7f5c9810d300 2023-10-08T12:58:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.588+0000 7f5c877fe700 1 -- 172.21.15.5:0/2233246291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5c90099110 con 0x7f5c9810d300 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5c800a14c0 msgr2=0x7f5c800a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5c800a14c0 0x7f5c800a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800b2e0 tx=0x7f5c88005fd0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 msgr2=0x7f5c9819d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 0x7f5c9819d740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c90007ee0 tx=0x7f5c9000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 shutdown_connections 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5c800a14c0 0x7f5c800a3980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9810d300 0x7f5c9819d740 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c98068190 0x7f5c98198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 --2- 172.21.15.5:0/2233246291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c98068ab0 0x7f5c98199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 >> 172.21.15.5:0/2233246291 conn(0x7f5c98075790 msgr2=0x7f5c9810e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.590+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 shutdown_connections 2023-10-08T12:58:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:56.591+0000 7f5c9cf7d700 1 -- 172.21.15.5:0/2233246291 wait complete. 2023-10-08T12:58:56.947 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi005') 2023-10-08T12:58:57.250 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:57 smithi005 ceph-mon[99496]: mgrmap e19: x(active, since 19s), standbys: z, y 2023-10-08T12:58:57.250 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:58:57.250 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:57 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/918025712' entity='client.admin' 2023-10-08T12:58:57.250 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:57 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/21078040' entity='client.admin' 2023-10-08T12:58:57.250 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:57 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2233246291' entity='client.admin' 2023-10-08T12:58:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.327+0000 7fcd1198f700 1 -- 172.21.15.5:0/182904023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 msgr2=0x7fcd0c068570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.327+0000 7fcd1198f700 1 --2- 172.21.15.5:0/182904023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c068570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009990 tx=0x7fccfc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.327+0000 7fcd1198f700 1 -- 172.21.15.5:0/182904023 shutdown_connections 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.327+0000 7fcd1198f700 1 --2- 172.21.15.5:0/182904023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd0c10d300 0x7fcd0c10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.327+0000 7fcd1198f700 1 --2- 172.21.15.5:0/182904023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c068570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.327+0000 7fcd1198f700 1 --2- 172.21.15.5:0/182904023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd0c068ab0 0x7fcd0c10cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.328+0000 7fcd1198f700 1 -- 172.21.15.5:0/182904023 >> 172.21.15.5:0/182904023 conn(0x7fcd0c075790 msgr2=0x7fcd0c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.328+0000 7fcd1198f700 1 -- 172.21.15.5:0/182904023 shutdown_connections 2023-10-08T12:58:57.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.328+0000 7fcd1198f700 1 -- 172.21.15.5:0/182904023 wait complete. 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.328+0000 7fcd1198f700 1 Processor -- start 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.328+0000 7fcd1198f700 1 -- start start 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd0c068ab0 0x7fcd0c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd0c10d300 0x7fcd0c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c19dcb0 con 0x7fcd0c068190 2023-10-08T12:58:57.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c19de20 con 0x7fcd0c068ab0 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c19dfe0 con 0x7fcd0c10d300 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59596/0 (socket says 172.21.15.5:59596) 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 -- 172.21.15.5:0/1446608449 learned_addr learned my addr 172.21.15.5:0/1446608449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0a7fc700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd0c068ab0 0x7fcd0c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0b7fe700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd0c10d300 0x7fcd0c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 -- 172.21.15.5:0/1446608449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd0c10d300 msgr2=0x7fcd0c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd0c10d300 0x7fcd0c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 -- 172.21.15.5:0/1446608449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd0c068ab0 msgr2=0x7fcd0c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd0c068ab0 0x7fcd0c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 -- 172.21.15.5:0/1446608449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0095f0 con 0x7fcd0c068190 2023-10-08T12:58:57.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd0affd700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c198e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:57.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc01d070 con 0x7fcd0c068190 2023-10-08T12:58:57.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fccfc022470 con 0x7fcd0c068190 2023-10-08T12:58:57.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c19e260 con 0x7fcd0c068190 2023-10-08T12:58:57.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.329+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc017650 con 0x7fcd0c068190 2023-10-08T12:58:57.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.330+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c1a5b20 con 0x7fcd0c068190 2023-10-08T12:58:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.330+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c108520 con 0x7fcd0c068190 2023-10-08T12:58:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.331+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fccfc0225e0 con 0x7fcd0c068190 2023-10-08T12:58:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.332+0000 7fcd1098d700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fccf40a1440 0x7fccf40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.332+0000 7fcd0a7fc700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fccf40a1440 0x7fccf40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.332+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fccfc0cc1c0 con 0x7fcd0c068190 2023-10-08T12:58:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.333+0000 7fcd0a7fc700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fccf40a1440 0x7fccf40a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c19a310 tx=0x7fcd0000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:57.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.336+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fccfc0974b0 con 0x7fcd0c068190 2023-10-08T12:58:57.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 -- 172.21.15.5:0/1871263828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4640ff950 msgr2=0x7ff464105490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 --2- 172.21.15.5:0/1871263828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4640ff950 0x7ff464105490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff458009990 tx=0x7ff458009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 -- 172.21.15.5:0/1871263828 shutdown_connections 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 --2- 172.21.15.5:0/1871263828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff464105b70 0x7ff46410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 --2- 172.21.15.5:0/1871263828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 0x7ff4640ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 --2- 172.21.15.5:0/1871263828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4640ff950 0x7ff464105490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 -- 172.21.15.5:0/1871263828 >> 172.21.15.5:0/1871263828 conn(0x7ff464075cf0 msgr2=0x7ff4640fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 -- 172.21.15.5:0/1871263828 shutdown_connections 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.178+0000 7ff469323700 1 -- 172.21.15.5:0/1871263828 wait complete. 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 Processor -- start 2023-10-08T12:58:57.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 -- start start 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 0x7ff46419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4640ff950 0x7ff46419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 0x7ff464196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641971c0 con 0x7ff464105b70 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464197330 con 0x7ff4640fefa0 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff469323700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641974f0 con 0x7ff4640ff950 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 0x7ff464196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 0x7ff464196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59586/0 (socket says 172.21.15.5:59586) 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 -- 172.21.15.5:0/288233778 learned_addr learned my addr 172.21.15.5:0/288233778 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff462ffd700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 0x7ff46419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4627fc700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4640ff950 0x7ff46419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 -- 172.21.15.5:0/288233778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4640ff950 msgr2=0x7ff46419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4640ff950 0x7ff46419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 -- 172.21.15.5:0/288233778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 msgr2=0x7ff46419c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 0x7ff46419c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.179+0000 7ff4637fe700 1 -- 172.21.15.5:0/288233778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580095f0 con 0x7ff464105b70 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff462ffd700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 0x7ff46419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff4637fe700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 0x7ff464196b60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff45c007ee0 tx=0x7ff45c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c017070 con 0x7ff464105b70 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4641977d0 con 0x7ff464105b70 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff45c00f040 con 0x7ff464105b70 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c005550 con 0x7ff464105b70 2023-10-08T12:58:57.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.180+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4641a39c0 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.181+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464108e20 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.182+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7ff45c00db20 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.183+0000 7ff44bfff700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff44c0a1440 0x7ff44c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.183+0000 7ff462ffd700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff44c0a1440 0x7ff44c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.183+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff45c0cadf0 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.184+0000 7ff462ffd700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff44c0a1440 0x7ff44c0a3900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff454005950 tx=0x7ff45400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.187+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff45c096050 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.394+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7ff464102060 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.397+0000 7ff44bfff700 1 -- 172.21.15.5:0/288233778 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v24)=0 v24) v1 ==== 116+0+0 (secure 0 0 0) 0x7ff45c099670 con 0x7ff464105b70 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff44c0a1440 msgr2=0x7ff44c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff44c0a1440 0x7ff44c0a3900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff454005950 tx=0x7ff45400b410 comp rx=0 tx=0).stop 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 msgr2=0x7ff464196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 0x7ff464196b60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff45c007ee0 tx=0x7ff45c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 shutdown_connections 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff44c0a1440 0x7ff44c0a3900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff464105b70 0x7ff464196b60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4640fefa0 0x7ff46419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 --2- 172.21.15.5:0/288233778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4640ff950 0x7ff46419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.399+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 >> 172.21.15.5:0/288233778 conn(0x7ff464075cf0 msgr2=0x7ff4640fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.400+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 shutdown_connections 2023-10-08T12:58:57.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.400+0000 7ff469323700 1 -- 172.21.15.5:0/288233778 wait complete. 2023-10-08T12:58:57.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:57 smithi118 ceph-mon[104234]: mgrmap e19: x(active, since 19s), standbys: z, y 2023-10-08T12:58:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:58:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:57 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/918025712' entity='client.admin' 2023-10-08T12:58:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:57 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/21078040' entity='client.admin' 2023-10-08T12:58:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:57 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2233246291' entity='client.admin' 2023-10-08T12:58:57.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.543+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fcd0c04e4c0 con 0x7fcd0c068190 2023-10-08T12:58:57.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.547+0000 7fcd1098d700 1 -- 172.21.15.5:0/1446608449 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v25)=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fccfc09aad0 con 0x7fcd0c068190 2023-10-08T12:58:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fccf40a1440 msgr2=0x7fccf40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fccf40a1440 0x7fccf40a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c19a310 tx=0x7fcd0000a380 comp rx=0 tx=0).stop 2023-10-08T12:58:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 msgr2=0x7fcd0c198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c198e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc00f670 comp rx=0 tx=0).stop 2023-10-08T12:58:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 shutdown_connections 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fccf40a1440 0x7fccf40a3900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd0c10d300 0x7fcd0c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c068190 0x7fcd0c198e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 --2- 172.21.15.5:0/1446608449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd0c068ab0 0x7fcd0c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 >> 172.21.15.5:0/1446608449 conn(0x7fcd0c075790 msgr2=0x7fcd0c10e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 shutdown_connections 2023-10-08T12:58:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:57.549+0000 7fcd1198f700 1 -- 172.21.15.5:0/1446608449 wait complete. 2023-10-08T12:58:57.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:57 smithi060 ceph-mon[103190]: mgrmap e19: x(active, since 19s), standbys: z, y 2023-10-08T12:58:57.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:58:57.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:57 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/918025712' entity='client.admin' 2023-10-08T12:58:57.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:57 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/21078040' entity='client.admin' 2023-10-08T12:58:57.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:57 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2233246291' entity='client.admin' 2023-10-08T12:58:58.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:58 smithi005 ceph-mon[99496]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:58.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:58 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/288233778' entity='client.admin' 2023-10-08T12:58:58.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:58:58 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1446608449' entity='client.admin' 2023-10-08T12:58:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:58 smithi060 ceph-mon[103190]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:58 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/288233778' entity='client.admin' 2023-10-08T12:58:58.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:58:58 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1446608449' entity='client.admin' 2023-10-08T12:58:58.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:58 smithi118 ceph-mon[104234]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:58:58.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:58 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/288233778' entity='client.admin' 2023-10-08T12:58:58.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:58:58 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1446608449' entity='client.admin' 2023-10-08T12:58:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 -- 172.21.15.5:0/1732345569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 msgr2=0x7fd0bc068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 --2- 172.21.15.5:0/1732345569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc068610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40099c0 tx=0x7fd0a4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 -- 172.21.15.5:0/1732345569 shutdown_connections 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 --2- 172.21.15.5:0/1732345569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc068b50 0x7fd0bc10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 --2- 172.21.15.5:0/1732345569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0bc106800 0x7fd0bc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 --2- 172.21.15.5:0/1732345569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc068610 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 -- 172.21.15.5:0/1732345569 >> 172.21.15.5:0/1732345569 conn(0x7fd0bc075790 msgr2=0x7fd0bc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.010+0000 7fd0c114e700 1 -- 172.21.15.5:0/1732345569 shutdown_connections 2023-10-08T12:58:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.011+0000 7fd0c114e700 1 -- 172.21.15.5:0/1732345569 wait complete. 2023-10-08T12:58:59.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.011+0000 7fd0c114e700 1 Processor -- start 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.011+0000 7fd0c114e700 1 -- start start 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc0ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0bc068b50 0x7fd0bc0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc106800 0x7fd0bc1002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1a5060 con 0x7fd0bc068190 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1a51d0 con 0x7fd0bc106800 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc1a5390 con 0x7fd0bc068b50 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc0ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc0ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59610/0 (socket says 172.21.15.5:59610) 2023-10-08T12:58:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 -- 172.21.15.5:0/3281668367 learned_addr learned my addr 172.21.15.5:0/3281668367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bb59e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc106800 0x7fd0bc1002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 -- 172.21.15.5:0/3281668367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0bc068b50 msgr2=0x7fd0bc0ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0b3fff700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0bc068b50 0x7fd0bc0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0bc068b50 0x7fd0bc0ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 -- 172.21.15.5:0/3281668367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc106800 msgr2=0x7fd0bc1002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc106800 0x7fd0bc1002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 -- 172.21.15.5:0/3281668367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40095f0 con 0x7fd0bc068190 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bb59e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc106800 0x7fd0bc1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0bad9d700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc0ff820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00b530 tx=0x7fd0ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011830 con 0x7fd0bc068190 2023-10-08T12:58:59.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ac011e50 con 0x7fd0bc068190 2023-10-08T12:58:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.012+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc1a5670 con 0x7fd0bc068190 2023-10-08T12:58:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.013+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00f2e0 con 0x7fd0bc068190 2023-10-08T12:58:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.013+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc1a5bc0 con 0x7fd0bc068190 2023-10-08T12:58:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.013+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc108d40 con 0x7fd0bc068190 2023-10-08T12:58:59.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.015+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fd0ac010580 con 0x7fd0bc068190 2023-10-08T12:58:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.015+0000 7fd0b8d99700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd0a80a14c0 0x7fd0a80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.015+0000 7fd0b3fff700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd0a80a14c0 0x7fd0a80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.015+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd0ac0cb140 con 0x7fd0bc068190 2023-10-08T12:58:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.016+0000 7fd0b3fff700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd0a80a14c0 0x7fd0a80a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40098e0 tx=0x7fd0a4000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.019+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd0ac0963a0 con 0x7fd0bc068190 2023-10-08T12:58:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.226+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fd0bc101ed0 con 0x7fd0bc068190 2023-10-08T12:58:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.229+0000 7fd0b8d99700 1 -- 172.21.15.5:0/3281668367 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd0ac015020 con 0x7fd0bc068190 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.231+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd0a80a14c0 msgr2=0x7fd0a80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.231+0000 7fd0c114e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd0a80a14c0 0x7fd0a80a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40098e0 tx=0x7fd0a4000bc0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.231+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 msgr2=0x7fd0bc0ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.231+0000 7fd0c114e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc0ff820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00b530 tx=0x7fd0ac00b8f0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 shutdown_connections 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd0a80a14c0 0x7fd0a80a3980 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0bc106800 0x7fd0bc1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0bc068190 0x7fd0bc0ff820 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 --2- 172.21.15.5:0/3281668367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0bc068b50 0x7fd0bc0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 >> 172.21.15.5:0/3281668367 conn(0x7fd0bc075790 msgr2=0x7fd0bc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 shutdown_connections 2023-10-08T12:58:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.232+0000 7fd0c114e700 1 -- 172.21.15.5:0/3281668367 wait complete. 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.317+0000 7f6e0794b700 1 -- 172.21.15.5:0/4042811892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00069410 msgr2=0x7f6e0010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.317+0000 7f6e0794b700 1 --2- 172.21.15.5:0/4042811892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00069410 0x7f6e0010d650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6df800b0d0 tx=0x7f6df800b3e0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.318+0000 7f6e0794b700 1 -- 172.21.15.5:0/4042811892 shutdown_connections 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.318+0000 7f6e0794b700 1 --2- 172.21.15.5:0/4042811892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00069410 0x7f6e0010d650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.318+0000 7f6e0794b700 1 --2- 172.21.15.5:0/4042811892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e00105670 0x7f6e00105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.318+0000 7f6e0794b700 1 --2- 172.21.15.5:0/4042811892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e00068a50 0x7f6e00068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.318+0000 7f6e0794b700 1 -- 172.21.15.5:0/4042811892 >> 172.21.15.5:0/4042811892 conn(0x7f6e000766c0 msgr2=0x7f6e00076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.319+0000 7f6e0794b700 1 -- 172.21.15.5:0/4042811892 shutdown_connections 2023-10-08T12:58:59.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.319+0000 7f6e0794b700 1 -- 172.21.15.5:0/4042811892 wait complete. 2023-10-08T12:58:59.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.319+0000 7f6e0794b700 1 Processor -- start 2023-10-08T12:58:59.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 -- start start 2023-10-08T12:58:59.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 0x7f6e0019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e00069410 0x7f6e0019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e00105670 0x7f6e00196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e001970f0 con 0x7f6e00068a50 2023-10-08T12:58:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e00197260 con 0x7f6e00105670 2023-10-08T12:58:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e0794b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e00197420 con 0x7f6e00069410 2023-10-08T12:58:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 0x7f6e0019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 0x7f6e0019c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59624/0 (socket says 172.21.15.5:59624) 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 -- 172.21.15.5:0/3639855812 learned_addr learned my addr 172.21.15.5:0/3639855812 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e05ee8700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e00105670 0x7f6e00196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e04ee6700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e00069410 0x7f6e0019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 -- 172.21.15.5:0/3639855812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e00069410 msgr2=0x7f6e0019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e00069410 0x7f6e0019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 -- 172.21.15.5:0/3639855812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e00105670 msgr2=0x7f6e00196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e00105670 0x7f6e00196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.320+0000 7f6e056e7700 1 -- 172.21.15.5:0/3639855812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8009d00 con 0x7f6e00068a50 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.321+0000 7f6e056e7700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 0x7f6e0019c950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00e9a0 tx=0x7f6dfc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.321+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc009790 con 0x7f6e00068a50 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.321+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dfc010430 con 0x7f6e00068a50 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.321+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e00197700 con 0x7f6e00068a50 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.321+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc018680 con 0x7f6e00068a50 2023-10-08T12:58:59.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.321+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e001a3940 con 0x7f6e00068a50 2023-10-08T12:58:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.322+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e00108d30 con 0x7f6e00068a50 2023-10-08T12:58:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.323+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f6dfc0105a0 con 0x7f6e00068a50 2023-10-08T12:58:59.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.324+0000 7f6df67fc700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6dec0a14c0 0x7f6dec0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.324+0000 7f6e04ee6700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6dec0a14c0 0x7f6dec0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.324+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6dfc014070 con 0x7f6e00068a50 2023-10-08T12:58:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.325+0000 7f6e04ee6700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6dec0a14c0 0x7f6dec0a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6e00197c50 tx=0x7f6df000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.328+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6dfc0966a0 con 0x7f6e00068a50 2023-10-08T12:58:59.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.542+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6e00101ee0 con 0x7f6e00068a50 2023-10-08T12:58:59.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.546+0000 7f6df67fc700 1 -- 172.21.15.5:0/3639855812 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6dfc026020 con 0x7f6e00068a50 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6dec0a14c0 msgr2=0x7f6dec0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6dec0a14c0 0x7f6dec0a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6e00197c50 tx=0x7f6df000a380 comp rx=0 tx=0).stop 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 msgr2=0x7f6e0019c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 0x7f6e0019c950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00e9a0 tx=0x7f6dfc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 shutdown_connections 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6dec0a14c0 0x7f6dec0a3980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e00105670 0x7f6e00196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e00068a50 0x7f6e0019c950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 --2- 172.21.15.5:0/3639855812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e00069410 0x7f6e0019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:59.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 >> 172.21.15.5:0/3639855812 conn(0x7f6e000766c0 msgr2=0x7f6e000fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:59.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 shutdown_connections 2023-10-08T12:58:59.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:58:59.549+0000 7f6e0794b700 1 -- 172.21.15.5:0/3639855812 wait complete. 2023-10-08T12:58:59.761 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:59.781 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi005') 2023-10-08T12:58:59.781 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi005') 2023-10-08T12:59:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:59:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3281668367' entity='client.admin' 2023-10-08T12:59:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3639855812' entity='client.admin' 2023-10-08T12:59:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:00.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:00.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3281668367' entity='client.admin' 2023-10-08T12:59:00.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3639855812' entity='client.admin' 2023-10-08T12:59:00.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:00.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:00.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:00.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:00.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3281668367' entity='client.admin' 2023-10-08T12:59:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3639855812' entity='client.admin' 2023-10-08T12:59:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.407+0000 7fd76ce37700 1 -- 172.21.15.5:0/3461429122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 msgr2=0x7fd768105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.407+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3461429122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd768105a90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd758009990 tx=0x7fd758009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 -- 172.21.15.5:0/3461429122 shutdown_connections 2023-10-08T12:59:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3461429122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd768100110 0x7fd76810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3461429122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd768105a90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3461429122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ff750 0x7fd7680ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 -- 172.21.15.5:0/3461429122 >> 172.21.15.5:0/3461429122 conn(0x7fd768075790 msgr2=0x7fd768075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 -- 172.21.15.5:0/3461429122 shutdown_connections 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 -- 172.21.15.5:0/3461429122 wait complete. 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 Processor -- start 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.408+0000 7fd76ce37700 1 -- start start 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76ce37700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ff750 0x7fd768198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76ce37700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd768100110 0x7fd768199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76ce37700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd76819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76ce37700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76819dd10 con 0x7fd7681056b0 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76ce37700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76819de80 con 0x7fd768100110 2023-10-08T12:59:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76ce37700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76819e040 con 0x7fd7680ff750 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd76819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd76819d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59642/0 (socket says 172.21.15.5:59642) 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 -- 172.21.15.5:0/3018516913 learned_addr learned my addr 172.21.15.5:0/3018516913 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd76659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ff750 0x7fd768198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd765d9b700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd768100110 0x7fd768199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 -- 172.21.15.5:0/3018516913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ff750 msgr2=0x7fd768198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ff750 0x7fd768198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 -- 172.21.15.5:0/3018516913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd768100110 msgr2=0x7fd768199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd768100110 0x7fd768199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 -- 172.21.15.5:0/3018516913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580095f0 con 0x7fd7681056b0 2023-10-08T12:59:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.409+0000 7fd766d9d700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd76819d700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd76000ada0 tx=0x7fd76000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.410+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000f070 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.410+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd760007b30 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.410+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76819e320 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.410+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760005280 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.410+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7681a5b80 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.411+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd768100df0 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.413+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fd76000c8d0 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.414+0000 7fd7577fe700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7500a14c0 0x7fd7500a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.414+0000 7fd76659c700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7500a14c0 0x7fd7500a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.414+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd7600ca5e0 con 0x7fd7681056b0 2023-10-08T12:59:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.415+0000 7fd76659c700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7500a14c0 0x7fd7500a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd75800b5c0 tx=0x7fd758005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.419+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7600958b0 con 0x7fd7681056b0 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.629+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7fd76819a1c0 con 0x7fd7681056b0 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.632+0000 7fd7577fe700 1 -- 172.21.15.5:0/3018516913 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd760098ed0 con 0x7fd7681056b0 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7500a14c0 msgr2=0x7fd7500a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7500a14c0 0x7fd7500a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd75800b5c0 tx=0x7fd758005960 comp rx=0 tx=0).stop 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 msgr2=0x7fd76819d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd76819d700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd76000ada0 tx=0x7fd76000c330 comp rx=0 tx=0).stop 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 shutdown_connections 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7500a14c0 0x7fd7500a3980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7681056b0 0x7fd76819d700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ff750 0x7fd768198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 --2- 172.21.15.5:0/3018516913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd768100110 0x7fd768199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 >> 172.21.15.5:0/3018516913 conn(0x7fd768075790 msgr2=0x7fd7680681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 shutdown_connections 2023-10-08T12:59:00.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:00.635+0000 7fd76ce37700 1 -- 172.21.15.5:0/3018516913 wait complete. 2023-10-08T12:59:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.141+0000 7fcc0739d700 1 -- 172.21.15.5:0/830375676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc000ff750 msgr2=0x7fcc000ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.141+0000 7fcc0739d700 1 --2- 172.21.15.5:0/830375676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc000ff750 0x7fcc000ffbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009990 tx=0x7fcbf0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.141+0000 7fcc0739d700 1 -- 172.21.15.5:0/830375676 shutdown_connections 2023-10-08T12:59:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 --2- 172.21.15.5:0/830375676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc00100110 0x7fcc0010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 --2- 172.21.15.5:0/830375676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 0x7fcc00105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 --2- 172.21.15.5:0/830375676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc000ff750 0x7fcc000ffbd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 -- 172.21.15.5:0/830375676 >> 172.21.15.5:0/830375676 conn(0x7fcc00075790 msgr2=0x7fcc00075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 -- 172.21.15.5:0/830375676 shutdown_connections 2023-10-08T12:59:01.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 -- 172.21.15.5:0/830375676 wait complete. 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 Processor -- start 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 -- start start 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc000ff750 0x7fcc0019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 0x7fcc0019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 0x7fcc00196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.142+0000 7fcc0739d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc001971d0 con 0x7fcc00100110 2023-10-08T12:59:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc0739d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00197340 con 0x7fcc001056b0 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc0739d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00197500 con 0x7fcc000ff750 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 0x7fcc0019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 0x7fcc0019cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59652/0 (socket says 172.21.15.5:59652) 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 -- 172.21.15.5:0/1445828986 learned_addr learned my addr 172.21.15.5:0/1445828986 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc05139700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc000ff750 0x7fcc0019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc0593a700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 0x7fcc00196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 -- 172.21.15.5:0/1445828986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc000ff750 msgr2=0x7fcc0019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc000ff750 0x7fcc0019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 -- 172.21.15.5:0/1445828986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 msgr2=0x7fcc00196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:01.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 0x7fcc00196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 -- 172.21.15.5:0/1445828986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf00095f0 con 0x7fcc00100110 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc0593a700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 0x7fcc00196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc04938700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 0x7fcc0019cf20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000c00 tx=0x7fcbf000f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf001d070 con 0x7fcc00100110 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbf000fd30 con 0x7fcc00100110 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0017630 con 0x7fcc00100110 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc00197780 con 0x7fcc00100110 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.143+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc001a39d0 con 0x7fcc00100110 2023-10-08T12:59:01.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.144+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc00100df0 con 0x7fcc00100110 2023-10-08T12:59:01.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.145+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fcbf00177d0 con 0x7fcc00100110 2023-10-08T12:59:01.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.146+0000 7fcbf67fc700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcbec0a14c0 0x7fcbec0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:01.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.146+0000 7fcc05139700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcbec0a14c0 0x7fcbec0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:01.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.146+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fcbf00cc600 con 0x7fcc00100110 2023-10-08T12:59:01.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.147+0000 7fcc05139700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcbec0a14c0 0x7fcbec0a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009a10 tx=0x7fcbfc009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:01.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.150+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcbf005d100 con 0x7fcc00100110 2023-10-08T12:59:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.356+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7fcc00197910 con 0x7fcc00100110 2023-10-08T12:59:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.360+0000 7fcbf67fc700 1 -- 172.21.15.5:0/1445828986 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7fcbf0097850 con 0x7fcc00100110 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcbec0a14c0 msgr2=0x7fcbec0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcbec0a14c0 0x7fcbec0a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009a10 tx=0x7fcbfc009190 comp rx=0 tx=0).stop 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 msgr2=0x7fcc0019cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 0x7fcc0019cf20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0000c00 tx=0x7fcbf000f7d0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 shutdown_connections 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcbec0a14c0 0x7fcbec0a3980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc001056b0 0x7fcc00196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc000ff750 0x7fcc0019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 --2- 172.21.15.5:0/1445828986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc00100110 0x7fcc0019cf20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 >> 172.21.15.5:0/1445828986 conn(0x7fcc00075790 msgr2=0x7fcc00103500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 shutdown_connections 2023-10-08T12:59:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:01.362+0000 7fcc0739d700 1 -- 172.21.15.5:0/1445828986 wait complete. 2023-10-08T12:59:01.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:01 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3018516913' entity='client.admin' 2023-10-08T12:59:01.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:01 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1445828986' entity='client.admin' 2023-10-08T12:59:01.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:01 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3018516913' entity='client.admin' 2023-10-08T12:59:01.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:01 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1445828986' entity='client.admin' 2023-10-08T12:59:02.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:01 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3018516913' entity='client.admin' 2023-10-08T12:59:02.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:01 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1445828986' entity='client.admin' 2023-10-08T12:59:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 -- 172.21.15.5:0/3120413865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd00ff750 msgr2=0x7f8bd00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:02.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 --2- 172.21.15.5:0/3120413865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd00ff750 0x7f8bd00ffbd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009990 tx=0x7f8bc4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 -- 172.21.15.5:0/3120413865 shutdown_connections 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 --2- 172.21.15.5:0/3120413865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd0100110 0x7f8bd010c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 --2- 172.21.15.5:0/3120413865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0105690 0x7f8bd0105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 --2- 172.21.15.5:0/3120413865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd00ff750 0x7f8bd00ffbd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 -- 172.21.15.5:0/3120413865 >> 172.21.15.5:0/3120413865 conn(0x7f8bd00757d0 msgr2=0x7f8bd0075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 -- 172.21.15.5:0/3120413865 shutdown_connections 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.155+0000 7f8bd584f700 1 -- 172.21.15.5:0/3120413865 wait complete. 2023-10-08T12:59:02.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 Processor -- start 2023-10-08T12:59:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 -- start start 2023-10-08T12:59:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd00ff750 0x7f8bd0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:02.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 0x7f8bd0198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0105690 0x7f8bd01a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0198950 con 0x7f8bd0100110 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01a3110 con 0x7f8bd0105690 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bd584f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01a3250 con 0x7f8bd00ff750 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bce7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 0x7f8bd0198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bce7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 0x7f8bd0198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59666/0 (socket says 172.21.15.5:59666) 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bce7fc700 1 -- 172.21.15.5:0/1145715542 learned_addr learned my addr 172.21.15.5:0/1145715542 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.156+0000 7f8bcf7fe700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0105690 0x7f8bd01a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bceffd700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd00ff750 0x7f8bd0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bce7fc700 1 -- 172.21.15.5:0/1145715542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd00ff750 msgr2=0x7f8bd0197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bce7fc700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd00ff750 0x7f8bd0197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bce7fc700 1 -- 172.21.15.5:0/1145715542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0105690 msgr2=0x7f8bd01a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bce7fc700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0105690 0x7f8bd01a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bce7fc700 1 -- 172.21.15.5:0/1145715542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40095f0 con 0x7f8bd0100110 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bce7fc700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 0x7f8bd0198090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4000c00 tx=0x7f8bc400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc401d070 con 0x7f8bd0100110 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bc400fb90 con 0x7f8bd0100110 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd01a3470 con 0x7f8bd0100110 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4017650 con 0x7f8bd0100110 2023-10-08T12:59:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.157+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd01a38e0 con 0x7f8bd0100110 2023-10-08T12:59:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.158+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0107cb0 con 0x7f8bd0100110 2023-10-08T12:59:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.159+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f8bc400fd00 con 0x7f8bd0100110 2023-10-08T12:59:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.160+0000 7f8bd484d700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8bb80a14c0 0x7f8bb80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:02.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.160+0000 7f8bceffd700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8bb80a14c0 0x7f8bb80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.160+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8bc40ccc60 con 0x7f8bd0100110 2023-10-08T12:59:02.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.160+0000 7f8bceffd700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8bb80a14c0 0x7f8bb80a3980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0006fd0 tx=0x7f8bc0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:02.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.163+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8bc4097f50 con 0x7f8bd0100110 2023-10-08T12:59:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.372+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7f8bd0069460 con 0x7f8bd0100110 2023-10-08T12:59:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.376+0000 7f8bd484d700 1 -- 172.21.15.5:0/1145715542 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v30)=0 v30) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8bc40270b0 con 0x7f8bd0100110 2023-10-08T12:59:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8bb80a14c0 msgr2=0x7f8bb80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8bb80a14c0 0x7f8bb80a3980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0006fd0 tx=0x7f8bc0008040 comp rx=0 tx=0).stop 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 msgr2=0x7f8bd0198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 0x7f8bd0198090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4000c00 tx=0x7f8bc400f670 comp rx=0 tx=0).stop 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 shutdown_connections 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8bb80a14c0 0x7f8bb80a3980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0105690 0x7f8bd01a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.378+0000 7f8bd584f700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd00ff750 0x7f8bd0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.379+0000 7f8bd584f700 1 --2- 172.21.15.5:0/1145715542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bd0100110 0x7f8bd0198090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.379+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 >> 172.21.15.5:0/1145715542 conn(0x7f8bd00757d0 msgr2=0x7f8bd00fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.379+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 shutdown_connections 2023-10-08T12:59:02.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:02.379+0000 7f8bd584f700 1 -- 172.21.15.5:0/1145715542 wait complete. 2023-10-08T12:59:02.451 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi005') 2023-10-08T12:59:02.451 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2023-10-08T12:59:02.451 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi005') 2023-10-08T12:59:02.451 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2023-10-08T12:59:02.451 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi005') 2023-10-08T12:59:02.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:02 smithi005 ceph-mon[99496]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:02.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:02 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1145715542' entity='client.admin' 2023-10-08T12:59:02.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:02.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:02.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:02.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:02.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:02 smithi060 ceph-mon[103190]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:02.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:02 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1145715542' entity='client.admin' 2023-10-08T12:59:02.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:02.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:02.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:02.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:03.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:02 smithi118 ceph-mon[104234]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:03.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:02 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1145715542' entity='client.admin' 2023-10-08T12:59:03.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:03.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:03.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:03.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:03.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/4150366160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc841057c0 msgr2=0x7fdc84105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/4150366160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc841057c0 0x7fdc84105ba0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009990 tx=0x7fdc80009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/4150366160 shutdown_connections 2023-10-08T12:59:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/4150366160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc84101260 0x7fdc8410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/4150366160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc841057c0 0x7fdc84105ba0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/4150366160 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc841008a0 0x7fdc84100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/4150366160 >> 172.21.15.5:0/4150366160 conn(0x7fdc840779e0 msgr2=0x7fdc84077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:03.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/4150366160 shutdown_connections 2023-10-08T12:59:03.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.231+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/4150366160 wait complete. 2023-10-08T12:59:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.232+0000 7fdc8c5d6700 1 Processor -- start 2023-10-08T12:59:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.232+0000 7fdc8c5d6700 1 -- start start 2023-10-08T12:59:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc841008a0 0x7fdc8419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 0x7fdc8419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc841057c0 0x7fdc84196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841970e0 con 0x7fdc84101260 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84197250 con 0x7fdc841057c0 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84197410 con 0x7fdc841008a0 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 0x7fdc8419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 0x7fdc8419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59680/0 (socket says 172.21.15.5:59680) 2023-10-08T12:59:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 -- 172.21.15.5:0/2668257629 learned_addr learned my addr 172.21.15.5:0/2668257629 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8a372700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc841008a0 0x7fdc8419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8ab73700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc841057c0 0x7fdc84196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 -- 172.21.15.5:0/2668257629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc841008a0 msgr2=0x7fdc8419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc841008a0 0x7fdc8419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 -- 172.21.15.5:0/2668257629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc841057c0 msgr2=0x7fdc84196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc841057c0 0x7fdc84196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 -- 172.21.15.5:0/2668257629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc800095f0 con 0x7fdc84101260 2023-10-08T12:59:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8ab73700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc841057c0 0x7fdc84196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc89b71700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 0x7fdc8419ce80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400b530 tx=0x7fdc7400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74011830 con 0x7fdc84101260 2023-10-08T12:59:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc74011e50 con 0x7fdc84101260 2023-10-08T12:59:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc841976f0 con 0x7fdc84101260 2023-10-08T12:59:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.233+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400f2e0 con 0x7fdc84101260 2023-10-08T12:59:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.234+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc841a3930 con 0x7fdc84101260 2023-10-08T12:59:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.235+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc84108d80 con 0x7fdc84101260 2023-10-08T12:59:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.236+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fdc74010380 con 0x7fdc84101260 2023-10-08T12:59:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.236+0000 7fdc7b7fe700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc700a1440 0x7fdc700a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.236+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fdc740cb220 con 0x7fdc84101260 2023-10-08T12:59:03.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.236+0000 7fdc8a372700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc700a1440 0x7fdc700a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.237+0000 7fdc8a372700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc700a1440 0x7fdc700a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000b5c0 tx=0x7fdc80005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:03.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.241+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdc74096480 con 0x7fdc84101260 2023-10-08T12:59:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.464+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fdc84101f30 con 0x7fdc84101260 2023-10-08T12:59:03.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.468+0000 7fdc7b7fe700 1 -- 172.21.15.5:0/2668257629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdc74099aa0 con 0x7fdc84101260 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc700a1440 msgr2=0x7fdc700a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc700a1440 0x7fdc700a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000b5c0 tx=0x7fdc80005fd0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 msgr2=0x7fdc8419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 0x7fdc8419ce80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400b530 tx=0x7fdc7400b840 comp rx=0 tx=0).stop 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 shutdown_connections 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc700a1440 0x7fdc700a3900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc841057c0 0x7fdc84196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc841008a0 0x7fdc8419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 --2- 172.21.15.5:0/2668257629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc84101260 0x7fdc8419ce80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 >> 172.21.15.5:0/2668257629 conn(0x7fdc840779e0 msgr2=0x7fdc840fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 shutdown_connections 2023-10-08T12:59:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.471+0000 7fdc8c5d6700 1 -- 172.21.15.5:0/2668257629 wait complete. 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 -- 172.21.15.5:0/3777364169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 msgr2=0x7f363c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 --2- 172.21.15.5:0/3777364169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c106b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3638009990 tx=0x7f3638009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 -- 172.21.15.5:0/3777364169 shutdown_connections 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 --2- 172.21.15.5:0/3777364169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068b30 0x7f363c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 --2- 172.21.15.5:0/3777364169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c106b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 --2- 172.21.15.5:0/3777364169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068190 0x7f363c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 -- 172.21.15.5:0/3777364169 >> 172.21.15.5:0/3777364169 conn(0x7f363c075790 msgr2=0x7f363c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 -- 172.21.15.5:0/3777364169 shutdown_connections 2023-10-08T12:59:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.550+0000 7f3643e69700 1 -- 172.21.15.5:0/3777364169 wait complete. 2023-10-08T12:59:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 Processor -- start 2023-10-08T12:59:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 -- start start 2023-10-08T12:59:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068190 0x7f363c0ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068b30 0x7f363c0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c1002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1a4f40 con 0x7f363c1067a0 2023-10-08T12:59:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1a50b0 con 0x7f363c068b30 2023-10-08T12:59:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3643e69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c1a5270 con 0x7f363c068190 2023-10-08T12:59:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3642406700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c1002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3641404700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068b30 0x7f363c0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3642406700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c1002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59696/0 (socket says 172.21.15.5:59696) 2023-10-08T12:59:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3642406700 1 -- 172.21.15.5:0/1451659632 learned_addr learned my addr 172.21.15.5:0/1451659632 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.551+0000 7f3641c05700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068190 0x7f363c0ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3642406700 1 -- 172.21.15.5:0/1451659632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068190 msgr2=0x7f363c0ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3642406700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068190 0x7f363c0ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3642406700 1 -- 172.21.15.5:0/1451659632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068b30 msgr2=0x7f363c0ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3642406700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068b30 0x7f363c0ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3642406700 1 -- 172.21.15.5:0/1451659632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36380095f0 con 0x7f363c1067a0 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3641c05700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068190 0x7f363c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3641404700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068b30 0x7f363c0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3642406700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c1002a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f363400ef30 tx=0x7f363400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634018070 con 0x7f363c1067a0 2023-10-08T12:59:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f363400f040 con 0x7f363c1067a0 2023-10-08T12:59:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363400cd00 con 0x7f363c1067a0 2023-10-08T12:59:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c1a54f0 con 0x7f363c1067a0 2023-10-08T12:59:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.552+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c1a59a0 con 0x7f363c1067a0 2023-10-08T12:59:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.553+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c108d50 con 0x7f363c1067a0 2023-10-08T12:59:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.555+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f3634003a00 con 0x7f363c1067a0 2023-10-08T12:59:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.556+0000 7f3632ffd700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36280a14c0 0x7f36280a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.556+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f36340cb660 con 0x7f363c1067a0 2023-10-08T12:59:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.556+0000 7f3641c05700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36280a14c0 0x7f36280a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.557+0000 7f3641c05700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36280a14c0 0x7f36280a3980 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f363800b2e0 tx=0x7f3638005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:03.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.562+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36340968b0 con 0x7f363c1067a0 2023-10-08T12:59:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 -- 172.21.15.5:0/2917090956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 msgr2=0x7fa3700685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 --2- 172.21.15.5:0/2917090956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700685f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009990 tx=0x7fa35c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 -- 172.21.15.5:0/2917090956 shutdown_connections 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 --2- 172.21.15.5:0/2917090956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa370068b30 0x7fa37010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 --2- 172.21.15.5:0/2917090956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701067c0 0x7fa370106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 --2- 172.21.15.5:0/2917090956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700685f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.680+0000 7fa3770aa700 1 -- 172.21.15.5:0/2917090956 >> 172.21.15.5:0/2917090956 conn(0x7fa370075790 msgr2=0x7fa370075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 -- 172.21.15.5:0/2917090956 shutdown_connections 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 -- 172.21.15.5:0/2917090956 wait complete. 2023-10-08T12:59:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 Processor -- start 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 -- start start 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa370068b30 0x7fa3700ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701067c0 0x7fa3701002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701a4f80 con 0x7fa370068190 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701a50f0 con 0x7fa370068b30 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.681+0000 7fa3770aa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3701a52b0 con 0x7fa3701067c0 2023-10-08T12:59:03.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59706/0 (socket says 172.21.15.5:59706) 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa375647700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701067c0 0x7fa3701002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 -- 172.21.15.5:0/840439724 learned_addr learned my addr 172.21.15.5:0/840439724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa36ffff700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa370068b30 0x7fa3700ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 -- 172.21.15.5:0/840439724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701067c0 msgr2=0x7fa3701002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701067c0 0x7fa3701002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 -- 172.21.15.5:0/840439724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa370068b30 msgr2=0x7fa3700ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa370068b30 0x7fa3700ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 -- 172.21.15.5:0/840439724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0095f0 con 0x7fa370068190 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa374e46700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700ff820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa36400e9a0 tx=0x7fa36400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364009790 con 0x7fa370068190 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa364010430 con 0x7fa370068190 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3701a5590 con 0x7fa370068190 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.682+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364018680 con 0x7fa370068190 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.683+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3701a5a60 con 0x7fa370068190 2023-10-08T12:59:03.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.684+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa370108de0 con 0x7fa370068190 2023-10-08T12:59:03.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.685+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fa3640105a0 con 0x7fa370068190 2023-10-08T12:59:03.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.686+0000 7fa36dffb700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa3600a1440 0x7fa3600a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:03.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.686+0000 7fa36ffff700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa3600a1440 0x7fa3600a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:03.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.686+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa364014070 con 0x7fa370068190 2023-10-08T12:59:03.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.686+0000 7fa36ffff700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa3600a1440 0x7fa3600a3900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b2e0 tx=0x7fa35c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:03.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.694+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa3640966a0 con 0x7fa370068190 2023-10-08T12:59:03.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.791+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f363c101ee0 con 0x7f363c1067a0 2023-10-08T12:59:03.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.795+0000 7f3632ffd700 1 -- 172.21.15.5:0/1451659632 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) v1 ==== 121+0+0 (secure 0 0 0) 0x7f3634099ed0 con 0x7f363c1067a0 2023-10-08T12:59:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36280a14c0 msgr2=0x7f36280a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36280a14c0 0x7f36280a3980 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f363800b2e0 tx=0x7f3638005960 comp rx=0 tx=0).stop 2023-10-08T12:59:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 msgr2=0x7f363c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c1002a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f363400ef30 tx=0x7f363400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 shutdown_connections 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36280a14c0 0x7f36280a3980 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1067a0 0x7f363c1002a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f363c068190 0x7f363c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 --2- 172.21.15.5:0/1451659632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f363c068b30 0x7f363c0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 >> 172.21.15.5:0/1451659632 conn(0x7f363c075790 msgr2=0x7f363c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.797+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 shutdown_connections 2023-10-08T12:59:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.798+0000 7f3643e69700 1 -- 172.21.15.5:0/1451659632 wait complete. 2023-10-08T12:59:03.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.902+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fa370101f00 con 0x7fa370068190 2023-10-08T12:59:03.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.906+0000 7fa36dffb700 1 -- 172.21.15.5:0/840439724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v33)=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa364099cc0 con 0x7fa370068190 2023-10-08T12:59:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa3600a1440 msgr2=0x7fa3600a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa3600a1440 0x7fa3600a3900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b2e0 tx=0x7fa35c005960 comp rx=0 tx=0).stop 2023-10-08T12:59:03.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 msgr2=0x7fa3700ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700ff820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa36400e9a0 tx=0x7fa36400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 shutdown_connections 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa3600a1440 0x7fa3600a3900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3701067c0 0x7fa3701002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa370068190 0x7fa3700ff820 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 --2- 172.21.15.5:0/840439724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa370068b30 0x7fa3700ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 >> 172.21.15.5:0/840439724 conn(0x7fa370075790 msgr2=0x7fa3700fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:03.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 shutdown_connections 2023-10-08T12:59:03.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:03.909+0000 7fa3770aa700 1 -- 172.21.15.5:0/840439724 wait complete. 2023-10-08T12:59:04.659 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi005') 2023-10-08T12:59:04.659 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi005') 2023-10-08T12:59:04.659 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi005') 2023-10-08T12:59:04.660 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi005') 2023-10-08T12:59:04.660 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi005') 2023-10-08T12:59:04.660 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f92d23c2-65d9-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2023-10-08T12:59:04.660 INFO:tasks.cephadm:Deploying OSDs... 2023-10-08T12:59:04.660 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T12:59:04.660 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:59:04.678 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:59:04.678 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 395501 Links: 1 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-08 12:57:40.830698969 +0000 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-08 12:51:46.482212070 +0000 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-08 12:51:46.482212070 +0000 2023-10-08T12:59:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-08T12:59:04.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:59:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2668257629' entity='client.admin' 2023-10-08T12:59:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1451659632' entity='client.admin' 2023-10-08T12:59:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/840439724' entity='client.admin' 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2668257629' entity='client.admin' 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1451659632' entity='client.admin' 2023-10-08T12:59:04.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/840439724' entity='client.admin' 2023-10-08T12:59:04.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-08T12:59:04.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-08T12:59:04.805 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000109679 s, 4.7 MB/s 2023-10-08T12:59:04.806 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:59:04.864 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-10-08T12:59:04.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:04.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2668257629' entity='client.admin' 2023-10-08T12:59:04.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:04.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1451659632' entity='client.admin' 2023-10-08T12:59:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/840439724' entity='client.admin' 2023-10-08T12:59:04.921 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:59:04.921 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:04.921 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 395625 Links: 1 2023-10-08T12:59:04.921 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:04.921 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:04.921 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-08 12:57:40.898697515 +0000 2023-10-08T12:59:04.922 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-08 12:51:47.000200976 +0000 2023-10-08T12:59:04.922 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-08 12:51:47.000200976 +0000 2023-10-08T12:59:04.922 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-08T12:59:04.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:59:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-08T12:59:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-08T12:59:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.5943e-05 s, 5.3 MB/s 2023-10-08T12:59:04.988 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:59:05.047 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-10-08T12:59:05.104 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:59:05.104 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 393740 Links: 1 2023-10-08T12:59:05.104 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-08 12:57:40.963696125 +0000 2023-10-08T12:59:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-08 12:51:47.496190352 +0000 2023-10-08T12:59:05.105 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-08 12:51:47.496190352 +0000 2023-10-08T12:59:05.105 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-08T12:59:05.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:59:05.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-08T12:59:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-08T12:59:05.171 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.7088e-05 s, 5.3 MB/s 2023-10-08T12:59:05.172 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:59:05.230 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-10-08T12:59:05.288 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:59:05.288 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:05.288 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 390799 Links: 1 2023-10-08T12:59:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-10-08 12:57:41.025694799 +0000 2023-10-08T12:59:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-10-08 12:51:48.010179344 +0000 2023-10-08T12:59:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-10-08 12:51:48.010179344 +0000 2023-10-08T12:59:05.289 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-10-08T12:59:05.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:59:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-10-08T12:59:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-10-08T12:59:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.9464e-05 s, 5.1 MB/s 2023-10-08T12:59:05.356 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:59:05.414 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-08T12:59:05.414 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:59:05.438 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:59:05.438 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 395302 Links: 1 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 12:58:46.993612800 +0000 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 12:51:59.758284404 +0000 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 12:51:59.758284404 +0000 2023-10-08T12:59:05.500 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T12:59:05.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:59:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T12:59:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T12:59:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000110618 s, 4.6 MB/s 2023-10-08T12:59:05.576 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:59:05.637 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-10-08T12:59:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 392484 Links: 1 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 12:58:46.993612800 +0000 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 12:52:00.268279563 +0000 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 12:52:00.268279563 +0000 2023-10-08T12:59:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T12:59:05.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:59:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T12:59:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T12:59:05.769 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000128868 s, 4.0 MB/s 2023-10-08T12:59:05.770 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:59:05.830 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 393532 Links: 1 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 12:58:46.994612791 +0000 2023-10-08T12:59:05.890 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 12:52:00.766274835 +0000 2023-10-08T12:59:05.891 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 12:52:00.766274835 +0000 2023-10-08T12:59:05.891 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T12:59:05.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:59:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T12:59:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T12:59:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000110431 s, 4.6 MB/s 2023-10-08T12:59:05.960 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:59:06.020 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-10-08T12:59:06.079 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:59:06.079 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:06.079 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 395557 Links: 1 2023-10-08T12:59:06.079 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:06.079 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:06.079 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-08 12:58:46.994612791 +0000 2023-10-08T12:59:06.080 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-08 12:52:01.275270003 +0000 2023-10-08T12:59:06.080 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-08 12:52:01.275270003 +0000 2023-10-08T12:59:06.080 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-08T12:59:06.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:59:06.147 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-08T12:59:06.147 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-08T12:59:06.147 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000112687 s, 4.5 MB/s 2023-10-08T12:59:06.148 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:59:06.207 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-08T12:59:06.207 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:59:06.229 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:59:06.229 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-10-08T12:59:06.291 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:59:06.291 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:06.291 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 384501 Links: 1 2023-10-08T12:59:06.291 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:06.291 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:06.292 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-08 12:58:44.696857923 +0000 2023-10-08T12:59:06.292 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-08 12:51:32.073469335 +0000 2023-10-08T12:59:06.292 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-08 12:51:32.073469335 +0000 2023-10-08T12:59:06.292 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-08T12:59:06.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:59:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-08T12:59:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-08T12:59:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000150133 s, 3.4 MB/s 2023-10-08T12:59:06.366 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:59:06.427 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-10-08T12:59:06.487 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 394044 Links: 1 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-08 12:58:44.696857923 +0000 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-08 12:51:32.576458153 +0000 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-08 12:51:32.576458153 +0000 2023-10-08T12:59:06.488 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-08T12:59:06.489 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:59:06.556 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-08T12:59:06.556 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-08T12:59:06.556 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000127133 s, 4.0 MB/s 2023-10-08T12:59:06.557 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:59:06.617 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-10-08T12:59:06.675 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:59:06.675 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:06.675 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 386004 Links: 1 2023-10-08T12:59:06.676 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:06.676 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:06.676 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-08 12:58:44.696857923 +0000 2023-10-08T12:59:06.676 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-08 12:51:33.078446994 +0000 2023-10-08T12:59:06.676 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-08 12:51:33.078446994 +0000 2023-10-08T12:59:06.676 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-08T12:59:06.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:59:06.739 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:06 smithi118 ceph-mon[104234]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:06.741 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-08T12:59:06.742 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-08T12:59:06.742 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000117596 s, 4.4 MB/s 2023-10-08T12:59:06.743 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:59:06.801 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-10-08T12:59:06.859 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:59:06.859 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:59:06.859 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 394861 Links: 1 2023-10-08T12:59:06.859 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:59:06.859 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:59:06.859 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-08 12:58:44.696857923 +0000 2023-10-08T12:59:06.860 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-08 12:51:33.609435189 +0000 2023-10-08T12:59:06.860 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-08 12:51:33.609435189 +0000 2023-10-08T12:59:06.860 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-08T12:59:06.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:59:06.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:06 smithi060 ceph-mon[103190]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:06.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:06 smithi005 ceph-mon[99496]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:06.924 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-08T12:59:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-08T12:59:06.925 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000110009 s, 4.7 MB/s 2023-10-08T12:59:06.926 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:59:06.984 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2023-10-08T12:59:06.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:59:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:59:08.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:08 smithi005 ceph-mon[99496]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:08 smithi118 ceph-mon[104234]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:08.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:08 smithi060 ceph-mon[103190]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:59:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:59:09.480 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-08T12:59:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-08T12:59:09.480 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00818651 s, 1.3 GB/s 2023-10-08T12:59:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-08T12:59:09.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2023-10-08T12:59:10.494 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:59:10.743 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:10 smithi005 ceph-mon[99496]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:10.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:10 smithi118 ceph-mon[104234]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:10.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:10 smithi060 ceph-mon[103190]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 -- 172.21.15.5:0/512691721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 msgr2=0x7fe47c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 --2- 172.21.15.5:0/512691721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c105ba0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe478009990 tx=0x7fe478009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 -- 172.21.15.5:0/512691721 shutdown_connections 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 --2- 172.21.15.5:0/512691721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c101260 0x7fe47c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 --2- 172.21.15.5:0/512691721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c105ba0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 --2- 172.21.15.5:0/512691721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47c1008a0 0x7fe47c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 -- 172.21.15.5:0/512691721 >> 172.21.15.5:0/512691721 conn(0x7fe47c0779e0 msgr2=0x7fe47c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 -- 172.21.15.5:0/512691721 shutdown_connections 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.718+0000 7fe48403e700 1 -- 172.21.15.5:0/512691721 wait complete. 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 Processor -- start 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 -- start start 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c1008a0 0x7fe47c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47c101260 0x7fe47c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c074ab0 con 0x7fe47c1057c0 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1a9590 con 0x7fe47c101260 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe48403e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1a9750 con 0x7fe47c1008a0 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe481dda700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c1008a0 0x7fe47c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59722/0 (socket says 172.21.15.5:59722) 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 -- 172.21.15.5:0/1072236770 learned_addr learned my addr 172.21.15.5:0/1072236770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4815d9700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47c101260 0x7fe47c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 -- 172.21.15.5:0/1072236770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c1008a0 msgr2=0x7fe47c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c1008a0 0x7fe47c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 -- 172.21.15.5:0/1072236770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47c101260 msgr2=0x7fe47c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47c101260 0x7fe47c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.719+0000 7fe4825db700 1 -- 172.21.15.5:0/1072236770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780095f0 con 0x7fe47c1057c0 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.720+0000 7fe4825db700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c073570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe474007f10 tx=0x7fe47400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.720+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474017070 con 0x7fe47c1057c0 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.720+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe47400f040 con 0x7fe47c1057c0 2023-10-08T12:59:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.720+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c1a9a30 con 0x7fe47c1057c0 2023-10-08T12:59:11.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.720+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474005580 con 0x7fe47c1057c0 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.720+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c1a9f30 con 0x7fe47c1057c0 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.721+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c108d80 con 0x7fe47c1057c0 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.722+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fe474004ad0 con 0x7fe47c1057c0 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.722+0000 7fe472ffd700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe4680a14c0 0x7fe4680a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.723+0000 7fe481dda700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe4680a14c0 0x7fe4680a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.723+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe4740ca6c0 con 0x7fe47c1057c0 2023-10-08T12:59:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.723+0000 7fe481dda700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe4680a14c0 0x7fe4680a3980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe478006010 tx=0x7fe478005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.727+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe474095920 con 0x7fe47c1057c0 2023-10-08T12:59:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:11.937+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe47c073fd0 con 0x7fe4680a14c0 2023-10-08T12:59:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:12 smithi118 ceph-mon[104234]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:12.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:12.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:12.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:12 smithi005 ceph-mon[99496]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:12.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:12.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:12.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:12.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:12 smithi060 ceph-mon[103190]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:12.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:12.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:12.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:13.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:13 smithi118 ceph-mon[104234]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:13.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:13 smithi060 ceph-mon[103190]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:13.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:13 smithi005 ceph-mon[99496]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:14 smithi118 ceph-mon[104234]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:14 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2883287086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55c71842-5a9c-458b-ae21-0a86b2d745b9"}]: dispatch 2023-10-08T12:59:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:14 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2883287086' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55c71842-5a9c-458b-ae21-0a86b2d745b9"}]': finished 2023-10-08T12:59:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:14 smithi118 ceph-mon[104234]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:59:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:14 smithi060 ceph-mon[103190]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:14 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2883287086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55c71842-5a9c-458b-ae21-0a86b2d745b9"}]: dispatch 2023-10-08T12:59:14.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:14 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2883287086' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55c71842-5a9c-458b-ae21-0a86b2d745b9"}]': finished 2023-10-08T12:59:14.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:14 smithi060 ceph-mon[103190]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:59:14.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:14.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:14 smithi005 ceph-mon[99496]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:14.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:14 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2883287086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55c71842-5a9c-458b-ae21-0a86b2d745b9"}]: dispatch 2023-10-08T12:59:14.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:14 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2883287086' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55c71842-5a9c-458b-ae21-0a86b2d745b9"}]': finished 2023-10-08T12:59:14.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:14 smithi005 ceph-mon[99496]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:59:14.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:15.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:15 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/401989807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:15.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:15 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/401989807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:15.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:15 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/401989807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:16.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:16 smithi118 ceph-mon[104234]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:16 smithi060 ceph-mon[103190]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:16.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:16 smithi005 ceph-mon[99496]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:18.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:18 smithi118 ceph-mon[104234]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:18 smithi060 ceph-mon[103190]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:18.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:18 smithi005 ceph-mon[99496]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:20.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:20 smithi118 ceph-mon[104234]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:20.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:20 smithi005 ceph-mon[99496]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:20.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:20 smithi060 ceph-mon[103190]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:21.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:59:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:21 smithi118 ceph-mon[104234]: Deploying daemon osd.0 on smithi005 2023-10-08T12:59:21.846 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:59:21.846 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:21.846 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:21 smithi005 ceph-mon[99496]: Deploying daemon osd.0 on smithi005 2023-10-08T12:59:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:59:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:21 smithi060 ceph-mon[103190]: Deploying daemon osd.0 on smithi005 2023-10-08T12:59:22.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:22 smithi118 ceph-mon[104234]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:22.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:22 smithi005 ceph-mon[99496]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:22.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:22 smithi060 ceph-mon[103190]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:24.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:24 smithi005 ceph-mon[99496]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:24.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:24 smithi118 ceph-mon[104234]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:24.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:24 smithi060 ceph-mon[103190]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:26.637 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:26 smithi005 ceph-mon[99496]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:26.637 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:26.638 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:26.638 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:26.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:26 smithi118 ceph-mon[104234]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:26.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:26 smithi060 ceph-mon[103190]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:26.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:26.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:26.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.241+0000 7fe472ffd700 1 -- 172.21.15.5:0/1072236770 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe47c073fd0 con 0x7fe4680a14c0 2023-10-08T12:59:28.242 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2023-10-08T12:59:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe4680a14c0 msgr2=0x7fe4680a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe4680a14c0 0x7fe4680a3980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe478006010 tx=0x7fe478005960 comp rx=0 tx=0).stop 2023-10-08T12:59:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 msgr2=0x7fe47c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c073570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe474007f10 tx=0x7fe47400d3b0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 shutdown_connections 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe4680a14c0 0x7fe4680a3980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c1057c0 0x7fe47c073570 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c1008a0 0x7fe47c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 --2- 172.21.15.5:0/1072236770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe47c101260 0x7fe47c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 >> 172.21.15.5:0/1072236770 conn(0x7fe47c0779e0 msgr2=0x7fe47c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 shutdown_connections 2023-10-08T12:59:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T12:59:28.243+0000 7fe48403e700 1 -- 172.21.15.5:0/1072236770 wait complete. 2023-10-08T12:59:28.708 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-08T12:59:28.710 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_4... 2023-10-08T12:59:28.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:59:28.742 INFO:journalctl@ceph.osd.0.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:28.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:59:29.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:29 smithi005 ceph-mon[99496]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:59:29.672 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 12:59:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0[125668]: 2023-10-08T12:59:29.419+0000 7fa9467ff640 -1 osd.0 0 log_to_monitors true 2023-10-08T12:59:29.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:29 smithi060 ceph-mon[103190]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:59:30.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:29 smithi118 ceph-mon[104234]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:59:30.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:30 smithi060 ceph-mon[103190]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:30.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:30 smithi060 ceph-mon[103190]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:59:30.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:30 smithi060 ceph-mon[103190]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:59:30.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:30 smithi060 ceph-mon[103190]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T12:59:30.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:30 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:30.995 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0[125668]: 2023-10-08T12:59:30.674+0000 7fa93be76700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T12:59:30.995 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0[125668]: 2023-10-08T12:59:30.677+0000 7fa936c69700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:59:30.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-mon[99496]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:30.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-mon[99496]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:59:30.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-mon[99496]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:59:30.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-mon[99496]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T12:59:30.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:30 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:31.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:30 smithi118 ceph-mon[104234]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:31.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:30 smithi118 ceph-mon[104234]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:59:31.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:30 smithi118 ceph-mon[104234]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:59:31.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:30 smithi118 ceph-mon[104234]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T12:59:31.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:30 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-08T12:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-08T12:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00819937 s, 1.3 GB/s 2023-10-08T12:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-08T12:59:31.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2023-10-08T12:59:31.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:31.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:32.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:32.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.097 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:59:32.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:32.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:32.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:32.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T12:59:32.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T12:59:32.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:32.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi005 2023-10-08T12:59:32.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi005 to 17173M 2023-10-08T12:59:32.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:32.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] boot 2023-10-08T12:59:32.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:59:32.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:32 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:33.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi005 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi005 to 17173M 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] boot 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:59:33.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:32 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:33.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi005 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi005 to 17173M 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: osd.0 [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] boot 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:59:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:32 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:59:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 -- 172.21.15.60:0/2870527255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa8100c60 msgr2=0x7fefa810c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2870527255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa8100c60 0x7fefa810c5c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fefa000b0a0 tx=0x7fefa000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:59:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 -- 172.21.15.60:0/2870527255 shutdown_connections 2023-10-08T12:59:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2870527255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa8100c60 0x7fefa810c5c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2870527255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 0x7fefa8104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2870527255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefa81002a0 0x7fefa8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 -- 172.21.15.60:0/2870527255 >> 172.21.15.60:0/2870527255 conn(0x7fefa8074a10 msgr2=0x7fefa8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 -- 172.21.15.60:0/2870527255 shutdown_connections 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.284+0000 7fefaf79d700 1 -- 172.21.15.60:0/2870527255 wait complete. 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 Processor -- start 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 -- start start 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 0x7fefa8196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefa8100c60 0x7fefa81972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 0x7fefa819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa819bc70 con 0x7fefa8104720 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa819bde0 con 0x7fefa81002a0 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefaf79d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa819bfa0 con 0x7fefa8100c60 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 0x7fefa8196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:33.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 0x7fefa8196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43594/0 (socket says 172.21.15.60:43594) 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 -- 172.21.15.60:0/2827453075 learned_addr learned my addr 172.21.15.60:0/2827453075 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefacd38700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefa8100c60 0x7fefa81972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefadd3a700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 0x7fefa819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 -- 172.21.15.60:0/2827453075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefa8100c60 msgr2=0x7fefa81972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefa8100c60 0x7fefa81972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 -- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 msgr2=0x7fefa819b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 0x7fefa819b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefad539700 1 -- 172.21.15.60:0/2827453075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0009d00 con 0x7fefa81002a0 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.285+0000 7fefadd3a700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 0x7fefa819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.286+0000 7fefad539700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 0x7fefa8196d70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefa400c920 tx=0x7fefa400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.286+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4007b00 con 0x7fefa81002a0 2023-10-08T12:59:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.286+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefa400ce70 con 0x7fefa81002a0 2023-10-08T12:59:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.286+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40054e0 con 0x7fefa81002a0 2023-10-08T12:59:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.286+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa819c280 con 0x7fefa81002a0 2023-10-08T12:59:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.286+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa81a3ae0 con 0x7fefa81002a0 2023-10-08T12:59:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.287+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8067d10 con 0x7fefa81002a0 2023-10-08T12:59:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.288+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fefa4004750 con 0x7fefa81002a0 2023-10-08T12:59:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.289+0000 7fef9e7fc700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fef940a14c0 0x7fef940a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.289+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fefa40cb250 con 0x7fefa81002a0 2023-10-08T12:59:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.289+0000 7fefacd38700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fef940a14c0 0x7fef940a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.290+0000 7fefacd38700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fef940a14c0 0x7fef940a3980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fefa81982d0 tx=0x7fef9800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:33.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.292+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fefa40962d0 con 0x7fefa81002a0 2023-10-08T12:59:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:33.499+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fefa810f6a0 con 0x7fef940a14c0 2023-10-08T12:59:34.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:33 smithi118 ceph-mon[104234]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:59:34.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:34.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:34.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:34.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:33 smithi060 ceph-mon[103190]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:59:34.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:34.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:34.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:33 smithi005 ceph-mon[99496]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:59:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:34.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:34 smithi060 ceph-mon[103190]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:34.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:34 smithi060 ceph-mon[103190]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:35.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:34 smithi118 ceph-mon[104234]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:35.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:34 smithi118 ceph-mon[104234]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:35.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:34 smithi005 ceph-mon[99496]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:35.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:34 smithi005 ceph-mon[99496]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:37.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:37.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/3088889300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]: dispatch 2023-10-08T12:59:37.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]: dispatch 2023-10-08T12:59:37.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]': finished 2023-10-08T12:59:37.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:59:37.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:37.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/2655438055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/3088889300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]: dispatch 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]: dispatch 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]': finished 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/2655438055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:37.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:37.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/3088889300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]: dispatch 2023-10-08T12:59:37.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]: dispatch 2023-10-08T12:59:37.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fccf574-a553-42c0-b7d8-1a606c9afa40"}]': finished 2023-10-08T12:59:37.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:59:37.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:37.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/2655438055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:39.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:38 smithi118 ceph-mon[104234]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:39.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:38 smithi060 ceph-mon[103190]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:39.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:38 smithi005 ceph-mon[99496]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:40 smithi060 ceph-mon[103190]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:41.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:40 smithi118 ceph-mon[104234]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:41.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:40 smithi005 ceph-mon[99496]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:42.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:42 smithi060 ceph-mon[103190]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:42.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:59:42.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:43.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:42 smithi118 ceph-mon[104234]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:43.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:59:43.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:43.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:42 smithi005 ceph-mon[99496]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:43.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:59:43.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:43.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:43 smithi060 ceph-mon[103190]: Deploying daemon osd.1 on smithi060 2023-10-08T12:59:44.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:43 smithi118 ceph-mon[104234]: Deploying daemon osd.1 on smithi060 2023-10-08T12:59:44.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:43 smithi005 ceph-mon[99496]: Deploying daemon osd.1 on smithi060 2023-10-08T12:59:45.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:44 smithi118 ceph-mon[104234]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:45.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:44 smithi060 ceph-mon[103190]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:45.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:44 smithi005 ceph-mon[99496]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:46.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:46 smithi060 ceph-mon[103190]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:47.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:46 smithi118 ceph-mon[104234]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:47.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:46 smithi005 ceph-mon[99496]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:48.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:48.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:48.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:48.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:47 smithi060 ceph-mon[103190]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:48.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:48.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:48.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:48.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:47 smithi118 ceph-mon[104234]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:47 smithi005 ceph-mon[99496]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2023-10-08T12:59:49.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.730+0000 7fef9e7fc700 1 -- 172.21.15.60:0/2827453075 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fefa810f6a0 con 0x7fef940a14c0 2023-10-08T12:59:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fef940a14c0 msgr2=0x7fef940a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fef940a14c0 0x7fef940a3980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fefa81982d0 tx=0x7fef9800a300 comp rx=0 tx=0).stop 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 msgr2=0x7fefa8196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 0x7fefa8196d70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefa400c920 tx=0x7fefa400cc30 comp rx=0 tx=0).stop 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 shutdown_connections 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fef940a14c0 0x7fef940a3980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8104720 0x7fefa819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefa81002a0 0x7fefa8196d70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 --2- 172.21.15.60:0/2827453075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefa8100c60 0x7fefa81972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 >> 172.21.15.60:0/2827453075 conn(0x7fefa8074a10 msgr2=0x7fefa8103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 shutdown_connections 2023-10-08T12:59:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T12:59:49.733+0000 7fefaf79d700 1 -- 172.21.15.60:0/2827453075 wait complete. 2023-10-08T12:59:50.197 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-08T12:59:50.199 INFO:tasks.cephadm:Deploying osd.2 on smithi118 with /dev/vg_nvme/lv_4... 2023-10-08T12:59:50.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:59:50.234 INFO:journalctl@ceph.osd.1.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T12:59:50.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:50.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:50.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:50.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:50.769 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:59:51.024 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 12:59:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1[109411]: 2023-10-08T12:59:50.939+0000 7f608e015640 -1 osd.1 0 log_to_monitors true 2023-10-08T12:59:51.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:51 smithi118 ceph-mon[104234]: from='osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:59:51.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:51 smithi118 ceph-mon[104234]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:59:51.300 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:51 smithi060 ceph-mon[103190]: from='osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:59:51.300 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:51 smithi060 ceph-mon[103190]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:59:51.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:51 smithi005 ceph-mon[99496]: from='osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:59:51.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:51 smithi005 ceph-mon[99496]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:59:52.403 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:59:52.403 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:59:52.403 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-08T12:59:52.403 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-08T12:59:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00814048 s, 1.3 GB/s 2023-10-08T12:59:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-08T12:59:52.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:52 smithi005 ceph-mon[99496]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:52 smithi005 ceph-mon[99496]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:59:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:52 smithi005 ceph-mon[99496]: from='osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T12:59:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:52 smithi005 ceph-mon[99496]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:59:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:52 smithi005 ceph-mon[99496]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T12:59:52.438 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:52 smithi118 ceph-mon[104234]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:52.438 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:52 smithi118 ceph-mon[104234]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:59:52.438 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:52 smithi118 ceph-mon[104234]: from='osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T12:59:52.438 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:52 smithi118 ceph-mon[104234]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:59:52.438 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:52.438 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:52 smithi118 ceph-mon[104234]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T12:59:52.522 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1[109411]: 2023-10-08T12:59:52.160+0000 7f608368c700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T12:59:52.522 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1[109411]: 2023-10-08T12:59:52.165+0000 7f607d47d700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:59:52.523 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-mon[103190]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:52.523 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-mon[103190]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:59:52.523 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-mon[103190]: from='osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T12:59:52.523 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-mon[103190]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:59:52.523 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:52.523 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:52 smithi060 ceph-mon[103190]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T12:59:52.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_4 2023-10-08T12:59:53.363 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:59:53.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:53.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:53.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:53.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T12:59:54.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T12:59:54.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T12:59:54.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi060 2023-10-08T12:59:54.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi060 to 17173M 2023-10-08T12:59:54.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:54.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] boot 2023-10-08T12:59:54.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:59:54.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:54.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi060 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi060 to 17173M 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] boot 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:59:54.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:54.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi060 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi060 to 17173M 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: osd.1 [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] boot 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:59:54.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2884953125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ffb50 msgr2=0x7ff1c410bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2884953125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ffb50 0x7ff1c410bd10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b0a0 tx=0x7ff1bc00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2884953125 shutdown_connections 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2884953125 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ffb50 0x7ff1c410bd10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2884953125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4103e70 0x7ff1c4104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2884953125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c40ff190 0x7ff1c40ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2884953125 >> 172.21.15.118:0/2884953125 conn(0x7ff1c4074a10 msgr2=0x7ff1c4074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2884953125 shutdown_connections 2023-10-08T12:59:54.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2884953125 wait complete. 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 Processor -- start 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.679+0000 7ff1c9b0e700 1 -- start start 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 0x7ff1c4195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c40ffb50 0x7ff1c4196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c4103e70 0x7ff1c4199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4199b40 con 0x7ff1c40ffb50 2023-10-08T12:59:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4199cb0 con 0x7ff1c4103e70 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4199e70 con 0x7ff1c40ff190 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 0x7ff1c4195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 0x7ff1c4195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45528/0 (socket says 172.21.15.118:45528) 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 -- 172.21.15.118:0/2719523906 learned_addr learned my addr 172.21.15.118:0/2719523906 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c2ffd700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c40ffb50 0x7ff1c4196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c3fff700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c4103e70 0x7ff1c4199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 -- 172.21.15.118:0/2719523906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c4103e70 msgr2=0x7ff1c4199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c4103e70 0x7ff1c4199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 -- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c40ffb50 msgr2=0x7ff1c4196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c40ffb50 0x7ff1c4196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:54.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 -- 172.21.15.118:0/2719523906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc009d00 con 0x7ff1c40ff190 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c3fff700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c4103e70 0x7ff1c4199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c37fe700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 0x7ff1c4195d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400b500 tx=0x7ff1b400b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4011830 con 0x7ff1c40ff190 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c419a150 con 0x7ff1c40ff190 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1b4011e50 con 0x7ff1c40ff190 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400f2e0 con 0x7ff1c40ff190 2023-10-08T12:59:54.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.680+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c41a2aa0 con 0x7ff1c40ff190 2023-10-08T12:59:54.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.681+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4107440 con 0x7ff1c40ff190 2023-10-08T12:59:54.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.682+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7ff1b4010580 con 0x7ff1c40ff190 2023-10-08T12:59:54.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.683+0000 7ff1c0ff9700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1ac0a1540 0x7ff1ac0a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:54.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.683+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2524+0+0 (secure 0 0 0) 0x7ff1b40cb010 con 0x7ff1c40ff190 2023-10-08T12:59:54.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.683+0000 7ff1c2ffd700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1ac0a1540 0x7ff1ac0a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:54.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.684+0000 7ff1c2ffd700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1ac0a1540 0x7ff1ac0a3a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4197220 tx=0x7ff1b8009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:54.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.687+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff1b4095d50 con 0x7ff1c40ff190 2023-10-08T12:59:54.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T12:59:54.882+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1c4196fd0 con 0x7ff1ac0a1540 2023-10-08T12:59:55.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:55 smithi118 ceph-mon[104234]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:59:55.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:55 smithi118 ceph-mon[104234]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:55.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:55.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:55.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:55 smithi060 ceph-mon[103190]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:59:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:55 smithi060 ceph-mon[103190]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:55.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:55 smithi005 ceph-mon[99496]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:59:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:55 smithi005 ceph-mon[99496]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:59:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:59:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:59:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:56.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:56 smithi118 ceph-mon[104234]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:59:56.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:56 smithi060 ceph-mon[103190]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:59:56.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:56 smithi005 ceph-mon[99496]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:59:57.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:57 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/3747824542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]: dispatch 2023-10-08T12:59:57.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:57 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]: dispatch 2023-10-08T12:59:57.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:57 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]': finished 2023-10-08T12:59:57.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:57 smithi118 ceph-mon[104234]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:59:57.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:59:57.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:57 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/3747824542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]: dispatch 2023-10-08T12:59:57.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:57 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]: dispatch 2023-10-08T12:59:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:57 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]': finished 2023-10-08T12:59:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:57 smithi060 ceph-mon[103190]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:59:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:59:57.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:57 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/3747824542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]: dispatch 2023-10-08T12:59:57.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:57 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]: dispatch 2023-10-08T12:59:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:57 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c012ac5-5677-47b6-8f91-a6146c53d52d"}]': finished 2023-10-08T12:59:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:57 smithi005 ceph-mon[99496]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:59:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:59:58.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:58 smithi118 ceph-mon[104234]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:59:58.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 12:59:58 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/1735265618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:58.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:58 smithi060 ceph-mon[103190]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:59:58.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 12:59:58 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/1735265618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:59:58.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:58 smithi005 ceph-mon[99496]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:59:58.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 12:59:58 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/1735265618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:00.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:00 smithi118 ceph-mon[104234]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:00.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:00 smithi118 ceph-mon[104234]: overall HEALTH_OK 2023-10-08T13:00:00.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:00 smithi060 ceph-mon[103190]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:00.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:00 smithi060 ceph-mon[103190]: overall HEALTH_OK 2023-10-08T13:00:00.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:00 smithi005 ceph-mon[99496]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:00.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:00 smithi005 ceph-mon[99496]: overall HEALTH_OK 2023-10-08T13:00:02.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:02 smithi118 ceph-mon[104234]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:02.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:02 smithi060 ceph-mon[103190]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:02.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:02 smithi005 ceph-mon[99496]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:04 smithi005 ceph-mon[99496]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T13:00:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:04 smithi005 ceph-mon[99496]: Deploying daemon osd.2 on smithi118 2023-10-08T13:00:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:04 smithi118 ceph-mon[104234]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T13:00:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:04 smithi118 ceph-mon[104234]: Deploying daemon osd.2 on smithi118 2023-10-08T13:00:04.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:04 smithi060 ceph-mon[103190]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T13:00:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:04.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:04 smithi060 ceph-mon[103190]: Deploying daemon osd.2 on smithi118 2023-10-08T13:00:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:06 smithi118 ceph-mon[104234]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:06.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:06 smithi060 ceph-mon[103190]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:06.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:06 smithi005 ceph-mon[99496]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:08 smithi118 ceph-mon[104234]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:08 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:08 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:08 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:08.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:08 smithi060 ceph-mon[103190]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:08.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:08 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:08 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:08 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:08.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:08 smithi005 ceph-mon[99496]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:08.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:08 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:08 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:08 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:10.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:10 smithi118 ceph-mon[104234]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:10.794 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.794 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.794 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:10.795 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:10.795 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:10 smithi060 ceph-mon[103190]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:10 smithi005 ceph-mon[99496]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:10.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:10.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:10.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:10.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:11.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.346+0000 7ff1c0ff9700 1 -- 172.21.15.118:0/2719523906 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff1c4196fd0 con 0x7ff1ac0a1540 2023-10-08T13:00:11.349 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 2 on host 'smithi118' 2023-10-08T13:00:11.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1ac0a1540 msgr2=0x7ff1ac0a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:11.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1ac0a1540 0x7ff1ac0a3a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4197220 tx=0x7ff1b8009190 comp rx=0 tx=0).stop 2023-10-08T13:00:11.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 msgr2=0x7ff1c4195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:11.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 0x7ff1c4195d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400b500 tx=0x7ff1b400b810 comp rx=0 tx=0).stop 2023-10-08T13:00:11.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 shutdown_connections 2023-10-08T13:00:11.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1ac0a1540 0x7ff1ac0a3a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:11.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c4103e70 0x7ff1c4199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:11.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1c40ff190 0x7ff1c4195d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:11.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 --2- 172.21.15.118:0/2719523906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c40ffb50 0x7ff1c4196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:11.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 >> 172.21.15.118:0/2719523906 conn(0x7ff1c4074a10 msgr2=0x7ff1c40fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:11.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.348+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 shutdown_connections 2023-10-08T13:00:11.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:00:11.349+0000 7ff1c9b0e700 1 -- 172.21.15.118:0/2719523906 wait complete. 2023-10-08T13:00:11.748 DEBUG:teuthology.orchestra.run.smithi118:osd.2> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-08T13:00:11.751 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_3... 2023-10-08T13:00:11.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T13:00:11.779 INFO:journalctl@ceph.osd.2.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:00:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:00:12.519 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2[111295]: 2023-10-08T13:00:12.142+0000 7f4d2ca8e640 -1 osd.2 0 log_to_monitors true 2023-10-08T13:00:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-mon[104234]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-mon[104234]: from='osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:00:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:12 smithi118 ceph-mon[104234]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:00:12.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:12 smithi005 ceph-mon[99496]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:12.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:12.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:12.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:12.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:12 smithi005 ceph-mon[99496]: from='osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:00:12.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:12 smithi005 ceph-mon[99496]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:00:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:12 smithi060 ceph-mon[103190]: pgmap v51: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:12.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:12.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:12.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:12.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:12 smithi060 ceph-mon[103190]: from='osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:00:12.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:12 smithi060 ceph-mon[103190]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:00:13.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-mon[104234]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T13:00:13.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-mon[104234]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T13:00:13.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:13.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-mon[104234]: from='osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:00:13.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-mon[104234]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:00:13.772 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2[111295]: 2023-10-08T13:00:13.511+0000 7f4d22105700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T13:00:13.772 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2[111295]: 2023-10-08T13:00:13.514+0000 7f4d19ef2700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:00:13.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:13 smithi060 ceph-mon[103190]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T13:00:13.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:13 smithi060 ceph-mon[103190]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T13:00:13.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:13 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:13.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:13 smithi060 ceph-mon[103190]: from='osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:00:13.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:13 smithi060 ceph-mon[103190]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:00:13.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:13 smithi005 ceph-mon[99496]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T13:00:13.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:13 smithi005 ceph-mon[99496]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T13:00:13.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:13 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:13.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:13 smithi005 ceph-mon[99496]: from='osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:00:13.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:13 smithi005 ceph-mon[99496]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:00:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T13:00:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T13:00:13.926 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-08T13:00:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-08T13:00:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00824208 s, 1.3 GB/s 2023-10-08T13:00:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-08T13:00:14.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2023-10-08T13:00:14.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:14 smithi005 ceph-mon[99496]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:14.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:14 smithi005 ceph-mon[99496]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:00:14.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:14 smithi005 ceph-mon[99496]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T13:00:14.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:14.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:14 smithi118 ceph-mon[104234]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:14 smithi118 ceph-mon[104234]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:00:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:14 smithi118 ceph-mon[104234]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T13:00:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:14 smithi060 ceph-mon[103190]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:14 smithi060 ceph-mon[103190]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:00:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:14 smithi060 ceph-mon[103190]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T13:00:14.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:14.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:00:15.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] boot 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi118 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi118 to 17168M 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:15.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:15.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:15 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] boot 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi118 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:15.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi118 to 17168M 2023-10-08T13:00:15.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:15.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:15.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:15.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:15 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:16.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: osd.2 [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] boot 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi118 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi118 to 17168M 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:16.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:15 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 -- 172.21.15.5:0/4247197121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c1008a0 msgr2=0x7fa91c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 --2- 172.21.15.5:0/4247197121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c1008a0 0x7fa91c100d20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa908009990 tx=0x7fa908009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 -- 172.21.15.5:0/4247197121 shutdown_connections 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 --2- 172.21.15.5:0/4247197121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c101260 0x7fa91c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 --2- 172.21.15.5:0/4247197121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa91c1057c0 0x7fa91c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 --2- 172.21.15.5:0/4247197121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c1008a0 0x7fa91c100d20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 -- 172.21.15.5:0/4247197121 >> 172.21.15.5:0/4247197121 conn(0x7fa91c0779e0 msgr2=0x7fa91c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 -- 172.21.15.5:0/4247197121 shutdown_connections 2023-10-08T13:00:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.180+0000 7fa922ce8700 1 -- 172.21.15.5:0/4247197121 wait complete. 2023-10-08T13:00:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 Processor -- start 2023-10-08T13:00:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 -- start start 2023-10-08T13:00:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c1008a0 0x7fa91c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 0x7fa91c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:16.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa91c1057c0 0x7fa91c196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c1970f0 con 0x7fa91c101260 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c197260 con 0x7fa91c1008a0 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa922ce8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c197420 con 0x7fa91c1057c0 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 0x7fa91c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 0x7fa91c19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59792/0 (socket says 172.21.15.5:59792) 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.181+0000 7fa91bfff700 1 -- 172.21.15.5:0/3805784606 learned_addr learned my addr 172.21.15.5:0/3805784606 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:00:16.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa920a84700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c1008a0 0x7fa91c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa921285700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa91c1057c0 0x7fa91c196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa91bfff700 1 -- 172.21.15.5:0/3805784606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa91c1057c0 msgr2=0x7fa91c196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa91bfff700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa91c1057c0 0x7fa91c196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa91bfff700 1 -- 172.21.15.5:0/3805784606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c1008a0 msgr2=0x7fa91c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa91bfff700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c1008a0 0x7fa91c19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa91bfff700 1 -- 172.21.15.5:0/3805784606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080095f0 con 0x7fa91c101260 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa920a84700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c1008a0 0x7fa91c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa91bfff700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 0x7fa91c19ce90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9080098e0 tx=0x7fa90800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90801d070 con 0x7fa91c101260 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa90800fb90 con 0x7fa91c101260 2023-10-08T13:00:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c1976a0 con 0x7fa91c101260 2023-10-08T13:00:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908017650 con 0x7fa91c101260 2023-10-08T13:00:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.182+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c1a3940 con 0x7fa91c101260 2023-10-08T13:00:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.183+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c108da0 con 0x7fa91c101260 2023-10-08T13:00:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.184+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fa90800fd00 con 0x7fa91c101260 2023-10-08T13:00:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.185+0000 7fa919ffb700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa90c0a1440 0x7fa90c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.185+0000 7fa920a84700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa90c0a1440 0x7fa90c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.185+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3441+0+0 (secure 0 0 0) 0x7fa9080cceb0 con 0x7fa91c101260 2023-10-08T13:00:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.185+0000 7fa920a84700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa90c0a1440 0x7fa90c0a3900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa910005fd0 tx=0x7fa910005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.189+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa9080978e0 con 0x7fa91c101260 2023-10-08T13:00:16.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:16.394+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa91c197f50 con 0x7fa90c0a1440 2023-10-08T13:00:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:00:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:00:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:00:16.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:16.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:00:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:17.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:00:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:17.496 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131387]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:00:17.497 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131387]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:17.497 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131387]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:17.497 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131387]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:17.679+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fa908097cb0 con 0x7fa91c101260 2023-10-08T13:00:17.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:17 smithi005 ceph-mon[99496]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:17.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:00:17.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:17 smithi005 ceph-mon[99496]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T13:00:17.758 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131425]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:00:17.758 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131425]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:17.758 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131425]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:17.758 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:00:17 smithi005 sudo[131425]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:18.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:17 smithi118 ceph-mon[104234]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:18.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:00:18.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:17 smithi118 ceph-mon[104234]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T13:00:18.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:17 smithi060 ceph-mon[103190]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:18.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:00:18.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:17 smithi060 ceph-mon[103190]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T13:00:18.610 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114213]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:00:18.610 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114213]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:18.610 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114213]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:18.611 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114213]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:18 smithi060 ceph-mon[103190]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:18 smithi060 ceph-mon[103190]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T13:00:18.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:18 smithi060 ceph-mon[103190]: mgrmap e20: x(active, since 100s), standbys: z, y 2023-10-08T13:00:18.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:18.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:18.909 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114216]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:00:18.909 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114216]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:18.909 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114216]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:18.909 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:00:18 smithi060 sudo[114216]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:19.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:18 smithi118 ceph-mon[104234]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:18 smithi118 ceph-mon[104234]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T13:00:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:18 smithi118 ceph-mon[104234]: mgrmap e20: x(active, since 100s), standbys: z, y 2023-10-08T13:00:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:19.020 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:18 smithi118 sudo[116114]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:00:19.020 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:18 smithi118 sudo[116114]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:19.020 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:18 smithi118 sudo[116114]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:19.020 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:18 smithi118 sudo[116114]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:19.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:18 smithi005 ceph-mon[99496]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:19.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:18 smithi005 ceph-mon[99496]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T13:00:19.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:18 smithi005 ceph-mon[99496]: mgrmap e20: x(active, since 100s), standbys: z, y 2023-10-08T13:00:19.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:19.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:19.519 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:19 smithi118 sudo[116117]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:00:19.519 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:19 smithi118 sudo[116117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:19.519 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:19 smithi118 sudo[116117]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:19.520 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:00:19 smithi118 sudo[116117]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:19.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:19 smithi005 sudo[131550]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:00:19.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:19 smithi005 sudo[131550]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:19.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:19 smithi005 sudo[131550]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:19.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:19 smithi005 sudo[131550]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1765700918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc8a556-63b4-44c7-92e7-0ab83f45b580"}]: dispatch 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1765700918' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcc8a556-63b4-44c7-92e7-0ab83f45b580"}]': finished 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 ceph-mon[104234]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 ceph-mon[104234]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116120]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116120]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:20.311 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116120]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:20.312 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116120]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:20.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1765700918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc8a556-63b4-44c7-92e7-0ab83f45b580"}]: dispatch 2023-10-08T13:00:20.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1765700918' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcc8a556-63b4-44c7-92e7-0ab83f45b580"}]': finished 2023-10-08T13:00:20.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 ceph-mon[103190]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T13:00:20.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:20.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:20.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 ceph-mon[103190]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:20.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 sudo[131553]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:00:20.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 sudo[131553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:20.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 sudo[131553]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:20.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 sudo[131553]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:20.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1765700918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc8a556-63b4-44c7-92e7-0ab83f45b580"}]: dispatch 2023-10-08T13:00:20.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1765700918' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcc8a556-63b4-44c7-92e7-0ab83f45b580"}]': finished 2023-10-08T13:00:20.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 ceph-mon[99496]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T13:00:20.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:20.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:20.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:20 smithi005 ceph-mon[99496]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:20.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116123]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:00:20.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:20.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116123]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:20.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:20 smithi118 sudo[116123]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:21.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 sudo[114219]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:00:21.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 sudo[114219]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:21.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:20 smithi060 sudo[114219]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:21.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 sudo[114219]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:21.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2085929151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 sudo[114222]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 sudo[114222]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 sudo[114222]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 sudo[114222]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2085929151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:21.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2085929151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:00:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:00:21.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:00:22.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:22 smithi118 ceph-mon[104234]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:22.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:22 smithi118 ceph-mon[104234]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:22.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:22 smithi118 ceph-mon[104234]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:22.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:22 smithi060 ceph-mon[103190]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:22.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:22 smithi060 ceph-mon[103190]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:22.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:22 smithi060 ceph-mon[103190]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:22.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:22 smithi005 ceph-mon[99496]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:00:22.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:22 smithi005 ceph-mon[99496]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:22 smithi005 ceph-mon[99496]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:00:24.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:24 smithi005 ceph-mon[99496]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:24.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:24 smithi118 ceph-mon[104234]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:24.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:24 smithi060 ceph-mon[103190]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:26.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:26 smithi118 ceph-mon[104234]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T13:00:26.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T13:00:26.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:26.838 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:26 smithi005 ceph-mon[99496]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T13:00:26.839 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T13:00:26.839 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:26.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:26 smithi060 ceph-mon[103190]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T13:00:26.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T13:00:26.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:27.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:27 smithi005 ceph-mon[99496]: Deploying daemon osd.3 on smithi005 2023-10-08T13:00:27.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:27 smithi118 ceph-mon[104234]: Deploying daemon osd.3 on smithi005 2023-10-08T13:00:27.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:27 smithi060 ceph-mon[103190]: Deploying daemon osd.3 on smithi005 2023-10-08T13:00:28.659 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:28 smithi005 ceph-mon[99496]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T13:00:28.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:28 smithi118 ceph-mon[104234]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T13:00:28.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:28 smithi060 ceph-mon[103190]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T13:00:30.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:30 smithi005 ceph-mon[99496]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T13:00:30.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:30 smithi118 ceph-mon[104234]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T13:00:30.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:30 smithi060 ceph-mon[103190]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T13:00:31.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:31.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:31.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:32.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:32.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:32.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:32.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:32.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:32.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:33.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:32 smithi118 ceph-mon[104234]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T13:00:33.078 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:32 smithi005 ceph-mon[99496]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T13:00:33.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:32 smithi060 ceph-mon[103190]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T13:00:33.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.497+0000 7fa919ffb700 1 -- 172.21.15.5:0/3805784606 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa91c197f50 con 0x7fa90c0a1440 2023-10-08T13:00:33.498 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2023-10-08T13:00:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa90c0a1440 msgr2=0x7fa90c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa90c0a1440 0x7fa90c0a3900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa910005fd0 tx=0x7fa910005d60 comp rx=0 tx=0).stop 2023-10-08T13:00:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 msgr2=0x7fa91c19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 0x7fa91c19ce90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9080098e0 tx=0x7fa90800f720 comp rx=0 tx=0).stop 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 shutdown_connections 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa90c0a1440 0x7fa90c0a3900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa91c1057c0 0x7fa91c196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa91c1008a0 0x7fa91c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 --2- 172.21.15.5:0/3805784606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa91c101260 0x7fa91c19ce90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 >> 172.21.15.5:0/3805784606 conn(0x7fa91c0779e0 msgr2=0x7fa91c0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 shutdown_connections 2023-10-08T13:00:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:00:33.500+0000 7fa922ce8700 1 -- 172.21.15.5:0/3805784606 wait complete. 2023-10-08T13:00:33.946 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-08T13:00:33.949 INFO:tasks.cephadm:Deploying osd.4 on smithi060 with /dev/vg_nvme/lv_3... 2023-10-08T13:00:33.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T13:00:33.978 INFO:journalctl@ceph.osd.3.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:34.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:34.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:34.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T13:00:34.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:34.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:34.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:00:34.669 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:00:34 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:00:34.306+0000 7f28b2aa2640 -1 osd.3 0 log_to_monitors true 2023-10-08T13:00:35.119 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:34 smithi060 ceph-mon[103190]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T13:00:35.247 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:34 smithi005 ceph-mon[99496]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T13:00:35.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:34 smithi118 ceph-mon[104234]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T13:00:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T13:00:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T13:00:36.166 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-08T13:00:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-08T13:00:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00801115 s, 1.3 GB/s 2023-10-08T13:00:36.166 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 2023-10-08T13:00:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-08T13:00:36.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:36 smithi118 ceph-mon[104234]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T13:00:36.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:36 smithi118 ceph-mon[104234]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T13:00:36.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:36 smithi118 ceph-mon[104234]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:00:36.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:36.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:36 smithi118 ceph-mon[104234]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:36.294 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-mon[99496]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T13:00:36.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-mon[99496]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T13:00:36.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-mon[99496]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:00:36.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:36.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-mon[99496]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:36.295 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:00:36.003+0000 7f28a8119700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T13:00:36.295 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:00:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:00:36.010+0000 7f28a1f0a700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:00:36.318 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:36 smithi060 ceph-mon[103190]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T13:00:36.319 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:36 smithi060 ceph-mon[103190]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T13:00:36.319 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:36 smithi060 ceph-mon[103190]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:00:36.319 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:36.319 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:36 smithi060 ceph-mon[103190]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:00:36.598 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2023-10-08T13:00:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:00:37.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi005 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi005 to 8586M 2023-10-08T13:00:37.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:37.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:37.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:37 smithi118 ceph-mon[104234]: osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] boot 2023-10-08T13:00:37.383 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi005 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi005 to 8586M 2023-10-08T13:00:37.384 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.385 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:37.385 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:37.385 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.385 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:37 smithi060 ceph-mon[103190]: osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] boot 2023-10-08T13:00:37.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi005 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi005 to 8586M 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:37.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:37.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:37.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:37 smithi005 ceph-mon[99496]: osd.3 [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] boot 2023-10-08T13:00:38.209 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:38 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:00:38.209 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:38 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:00:38.209 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:38 smithi060 ceph-mon[103190]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T13:00:38.209 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:38.210 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:38 smithi060 ceph-mon[103190]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:38.210 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:38 smithi060 ceph-mon[103190]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T13:00:38.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:38 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:00:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:38 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:00:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:38 smithi118 ceph-mon[104234]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T13:00:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:38 smithi118 ceph-mon[104234]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:38 smithi118 ceph-mon[104234]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 -- 172.21.15.60:0/4131634152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac100840 msgr2=0x7fc8ac100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 --2- 172.21.15.60:0/4131634152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac100840 0x7fc8ac100cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009990 tx=0x7fc8a8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 -- 172.21.15.60:0/4131634152 shutdown_connections 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 --2- 172.21.15.60:0/4131634152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8ac101200 0x7fc8ac10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 --2- 172.21.15.60:0/4131634152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 --2- 172.21.15.60:0/4131634152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac100840 0x7fc8ac100cc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 -- 172.21.15.60:0/4131634152 >> 172.21.15.60:0/4131634152 conn(0x7fc8ac077950 msgr2=0x7fc8ac077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 -- 172.21.15.60:0/4131634152 shutdown_connections 2023-10-08T13:00:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.360+0000 7fc8b3655700 1 -- 172.21.15.60:0/4131634152 wait complete. 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 Processor -- start 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 -- start start 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac100840 0x7fc8ac072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8ac101200 0x7fc8ac073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac1a5090 con 0x7fc8ac101200 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac1a5200 con 0x7fc8ac1057a0 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b3655700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac1a53c0 con 0x7fc8ac100840 2023-10-08T13:00:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b1bf2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b1bf2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43680/0 (socket says 172.21.15.60:43680) 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b1bf2700 1 -- 172.21.15.60:0/1125877867 learned_addr learned my addr 172.21.15.60:0/1125877867 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.361+0000 7fc8b0bf0700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8ac101200 0x7fc8ac073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b1bf2700 1 -- 172.21.15.60:0/1125877867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac100840 msgr2=0x7fc8ac072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b13f1700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac100840 0x7fc8ac072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b1bf2700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac100840 0x7fc8ac072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b1bf2700 1 -- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8ac101200 msgr2=0x7fc8ac073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b1bf2700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8ac101200 0x7fc8ac073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b1bf2700 1 -- 172.21.15.60:0/1125877867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80095f0 con 0x7fc8ac1057a0 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b13f1700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac100840 0x7fc8ac072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b1bf2700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac073570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4007ee0 tx=0x7fc8a400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4017070 con 0x7fc8ac1057a0 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8a400f040 con 0x7fc8ac1057a0 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac1a56a0 con 0x7fc8ac1057a0 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4005740 con 0x7fc8ac1057a0 2023-10-08T13:00:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.362+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac1a5b20 con 0x7fc8ac1057a0 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.363+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ac108d80 con 0x7fc8ac1057a0 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.364+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc8a400dc60 con 0x7fc8ac1057a0 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.365+0000 7fc89e7fc700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc8980a14d0 0x7fc8980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.365+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3913+0+0 (secure 0 0 0) 0x7fc8a40cbae0 con 0x7fc8ac1057a0 2023-10-08T13:00:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.365+0000 7fc8b13f1700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc8980a14d0 0x7fc8980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.366+0000 7fc8b13f1700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc8980a14d0 0x7fc8980a3990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009b50 tx=0x7fc8a0009550 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:00:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.369+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc8a4096270 con 0x7fc8ac1057a0 2023-10-08T13:00:38.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:38 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:00:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:38 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:00:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:38 smithi005 ceph-mon[99496]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T13:00:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:00:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:38 smithi005 ceph-mon[99496]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:38 smithi005 ceph-mon[99496]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T13:00:38.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:38.575+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8ac073fd0 con 0x7fc8980a14d0 2023-10-08T13:00:39.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:39 smithi118 ceph-mon[104234]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:00:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:00:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:39 smithi118 ceph-mon[104234]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T13:00:39.391 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:39 smithi060 ceph-mon[103190]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:39.392 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:00:39.392 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:00:39.392 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:39.392 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:39 smithi060 ceph-mon[103190]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T13:00:39.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:39 smithi005 ceph-mon[99496]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:00:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:00:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:00:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:39 smithi005 ceph-mon[99496]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T13:00:40.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:40 smithi118 ceph-mon[104234]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:40.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:40 smithi060 ceph-mon[103190]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:40.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:40 smithi005 ceph-mon[99496]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:41 smithi118 ceph-mon[104234]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T13:00:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:41 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/733184093' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]: dispatch 2023-10-08T13:00:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:41 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]: dispatch 2023-10-08T13:00:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:41 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]': finished 2023-10-08T13:00:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:41 smithi118 ceph-mon[104234]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T13:00:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:41.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:41 smithi060 ceph-mon[103190]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T13:00:41.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:41 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/733184093' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]: dispatch 2023-10-08T13:00:41.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:41 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]: dispatch 2023-10-08T13:00:41.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:41 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]': finished 2023-10-08T13:00:41.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:41 smithi060 ceph-mon[103190]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T13:00:41.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:41.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:41 smithi005 ceph-mon[99496]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T13:00:41.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:41 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/733184093' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]: dispatch 2023-10-08T13:00:41.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:41 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]: dispatch 2023-10-08T13:00:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:41 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd5a0f8e-6be8-490d-b202-a85853020088"}]': finished 2023-10-08T13:00:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:41 smithi005 ceph-mon[99496]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T13:00:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:42.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:42 smithi060 ceph-mon[103190]: pgmap v80: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-10-08T13:00:42.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:42 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/2856587312' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:42.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:42 smithi005 ceph-mon[99496]: pgmap v80: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-10-08T13:00:42.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:42 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/2856587312' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:42.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:42 smithi118 ceph-mon[104234]: pgmap v80: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-10-08T13:00:42.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:42 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/2856587312' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:00:43.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:43 smithi060 ceph-mon[103190]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-08T13:00:43.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:43 smithi005 ceph-mon[99496]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-08T13:00:43.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:43 smithi118 ceph-mon[104234]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-08T13:00:44.393 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:44 smithi005 ceph-mon[99496]: pgmap v81: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-10-08T13:00:44.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:44 smithi060 ceph-mon[103190]: pgmap v81: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-10-08T13:00:44.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:44 smithi118 ceph-mon[104234]: pgmap v81: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-10-08T13:00:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:46 smithi060 ceph-mon[103190]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-08T13:00:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:46 smithi060 ceph-mon[103190]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-08T13:00:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:46 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T13:00:46.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:46 smithi005 ceph-mon[99496]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-08T13:00:46.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:46 smithi005 ceph-mon[99496]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-08T13:00:46.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:46 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T13:00:46.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:46 smithi118 ceph-mon[104234]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2023-10-08T13:00:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:46 smithi118 ceph-mon[104234]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-08T13:00:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:46 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T13:00:48.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:48 smithi060 ceph-mon[103190]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:00:48.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T13:00:48.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:48.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:48 smithi060 ceph-mon[103190]: Deploying daemon osd.4 on smithi060 2023-10-08T13:00:48.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:48 smithi005 ceph-mon[99496]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:00:48.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T13:00:48.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:48 smithi005 ceph-mon[99496]: Deploying daemon osd.4 on smithi060 2023-10-08T13:00:48.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:48 smithi118 ceph-mon[104234]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:00:48.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T13:00:48.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:48.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:48 smithi118 ceph-mon[104234]: Deploying daemon osd.4 on smithi060 2023-10-08T13:00:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:50 smithi060 ceph-mon[103190]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:00:50.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:50 smithi005 ceph-mon[99496]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:00:50.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:50 smithi118 ceph-mon[104234]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:00:52.109 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:52 smithi060 ceph-mon[103190]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T13:00:52.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:52 smithi005 ceph-mon[99496]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T13:00:52.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:52 smithi118 ceph-mon[104234]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T13:00:53.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:53.388 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:53.388 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:53.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:54.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:54 smithi060 ceph-mon[103190]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:00:54.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:54 smithi005 ceph-mon[99496]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:00:54.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:54 smithi118 ceph-mon[104234]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:00:55.054 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 4 on host 'smithi060' 2023-10-08T13:00:55.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.053+0000 7fc89e7fc700 1 -- 172.21.15.60:0/1125877867 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc8ac073fd0 con 0x7fc8980a14d0 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc8980a14d0 msgr2=0x7fc8980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc8980a14d0 0x7fc8980a3990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009b50 tx=0x7fc8a0009550 comp rx=0 tx=0).stop 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 msgr2=0x7fc8ac073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac073570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4007ee0 tx=0x7fc8a400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 shutdown_connections 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc8980a14d0 0x7fc8980a3990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ac1057a0 0x7fc8ac073570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8ac100840 0x7fc8ac072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:55.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 --2- 172.21.15.60:0/1125877867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8ac101200 0x7fc8ac073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:00:55.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 >> 172.21.15.60:0/1125877867 conn(0x7fc8ac077950 msgr2=0x7fc8ac0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:00:55.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 shutdown_connections 2023-10-08T13:00:55.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:00:55.055+0000 7fc8b3655700 1 -- 172.21.15.60:0/1125877867 wait complete. 2023-10-08T13:00:55.468 DEBUG:teuthology.orchestra.run.smithi060:osd.4> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-08T13:00:55.470 INFO:tasks.cephadm:Deploying osd.5 on smithi118 with /dev/vg_nvme/lv_3... 2023-10-08T13:00:55.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T13:00:55.499 INFO:journalctl@ceph.osd.4.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:00:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:55.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:55.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:55.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:00:56.048 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:00:56.374 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:00:56 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:00:56.093+0000 7f568e653640 -1 osd.4 0 log_to_monitors true 2023-10-08T13:00:56.599 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:56 smithi118 ceph-mon[104234]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:00:56.600 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:56 smithi118 ceph-mon[104234]: from='osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:00:56.600 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:56 smithi118 ceph-mon[104234]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:00:56.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:56 smithi060 ceph-mon[103190]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:00:56.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:56 smithi060 ceph-mon[103190]: from='osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:00:56.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:56 smithi060 ceph-mon[103190]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:00:56.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:56 smithi005 ceph-mon[99496]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:00:56.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:56 smithi005 ceph-mon[99496]: from='osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:00:56.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:56 smithi005 ceph-mon[99496]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T13:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T13:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-08T13:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-08T13:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00809343 s, 1.3 GB/s 2023-10-08T13:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-08T13:00:58.158 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:00:58.017+0000 7f5683cca700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T13:00:58.159 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:00:58.024+0000 7f567f2be700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:00:58.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-mon[103190]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T13:00:58.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-mon[103190]: from='osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:00:58.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-mon[103190]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T13:00:58.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:58.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-mon[103190]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:00:58.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:58 smithi060 ceph-mon[103190]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:58.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_3 2023-10-08T13:00:58.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:58 smithi118 ceph-mon[104234]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T13:00:58.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:58 smithi118 ceph-mon[104234]: from='osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:00:58.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:58 smithi118 ceph-mon[104234]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T13:00:58.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:58 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:58.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:58 smithi118 ceph-mon[104234]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:00:58.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:58 smithi118 ceph-mon[104234]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:58.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:58 smithi005 ceph-mon[99496]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T13:00:58.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:58 smithi005 ceph-mon[99496]: from='osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:00:58.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:58 smithi005 ceph-mon[99496]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T13:00:58.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:58 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:58.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:58 smithi005 ceph-mon[99496]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:00:58.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:58 smithi005 ceph-mon[99496]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:00:58.763 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:00:59.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi060 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:59.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi060 to 8586M 2023-10-08T13:00:59.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:59.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:59.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:00:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi060 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi060 to 8586M 2023-10-08T13:00:59.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:59.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:59.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:00:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:00:59.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi060 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi060 to 8586M 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:00:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:00:59.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:00:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:00.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 -- 172.21.15.118:0/420653059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc100810 msgr2=0x7f2dcc10c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:00.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/420653059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc100810 0x7f2dcc10c590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b0a0 tx=0x7f2dc400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:01:00.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 -- 172.21.15.118:0/420653059 shutdown_connections 2023-10-08T13:01:00.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/420653059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc100810 0x7f2dcc10c590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/420653059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dcc1056c0 0x7f2dcc105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/420653059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 -- 172.21.15.118:0/420653059 >> 172.21.15.118:0/420653059 conn(0x7f2dcc075cf0 msgr2=0x7f2dcc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 -- 172.21.15.118:0/420653059 shutdown_connections 2023-10-08T13:01:00.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 -- 172.21.15.118:0/420653059 wait complete. 2023-10-08T13:01:00.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.087+0000 7f2dd25d7700 1 Processor -- start 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 -- start start 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc10cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dcc100810 0x7f2dcc10d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1056c0 0x7f2dcc10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1a5140 con 0x7f2dcc100810 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1a52b0 con 0x7f2dcc1056c0 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd25d7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1a5470 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc10cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc10cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45602/0 (socket says 172.21.15.118:45602) 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 -- 172.21.15.118:0/3006465762 learned_addr learned my addr 172.21.15.118:0/3006465762 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dd0b74700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1056c0 0x7f2dcc10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcb7fe700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dcc100810 0x7f2dcc10d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 -- 172.21.15.118:0/3006465762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1056c0 msgr2=0x7f2dcc10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1056c0 0x7f2dcc10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 -- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dcc100810 msgr2=0x7f2dcc10d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dcc100810 0x7f2dcc10d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 -- 172.21.15.118:0/3006465762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4009d00 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.088+0000 7f2dcbfff700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc10cf60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000c920 tx=0x7f2dc000cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:00.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.089+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0004a30 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.089+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dc00054e0 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.089+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc1a5750 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.089+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0007bd0 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.089+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc1a5ca0 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.094 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.090+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc107ce0 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.091+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f2dc0005000 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.091+0000 7f2dc97fa700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2db40a1550 0x7f2db40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:00.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.091+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f2dc00cb800 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.091+0000 7f2dcb7fe700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2db40a1550 0x7f2db40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.092+0000 7f2dcb7fe700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2db40a1550 0x7f2db40a3a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc10e640 tx=0x7f2dbc00a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.096+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2dc0095e00 con 0x7f2dcc0ffe50 2023-10-08T13:01:00.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:00 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:01:00.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:00 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:01:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:00 smithi118 ceph-mon[104234]: osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] boot 2023-10-08T13:01:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:00 smithi118 ceph-mon[104234]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T13:01:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:01:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:00 smithi118 ceph-mon[104234]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:01:00.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:00.293+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dcc10e3f0 con 0x7f2db40a1550 2023-10-08T13:01:00.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:00 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:01:00.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:00 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:01:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:00 smithi060 ceph-mon[103190]: osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] boot 2023-10-08T13:01:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:00 smithi060 ceph-mon[103190]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T13:01:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:01:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:00 smithi060 ceph-mon[103190]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:01:00.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:00 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:01:00.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:00 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:01:00.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:00 smithi005 ceph-mon[99496]: osd.4 [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] boot 2023-10-08T13:01:00.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:00 smithi005 ceph-mon[99496]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T13:01:00.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:01:00.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:00 smithi005 ceph-mon[99496]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:01:01.307 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:01 smithi118 ceph-mon[104234]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T13:01:01.308 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:01 smithi118 ceph-mon[104234]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:01.308 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:01 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:01.308 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:01 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:01.308 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:01 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:01.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:01 smithi060 ceph-mon[103190]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T13:01:01.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:01 smithi060 ceph-mon[103190]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:01.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:01 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:01.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:01 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:01.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:01 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:01 smithi005 ceph-mon[99496]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T13:01:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:01 smithi005 ceph-mon[99496]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:01 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:01 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:01 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:02.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:02 smithi118 ceph-mon[104234]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:02.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:02 smithi060 ceph-mon[103190]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:02.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:02 smithi005 ceph-mon[99496]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:03.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:03 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/524583632' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]: dispatch 2023-10-08T13:01:03.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:03 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]: dispatch 2023-10-08T13:01:03.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:03 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]': finished 2023-10-08T13:01:03.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:03 smithi060 ceph-mon[103190]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T13:01:03.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:03.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:03 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/524583632' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]: dispatch 2023-10-08T13:01:03.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:03 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]: dispatch 2023-10-08T13:01:03.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:03 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]': finished 2023-10-08T13:01:03.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:03 smithi005 ceph-mon[99496]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T13:01:03.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:03 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/524583632' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]: dispatch 2023-10-08T13:01:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:03 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]: dispatch 2023-10-08T13:01:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:03 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2895b033-b0cd-4ef9-b418-d7d88abf919d"}]': finished 2023-10-08T13:01:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:03 smithi118 ceph-mon[104234]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T13:01:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:04.292 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:04 smithi005 ceph-mon[99496]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:04.292 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/1062279870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:04.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:04 smithi060 ceph-mon[103190]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:04.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/1062279870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:04 smithi118 ceph-mon[104234]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/1062279870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:06.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:06 smithi060 ceph-mon[103190]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:06.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:06 smithi005 ceph-mon[99496]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:06.515 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:06 smithi118 ceph-mon[104234]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:08.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:08 smithi060 ceph-mon[103190]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:08.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:08 smithi005 ceph-mon[99496]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:08.445 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:08 smithi118 ceph-mon[104234]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:10.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:10 smithi060 ceph-mon[103190]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:10.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T13:01:10.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:10.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:10 smithi060 ceph-mon[103190]: Deploying daemon osd.5 on smithi118 2023-10-08T13:01:10.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:10 smithi005 ceph-mon[99496]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:10.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T13:01:10.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:10.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:10 smithi005 ceph-mon[99496]: Deploying daemon osd.5 on smithi118 2023-10-08T13:01:10.452 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:10 smithi118 ceph-mon[104234]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:10.452 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T13:01:10.452 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:10.452 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:10 smithi118 ceph-mon[104234]: Deploying daemon osd.5 on smithi118 2023-10-08T13:01:12.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:12 smithi060 ceph-mon[103190]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:12.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:12 smithi005 ceph-mon[99496]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:12.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:12 smithi118 ceph-mon[104234]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:14.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:14 smithi118 ceph-mon[104234]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:14.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:14.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:14.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:14 smithi060 ceph-mon[103190]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:14.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:14.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:14.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:14.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:14 smithi005 ceph-mon[99496]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:14.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:16.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:16 smithi118 ceph-mon[104234]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:16.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:16 smithi060 ceph-mon[103190]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:16.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:16 smithi005 ceph-mon[99496]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:16.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.808+0000 7f2dc97fa700 1 -- 172.21.15.118:0/3006465762 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2dcc10e3f0 con 0x7f2db40a1550 2023-10-08T13:01:16.810 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 5 on host 'smithi118' 2023-10-08T13:01:16.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2db40a1550 msgr2=0x7f2db40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:16.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2db40a1550 0x7f2db40a3a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc10e640 tx=0x7f2dbc00a300 comp rx=0 tx=0).stop 2023-10-08T13:01:16.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 msgr2=0x7f2dcc10cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc10cf60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000c920 tx=0x7f2dc000cc30 comp rx=0 tx=0).stop 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 shutdown_connections 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2db40a1550 0x7f2db40a3a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1056c0 0x7f2dcc10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dcc0ffe50 0x7f2dcc10cf60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 --2- 172.21.15.118:0/3006465762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dcc100810 0x7f2dcc10d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 >> 172.21.15.118:0/3006465762 conn(0x7f2dcc075cf0 msgr2=0x7f2dcc102540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 shutdown_connections 2023-10-08T13:01:16.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:01:16.810+0000 7f2dd25d7700 1 -- 172.21.15.118:0/3006465762 wait complete. 2023-10-08T13:01:17.243 DEBUG:teuthology.orchestra.run.smithi118:osd.5> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-08T13:01:17.245 INFO:tasks.cephadm:Deploying osd.6 on smithi005 with /dev/vg_nvme/lv_2... 2023-10-08T13:01:17.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T13:01:17.276 INFO:journalctl@ceph.osd.5.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:17.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:01:17.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:17.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:18.255 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:01:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:01:18.037+0000 7f4b76dd2640 -1 osd.5 0 log_to_monitors true 2023-10-08T13:01:18.905 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:18 smithi005 ceph-mon[99496]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:18.905 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:18 smithi005 ceph-mon[99496]: from='osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:01:18.905 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:18 smithi005 ceph-mon[99496]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:01:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:18 smithi118 ceph-mon[104234]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:18 smithi118 ceph-mon[104234]: from='osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:01:19.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:18 smithi118 ceph-mon[104234]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:01:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:18 smithi060 ceph-mon[103190]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:18 smithi060 ceph-mon[103190]: from='osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:01:19.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:18 smithi060 ceph-mon[103190]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:01:19.346 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T13:01:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T13:01:19.347 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-08T13:01:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-08T13:01:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00812815 s, 1.3 GB/s 2023-10-08T13:01:19.347 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 2023-10-08T13:01:19.347 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-08T13:01:19.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2023-10-08T13:01:20.019 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:01:19.773+0000 7f4b6c449700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T13:01:20.019 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:01:19.781+0000 7f4b6623a700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:20.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:20.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:20.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:20.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:20.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:20.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:20.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:20.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:20.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:20.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:01:20.913 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi118 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi118 to 8584M 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] boot 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T13:01:20.914 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:20 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi118 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi118 to 8584M 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] boot 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T13:01:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:20 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi118 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi118 to 8584M 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: osd.5 [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] boot 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T13:01:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:20 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 -- 172.21.15.5:0/3596968400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 msgr2=0x7f78f810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 --2- 172.21.15.5:0/3596968400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f810cd10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009990 tx=0x7f78e8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 -- 172.21.15.5:0/3596968400 shutdown_connections 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 --2- 172.21.15.5:0/3596968400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f810d250 0x7f78f810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 --2- 172.21.15.5:0/3596968400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8072a20 0x7f78f8072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 --2- 172.21.15.5:0/3596968400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f810cd10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 -- 172.21.15.5:0/3596968400 >> 172.21.15.5:0/3596968400 conn(0x7f78f80779e0 msgr2=0x7f78f8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 -- 172.21.15.5:0/3596968400 shutdown_connections 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.603+0000 7f78fda79700 1 -- 172.21.15.5:0/3596968400 wait complete. 2023-10-08T13:01:21.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.604+0000 7f78fda79700 1 Processor -- start 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.604+0000 7f78fda79700 1 -- start start 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.604+0000 7f78fda79700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8072a20 0x7f78f8198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.604+0000 7f78fda79700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.604+0000 7f78fda79700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f810d250 0x7f78f819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.604+0000 7f78fda79700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819dd90 con 0x7f78f8073340 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78fda79700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819df00 con 0x7f78f810d250 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78fda79700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819e0c0 con 0x7f78f8072a20 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f81993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59924/0 (socket says 172.21.15.5:59924) 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 -- 172.21.15.5:0/635961200 learned_addr learned my addr 172.21.15.5:0/635961200 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:01:21.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f7fff700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f810d250 0x7f78f819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f77fe700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8072a20 0x7f78f8198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 -- 172.21.15.5:0/635961200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8072a20 msgr2=0x7f78f8198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8072a20 0x7f78f8198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 -- 172.21.15.5:0/635961200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f810d250 msgr2=0x7f78f819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f810d250 0x7f78f819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 -- 172.21.15.5:0/635961200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80095f0 con 0x7f78f8073340 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f6ffd700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f81993d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f78e80098e0 tx=0x7f78e800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e801d070 con 0x7f78f8073340 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f819e340 con 0x7f78f8073340 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78e8022470 con 0x7f78f8073340 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8017650 con 0x7f78f8073340 2023-10-08T13:01:21.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.605+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f81a5c00 con 0x7f78f8073340 2023-10-08T13:01:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.606+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f8108460 con 0x7f78f8073340 2023-10-08T13:01:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.608+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f78e80225e0 con 0x7f78f8073340 2023-10-08T13:01:21.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.609+0000 7f78f4ff9700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78e00a14d0 0x7f78e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.609+0000 7f78f77fe700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78e00a14d0 0x7f78e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.609+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4777+0+0 (secure 0 0 0) 0x7f78e80cd410 con 0x7f78f8073340 2023-10-08T13:01:21.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.609+0000 7f78f77fe700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78e00a14d0 0x7f78e00a3990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005950 tx=0x7f78ec0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:21.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.613+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f78e8097830 con 0x7f78f8073340 2023-10-08T13:01:21.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:21.823+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f78f804e4c0 con 0x7f78e00a14d0 2023-10-08T13:01:22.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:21 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:01:22.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:21 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:01:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:21 smithi060 ceph-mon[103190]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T13:01:22.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:21 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:01:22.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:21 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:01:22.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:21 smithi005 ceph-mon[99496]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T13:01:22.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:21 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:01:22.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:21 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:01:22.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:21 smithi118 ceph-mon[104234]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T13:01:22.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:22 smithi005 ceph-mon[99496]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:22 smithi005 ceph-mon[99496]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:22 smithi005 ceph-mon[99496]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T13:01:23.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:22 smithi060 ceph-mon[103190]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:22 smithi060 ceph-mon[103190]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:22 smithi060 ceph-mon[103190]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T13:01:23.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:22 smithi118 ceph-mon[104234]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:22 smithi118 ceph-mon[104234]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:22 smithi118 ceph-mon[104234]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T13:01:24.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:24 smithi060 ceph-mon[103190]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:24.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:24 smithi060 ceph-mon[103190]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T13:01:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:24 smithi005 ceph-mon[99496]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:24 smithi005 ceph-mon[99496]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T13:01:24.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:24 smithi118 ceph-mon[104234]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:24.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:24 smithi118 ceph-mon[104234]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T13:01:25.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:25 smithi060 ceph-mon[103190]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T13:01:25.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4060297802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70aac32e-a230-4d6f-b65d-1d390ccd9d5f"}]: dispatch 2023-10-08T13:01:25.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4060297802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70aac32e-a230-4d6f-b65d-1d390ccd9d5f"}]': finished 2023-10-08T13:01:25.411 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:25 smithi060 ceph-mon[103190]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T13:01:25.411 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:25.411 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3911855406' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:25 smithi005 ceph-mon[99496]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T13:01:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4060297802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70aac32e-a230-4d6f-b65d-1d390ccd9d5f"}]: dispatch 2023-10-08T13:01:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4060297802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70aac32e-a230-4d6f-b65d-1d390ccd9d5f"}]': finished 2023-10-08T13:01:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:25 smithi005 ceph-mon[99496]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T13:01:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3911855406' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:25 smithi118 ceph-mon[104234]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T13:01:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4060297802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70aac32e-a230-4d6f-b65d-1d390ccd9d5f"}]: dispatch 2023-10-08T13:01:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4060297802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70aac32e-a230-4d6f-b65d-1d390ccd9d5f"}]': finished 2023-10-08T13:01:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:25 smithi118 ceph-mon[104234]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T13:01:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3911855406' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:26.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:26 smithi118 ceph-mon[104234]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T13:01:26.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:26 smithi060 ceph-mon[103190]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T13:01:26.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:26 smithi005 ceph-mon[99496]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T13:01:28.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:28 smithi118 ceph-mon[104234]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T13:01:28.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:28 smithi060 ceph-mon[103190]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T13:01:28.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:28 smithi005 ceph-mon[99496]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T13:01:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:30 smithi005 ceph-mon[99496]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:01:30.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:30 smithi118 ceph-mon[104234]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:01:30.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:30 smithi060 ceph-mon[103190]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:01:31.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T13:01:31.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:31 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:31.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:31 smithi005 ceph-mon[99496]: Deploying daemon osd.6 on smithi005 2023-10-08T13:01:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T13:01:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:31 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:31 smithi118 ceph-mon[104234]: Deploying daemon osd.6 on smithi005 2023-10-08T13:01:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T13:01:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:31 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:31 smithi060 ceph-mon[103190]: Deploying daemon osd.6 on smithi005 2023-10-08T13:01:32.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:32 smithi118 ceph-mon[104234]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:01:32.622 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:32 smithi005 ceph-mon[99496]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:01:32.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:32 smithi060 ceph-mon[103190]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:01:34.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:34 smithi118 ceph-mon[104234]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:01:34.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:34 smithi060 ceph-mon[103190]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:01:34.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:34 smithi005 ceph-mon[99496]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:01:36.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:36 smithi005 ceph-mon[99496]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:36.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:36.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:36.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:36.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:36 smithi060 ceph-mon[103190]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:36.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:36.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:36.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:36 smithi118 ceph-mon[104234]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:36.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:36.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:37.928 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 6 on host 'smithi005' 2023-10-08T13:01:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.926+0000 7f78f4ff9700 1 -- 172.21.15.5:0/635961200 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f78f804e4c0 con 0x7f78e00a14d0 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78e00a14d0 msgr2=0x7f78e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78e00a14d0 0x7f78e00a3990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005950 tx=0x7f78ec0058e0 comp rx=0 tx=0).stop 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 msgr2=0x7f78f81993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f81993d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f78e80098e0 tx=0x7f78e800f670 comp rx=0 tx=0).stop 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 shutdown_connections 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78e00a14d0 0x7f78e00a3990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f810d250 0x7f78f819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f8072a20 0x7f78f8198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 --2- 172.21.15.5:0/635961200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78f8073340 0x7f78f81993d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.929+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 >> 172.21.15.5:0/635961200 conn(0x7f78f80779e0 msgr2=0x7f78f80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.930+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 shutdown_connections 2023-10-08T13:01:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:01:37.930+0000 7f78fda79700 1 -- 172.21.15.5:0/635961200 wait complete. 2023-10-08T13:01:38.568 DEBUG:teuthology.orchestra.run.smithi005:osd.6> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-08T13:01:38.570 INFO:tasks.cephadm:Deploying osd.7 on smithi060 with /dev/vg_nvme/lv_2... 2023-10-08T13:01:38.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T13:01:38.602 INFO:journalctl@ceph.osd.6.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:01:38.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:38.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:38.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:38.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:38.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:38.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:39.155 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:01:39.327 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:01:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:01:39.071+0000 7f3667124640 -1 osd.6 0 log_to_monitors true 2023-10-08T13:01:39.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:39 smithi060 ceph-mon[103190]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T13:01:39.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:39 smithi005 ceph-mon[99496]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T13:01:39.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:39 smithi118 ceph-mon[104234]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T13:01:40.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:40 smithi060 ceph-mon[103190]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:40 smithi060 ceph-mon[103190]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T13:01:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:40 smithi060 ceph-mon[103190]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T13:01:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:40 smithi060 ceph-mon[103190]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:01:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:40.737 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:01:40.467+0000 7f365c79b700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T13:01:40.737 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:01:40.478+0000 7f3654d89700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:01:40.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-mon[99496]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:40.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-mon[99496]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T13:01:40.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-mon[99496]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T13:01:40.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-mon[99496]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:01:40.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:40 smithi118 ceph-mon[104234]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:40 smithi118 ceph-mon[104234]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T13:01:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:40 smithi118 ceph-mon[104234]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T13:01:40.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:40 smithi118 ceph-mon[104234]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:01:40.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T13:01:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T13:01:40.781 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-08T13:01:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-08T13:01:40.782 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00805799 s, 1.3 GB/s 2023-10-08T13:01:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-08T13:01:41.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2023-10-08T13:01:41.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:41.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:41.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.775 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:01:41.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:01:41.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:41.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:41.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:01:41.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T13:01:41.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:41.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:41.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:01:41.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:41.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:41.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:01:41.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi005 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi005 to 5724M 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] boot 2023-10-08T13:01:42.568 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T13:01:42.569 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi005 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi005 to 5724M 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] boot 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T13:01:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:42.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi005 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi005 to 5724M 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: osd.6 [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] boot 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T13:01:42.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:01:42.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 -- 172.21.15.60:0/1100400206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27401000a0 msgr2=0x7f274010c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- 172.21.15.60:0/1100400206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27401000a0 0x7f274010c540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f273800b0a0 tx=0x7f273800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 -- 172.21.15.60:0/1100400206 shutdown_connections 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- 172.21.15.60:0/1100400206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27401000a0 0x7f274010c540 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- 172.21.15.60:0/1100400206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 0x7f2740104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- 172.21.15.60:0/1100400206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400ff6e0 0x7f27400ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 -- 172.21.15.60:0/1100400206 >> 172.21.15.60:0/1100400206 conn(0x7f27400766c0 msgr2=0x7f2740076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 -- 172.21.15.60:0/1100400206 shutdown_connections 2023-10-08T13:01:42.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 -- 172.21.15.60:0/1100400206 wait complete. 2023-10-08T13:01:42.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 Processor -- start 2023-10-08T13:01:42.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 -- start start 2023-10-08T13:01:43.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 0x7f274019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27401000a0 0x7f274019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.996+0000 7f2746e10700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 0x7f2740195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2746e10700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740195fd0 con 0x7f27401000a0 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2746e10700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740196140 con 0x7f27400ff6e0 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2746e10700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740196300 con 0x7f27401045b0 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 0x7f274019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 0x7f274019b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43788/0 (socket says 172.21.15.60:43788) 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 -- 172.21.15.60:0/95131727 learned_addr learned my addr 172.21.15.60:0/95131727 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f273ffff700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27401000a0 0x7f274019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:43.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f27453ad700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 0x7f2740195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 -- 172.21.15.60:0/95131727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 msgr2=0x7f2740195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 0x7f2740195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 -- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27401000a0 msgr2=0x7f274019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27401000a0 0x7f274019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 -- 172.21.15.60:0/95131727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009d00 con 0x7f27400ff6e0 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f27453ad700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 0x7f2740195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2744bac700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 0x7f274019b7e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2734007b50 tx=0x7f2734007e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734011070 con 0x7f27400ff6e0 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27401965e0 con 0x7f27400ff6e0 2023-10-08T13:01:43.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f273400c2e0 con 0x7f27400ff6e0 2023-10-08T13:01:43.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.997+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400a900 con 0x7f27400ff6e0 2023-10-08T13:01:43.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.998+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2740068bf0 con 0x7f27400ff6e0 2023-10-08T13:01:43.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.998+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2740100dd0 con 0x7f27400ff6e0 2023-10-08T13:01:43.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:42.999+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f273400aaa0 con 0x7f27400ff6e0 2023-10-08T13:01:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:43.000+0000 7f273dffb700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27300a14d0 0x7f27300a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:01:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:43.000+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5180+0+0 (secure 0 0 0) 0x7f27340cd2c0 con 0x7f27400ff6e0 2023-10-08T13:01:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:43.000+0000 7f273ffff700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27300a14d0 0x7f27300a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:01:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:43.001+0000 7f273ffff700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27300a14d0 0x7f27300a3990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2740196ae0 tx=0x7f272c00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:01:43.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:43.004+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f27340975f0 con 0x7f27400ff6e0 2023-10-08T13:01:43.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:43.212+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f274010f610 con 0x7f27300a14d0 2023-10-08T13:01:43.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:43 smithi118 ceph-mon[104234]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T13:01:43.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:43 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:43.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:43 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:43.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:43 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:43.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:43 smithi060 ceph-mon[103190]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T13:01:43.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:43 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:43.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:43 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:43.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:43 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:43.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:43 smithi005 ceph-mon[99496]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T13:01:43.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:43 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:01:43.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:43 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:01:43.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:43 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:44.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:44 smithi060 ceph-mon[103190]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:44.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:44 smithi060 ceph-mon[103190]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:44.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:44 smithi005 ceph-mon[99496]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:44.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:44 smithi005 ceph-mon[99496]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:44.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:44 smithi118 ceph-mon[104234]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:44.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:44 smithi118 ceph-mon[104234]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:01:46.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/674178555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]: dispatch 2023-10-08T13:01:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]: dispatch 2023-10-08T13:01:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]': finished 2023-10-08T13:01:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T13:01:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:01:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:46 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/931939592' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:46.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:46.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/674178555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]: dispatch 2023-10-08T13:01:46.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]: dispatch 2023-10-08T13:01:46.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]': finished 2023-10-08T13:01:46.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T13:01:46.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:01:46.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:46 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/931939592' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:46.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/674178555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]: dispatch 2023-10-08T13:01:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]: dispatch 2023-10-08T13:01:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef2634ca-f063-4030-91dd-69d8d3e5216f"}]': finished 2023-10-08T13:01:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T13:01:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:01:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:46 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/931939592' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:01:48.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:48 smithi118 ceph-mon[104234]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:48.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:48 smithi060 ceph-mon[103190]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:48.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:48 smithi005 ceph-mon[99496]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:50.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:50 smithi118 ceph-mon[104234]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:50.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:50 smithi060 ceph-mon[103190]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:50.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:50 smithi005 ceph-mon[99496]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:52.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:52 smithi118 ceph-mon[104234]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:52.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T13:01:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:52.838 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:52 smithi060 ceph-mon[103190]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:52.838 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T13:01:52.838 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:52.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:52 smithi005 ceph-mon[99496]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T13:01:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:01:53.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:53 smithi118 ceph-mon[104234]: Deploying daemon osd.7 on smithi060 2023-10-08T13:01:53.887 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:53 smithi060 ceph-mon[103190]: Deploying daemon osd.7 on smithi060 2023-10-08T13:01:53.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:53 smithi005 ceph-mon[99496]: Deploying daemon osd.7 on smithi060 2023-10-08T13:01:54.544 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:54 smithi060 ceph-mon[103190]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:54.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:54 smithi118 ceph-mon[104234]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:54.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:54 smithi005 ceph-mon[99496]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:56.651 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:56 smithi060 ceph-mon[103190]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:56.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:56 smithi118 ceph-mon[104234]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:56.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:56 smithi005 ceph-mon[99496]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:57.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:57.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:58.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:58.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:58.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:58.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:58.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:01:58.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:01:58.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:01:58 smithi060 ceph-mon[103190]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:59.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:01:58 smithi118 ceph-mon[104234]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:59.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:01:58 smithi005 ceph-mon[99496]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:01:59.488 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 7 on host 'smithi060' 2023-10-08T13:01:59.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.486+0000 7f273dffb700 1 -- 172.21.15.60:0/95131727 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f274010f610 con 0x7f27300a14d0 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27300a14d0 msgr2=0x7f27300a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27300a14d0 0x7f27300a3990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2740196ae0 tx=0x7f272c00a380 comp rx=0 tx=0).stop 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 msgr2=0x7f274019b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 0x7f274019b7e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2734007b50 tx=0x7f2734007e60 comp rx=0 tx=0).stop 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 shutdown_connections 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27300a14d0 0x7f27300a3990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27401045b0 0x7f2740195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27400ff6e0 0x7f274019b7e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 --2- 172.21.15.60:0/95131727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27401000a0 0x7f274019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:01:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 >> 172.21.15.60:0/95131727 conn(0x7f27400766c0 msgr2=0x7f27400fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:01:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.488+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 shutdown_connections 2023-10-08T13:01:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:01:59.489+0000 7f2746e10700 1 -- 172.21.15.60:0/95131727 wait complete. 2023-10-08T13:01:59.881 DEBUG:teuthology.orchestra.run.smithi060:osd.7> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-08T13:01:59.883 INFO:tasks.cephadm:Deploying osd.8 on smithi118 with /dev/vg_nvme/lv_2... 2023-10-08T13:01:59.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T13:01:59.918 INFO:journalctl@ceph.osd.7.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:02:00.457 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:02:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:00 smithi118 ceph-mon[104234]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:00 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.589 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:00 smithi060 ceph-mon[103190]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:00.589 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.589 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.590 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.590 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:00 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:00 smithi005 ceph-mon[99496]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:00 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:00.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:02:00 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:02:00.632+0000 7f6843c0f640 -1 osd.7 0 log_to_monitors true 2023-10-08T13:02:01.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:01 smithi118 ceph-mon[104234]: from='osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:02:01.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:01 smithi118 ceph-mon[104234]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:02:01.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:01 smithi060 ceph-mon[103190]: from='osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:02:01.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:01 smithi060 ceph-mon[103190]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:02:01.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:01 smithi005 ceph-mon[99496]: from='osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:02:01.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:01 smithi005 ceph-mon[99496]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:02:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T13:02:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T13:02:02.064 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-08T13:02:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-08T13:02:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122515 s, 856 MB/s 2023-10-08T13:02:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-08T13:02:02.499 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:02 smithi118 ceph-mon[104234]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:02.499 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:02 smithi118 ceph-mon[104234]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T13:02:02.499 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:02 smithi118 ceph-mon[104234]: from='osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:02:02.499 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:02 smithi118 ceph-mon[104234]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T13:02:02.500 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:02.500 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:02 smithi118 ceph-mon[104234]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:02:02.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_2 2023-10-08T13:02:02.524 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:02:02.268+0000 7f6839286700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T13:02:02.524 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:02:02.277+0000 7f6832876700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:02:02.524 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-mon[103190]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:02.524 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-mon[103190]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T13:02:02.524 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-mon[103190]: from='osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:02:02.524 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-mon[103190]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T13:02:02.524 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:02.525 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:02 smithi060 ceph-mon[103190]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:02:02.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:02 smithi005 ceph-mon[99496]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:02 smithi005 ceph-mon[99496]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T13:02:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:02 smithi005 ceph-mon[99496]: from='osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:02:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:02 smithi005 ceph-mon[99496]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T13:02:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:02 smithi005 ceph-mon[99496]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:02:03.060 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi060 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi060 to 5724M 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:03.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:03 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi060 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi060 to 5724M 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:03.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:03 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi060 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi060 to 5724M 2023-10-08T13:02:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:03.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:03 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:04.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 -- 172.21.15.118:0/451994863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 msgr2=0x7fc4cc105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 --2- 172.21.15.118:0/451994863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc105a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009990 tx=0x7fc4c0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 -- 172.21.15.118:0/451994863 shutdown_connections 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 --2- 172.21.15.118:0/451994863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4cc069450 0x7fc4cc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 --2- 172.21.15.118:0/451994863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc105a50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 --2- 172.21.15.118:0/451994863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4cc068a90 0x7fc4cc068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 -- 172.21.15.118:0/451994863 >> 172.21.15.118:0/451994863 conn(0x7fc4cc0766c0 msgr2=0x7fc4cc076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 -- 172.21.15.118:0/451994863 shutdown_connections 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.392+0000 7fc4d2864700 1 -- 172.21.15.118:0/451994863 wait complete. 2023-10-08T13:02:04.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 Processor -- start 2023-10-08T13:02:04.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 -- start start 2023-10-08T13:02:04.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4cc068a90 0x7fc4cc19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:04.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4cc069450 0x7fc4cc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc1971a0 con 0x7fc4cc069450 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc197310 con 0x7fc4cc068a90 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d2864700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc1974d0 con 0x7fc4cc105670 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45718/0 (socket says 172.21.15.118:45718) 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 -- 172.21.15.118:0/1237818729 learned_addr learned my addr 172.21.15.118:0/1237818729 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4cb7fe700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4cc069450 0x7fc4cc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4cbfff700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4cc068a90 0x7fc4cc19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 -- 172.21.15.118:0/1237818729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4cc068a90 msgr2=0x7fc4cc19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:04.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4cc068a90 0x7fc4cc19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 -- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4cc069450 msgr2=0x7fc4cc19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.393+0000 7fc4d0e01700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4cc069450 0x7fc4cc19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4d0e01700 1 -- 172.21.15.118:0/1237818729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c00095f0 con 0x7fc4cc105670 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4d0e01700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc1969f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400ada0 tx=0x7fc4c400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400f070 con 0x7fc4cc105670 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4c4007b30 con 0x7fc4cc105670 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4005280 con 0x7fc4cc105670 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc1977b0 con 0x7fc4cc105670 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.394+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc1a38c0 con 0x7fc4cc105670 2023-10-08T13:02:04.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.395+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc108d30 con 0x7fc4cc105670 2023-10-08T13:02:04.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.396+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc4c400a090 con 0x7fc4cc105670 2023-10-08T13:02:04.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.396+0000 7fc4c97fa700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4b40a1550 0x7fc4b40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:04.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.396+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5641+0+0 (secure 0 0 0) 0x7fc4c40cbcd0 con 0x7fc4cc105670 2023-10-08T13:02:04.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.397+0000 7fc4cbfff700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4b40a1550 0x7fc4b40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:04.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.397+0000 7fc4cbfff700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4b40a1550 0x7fc4b40a3a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000b5c0 tx=0x7fc4c0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:02:04.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.400+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc4c4095e30 con 0x7fc4cc105670 2023-10-08T13:02:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:04 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:02:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:04 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:02:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:04 smithi118 ceph-mon[104234]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:04 smithi118 ceph-mon[104234]: osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] boot 2023-10-08T13:02:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:04 smithi118 ceph-mon[104234]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T13:02:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:04.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:04.596+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4cc1106f0 con 0x7fc4b40a1550 2023-10-08T13:02:04.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:04 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:02:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:04 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:02:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:04 smithi060 ceph-mon[103190]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:04 smithi060 ceph-mon[103190]: osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] boot 2023-10-08T13:02:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:04 smithi060 ceph-mon[103190]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T13:02:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:04.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:04 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:02:04.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:04 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:02:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:04 smithi005 ceph-mon[99496]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:02:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:04 smithi005 ceph-mon[99496]: osd.7 [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] boot 2023-10-08T13:02:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:04 smithi005 ceph-mon[99496]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T13:02:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:02:05.634 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:05 smithi118 ceph-mon[104234]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T13:02:05.635 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:05 smithi118 ceph-mon[104234]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:05.635 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:05 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:05.635 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:05 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:05.635 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:05 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:05 smithi060 ceph-mon[103190]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T13:02:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:05 smithi060 ceph-mon[103190]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:05 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:05.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:05 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:05.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:05 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:05.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:05 smithi005 ceph-mon[99496]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T13:02:05.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:05 smithi005 ceph-mon[99496]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:05.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:05 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:05.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:05 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:05.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:05 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:06.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:06 smithi060 ceph-mon[103190]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:06 smithi060 ceph-mon[103190]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T13:02:06.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:06 smithi005 ceph-mon[99496]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:06.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:06 smithi005 ceph-mon[99496]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T13:02:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:06 smithi118 ceph-mon[104234]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:06 smithi118 ceph-mon[104234]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T13:02:07.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:07 smithi060 ceph-mon[103190]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T13:02:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:07 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/1662454966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]: dispatch 2023-10-08T13:02:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:07 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]: dispatch 2023-10-08T13:02:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:07 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]': finished 2023-10-08T13:02:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:07 smithi060 ceph-mon[103190]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T13:02:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:07 smithi005 ceph-mon[99496]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T13:02:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:07 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/1662454966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]: dispatch 2023-10-08T13:02:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:07 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]: dispatch 2023-10-08T13:02:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:07 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]': finished 2023-10-08T13:02:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:07 smithi005 ceph-mon[99496]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T13:02:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:07.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:07 smithi118 ceph-mon[104234]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T13:02:07.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:07 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/1662454966' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]: dispatch 2023-10-08T13:02:07.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:07 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]: dispatch 2023-10-08T13:02:07.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:07 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5296573e-315f-4f81-8519-aa97734c73da"}]': finished 2023-10-08T13:02:07.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:07 smithi118 ceph-mon[104234]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T13:02:07.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:08.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:08 smithi060 ceph-mon[103190]: pgmap v147: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:08.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:08 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/731940725' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:08.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:08 smithi005 ceph-mon[99496]: pgmap v147: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:08.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:08 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/731940725' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:08 smithi118 ceph-mon[104234]: pgmap v147: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:08 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/731940725' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:10 smithi060 ceph-mon[103190]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:10.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:10 smithi005 ceph-mon[99496]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:10.742 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:10 smithi118 ceph-mon[104234]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:12.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:12 smithi118 ceph-mon[104234]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:12 smithi060 ceph-mon[103190]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:12.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:12 smithi005 ceph-mon[99496]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:14.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:14 smithi118 ceph-mon[104234]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:14.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T13:02:14.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:14 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:14.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:14 smithi118 ceph-mon[104234]: Deploying daemon osd.8 on smithi118 2023-10-08T13:02:14.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:14 smithi060 ceph-mon[103190]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:14.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T13:02:14.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:14 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:14.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:14 smithi060 ceph-mon[103190]: Deploying daemon osd.8 on smithi118 2023-10-08T13:02:14.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:14 smithi005 ceph-mon[99496]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:14.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T13:02:14.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:14 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:14.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:14 smithi005 ceph-mon[99496]: Deploying daemon osd.8 on smithi118 2023-10-08T13:02:16.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:16 smithi060 ceph-mon[103190]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:16.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:16 smithi005 ceph-mon[99496]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:16.746 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:16 smithi118 ceph-mon[104234]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:18.651 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:18 smithi118 ceph-mon[104234]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:18.651 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:18.651 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:18.651 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:18 smithi060 ceph-mon[103190]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:18.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:18 smithi005 ceph-mon[99496]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:18.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:18.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:18.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:20.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:20 smithi118 ceph-mon[104234]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:20.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:20 smithi060 ceph-mon[103190]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:20.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:20 smithi005 ceph-mon[99496]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:21.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.109+0000 7fc4c97fa700 1 -- 172.21.15.118:0/1237818729 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc4cc1106f0 con 0x7fc4b40a1550 2023-10-08T13:02:21.110 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 8 on host 'smithi118' 2023-10-08T13:02:21.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4b40a1550 msgr2=0x7fc4b40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:21.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4b40a1550 0x7fc4b40a3a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000b5c0 tx=0x7fc4c0005960 comp rx=0 tx=0).stop 2023-10-08T13:02:21.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 msgr2=0x7fc4cc1969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc1969f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400ada0 tx=0x7fc4c400c330 comp rx=0 tx=0).stop 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 shutdown_connections 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4b40a1550 0x7fc4b40a3a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc105670 0x7fc4cc1969f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4cc068a90 0x7fc4cc19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 --2- 172.21.15.118:0/1237818729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4cc069450 0x7fc4cc19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 >> 172.21.15.118:0/1237818729 conn(0x7fc4cc0766c0 msgr2=0x7fc4cc0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 shutdown_connections 2023-10-08T13:02:21.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:02:21.111+0000 7fc4d2864700 1 -- 172.21.15.118:0/1237818729 wait complete. 2023-10-08T13:02:21.547 DEBUG:teuthology.orchestra.run.smithi118:osd.8> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-08T13:02:21.549 INFO:tasks.cephadm:Deploying osd.9 on smithi005 with /dev/vg_nvme/lv_1... 2023-10-08T13:02:21.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T13:02:21.579 INFO:journalctl@ceph.osd.8.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:02:21.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:21.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:21 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:02:22.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:22.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:21 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:22.213 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:02:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:02:21.920+0000 7fc80a733640 -1 osd.8 0 log_to_monitors true 2023-10-08T13:02:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:22 smithi118 ceph-mon[104234]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:22 smithi118 ceph-mon[104234]: from='osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:02:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:22 smithi118 ceph-mon[104234]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:02:23.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:22 smithi005 ceph-mon[99496]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:23.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:22 smithi005 ceph-mon[99496]: from='osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:02:23.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:22 smithi005 ceph-mon[99496]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:02:23.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:22 smithi060 ceph-mon[103190]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:23.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:22 smithi060 ceph-mon[103190]: from='osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:02:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:22 smithi060 ceph-mon[103190]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:02:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T13:02:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T13:02:23.634 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2023-10-08T13:02:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2023-10-08T13:02:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00803763 s, 1.3 GB/s 2023-10-08T13:02:23.634 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2023-10-08T13:02:23.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:23 smithi005 ceph-mon[99496]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T13:02:23.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:23 smithi005 ceph-mon[99496]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T13:02:23.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:23 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:23.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:23 smithi005 ceph-mon[99496]: from='osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:02:23.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:23 smithi005 ceph-mon[99496]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:02:23.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2023-10-08T13:02:24.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:02:23.734+0000 7fc7ffdaa700 -1 osd.8 0 waiting for initial osdmap 2023-10-08T13:02:24.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:02:23.745+0000 7fc7fbb9f700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:02:24.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-mon[104234]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T13:02:24.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-mon[104234]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T13:02:24.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:24.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-mon[104234]: from='osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:02:24.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:23 smithi118 ceph-mon[104234]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:02:24.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:23 smithi060 ceph-mon[103190]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T13:02:24.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:23 smithi060 ceph-mon[103190]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T13:02:24.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:23 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:24.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:23 smithi060 ceph-mon[103190]: from='osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:02:24.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:23 smithi060 ceph-mon[103190]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:02:24.570 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:02:25.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:25.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:25.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:25.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:02:25.111 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:25.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:25.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 -- 172.21.15.5:0/1026875901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c1000a0 msgr2=0x7f926c10c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 --2- 172.21.15.5:0/1026875901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c1000a0 0x7f926c10c540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f926400b0a0 tx=0x7f926400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:02:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 -- 172.21.15.5:0/1026875901 shutdown_connections 2023-10-08T13:02:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 --2- 172.21.15.5:0/1026875901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c1000a0 0x7f926c10c540 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:25.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 --2- 172.21.15.5:0/1026875901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c1045b0 0x7f926c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 --2- 172.21.15.5:0/1026875901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926c0ff6e0 0x7f926c0ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 -- 172.21.15.5:0/1026875901 >> 172.21.15.5:0/1026875901 conn(0x7f926c0766c0 msgr2=0x7f926c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 -- 172.21.15.5:0/1026875901 shutdown_connections 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.748+0000 7f9273361700 1 -- 172.21.15.5:0/1026875901 wait complete. 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 Processor -- start 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 -- start start 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 0x7f926c197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c1000a0 0x7f926c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926c1045b0 0x7f926c1a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:25.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c198970 con 0x7f926c0ff6e0 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1a31a0 con 0x7f926c1000a0 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f9273361700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1a32e0 con 0x7f926c1045b0 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 0x7f926c197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 0x7f926c197be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60066/0 (socket says 172.21.15.5:60066) 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 -- 172.21.15.5:0/588012640 learned_addr learned my addr 172.21.15.5:0/588012640 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92718fe700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926c1045b0 0x7f926c1a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92708fc700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c1000a0 0x7f926c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 -- 172.21.15.5:0/588012640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926c1045b0 msgr2=0x7f926c1a2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:25.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926c1045b0 0x7f926c1a2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 -- 172.21.15.5:0/588012640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c1000a0 msgr2=0x7f926c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c1000a0 0x7f926c198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.749+0000 7f92710fd700 1 -- 172.21.15.5:0/588012640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009d00 con 0x7f926c0ff6e0 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.750+0000 7f92710fd700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 0x7f926c197be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f926800c9a0 tx=0x7f926800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.750+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268007a60 con 0x7f926c0ff6e0 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.750+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9268004cf0 con 0x7f926c0ff6e0 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.750+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268005560 con 0x7f926c0ff6e0 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.750+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c1a3540 con 0x7f926c0ff6e0 2023-10-08T13:02:25.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.750+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c1a39f0 con 0x7f926c0ff6e0 2023-10-08T13:02:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.751+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c107c20 con 0x7f926c0ff6e0 2023-10-08T13:02:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.752+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f9268004750 con 0x7f926c0ff6e0 2023-10-08T13:02:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.752+0000 7f92627fc700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f92580a1550 0x7f92580a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.752+0000 7f92708fc700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f92580a1550 0x7f92580a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.752+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9268013070 con 0x7f926c0ff6e0 2023-10-08T13:02:25.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.753+0000 7f92708fc700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f92580a1550 0x7f92580a3a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f925c005950 tx=0x7f925c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:02:25.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.757+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92680960d0 con 0x7f926c0ff6e0 2023-10-08T13:02:25.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi118 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi118 to 5722M 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] boot 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:25.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:25 smithi005 ceph-mon[99496]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T13:02:25.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:25.966+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f926c069030 con 0x7f92580a1550 2023-10-08T13:02:26.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:02:26.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi118 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi118 to 5722M 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] boot 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:26.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:25 smithi118 ceph-mon[104234]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T13:02:26.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:02:26.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi118 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi118 to 5722M 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: osd.8 [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] boot 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:02:26.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:25 smithi060 ceph-mon[103190]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T13:02:27.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:26 smithi118 ceph-mon[104234]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:27.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:27.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:27.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:27.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:26 smithi118 ceph-mon[104234]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T13:02:27.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:26 smithi005 ceph-mon[99496]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:27.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:27.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:27.087 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:27.087 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:26 smithi005 ceph-mon[99496]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T13:02:27.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:26 smithi060 ceph-mon[103190]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:02:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:26 smithi060 ceph-mon[103190]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T13:02:27.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:27 smithi005 ceph-mon[99496]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:27.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:27 smithi005 ceph-mon[99496]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T13:02:28.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:27 smithi118 ceph-mon[104234]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:28.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:27 smithi118 ceph-mon[104234]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T13:02:28.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:27 smithi060 ceph-mon[103190]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:28.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:27 smithi060 ceph-mon[103190]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T13:02:29.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:28 smithi118 ceph-mon[104234]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:29.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:28 smithi118 ceph-mon[104234]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T13:02:29.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3197428626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a7f6068-38ca-4855-85bf-4f8369179767"}]: dispatch 2023-10-08T13:02:29.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3197428626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a7f6068-38ca-4855-85bf-4f8369179767"}]': finished 2023-10-08T13:02:29.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:28 smithi118 ceph-mon[104234]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T13:02:29.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:28 smithi060 ceph-mon[103190]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:28 smithi060 ceph-mon[103190]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T13:02:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3197428626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a7f6068-38ca-4855-85bf-4f8369179767"}]: dispatch 2023-10-08T13:02:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3197428626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a7f6068-38ca-4855-85bf-4f8369179767"}]': finished 2023-10-08T13:02:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:28 smithi060 ceph-mon[103190]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T13:02:29.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:28 smithi005 ceph-mon[99496]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:28 smithi005 ceph-mon[99496]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T13:02:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3197428626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a7f6068-38ca-4855-85bf-4f8369179767"}]: dispatch 2023-10-08T13:02:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3197428626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a7f6068-38ca-4855-85bf-4f8369179767"}]': finished 2023-10-08T13:02:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:28 smithi005 ceph-mon[99496]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T13:02:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:30.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:29 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1226296407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:30.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:29 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1226296407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:30.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:29 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1226296407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:31.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:30 smithi118 ceph-mon[104234]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T13:02:31.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:30 smithi060 ceph-mon[103190]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T13:02:31.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:30 smithi005 ceph-mon[99496]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 145 KiB/s, 0 objects/s recovering 2023-10-08T13:02:33.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:32 smithi118 ceph-mon[104234]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T13:02:33.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:32 smithi060 ceph-mon[103190]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T13:02:33.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:32 smithi005 ceph-mon[99496]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-08T13:02:34.886 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:34 smithi005 ceph-mon[99496]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:02:35.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:34 smithi118 ceph-mon[104234]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:02:35.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:34 smithi060 ceph-mon[103190]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:02:35.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:35 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T13:02:35.885 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:35 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:35.885 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:35 smithi005 ceph-mon[99496]: Deploying daemon osd.9 on smithi005 2023-10-08T13:02:36.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:35 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T13:02:36.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:35 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:36.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:35 smithi118 ceph-mon[104234]: Deploying daemon osd.9 on smithi005 2023-10-08T13:02:36.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:35 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T13:02:36.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:35 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:36.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:35 smithi060 ceph-mon[103190]: Deploying daemon osd.9 on smithi005 2023-10-08T13:02:37.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:36 smithi118 ceph-mon[104234]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:02:37.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:36 smithi005 ceph-mon[99496]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:02:37.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:36 smithi060 ceph-mon[103190]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:02:39.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:38 smithi118 ceph-mon[104234]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:02:39.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:38 smithi005 ceph-mon[99496]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:02:39.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:38 smithi060 ceph-mon[103190]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:02:40.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:40 smithi005 ceph-mon[99496]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:40 smithi118 ceph-mon[104234]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:40.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:40.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:40.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:40 smithi060 ceph-mon[103190]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:40.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:40.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:40.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.273 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 9 on host 'smithi005' 2023-10-08T13:02:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.272+0000 7f92627fc700 1 -- 172.21.15.5:0/588012640 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f926c069030 con 0x7f92580a1550 2023-10-08T13:02:42.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f92580a1550 msgr2=0x7f92580a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:42.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f92580a1550 0x7f92580a3a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f925c005950 tx=0x7f925c0058e0 comp rx=0 tx=0).stop 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 msgr2=0x7f926c197be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 0x7f926c197be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f926800c9a0 tx=0x7f926800ccb0 comp rx=0 tx=0).stop 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 shutdown_connections 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f92580a1550 0x7f92580a3a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f926c1045b0 0x7f926c1a2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0ff6e0 0x7f926c197be0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 --2- 172.21.15.5:0/588012640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f926c1000a0 0x7f926c198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:42.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.274+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 >> 172.21.15.5:0/588012640 conn(0x7f926c0766c0 msgr2=0x7f926c0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:02:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.275+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 shutdown_connections 2023-10-08T13:02:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:02:42.275+0000 7f9273361700 1 -- 172.21.15.5:0/588012640 wait complete. 2023-10-08T13:02:42.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:42.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:42.661 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:42.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:42 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:42.663 DEBUG:teuthology.orchestra.run.smithi005:osd.9> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-08T13:02:42.666 INFO:tasks.cephadm:Deploying osd.10 on smithi060 with /dev/vg_nvme/lv_1... 2023-10-08T13:02:42.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T13:02:42.699 INFO:journalctl@ceph.osd.9.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:02:42.700 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:42.700 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.700 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:42.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:42.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:42 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:42.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:42.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:42 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:02:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:02:43.371 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:02:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:02:43.080+0000 7f043027f640 -1 osd.9 0 log_to_monitors true 2023-10-08T13:02:43.666 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:43 smithi060 ceph-mon[103190]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T13:02:43.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:43 smithi005 ceph-mon[99496]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T13:02:43.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:43 smithi118 ceph-mon[104234]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T13:02:44.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-mon[99496]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:44.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-mon[99496]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T13:02:44.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-mon[99496]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T13:02:44.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-mon[99496]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:02:44.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:44.673 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:02:44.430+0000 7f04258f6700 -1 osd.9 0 waiting for initial osdmap 2023-10-08T13:02:44.673 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:02:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:02:44.446+0000 7f041dee4700 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:02:44.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:44 smithi118 ceph-mon[104234]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:44.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:44 smithi118 ceph-mon[104234]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T13:02:44.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:44 smithi118 ceph-mon[104234]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T13:02:44.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:44 smithi118 ceph-mon[104234]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:02:44.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:44.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:44 smithi060 ceph-mon[103190]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:44.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:44 smithi060 ceph-mon[103190]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T13:02:44.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:44 smithi060 ceph-mon[103190]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T13:02:44.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:44 smithi060 ceph-mon[103190]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2023-10-08T13:02:44.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:44.953 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T13:02:44.953 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T13:02:44.953 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2023-10-08T13:02:44.953 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2023-10-08T13:02:44.953 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0082732 s, 1.3 GB/s 2023-10-08T13:02:44.953 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2023-10-08T13:02:45.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2023-10-08T13:02:45.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:45 smithi060 ceph-mon[103190]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:02:45.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:45 smithi060 ceph-mon[103190]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T13:02:45.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:45 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:45.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:45 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:45.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:45 smithi118 ceph-mon[104234]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:02:45.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:45 smithi118 ceph-mon[104234]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T13:02:45.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:45 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:45.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:45 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:45.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:45 smithi005 ceph-mon[99496]: from='osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2023-10-08T13:02:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:45 smithi005 ceph-mon[99496]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T13:02:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:45 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:45.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:45 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.013 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:02:46.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:02:46.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:02:46.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:46.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] boot 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi005 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi005 to 4293M 2023-10-08T13:02:46.562 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.563 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:46.563 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:46.563 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] boot 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi005 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi005 to 4293M 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:46.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: osd.9 [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] boot 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi005 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi005 to 4293M 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:02:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:02:47.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 -- 172.21.15.60:0/430607288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e0101260 msgr2=0x7f25e010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:47.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 --2- 172.21.15.60:0/430607288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e0101260 0x7f25e010d650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f25d800b0a0 tx=0x7f25d800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 -- 172.21.15.60:0/430607288 shutdown_connections 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 --2- 172.21.15.60:0/430607288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e0101260 0x7f25e010d650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 --2- 172.21.15.60:0/430607288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e01057c0 0x7f25e0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 --2- 172.21.15.60:0/430607288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e01008a0 0x7f25e0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.270+0000 7f25e7979700 1 -- 172.21.15.60:0/430607288 >> 172.21.15.60:0/430607288 conn(0x7f25e00779e0 msgr2=0x7f25e0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.271+0000 7f25e7979700 1 -- 172.21.15.60:0/430607288 shutdown_connections 2023-10-08T13:02:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.271+0000 7f25e7979700 1 -- 172.21.15.60:0/430607288 wait complete. 2023-10-08T13:02:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.271+0000 7f25e7979700 1 Processor -- start 2023-10-08T13:02:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.271+0000 7f25e7979700 1 -- start start 2023-10-08T13:02:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.271+0000 7f25e7979700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e01008a0 0x7f25e019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e0101260 0x7f25e019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 0x7f25e0196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0197230 con 0x7f25e0101260 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01973a0 con 0x7f25e01057c0 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0197560 con 0x7f25e01008a0 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 0x7f25e0196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 0x7f25e0196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43936/0 (socket says 172.21.15.60:43936) 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 -- 172.21.15.60:0/1692907672 learned_addr learned my addr 172.21.15.60:0/1692907672 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e4f14700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e0101260 0x7f25e019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5715700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e01008a0 0x7f25e019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 -- 172.21.15.60:0/1692907672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e01008a0 msgr2=0x7f25e019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e01008a0 0x7f25e019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 -- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e0101260 msgr2=0x7f25e019cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e0101260 0x7f25e019cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 -- 172.21.15.60:0/1692907672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8009d00 con 0x7f25e01057c0 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e5f16700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 0x7f25e0196bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25d800b070 tx=0x7f25d80094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800e040 con 0x7f25e01057c0 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25d8007990 con 0x7f25e01057c0 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e01977e0 con 0x7f25e01057c0 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d801b450 con 0x7f25e01057c0 2023-10-08T13:02:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.272+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e01a3a30 con 0x7f25e01057c0 2023-10-08T13:02:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.273+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0108d80 con 0x7f25e01057c0 2023-10-08T13:02:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.274+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f25d801d610 con 0x7f25e01057c0 2023-10-08T13:02:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.275+0000 7f25d27fc700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25cc0a14d0 0x7f25cc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:02:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.275+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6476+0+0 (secure 0 0 0) 0x7f25d80cdbb0 con 0x7f25e01057c0 2023-10-08T13:02:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.275+0000 7f25e5715700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25cc0a14d0 0x7f25cc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:02:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.276+0000 7f25e5715700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25cc0a14d0 0x7f25cc0a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006fd0 tx=0x7f25dc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:02:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.280+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f25d8097930 con 0x7f25e01057c0 2023-10-08T13:02:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:02:47.490+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f25e0197fd0 con 0x7f25cc0a14d0 2023-10-08T13:02:47.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:47 smithi060 ceph-mon[103190]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T13:02:47.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:47.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:47.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:47.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:47 smithi005 ceph-mon[99496]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T13:02:47.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:47.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:47.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:48.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:47 smithi118 ceph-mon[104234]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T13:02:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:02:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:02:48.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:48.818 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:48 smithi060 ceph-mon[103190]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:48.818 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:48 smithi060 ceph-mon[103190]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:48.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:48 smithi005 ceph-mon[99496]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:48 smithi005 ceph-mon[99496]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:49.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:48 smithi118 ceph-mon[104234]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:49.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:48 smithi118 ceph-mon[104234]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:02:50.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/235836953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]: dispatch 2023-10-08T13:02:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]: dispatch 2023-10-08T13:02:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]': finished 2023-10-08T13:02:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T13:02:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:02:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.60:0/2492794462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:50.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/235836953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]: dispatch 2023-10-08T13:02:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]: dispatch 2023-10-08T13:02:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]': finished 2023-10-08T13:02:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T13:02:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:02:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.60:0/2492794462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:51.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:51.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/235836953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]: dispatch 2023-10-08T13:02:51.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]: dispatch 2023-10-08T13:02:51.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2ca2394-71e1-489e-b517-492641d774bc"}]': finished 2023-10-08T13:02:51.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T13:02:51.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:02:51.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.60:0/2492794462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:02:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:52 smithi060 ceph-mon[103190]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:52.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:52 smithi005 ceph-mon[99496]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:53.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:52 smithi118 ceph-mon[104234]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:54.899 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:54 smithi060 ceph-mon[103190]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:54.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:54 smithi005 ceph-mon[99496]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:55.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:54 smithi118 ceph-mon[104234]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:56.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:56 smithi060 ceph-mon[103190]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:56.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T13:02:56.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:56.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:56 smithi005 ceph-mon[99496]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:56.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T13:02:56.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:57.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:56 smithi118 ceph-mon[104234]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:57.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T13:02:57.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:02:57.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:57 smithi060 ceph-mon[103190]: Deploying daemon osd.10 on smithi060 2023-10-08T13:02:57.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:57 smithi005 ceph-mon[99496]: Deploying daemon osd.10 on smithi060 2023-10-08T13:02:58.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:57 smithi118 ceph-mon[104234]: Deploying daemon osd.10 on smithi060 2023-10-08T13:02:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:02:58 smithi060 ceph-mon[103190]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:58.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:02:58 smithi005 ceph-mon[99496]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:02:59.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:02:58 smithi118 ceph-mon[104234]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:00.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:00 smithi060 ceph-mon[103190]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:00.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:00 smithi005 ceph-mon[99496]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:01.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:00 smithi118 ceph-mon[104234]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:02.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:01 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:02.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:01 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:01 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:02.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:01 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:01 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:02.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:01 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:02.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:01 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:02.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:01 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:02.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:01 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:03.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:02 smithi060 ceph-mon[103190]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:03.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:02 smithi005 ceph-mon[99496]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:03.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:02 smithi118 ceph-mon[104234]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:03.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.662+0000 7f25d27fc700 1 -- 172.21.15.60:0/1692907672 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f25e0197fd0 con 0x7f25cc0a14d0 2023-10-08T13:03:03.664 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 10 on host 'smithi060' 2023-10-08T13:03:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25cc0a14d0 msgr2=0x7f25cc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25cc0a14d0 0x7f25cc0a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f25dc006fd0 tx=0x7f25dc008040 comp rx=0 tx=0).stop 2023-10-08T13:03:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 msgr2=0x7f25e0196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 0x7f25e0196bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f25d800b070 tx=0x7f25d80094c0 comp rx=0 tx=0).stop 2023-10-08T13:03:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 shutdown_connections 2023-10-08T13:03:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25cc0a14d0 0x7f25cc0a3990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25e01057c0 0x7f25e0196bd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25e01008a0 0x7f25e019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 --2- 172.21.15.60:0/1692907672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25e0101260 0x7f25e019cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 >> 172.21.15.60:0/1692907672 conn(0x7f25e00779e0 msgr2=0x7f25e00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.664+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 shutdown_connections 2023-10-08T13:03:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-08T13:03:03.665+0000 7f25e7979700 1 -- 172.21.15.60:0/1692907672 wait complete. 2023-10-08T13:03:04.009 DEBUG:teuthology.orchestra.run.smithi060:osd.10> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-08T13:03:04.011 INFO:tasks.cephadm:Deploying osd.11 on smithi118 with /dev/vg_nvme/lv_1... 2023-10-08T13:03:04.011 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T13:03:04.049 INFO:journalctl@ceph.osd.10.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:03:04.585 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:03:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:04 smithi005 ceph-mon[99496]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:04 smithi118 ceph-mon[104234]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.804 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:04 smithi060 ceph-mon[103190]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:04.804 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.805 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.805 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:04.805 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:05.057 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:03:04 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:03:04.802+0000 7faa6e37a640 -1 osd.10 0 log_to_monitors true 2023-10-08T13:03:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:05 smithi060 ceph-mon[103190]: from='osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:03:05.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:05 smithi060 ceph-mon[103190]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:03:05.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:05 smithi118 ceph-mon[104234]: from='osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:03:05.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:05 smithi118 ceph-mon[104234]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:03:05.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:05 smithi005 ceph-mon[99496]: from='osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:03:05.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:05 smithi005 ceph-mon[99496]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:03:06.056 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T13:03:06.056 INFO:teuthology.orchestra.run.smithi118.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T13:03:06.057 INFO:teuthology.orchestra.run.smithi118.stderr: stderr: 10+0 records in 2023-10-08T13:03:06.057 INFO:teuthology.orchestra.run.smithi118.stderr:10+0 records out 2023-10-08T13:03:06.057 INFO:teuthology.orchestra.run.smithi118.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00867357 s, 1.2 GB/s 2023-10-08T13:03:06.057 INFO:teuthology.orchestra.run.smithi118.stderr:--> Zapping successful for: 2023-10-08T13:03:06.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi118:vg_nvme/lv_1 2023-10-08T13:03:06.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:06 smithi118 ceph-mon[104234]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:06.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:06 smithi118 ceph-mon[104234]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T13:03:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:06 smithi118 ceph-mon[104234]: from='osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:03:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:06 smithi118 ceph-mon[104234]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T13:03:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:06.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:06 smithi118 ceph-mon[104234]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:03:06.898 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-mon[103190]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:06.898 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-mon[103190]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T13:03:06.899 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-mon[103190]: from='osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:03:06.899 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-mon[103190]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T13:03:06.899 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:06.899 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-mon[103190]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:03:06.899 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:03:06.500+0000 7faa639f1700 -1 osd.10 0 waiting for initial osdmap 2023-10-08T13:03:06.899 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:03:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:03:06.512+0000 7faa5cfe1700 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:03:06.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:06 smithi005 ceph-mon[99496]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:06.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:06 smithi005 ceph-mon[99496]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T13:03:06.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:06 smithi005 ceph-mon[99496]: from='osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:03:06.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:06 smithi005 ceph-mon[99496]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T13:03:06.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:06.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:06 smithi005 ceph-mon[99496]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2023-10-08T13:03:06.988 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:03:07.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:07.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:07.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:07.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3744631014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4100840 msgr2=0x7fd6d4100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:08.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3744631014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4100840 0x7fd6d4100cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009990 tx=0x7fd6c4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3744631014 shutdown_connections 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3744631014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6d4101200 0x7fd6d410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3744631014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d41056a0 0x7fd6d4105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3744631014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4100840 0x7fd6d4100cc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3744631014 >> 172.21.15.118:0/3744631014 conn(0x7fd6d4077950 msgr2=0x7fd6d4077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3744631014 shutdown_connections 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3744631014 wait complete. 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.282+0000 7fd6d99eb700 1 Processor -- start 2023-10-08T13:03:08.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 -- start start 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d4100840 0x7fd6d419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 0x7fd6d419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6d41056a0 0x7fd6d4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41970a0 con 0x7fd6d41056a0 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4197210 con 0x7fd6d4100840 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d99eb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41973d0 con 0x7fd6d4101200 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 0x7fd6d419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 0x7fd6d419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45866/0 (socket says 172.21.15.118:45866) 2023-10-08T13:03:08.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 -- 172.21.15.118:0/3748000687 learned_addr learned my addr 172.21.15.118:0/3748000687 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d2ffd700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d4100840 0x7fd6d419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d37fe700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6d41056a0 0x7fd6d4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 -- 172.21.15.118:0/3748000687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d4100840 msgr2=0x7fd6d419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d4100840 0x7fd6d419c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 -- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6d41056a0 msgr2=0x7fd6d4196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6d41056a0 0x7fd6d4196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 -- 172.21.15.118:0/3748000687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40095f0 con 0x7fd6d4101200 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.283+0000 7fd6d27fc700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 0x7fd6d419ce40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4000c00 tx=0x7fd6c400f7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:08.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.284+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c401d070 con 0x7fd6d4101200 2023-10-08T13:03:08.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.284+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4197650 con 0x7fd6d4101200 2023-10-08T13:03:08.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.284+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6c400fd30 con 0x7fd6d4101200 2023-10-08T13:03:08.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.284+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4017630 con 0x7fd6d4101200 2023-10-08T13:03:08.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.284+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d41a38f0 con 0x7fd6d4101200 2023-10-08T13:03:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.285+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d4108d10 con 0x7fd6d4101200 2023-10-08T13:03:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.286+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd6c4004830 con 0x7fd6d4101200 2023-10-08T13:03:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.286+0000 7fd6d89e9700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6bc0a14d0 0x7fd6bc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.286+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6942+0+0 (secure 0 0 0) 0x7fd6c40cdde0 con 0x7fd6d4101200 2023-10-08T13:03:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.287+0000 7fd6d2ffd700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6bc0a14d0 0x7fd6bc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.287+0000 7fd6d2ffd700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6bc0a14d0 0x7fd6bc0a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005950 tx=0x7fd6c800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.290+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6c4097a30 con 0x7fd6d4101200 2023-10-08T13:03:08.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:08.488+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d4197f00 con 0x7fd6bc0a14d0 2023-10-08T13:03:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi060 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi060 to 4293M 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] boot 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:03:08.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:08 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:03:08.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:03:08.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi060 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi060 to 4293M 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] boot 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:03:08.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:08 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:03:08.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi060 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi060 to 4293M 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: osd.10 [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] boot 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:03:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:08 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:03:09.628 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:09 smithi118 ceph-mon[104234]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:03:09.629 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:09.629 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:09 smithi118 ceph-mon[104234]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T13:03:09.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:09 smithi060 ceph-mon[103190]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:03:09.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:09.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:09 smithi060 ceph-mon[103190]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T13:03:09.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:09 smithi005 ceph-mon[99496]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi118:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:03:09.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:09.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:09 smithi005 ceph-mon[99496]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T13:03:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:10 smithi118 ceph-mon[104234]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:10 smithi118 ceph-mon[104234]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T13:03:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:10 smithi118 ceph-mon[104234]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T13:03:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:10 smithi060 ceph-mon[103190]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:10 smithi060 ceph-mon[103190]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T13:03:10.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:10 smithi060 ceph-mon[103190]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T13:03:10.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:10 smithi005 ceph-mon[99496]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:10.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:10 smithi005 ceph-mon[99496]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T13:03:10.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:10 smithi005 ceph-mon[99496]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T13:03:11.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:11 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/3575553201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]: dispatch 2023-10-08T13:03:11.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:11 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]: dispatch 2023-10-08T13:03:11.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:11 smithi118 ceph-mon[104234]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]': finished 2023-10-08T13:03:11.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:11 smithi118 ceph-mon[104234]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T13:03:11.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:11 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:11.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:11 smithi118 ceph-mon[104234]: from='client.? 172.21.15.118:0/261215798' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:03:11.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:11 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/3575553201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]: dispatch 2023-10-08T13:03:11.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:11 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]: dispatch 2023-10-08T13:03:11.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:11 smithi060 ceph-mon[103190]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]': finished 2023-10-08T13:03:11.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:11 smithi060 ceph-mon[103190]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T13:03:11.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:11 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:11.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:11 smithi060 ceph-mon[103190]: from='client.? 172.21.15.118:0/261215798' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:03:11.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:11 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/3575553201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]: dispatch 2023-10-08T13:03:11.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:11 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]: dispatch 2023-10-08T13:03:11.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:11 smithi005 ceph-mon[99496]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15ba66fb-f768-4c8c-8364-b578f94d5543"}]': finished 2023-10-08T13:03:11.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:11 smithi005 ceph-mon[99496]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T13:03:11.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:11 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:11.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:11 smithi005 ceph-mon[99496]: from='client.? 172.21.15.118:0/261215798' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:03:13.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:12 smithi060 ceph-mon[103190]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:13.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:12 smithi005 ceph-mon[99496]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:13.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:12 smithi118 ceph-mon[104234]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:15.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:14 smithi060 ceph-mon[103190]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:15.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:14 smithi005 ceph-mon[99496]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:15.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:14 smithi118 ceph-mon[104234]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:16 smithi118 ceph-mon[104234]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:03:17.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:16 smithi060 ceph-mon[103190]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:03:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:16 smithi005 ceph-mon[99496]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T13:03:18.115 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T13:03:18.116 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:17 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:18.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T13:03:18.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:17 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:18.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T13:03:18.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:17 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:18 smithi060 ceph-mon[103190]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2023-10-08T13:03:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:18 smithi060 ceph-mon[103190]: Deploying daemon osd.11 on smithi118 2023-10-08T13:03:19.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:18 smithi005 ceph-mon[99496]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2023-10-08T13:03:19.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:18 smithi005 ceph-mon[99496]: Deploying daemon osd.11 on smithi118 2023-10-08T13:03:19.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:18 smithi118 ceph-mon[104234]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2023-10-08T13:03:19.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:18 smithi118 ceph-mon[104234]: Deploying daemon osd.11 on smithi118 2023-10-08T13:03:21.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:20 smithi060 ceph-mon[103190]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:03:21.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:20 smithi005 ceph-mon[99496]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:03:21.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:20 smithi118 ceph-mon[104234]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-08T13:03:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:22 smithi118 ceph-mon[104234]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-08T13:03:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:23.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:22 smithi060 ceph-mon[103190]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-08T13:03:23.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:23.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:22 smithi005 ceph-mon[99496]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-08T13:03:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:24.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.754+0000 7fd6d89e9700 1 -- 172.21.15.118:0/3748000687 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd6d4197f00 con 0x7fd6bc0a14d0 2023-10-08T13:03:24.756 INFO:teuthology.orchestra.run.smithi118.stdout:Created osd(s) 11 on host 'smithi118' 2023-10-08T13:03:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6bc0a14d0 msgr2=0x7fd6bc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:24.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6bc0a14d0 0x7fd6bc0a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005950 tx=0x7fd6c800a300 comp rx=0 tx=0).stop 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 msgr2=0x7fd6d419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 0x7fd6d419ce40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4000c00 tx=0x7fd6c400f7d0 comp rx=0 tx=0).stop 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 shutdown_connections 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6bc0a14d0 0x7fd6bc0a3990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6d41056a0 0x7fd6d4196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d4100840 0x7fd6d419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 --2- 172.21.15.118:0/3748000687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6d4101200 0x7fd6d419ce40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 >> 172.21.15.118:0/3748000687 conn(0x7fd6d4077950 msgr2=0x7fd6d40fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 shutdown_connections 2023-10-08T13:03:24.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:24.756+0000 7fd6d99eb700 1 -- 172.21.15.118:0/3748000687 wait complete. 2023-10-08T13:03:25.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:24 smithi118 ceph-mon[104234]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:03:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:24 smithi060 ceph-mon[103190]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:03:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.162 DEBUG:teuthology.orchestra.run.smithi118:osd.11> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-08T13:03:25.164 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-08T13:03:25.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T13:03:25.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:24 smithi005 ceph-mon[99496]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:03:25.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:25.193 INFO:journalctl@ceph.osd.11.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:03:25.748 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:03:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:03:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:03:25.835+0000 7f8a38f0e640 -1 osd.11 0 log_to_monitors true 2023-10-08T13:03:26.235 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:26 smithi005 ceph-mon[99496]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:03:26.236 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:26 smithi005 ceph-mon[99496]: from='osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:03:26.236 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:26 smithi005 ceph-mon[99496]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:03:26.301 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:26 smithi118 ceph-mon[104234]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:03:26.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:26 smithi118 ceph-mon[104234]: from='osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:03:26.302 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:26 smithi118 ceph-mon[104234]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:03:26.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:26 smithi060 ceph-mon[103190]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:03:26.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:26 smithi060 ceph-mon[103190]: from='osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:03:26.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:26 smithi060 ceph-mon[103190]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.960+0000 7f1ee4877700 1 -- 172.21.15.5:0/4194816502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0100110 msgr2=0x7f1ee010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.960+0000 7f1ee4877700 1 --2- 172.21.15.5:0/4194816502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0100110 0x7f1ee010c580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009f90 tx=0x7f1ed800b330 comp rx=0 tx=0).stop 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 -- 172.21.15.5:0/4194816502 shutdown_connections 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 --2- 172.21.15.5:0/4194816502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0100110 0x7f1ee010c580 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 --2- 172.21.15.5:0/4194816502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee01056b0 0x7f1ee0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 --2- 172.21.15.5:0/4194816502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee00ff750 0x7f1ee00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:26.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 -- 172.21.15.5:0/4194816502 >> 172.21.15.5:0/4194816502 conn(0x7f1ee0075790 msgr2=0x7f1ee0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 -- 172.21.15.5:0/4194816502 shutdown_connections 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 -- 172.21.15.5:0/4194816502 wait complete. 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.961+0000 7f1ee4877700 1 Processor -- start 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 -- start start 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee00ff750 0x7f1ee01971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee0100110 0x7f1ee01976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 0x7f1ee019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee019cd50 con 0x7f1ee01056b0 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee019cec0 con 0x7f1ee0100110 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ee4877700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee019d080 con 0x7f1ee00ff750 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 0x7f1ee019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ede59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee00ff750 0x7f1ee01971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ede59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee00ff750 0x7f1ee01971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:45196/0 (socket says 172.21.15.5:45196) 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1ede59c700 1 -- 172.21.15.5:0/3216736516 learned_addr learned my addr 172.21.15.5:0/3216736516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 0x7f1ee019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60228/0 (socket says 172.21.15.5:60228) 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eddd9b700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee0100110 0x7f1ee01976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 -- 172.21.15.5:0/3216736516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee00ff750 msgr2=0x7f1ee01971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee00ff750 0x7f1ee01971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 -- 172.21.15.5:0/3216736516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee0100110 msgr2=0x7f1ee01976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee0100110 0x7f1ee01976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 -- 172.21.15.5:0/3216736516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8009c40 con 0x7f1ee01056b0 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eddd9b700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee0100110 0x7f1ee01976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:03:26.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.962+0000 7f1eded9d700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 0x7f1ee019c6c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800b6c0 tx=0x7f1ed80094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.963+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800e040 con 0x7f1ee01056b0 2023-10-08T13:03:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.963+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ed8007e10 con 0x7f1ee01056b0 2023-10-08T13:03:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.963+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee019d300 con 0x7f1ee01056b0 2023-10-08T13:03:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.963+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8005040 con 0x7f1ee01056b0 2023-10-08T13:03:26.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.963+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee01a3a10 con 0x7f1ee01056b0 2023-10-08T13:03:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.963+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee0100df0 con 0x7f1ee01056b0 2023-10-08T13:03:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.965+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1ed801b450 con 0x7f1ee01056b0 2023-10-08T13:03:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.965+0000 7f1ed77fe700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1ecc0a14d0 0x7f1ecc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.965+0000 7f1ede59c700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1ecc0a14d0 0x7f1ecc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.965+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7046+0+0 (secure 0 0 0) 0x7f1ed80ce250 con 0x7f1ee01056b0 2023-10-08T13:03:26.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.966+0000 7f1ede59c700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1ecc0a14d0 0x7f1ecc0a3990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0198320 tx=0x7f1ed0009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:26.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:26.969+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ed8097e30 con 0x7f1ee01056b0 2023-10-08T13:03:27.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.174+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1ee0198070 con 0x7f1ee01056b0 2023-10-08T13:03:27.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.174+0000 7f1ed77fe700 1 -- 172.21.15.5:0/3216736516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7f1ed809b450 con 0x7f1ee01056b0 2023-10-08T13:03:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1ecc0a14d0 msgr2=0x7f1ecc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1ecc0a14d0 0x7f1ecc0a3990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0198320 tx=0x7f1ed0009310 comp rx=0 tx=0).stop 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 msgr2=0x7f1ee019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 0x7f1ee019c6c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800b6c0 tx=0x7f1ed80094b0 comp rx=0 tx=0).stop 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 shutdown_connections 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1ecc0a14d0 0x7f1ecc0a3990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee01056b0 0x7f1ee019c6c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee00ff750 0x7f1ee01971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 --2- 172.21.15.5:0/3216736516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee0100110 0x7f1ee01976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 >> 172.21.15.5:0/3216736516 conn(0x7f1ee0075790 msgr2=0x7f1ee00fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 shutdown_connections 2023-10-08T13:03:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:27.176+0000 7f1ee4877700 1 -- 172.21.15.5:0/3216736516 wait complete. 2023-10-08T13:03:27.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:27 smithi060 ceph-mon[103190]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T13:03:27.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:27 smithi060 ceph-mon[103190]: from='osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:03:27.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:27 smithi060 ceph-mon[103190]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T13:03:27.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:27 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:27.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:27 smithi060 ceph-mon[103190]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:03:27.421 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:03:27.112+0000 7f8a2e585700 -1 osd.11 0 waiting for initial osdmap 2023-10-08T13:03:27.421 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:03:27.124+0000 7f8a28376700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:03:27.421 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-mon[104234]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T13:03:27.421 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-mon[104234]: from='osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-mon[104234]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:27 smithi118 ceph-mon[104234]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:27 smithi005 ceph-mon[99496]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:27 smithi005 ceph-mon[99496]: from='osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:27 smithi005 ceph-mon[99496]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T13:03:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:27 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:27.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:27 smithi005 ceph-mon[99496]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]: dispatch 2023-10-08T13:03:27.609 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1696770187,"num_in_osds":12,"osd_in_since":1696770190,"num_remapped_pgs":0} 2023-10-08T13:03:28.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3216736516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: Detected new or changed devices on smithi118 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi118 to 4292M 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:28.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3216736516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: Detected new or changed devices on smithi118 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi118 to 4292M 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:28.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:28.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:03:28.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi118", "root=default"]}]': finished 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3216736516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: Detected new or changed devices on smithi118 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi118 to 4292M 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:28.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:28.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T13:03:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:03:29.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:29 smithi005 ceph-mon[99496]: purged_snaps scrub starts 2023-10-08T13:03:29.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:29 smithi005 ceph-mon[99496]: purged_snaps scrub ok 2023-10-08T13:03:29.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:29 smithi005 ceph-mon[99496]: osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] boot 2023-10-08T13:03:29.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:29 smithi005 ceph-mon[99496]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T13:03:29.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:29 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:29.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:29 smithi060 ceph-mon[103190]: purged_snaps scrub starts 2023-10-08T13:03:29.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:29 smithi060 ceph-mon[103190]: purged_snaps scrub ok 2023-10-08T13:03:29.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:29 smithi060 ceph-mon[103190]: osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] boot 2023-10-08T13:03:29.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:29 smithi060 ceph-mon[103190]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T13:03:29.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:29 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:29.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:29 smithi118 ceph-mon[104234]: purged_snaps scrub starts 2023-10-08T13:03:29.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:29 smithi118 ceph-mon[104234]: purged_snaps scrub ok 2023-10-08T13:03:29.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:29 smithi118 ceph-mon[104234]: osd.11 [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] boot 2023-10-08T13:03:29.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:29 smithi118 ceph-mon[104234]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T13:03:29.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:29 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:03:30.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:30 smithi060 ceph-mon[103190]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:30.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:30 smithi060 ceph-mon[103190]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T13:03:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 -- 172.21.15.5:0/3761049529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 msgr2=0x7fcdb410c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/3761049529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 0x7fcdb410c590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00b0a0 tx=0x7fcdac00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 -- 172.21.15.5:0/3761049529 shutdown_connections 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/3761049529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 0x7fcdb410c590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/3761049529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb41056c0 0x7fcdb4105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/3761049529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb41002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 -- 172.21.15.5:0/3761049529 >> 172.21.15.5:0/3761049529 conn(0x7fcdb4075cf0 msgr2=0x7fcdb40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 -- 172.21.15.5:0/3761049529 shutdown_connections 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 -- 172.21.15.5:0/3761049529 wait complete. 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.416+0000 7fcdb97f8700 1 Processor -- start 2023-10-08T13:03:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 -- start start 2023-10-08T13:03:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 0x7fcdb4198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb41056c0 0x7fcdb41a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb41988b0 con 0x7fcdb40ffe50 2023-10-08T13:03:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb41a3090 con 0x7fcdb4100810 2023-10-08T13:03:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb97f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb41a31d0 con 0x7fcdb41056c0 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb4197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60248/0 (socket says 172.21.15.5:60248) 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 -- 172.21.15.5:0/1851744464 learned_addr learned my addr 172.21.15.5:0/1851744464 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb27fc700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 0x7fcdb4198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb37fe700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb41056c0 0x7fcdb41a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 -- 172.21.15.5:0/1851744464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb41056c0 msgr2=0x7fcdb41a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb41056c0 0x7fcdb41a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 -- 172.21.15.5:0/1851744464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 msgr2=0x7fcdb4198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 0x7fcdb4198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.417+0000 7fcdb2ffd700 1 -- 172.21.15.5:0/1851744464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac009d00 con 0x7fcdb40ffe50 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.418+0000 7fcdb2ffd700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb4197ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcda400d980 tx=0x7fcda400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.418+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40098d0 con 0x7fcdb40ffe50 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.418+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcda4010460 con 0x7fcdb40ffe50 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.418+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb41a3480 con 0x7fcdb40ffe50 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.418+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400f620 con 0x7fcdb40ffe50 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.418+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb41a3980 con 0x7fcdb40ffe50 2023-10-08T13:03:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.419+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb4107ce0 con 0x7fcdb40ffe50 2023-10-08T13:03:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.420+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fcda4010860 con 0x7fcdb40ffe50 2023-10-08T13:03:30.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:30 smithi005 ceph-mon[99496]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:30.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:30 smithi005 ceph-mon[99496]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T13:03:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.420+0000 7fcd9bfff700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcd9c0a14d0 0x7fcd9c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.420+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fcda40cc690 con 0x7fcdb40ffe50 2023-10-08T13:03:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.421+0000 7fcdb27fc700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcd9c0a14d0 0x7fcd9c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.421+0000 7fcdb27fc700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcd9c0a14d0 0x7fcd9c0a3990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40ff590 tx=0x7fcda8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.425+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcda40960c0 con 0x7fcdb40ffe50 2023-10-08T13:03:30.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:30 smithi118 ceph-mon[104234]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:30.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:30 smithi118 ceph-mon[104234]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T13:03:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.627+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fcdb40ff340 con 0x7fcdb40ffe50 2023-10-08T13:03:30.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.628+0000 7fcd9bfff700 1 -- 172.21.15.5:0/1851744464 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7fcda40996e0 con 0x7fcdb40ffe50 2023-10-08T13:03:30.630 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcd9c0a14d0 msgr2=0x7fcd9c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcd9c0a14d0 0x7fcd9c0a3990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40ff590 tx=0x7fcda8009260 comp rx=0 tx=0).stop 2023-10-08T13:03:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 msgr2=0x7fcdb4197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb4197ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcda400d980 tx=0x7fcda400dc90 comp rx=0 tx=0).stop 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 shutdown_connections 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcd9c0a14d0 0x7fcd9c0a3990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdb41056c0 0x7fcdb41a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdb40ffe50 0x7fcdb4197ad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 --2- 172.21.15.5:0/1851744464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb4100810 0x7fcdb4198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 >> 172.21.15.5:0/1851744464 conn(0x7fcdb4075cf0 msgr2=0x7fcdb4102470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 shutdown_connections 2023-10-08T13:03:30.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:30.630+0000 7fcdb97f8700 1 -- 172.21.15.5:0/1851744464 wait complete. 2023-10-08T13:03:31.042 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1696770208,"num_in_osds":12,"osd_in_since":1696770190,"num_remapped_pgs":0} 2023-10-08T13:03:31.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T13:03:31.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:31 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1851744464' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:03:31.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:31 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1851744464' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:03:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:31 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1851744464' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:03:31.611 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:03:32.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:32 smithi060 ceph-mon[103190]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:32.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:32 smithi005 ceph-mon[99496]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:32.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:32 smithi118 ceph-mon[104234]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 -- 172.21.15.5:0/645134531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f01008a0 msgr2=0x7f02f0100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 --2- 172.21.15.5:0/645134531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f01008a0 0x7f02f0100d20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009990 tx=0x7f02e0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 -- 172.21.15.5:0/645134531 shutdown_connections 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 --2- 172.21.15.5:0/645134531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f0101260 0x7f02f010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 --2- 172.21.15.5:0/645134531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f01057c0 0x7f02f0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 --2- 172.21.15.5:0/645134531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f01008a0 0x7f02f0100d20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 -- 172.21.15.5:0/645134531 >> 172.21.15.5:0/645134531 conn(0x7f02f00779e0 msgr2=0x7f02f0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 -- 172.21.15.5:0/645134531 shutdown_connections 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.786+0000 7f02f7610700 1 -- 172.21.15.5:0/645134531 wait complete. 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 Processor -- start 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 -- start start 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f01008a0 0x7f02f019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 0x7f02f019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f01057c0 0x7f02f0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01970c0 con 0x7f02f0101260 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0197230 con 0x7f02f01008a0 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f7610700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f01973f0 con 0x7f02f01057c0 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 0x7f02f019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:32.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 0x7f02f019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60262/0 (socket says 172.21.15.5:60262) 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 -- 172.21.15.5:0/3911248087 learned_addr learned my addr 172.21.15.5:0/3911248087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f5bad700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f01057c0 0x7f02f0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f53ac700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f01008a0 0x7f02f019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 -- 172.21.15.5:0/3911248087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f01057c0 msgr2=0x7f02f0196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f01057c0 0x7f02f0196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 -- 172.21.15.5:0/3911248087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f01008a0 msgr2=0x7f02f019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f01008a0 0x7f02f019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.787+0000 7f02f4bab700 1 -- 172.21.15.5:0/3911248087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00095f0 con 0x7f02f0101260 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.788+0000 7f02f4bab700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 0x7f02f019ce60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02e0000c00 tx=0x7f02e000f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.788+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e001d070 con 0x7f02f0101260 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.788+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f0197670 con 0x7f02f0101260 2023-10-08T13:03:32.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.788+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e000fbf0 con 0x7f02f0101260 2023-10-08T13:03:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.788+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00176e0 con 0x7f02f0101260 2023-10-08T13:03:32.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.788+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f01a3910 con 0x7f02f0101260 2023-10-08T13:03:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.789+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f0108da0 con 0x7f02f0101260 2023-10-08T13:03:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.790+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f02e00229c0 con 0x7f02f0101260 2023-10-08T13:03:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.790+0000 7f02e67fc700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02dc0a14d0 0x7f02dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.790+0000 7f02f53ac700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02dc0a14d0 0x7f02dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.791+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f02e00ce610 con 0x7f02f0101260 2023-10-08T13:03:32.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.791+0000 7f02f53ac700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02dc0a14d0 0x7f02dc0a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02ec005fd0 tx=0x7f02ec005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.794+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f02e0098030 con 0x7f02f0101260 2023-10-08T13:03:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.995+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02f0101f30 con 0x7f02f0101260 2023-10-08T13:03:32.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.996+0000 7f02e67fc700 1 -- 172.21.15.5:0/3911248087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18632 (secure 0 0 0) 0x7f02e009b650 con 0x7f02f0101260 2023-10-08T13:03:32.996 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:32.996 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:03:29.115462+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02dc0a14d0 msgr2=0x7f02dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02dc0a14d0 0x7f02dc0a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02ec005fd0 tx=0x7f02ec005e50 comp rx=0 tx=0).stop 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 msgr2=0x7f02f019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 0x7f02f019ce60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02e0000c00 tx=0x7f02e000f700 comp rx=0 tx=0).stop 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 shutdown_connections 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02dc0a14d0 0x7f02dc0a3990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f01057c0 0x7f02f0196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f01008a0 0x7f02f019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 --2- 172.21.15.5:0/3911248087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f0101260 0x7f02f019ce60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 >> 172.21.15.5:0/3911248087 conn(0x7f02f00779e0 msgr2=0x7f02f00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 shutdown_connections 2023-10-08T13:03:32.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:32.998+0000 7f02f7610700 1 -- 172.21.15.5:0/3911248087 wait complete. 2023-10-08T13:03:33.342 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:33 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3911248087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:03:33.372 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:03:33.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-08T13:03:33.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:33 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3911248087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:03:33.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:33 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3911248087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:03:33.935 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:03:34.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:34 smithi060 ceph-mon[103190]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:34.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:34 smithi005 ceph-mon[99496]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:34.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:34 smithi118 ceph-mon[104234]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:35.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 -- 172.21.15.5:0/2423517823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0101230 msgr2=0x7fe1c010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2423517823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0101230 0x7fe1c010d660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800b0a0 tx=0x7fe1b800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 -- 172.21.15.5:0/2423517823 shutdown_connections 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2423517823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0101230 0x7fe1c010d660 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2423517823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0106800 0x7fe1c0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2423517823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c0100870 0x7fe1c0100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 -- 172.21.15.5:0/2423517823 >> 172.21.15.5:0/2423517823 conn(0x7fe1c00779a0 msgr2=0x7fe1c0077db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 -- 172.21.15.5:0/2423517823 shutdown_connections 2023-10-08T13:03:35.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.120+0000 7fe1c865a700 1 -- 172.21.15.5:0/2423517823 wait complete. 2023-10-08T13:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 Processor -- start 2023-10-08T13:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 -- start start 2023-10-08T13:03:35.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 0x7fe1c0196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c0101230 0x7fe1c01972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0106800 0x7fe1c019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c019bc80 con 0x7fe1c0100870 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c019bdf0 con 0x7fe1c0101230 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c865a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c019bfb0 con 0x7fe1c0106800 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c63f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 0x7fe1c0196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c63f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 0x7fe1c0196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60272/0 (socket says 172.21.15.5:60272) 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c63f6700 1 -- 172.21.15.5:0/2820354774 learned_addr learned my addr 172.21.15.5:0/2820354774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.121+0000 7fe1c5bf5700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c0101230 0x7fe1c01972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c6bf7700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0106800 0x7fe1c019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c63f6700 1 -- 172.21.15.5:0/2820354774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0106800 msgr2=0x7fe1c019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c63f6700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0106800 0x7fe1c019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c63f6700 1 -- 172.21.15.5:0/2820354774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c0101230 msgr2=0x7fe1c01972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c63f6700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c0101230 0x7fe1c01972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c63f6700 1 -- 172.21.15.5:0/2820354774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009d00 con 0x7fe1c0100870 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c63f6700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 0x7fe1c0196d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00d980 tx=0x7fe1bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc004220 con 0x7fe1c0100870 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1bc007640 con 0x7fe1c0100870 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c019c290 con 0x7fe1c0100870 2023-10-08T13:03:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc005610 con 0x7fe1c0100870 2023-10-08T13:03:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.122+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01a3af0 con 0x7fe1c0100870 2023-10-08T13:03:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.123+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0108d40 con 0x7fe1c0100870 2023-10-08T13:03:35.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.124+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fe1bc004750 con 0x7fe1c0100870 2023-10-08T13:03:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.125+0000 7fe1b77fe700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1ac0a14d0 0x7fe1ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.125+0000 7fe1c5bf5700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1ac0a14d0 0x7fe1ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.125+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fe1bc0cc820 con 0x7fe1c0100870 2023-10-08T13:03:35.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.125+0000 7fe1c5bf5700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1ac0a14d0 0x7fe1ac0a3990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1c01982e0 tx=0x7fe1b000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.129+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1bc0961b0 con 0x7fe1c0100870 2023-10-08T13:03:35.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.329+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1c0198090 con 0x7fe1c0100870 2023-10-08T13:03:35.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.329+0000 7fe1b77fe700 1 -- 172.21.15.5:0/2820354774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1bc0997d0 con 0x7fe1c0100870 2023-10-08T13:03:35.329 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:03:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1ac0a14d0 msgr2=0x7fe1ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1ac0a14d0 0x7fe1ac0a3990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1c01982e0 tx=0x7fe1b000b410 comp rx=0 tx=0).stop 2023-10-08T13:03:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 msgr2=0x7fe1c0196d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 0x7fe1c0196d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00d980 tx=0x7fe1bc00dc90 comp rx=0 tx=0).stop 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 shutdown_connections 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1ac0a14d0 0x7fe1ac0a3990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c0106800 0x7fe1c019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1c0100870 0x7fe1c0196d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 --2- 172.21.15.5:0/2820354774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1c0101230 0x7fe1c01972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 >> 172.21.15.5:0/2820354774 conn(0x7fe1c00779a0 msgr2=0x7fe1c00ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 shutdown_connections 2023-10-08T13:03:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:35.331+0000 7fe1c865a700 1 -- 172.21.15.5:0/2820354774 wait complete. 2023-10-08T13:03:35.795 INFO:tasks.cephadm:Adding mds.a on smithi005 2023-10-08T13:03:35.795 INFO:tasks.cephadm:Adding mds.d on smithi005 2023-10-08T13:03:35.795 INFO:tasks.cephadm:Adding mds.g on smithi005 2023-10-08T13:03:35.795 INFO:tasks.cephadm:Adding mds.j on smithi005 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.b on smithi060 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.e on smithi060 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.h on smithi060 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.k on smithi060 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.c on smithi118 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.f on smithi118 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.i on smithi118 2023-10-08T13:03:35.796 INFO:tasks.cephadm:Adding mds.l on smithi118 2023-10-08T13:03:35.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l' 2023-10-08T13:03:36.374 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:03:36.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:36 smithi060 ceph-mon[103190]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:36.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2820354774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:03:36.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:36 smithi005 ceph-mon[99496]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:36.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2820354774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:03:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:36 smithi118 ceph-mon[104234]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:36.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2820354774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:03:37.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2783059539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 msgr2=0x7f8c140ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2783059539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c140ffbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009990 tx=0x7f8bfc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2783059539 shutdown_connections 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2783059539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c14100110 0x7f8c1410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2783059539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c141056b0 0x7f8c14105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2783059539 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c140ffbd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2783059539 >> 172.21.15.118:0/2783059539 conn(0x7f8c14075790 msgr2=0x7f8c14075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2783059539 shutdown_connections 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.706+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2783059539 wait complete. 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 Processor -- start 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 -- start start 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c1419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:37.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c14100110 0x7f8c1419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c141056b0 0x7f8c14196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14197200 con 0x7f8c141056b0 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14197370 con 0x7f8c14100110 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c1a0e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14197530 con 0x7f8c140ff750 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c137fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c1419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c137fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c1419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45990/0 (socket says 172.21.15.118:45990) 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c137fe700 1 -- 172.21.15.118:0/2595557068 learned_addr learned my addr 172.21.15.118:0/2595557068 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.707+0000 7f8c12ffd700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c14100110 0x7f8c1419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c13fff700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c141056b0 0x7f8c14196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c137fe700 1 -- 172.21.15.118:0/2595557068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c14100110 msgr2=0x7f8c1419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:37.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c137fe700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c14100110 0x7f8c1419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c137fe700 1 -- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c141056b0 msgr2=0x7f8c14196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c137fe700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c141056b0 0x7f8c14196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c137fe700 1 -- 172.21.15.118:0/2595557068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0095f0 con 0x7f8c140ff750 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c137fe700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c1419c950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c9b0 tx=0x7f8c0400ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04007b00 con 0x7f8c140ff750 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c14197810 con 0x7f8c140ff750 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c04007c60 con 0x7f8c140ff750 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04018660 con 0x7f8c140ff750 2023-10-08T13:03:37.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.708+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c141a38d0 con 0x7f8c140ff750 2023-10-08T13:03:37.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.709+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c14100df0 con 0x7f8c140ff750 2023-10-08T13:03:37.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.710+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f8c0400f450 con 0x7f8c140ff750 2023-10-08T13:03:37.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.711+0000 7f8c10ff9700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8c000a14d0 0x7f8c000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:37.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.711+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f8c040ccbc0 con 0x7f8c140ff750 2023-10-08T13:03:37.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.711+0000 7f8c12ffd700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8c000a14d0 0x7f8c000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:37.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.712+0000 7f8c12ffd700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8c000a14d0 0x7f8c000a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0098e0 tx=0x7f8bfc005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:37.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.714+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8c04096680 con 0x7f8c140ff750 2023-10-08T13:03:37.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.912+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c1410f6a0 con 0x7f8c000a14d0 2023-10-08T13:03:37.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.921+0000 7f8c10ff9700 1 -- 172.21.15.118:0/2595557068 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8c1410f6a0 con 0x7f8c000a14d0 2023-10-08T13:03:37.921 INFO:teuthology.orchestra.run.smithi118.stdout:Scheduled mds.all update... 2023-10-08T13:03:37.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8c000a14d0 msgr2=0x7f8c000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:37.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8c000a14d0 0x7f8c000a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0098e0 tx=0x7f8bfc005960 comp rx=0 tx=0).stop 2023-10-08T13:03:37.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 msgr2=0x7f8c1419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c1419c950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c9b0 tx=0x7f8c0400ccc0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 shutdown_connections 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8c000a14d0 0x7f8c000a3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c141056b0 0x7f8c14196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c140ff750 0x7f8c1419c950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 --2- 172.21.15.118:0/2595557068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c14100110 0x7f8c1419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 >> 172.21.15.118:0/2595557068 conn(0x7f8c14075790 msgr2=0x7f8c14103500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 shutdown_connections 2023-10-08T13:03:37.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-08T13:03:37.923+0000 7f8c1a0e2700 1 -- 172.21.15.118:0/2595557068 wait complete. 2023-10-08T13:03:38.435 DEBUG:teuthology.orchestra.run.smithi005:mds.a> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-08T13:03:38.437 DEBUG:teuthology.orchestra.run.smithi005:mds.d> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-08T13:03:38.475 INFO:journalctl@ceph.mds.a.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:03:38.476 DEBUG:teuthology.orchestra.run.smithi005:mds.g> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-08T13:03:38.506 INFO:journalctl@ceph.mds.d.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:03:38.510 DEBUG:teuthology.orchestra.run.smithi005:mds.j> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-08T13:03:38.535 INFO:journalctl@ceph.mds.g.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:03:38.537 DEBUG:teuthology.orchestra.run.smithi060:mds.b> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-08T13:03:38.540 DEBUG:teuthology.orchestra.run.smithi060:mds.e> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-08T13:03:38.564 INFO:journalctl@ceph.mds.j.smithi005.stdout:-- Logs begin at Sun 2023-10-08 12:39:35 UTC. -- 2023-10-08T13:03:38.579 INFO:journalctl@ceph.mds.b.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:03:38.580 DEBUG:teuthology.orchestra.run.smithi060:mds.h> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-08T13:03:38.610 INFO:journalctl@ceph.mds.e.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:03:38.611 DEBUG:teuthology.orchestra.run.smithi060:mds.k> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-08T13:03:38.639 INFO:journalctl@ceph.mds.h.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:03:38.640 DEBUG:teuthology.orchestra.run.smithi118:mds.c> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-08T13:03:38.643 DEBUG:teuthology.orchestra.run.smithi118:mds.f> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-08T13:03:38.668 INFO:journalctl@ceph.mds.k.smithi060.stdout:-- Logs begin at Sun 2023-10-08 12:39:57 UTC. -- 2023-10-08T13:03:38.671 INFO:journalctl@ceph.mds.c.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:03:38.672 DEBUG:teuthology.orchestra.run.smithi118:mds.i> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-08T13:03:38.697 INFO:journalctl@ceph.mds.f.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:03:38.698 DEBUG:teuthology.orchestra.run.smithi118:mds.l> sudo journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-08T13:03:38.723 INFO:journalctl@ceph.mds.i.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:03:38.724 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-08T13:03:38.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:03:38.748 INFO:journalctl@ceph.mds.l.smithi118.stdout:-- Logs begin at Sun 2023-10-08 12:40:35 UTC. -- 2023-10-08T13:03:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 -- 172.21.15.5:0/167222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00680fff00 msgr2=0x7f006810c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 --2- 172.21.15.5:0/167222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00680fff00 0x7f006810c3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f006000b0d0 tx=0x7f006000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:03:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 -- 172.21.15.5:0/167222870 shutdown_connections 2023-10-08T13:03:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 --2- 172.21.15.5:0/167222870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00680fff00 0x7f006810c3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 --2- 172.21.15.5:0/167222870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0068105600 0x7f00681059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 --2- 172.21.15.5:0/167222870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680ff540 0x7f00680ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 -- 172.21.15.5:0/167222870 >> 172.21.15.5:0/167222870 conn(0x7f00680fb010 msgr2=0x7f00680fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 -- 172.21.15.5:0/167222870 shutdown_connections 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.870+0000 7f006f493700 1 -- 172.21.15.5:0/167222870 wait complete. 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 Processor -- start 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 -- start start 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680ff540 0x7f006819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680fff00 0x7f006819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 0x7f00681958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068195f10 con 0x7f0068105600 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068196080 con 0x7f00680ff540 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006f493700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068196240 con 0x7f00680fff00 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 0x7f00681958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 0x7f00681958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60290/0 (socket says 172.21.15.5:60290) 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 -- 172.21.15.5:0/3041910247 learned_addr learned my addr 172.21.15.5:0/3041910247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006d22f700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680ff540 0x7f006819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006ca2e700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680fff00 0x7f006819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 -- 172.21.15.5:0/3041910247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680fff00 msgr2=0x7f006819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680fff00 0x7f006819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:38.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 -- 172.21.15.5:0/3041910247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680ff540 msgr2=0x7f006819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680ff540 0x7f006819b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 -- 172.21.15.5:0/3041910247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060009d00 con 0x7f0068105600 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006ca2e700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680fff00 0x7f006819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.871+0000 7f006da30700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 0x7f00681958a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f00600094c0 tx=0x7f00600094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.872+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000e040 con 0x7f0068105600 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.872+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f006001a980 con 0x7f0068105600 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.872+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060012ad0 con 0x7f0068105600 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.872+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00681964c0 con 0x7f0068105600 2023-10-08T13:03:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.872+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0068068e50 con 0x7f0068105600 2023-10-08T13:03:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.873+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0068100c60 con 0x7f0068105600 2023-10-08T13:03:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.874+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f0060012c30 con 0x7f0068105600 2023-10-08T13:03:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.874+0000 7f005e7fc700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00540a1550 0x7f00540a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.874+0000 7f006d22f700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00540a1550 0x7f00540a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.874+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f00600cfb10 con 0x7f0068105600 2023-10-08T13:03:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.875+0000 7f006d22f700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00540a1550 0x7f00540a3a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0064005950 tx=0x7f006400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:38.878+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0060099660 con 0x7f0068105600 2023-10-08T13:03:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.082+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00680679a0 con 0x7f0068105600 2023-10-08T13:03:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.083+0000 7f005e7fc700 1 -- 172.21.15.5:0/3041910247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18632 (secure 0 0 0) 0x7f006009cc80 con 0x7f0068105600 2023-10-08T13:03:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:39.084 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:03:29.115462+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:03:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00540a1550 msgr2=0x7f00540a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00540a1550 0x7f00540a3a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0064005950 tx=0x7f006400b410 comp rx=0 tx=0).stop 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 msgr2=0x7f00681958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 0x7f00681958a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f00600094c0 tx=0x7f00600094f0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 shutdown_connections 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00540a1550 0x7f00540a3a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105600 0x7f00681958a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680ff540 0x7f006819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 --2- 172.21.15.5:0/3041910247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680fff00 0x7f006819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 >> 172.21.15.5:0/3041910247 conn(0x7f00680fb010 msgr2=0x7f00680fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 shutdown_connections 2023-10-08T13:03:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.085+0000 7f006f493700 1 -- 172.21.15.5:0/3041910247 wait complete. 2023-10-08T13:03:39.097 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:39.097 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:03:39.097 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l;count:12 2023-10-08T13:03:39.097 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:39.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:38 smithi005 ceph-mon[99496]: Deploying daemon mds.l on smithi118 2023-10-08T13:03:39.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:03:39.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 -- 172.21.15.5:0/3708245498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0200ff230 msgr2=0x7fc0200ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 --2- 172.21.15.5:0/3708245498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0200ff230 0x7fc0200ff610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc010009990 tx=0x7fc010009ca0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 -- 172.21.15.5:0/3708245498 shutdown_connections 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 --2- 172.21.15.5:0/3708245498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc020105a40 0x7fc02010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 --2- 172.21.15.5:0/3708245498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0200ff230 0x7fc0200ff610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 --2- 172.21.15.5:0/3708245498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0200ffbe0 0x7fc020105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 -- 172.21.15.5:0/3708245498 >> 172.21.15.5:0/3708245498 conn(0x7fc020074830 msgr2=0x7fc020074c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 -- 172.21.15.5:0/3708245498 shutdown_connections 2023-10-08T13:03:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.228+0000 7fc0269e1700 1 -- 172.21.15.5:0/3708245498 wait complete. 2023-10-08T13:03:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 Processor -- start 2023-10-08T13:03:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 -- start start 2023-10-08T13:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0200ff230 0x7fc02019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc020105a40 0x7fc02019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 0x7fc020196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc020197480 con 0x7fc020196a00 2023-10-08T13:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201975f0 con 0x7fc0200ff230 2023-10-08T13:03:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.229+0000 7fc0269e1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201977b0 con 0x7fc020105a40 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 0x7fc020196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 0x7fc020196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60304/0 (socket says 172.21.15.5:60304) 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 -- 172.21.15.5:0/2731921654 learned_addr learned my addr 172.21.15.5:0/2731921654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc01ffff700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0200ff230 0x7fc02019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc01f7fe700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc020105a40 0x7fc02019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 -- 172.21.15.5:0/2731921654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc020105a40 msgr2=0x7fc02019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc020105a40 0x7fc02019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 -- 172.21.15.5:0/2731921654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0200ff230 msgr2=0x7fc02019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0200ff230 0x7fc02019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 -- 172.21.15.5:0/2731921654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100095f0 con 0x7fc020196a00 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc01f7fe700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc020105a40 0x7fc02019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc024f7e700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 0x7fc020196eb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc018007ee0 tx=0x7fc01800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018017070 con 0x7fc020196a00 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc01800f040 con 0x7fc020196a00 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0201a3750 con 0x7fc020196a00 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018005740 con 0x7fc020196a00 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.230+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0201a3be0 con 0x7fc020196a00 2023-10-08T13:03:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.231+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc020066f80 con 0x7fc020196a00 2023-10-08T13:03:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.232+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc01800dc60 con 0x7fc020196a00 2023-10-08T13:03:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.233+0000 7fc01d7fa700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0080a14d0 0x7fc0080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.233+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc0180cc830 con 0x7fc020196a00 2023-10-08T13:03:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.233+0000 7fc01ffff700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0080a14d0 0x7fc0080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.233+0000 7fc01ffff700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0080a14d0 0x7fc0080a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc010006010 tx=0x7fc010005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.237+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc0180961c0 con 0x7fc020196a00 2023-10-08T13:03:39.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:39.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l;count:12 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:39.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:38 smithi118 ceph-mon[104234]: Deploying daemon mds.l on smithi118 2023-10-08T13:03:39.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='client.24577 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l;count:12 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:39.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:39.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:38 smithi060 ceph-mon[103190]: Deploying daemon mds.l on smithi118 2023-10-08T13:03:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.436+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc020197e70 con 0x7fc020196a00 2023-10-08T13:03:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.437+0000 7fc01d7fa700 1 -- 172.21.15.5:0/2731921654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0180997e0 con 0x7fc020196a00 2023-10-08T13:03:39.437 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:03:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0080a14d0 msgr2=0x7fc0080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0080a14d0 0x7fc0080a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc010006010 tx=0x7fc010005960 comp rx=0 tx=0).stop 2023-10-08T13:03:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 msgr2=0x7fc020196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 0x7fc020196eb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc018007ee0 tx=0x7fc01800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 shutdown_connections 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0080a14d0 0x7fc0080a3990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc020196a00 0x7fc020196eb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0200ff230 0x7fc02019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 --2- 172.21.15.5:0/2731921654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc020105a40 0x7fc02019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 >> 172.21.15.5:0/2731921654 conn(0x7fc020074830 msgr2=0x7fc0200fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 shutdown_connections 2023-10-08T13:03:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.439+0000 7fc0269e1700 1 -- 172.21.15.5:0/2731921654 wait complete. 2023-10-08T13:03:39.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:39.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 -- 172.21.15.5:0/604788415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4490105610 msgr2=0x7f44901059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 --2- 172.21.15.5:0/604788415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4490105610 0x7f44901059f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f448c0099c0 tx=0x7f448c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 -- 172.21.15.5:0/604788415 shutdown_connections 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 --2- 172.21.15.5:0/604788415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44900fff10 0x7f449010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 --2- 172.21.15.5:0/604788415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4490105610 0x7f44901059f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 --2- 172.21.15.5:0/604788415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44900ff550 0x7f44900ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 -- 172.21.15.5:0/604788415 >> 172.21.15.5:0/604788415 conn(0x7f44900fb040 msgr2=0x7f44900fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 -- 172.21.15.5:0/604788415 shutdown_connections 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.577+0000 7f44975bb700 1 -- 172.21.15.5:0/604788415 wait complete. 2023-10-08T13:03:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 Processor -- start 2023-10-08T13:03:39.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 -- start start 2023-10-08T13:03:39.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44900ff550 0x7f4490197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 0x7f4490197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4490105610 0x7f44901a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44901985d0 con 0x7f44900fff10 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44901a2de0 con 0x7f4490105610 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f44975bb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44901a2f20 con 0x7f44900ff550 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 0x7f4490197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 0x7f4490197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60316/0 (socket says 172.21.15.5:60316) 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 -- 172.21.15.5:0/3574889882 learned_addr learned my addr 172.21.15.5:0/3574889882 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:39.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4495357700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44900ff550 0x7f4490197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4495b58700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4490105610 0x7f44901a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 -- 172.21.15.5:0/3574889882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44900ff550 msgr2=0x7f4490197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44900ff550 0x7f4490197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 -- 172.21.15.5:0/3574889882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4490105610 msgr2=0x7f44901a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4490105610 0x7f44901a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.578+0000 7f4494b56700 1 -- 172.21.15.5:0/3574889882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0095f0 con 0x7f44900fff10 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.579+0000 7f4494b56700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 0x7f4490197d60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f448000c9b0 tx=0x7f448000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.579+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480007b00 con 0x7f44900fff10 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.579+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4480007c60 con 0x7f44900fff10 2023-10-08T13:03:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.579+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44901a31b0 con 0x7f44900fff10 2023-10-08T13:03:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.579+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480018660 con 0x7f44900fff10 2023-10-08T13:03:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.579+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44901a36c0 con 0x7f44900fff10 2023-10-08T13:03:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.580+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4490107a90 con 0x7f44900fff10 2023-10-08T13:03:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.581+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f448000f450 con 0x7f44900fff10 2023-10-08T13:03:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.582+0000 7f44867fc700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f447c0a14d0 0x7f447c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.582+0000 7f4495357700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f447c0a14d0 0x7f447c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.582+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f44800ccc30 con 0x7f44900fff10 2023-10-08T13:03:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.582+0000 7f4495357700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f447c0a14d0 0x7f447c0a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f448c009990 tx=0x7f448c019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.585+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f44800966f0 con 0x7f44900fff10 2023-10-08T13:03:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.833+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4490100c70 con 0x7f44900fff10 2023-10-08T13:03:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.833+0000 7f44867fc700 1 -- 172.21.15.5:0/3574889882 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f4480099d10 con 0x7f44900fff10 2023-10-08T13:03:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:39.833 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-08T13:03:39.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f447c0a14d0 msgr2=0x7f447c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f447c0a14d0 0x7f447c0a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f448c009990 tx=0x7f448c019040 comp rx=0 tx=0).stop 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 msgr2=0x7f4490197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 0x7f4490197d60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f448000c9b0 tx=0x7f448000ccc0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 shutdown_connections 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f447c0a14d0 0x7f447c0a3990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4490105610 0x7f44901a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44900ff550 0x7f4490197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 --2- 172.21.15.5:0/3574889882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44900fff10 0x7f4490197d60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:39.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 >> 172.21.15.5:0/3574889882 conn(0x7f44900fb040 msgr2=0x7f44900fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 shutdown_connections 2023-10-08T13:03:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:39.835+0000 7f44975bb700 1 -- 172.21.15.5:0/3574889882 wait complete. 2023-10-08T13:03:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 1 2023-10-08T13:03:39.925 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:03:39 smithi118 systemd[1]: Starting Ceph mds.l for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:40.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3041910247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:03:40.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2731921654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:03:40.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3574889882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:40.181 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3041910247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:03:40.181 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2731921654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:03:40.181 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3574889882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:40.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3041910247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:03:40.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2731921654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:03:40.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3574889882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:40.471 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:03:40 smithi118 podman[141588]: 2023-10-08T13:03:40.770 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mds[141628]: -- 172.21.15.118:0/476980949 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556cbb07b1e0 con 0x556cbb050800 2023-10-08T13:03:40.770 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:03:40 smithi118 bash[141588]: 65efcb97e8add2a61a4c5767cbb938588d36750f13921b787e4171abd55ff0ec 2023-10-08T13:03:40.770 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l[141604]: starting mds.l at 2023-10-08T13:03:40.770 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:03:40 smithi118 systemd[1]: Started Ceph mds.l for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:41.269 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:41.269 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6832/2301164453,v1:172.21.15.118:6833/2301164453] up:boot 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: fsmap 1 up:standby 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:41.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:40 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6832/2301164453,v1:172.21.15.118:6833/2301164453] up:boot 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: fsmap 1 up:standby 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:41.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:40 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6832/2301164453,v1:172.21.15.118:6833/2301164453] up:boot 2023-10-08T13:03:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: fsmap 1 up:standby 2023-10-08T13:03:41.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:03:41.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:41.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:41.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:41.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:40 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:41.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 -- 172.21.15.5:0/2594503933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 msgr2=0x7ffb0c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 --2- 172.21.15.5:0/2594503933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c105a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40099c0 tx=0x7ffaf4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:03:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 -- 172.21.15.5:0/2594503933 shutdown_connections 2023-10-08T13:03:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 --2- 172.21.15.5:0/2594503933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c100660 0x7ffb0c10c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 --2- 172.21.15.5:0/2594503933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c105a90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 --2- 172.21.15.5:0/2594503933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c0ffca0 0x7ffb0c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 -- 172.21.15.5:0/2594503933 >> 172.21.15.5:0/2594503933 conn(0x7ffb0c075b20 msgr2=0x7ffb0c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 -- 172.21.15.5:0/2594503933 shutdown_connections 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 -- 172.21.15.5:0/2594503933 wait complete. 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.992+0000 7ffb12153700 1 Processor -- start 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 -- start start 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ffca0 0x7ffb0c197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c100660 0x7ffb0c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c1a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1985f0 con 0x7ffb0c1056b0 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1a2e20 con 0x7ffb0c0ffca0 2023-10-08T13:03:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb12153700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1a2f60 con 0x7ffb0c100660 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c1a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ffca0 0x7ffb0c197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c1a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60332/0 (socket says 172.21.15.5:60332) 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ffca0 0x7ffb0c197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:55278/0 (socket says 172.21.15.5:55278) 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 -- 172.21.15.5:0/447373712 learned_addr learned my addr 172.21.15.5:0/447373712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0affd700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c100660 0x7ffb0c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 -- 172.21.15.5:0/447373712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c100660 msgr2=0x7ffb0c197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c100660 0x7ffb0c197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 -- 172.21.15.5:0/447373712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ffca0 msgr2=0x7ffb0c197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ffca0 0x7ffb0c197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0bfff700 1 -- 172.21.15.5:0/447373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40095f0 con 0x7ffb0c1056b0 2023-10-08T13:03:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.993+0000 7ffb0affd700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c100660 0x7ffb0c197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:03:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.994+0000 7ffb0bfff700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c1a28e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffb04007d40 tx=0x7ffb0400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.994+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400ad60 con 0x7ffb0c1056b0 2023-10-08T13:03:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.994+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c1a31c0 con 0x7ffb0c1056b0 2023-10-08T13:03:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.994+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb04007e90 con 0x7ffb0c1056b0 2023-10-08T13:03:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.994+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb040116b0 con 0x7ffb0c1056b0 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.994+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c1a3680 con 0x7ffb0c1056b0 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.995+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c107b60 con 0x7ffb0c1056b0 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.996+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7ffb04012420 con 0x7ffb0c1056b0 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.996+0000 7ffb08ff9700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a14d0 0x7ffaf80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.997+0000 7ffb0b7fe700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a14d0 0x7ffaf80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.997+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ffb040cd0a0 con 0x7ffb0c1056b0 2023-10-08T13:03:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:41.997+0000 7ffb0b7fe700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a14d0 0x7ffaf80a3990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4006010 tx=0x7ffaf4005c40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.000+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffb04096a30 con 0x7ffb0c1056b0 2023-10-08T13:03:42.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:41 smithi005 ceph-mon[99496]: Deploying daemon mds.k on smithi060 2023-10-08T13:03:42.193 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:41 smithi060 ceph-mon[103190]: Deploying daemon mds.k on smithi060 2023-10-08T13:03:42.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.245+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb0c100cb0 con 0x7ffb0c1056b0 2023-10-08T13:03:42.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.245+0000 7ffb08ff9700 1 -- 172.21.15.5:0/447373712 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7ffb0409a050 con 0x7ffb0c1056b0 2023-10-08T13:03:42.246 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:42.247 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a14d0 msgr2=0x7ffaf80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a14d0 0x7ffaf80a3990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4006010 tx=0x7ffaf4005c40 comp rx=0 tx=0).stop 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 msgr2=0x7ffb0c1a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c1a28e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffb04007d40 tx=0x7ffb0400a340 comp rx=0 tx=0).stop 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 shutdown_connections 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a14d0 0x7ffaf80a3990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c1056b0 0x7ffb0c1a28e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ffca0 0x7ffb0c197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 --2- 172.21.15.5:0/447373712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c100660 0x7ffb0c197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.247+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 >> 172.21.15.5:0/447373712 conn(0x7ffb0c075b20 msgr2=0x7ffb0c0fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:42.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.248+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 shutdown_connections 2023-10-08T13:03:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:42.248+0000 7ffb12153700 1 -- 172.21.15.5:0/447373712 wait complete. 2023-10-08T13:03:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2023-10-08T13:03:42.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:41 smithi118 ceph-mon[104234]: Deploying daemon mds.k on smithi060 2023-10-08T13:03:42.658 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:03:42 smithi060 systemd[1]: Starting Ceph mds.k for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:43.051 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:03:42 smithi060 podman[140033]: 2023-10-08T13:03:43.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:42 smithi060 ceph-mon[103190]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:43.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:42 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/447373712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:42 smithi118 ceph-mon[104234]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:42 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/447373712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:43.408 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:03:43 smithi060 bash[140033]: 330bba50d489adb92cd583762a7d6da5f30fffa2c15350b399c3ac3e2a2451da 2023-10-08T13:03:43.409 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:03:43 smithi060 ceph-mds[140073]: -- 172.21.15.60:0/2058572362 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560a9efbd1e0 con 0x560a9ef93000 2023-10-08T13:03:43.409 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:03:43 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k[140049]: starting mds.k at 2023-10-08T13:03:43.409 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:03:43 smithi060 systemd[1]: Started Ceph mds.k for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:43.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:42 smithi005 ceph-mon[99496]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:43.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:42 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/447373712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:44.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 -- 172.21.15.5:0/4191845128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 msgr2=0x7f78481059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 --2- 172.21.15.5:0/4191845128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f78481059e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78380099c0 tx=0x7f7838009cd0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 -- 172.21.15.5:0/4191845128 shutdown_connections 2023-10-08T13:03:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 --2- 172.21.15.5:0/4191845128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480fff00 0x7f784810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 --2- 172.21.15.5:0/4191845128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f78481059e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 --2- 172.21.15.5:0/4191845128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 0x7f78480ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 -- 172.21.15.5:0/4191845128 >> 172.21.15.5:0/4191845128 conn(0x7f78480fb010 msgr2=0x7f78480fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 -- 172.21.15.5:0/4191845128 shutdown_connections 2023-10-08T13:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 -- 172.21.15.5:0/4191845128 wait complete. 2023-10-08T13:03:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.394+0000 7f784d7ac700 1 Processor -- start 2023-10-08T13:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 -- start start 2023-10-08T13:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 0x7f784819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480fff00 0x7f784819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f7848196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848196ec0 con 0x7f7848105600 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848197030 con 0x7f78480ff540 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f784d7ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481971f0 con 0x7f78480fff00 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f7848196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f7848196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60344/0 (socket says 172.21.15.5:60344) 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 -- 172.21.15.5:0/3150050213 learned_addr learned my addr 172.21.15.5:0/3150050213 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f7846ffd700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 0x7f784819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78467fc700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480fff00 0x7f784819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 -- 172.21.15.5:0/3150050213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480fff00 msgr2=0x7f784819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480fff00 0x7f784819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 -- 172.21.15.5:0/3150050213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 msgr2=0x7f784819c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 0x7f784819c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 -- 172.21.15.5:0/3150050213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380095f0 con 0x7f7848105600 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f7846ffd700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 0x7f784819c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.395+0000 7f78477fe700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f7848196850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7840007ee0 tx=0x7f784000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.396+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840017070 con 0x7f7848105600 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.396+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f784000f040 con 0x7f7848105600 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.396+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840005740 con 0x7f7848105600 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.396+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78481974d0 con 0x7f7848105600 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.396+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78481a3710 con 0x7f7848105600 2023-10-08T13:03:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.397+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7848100c60 con 0x7f7848105600 2023-10-08T13:03:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.398+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f78400058a0 con 0x7f7848105600 2023-10-08T13:03:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.398+0000 7f783ffff700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78340a1550 0x7f78340a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.398+0000 7f7846ffd700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78340a1550 0x7f78340a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.398+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f78400cc1e0 con 0x7f7848105600 2023-10-08T13:03:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.399+0000 7f7846ffd700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78340a1550 0x7f78340a3a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7838009fd0 tx=0x7f7838005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.403+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7840095c10 con 0x7f7848105600 2023-10-08T13:03:44.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:44.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:44.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:44.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:44.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: Deploying daemon mds.j on smithi005 2023-10-08T13:03:44.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6832/2732299433,v1:172.21.15.60:6833/2732299433] up:boot 2023-10-08T13:03:44.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: fsmap 2 up:standby 2023-10-08T13:03:44.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:44 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:03:44.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: Deploying daemon mds.j on smithi005 2023-10-08T13:03:44.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6832/2732299433,v1:172.21.15.60:6833/2732299433] up:boot 2023-10-08T13:03:44.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: fsmap 2 up:standby 2023-10-08T13:03:44.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:44 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:03:44.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:44.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: Deploying daemon mds.j on smithi005 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6832/2732299433,v1:172.21.15.60:6833/2732299433] up:boot 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: fsmap 2 up:standby 2023-10-08T13:03:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:44 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:03:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.669+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78480679a0 con 0x7f7848105600 2023-10-08T13:03:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.669+0000 7f783ffff700 1 -- 172.21.15.5:0/3150050213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f7840099230 con 0x7f7848105600 2023-10-08T13:03:44.671 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:44.671 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T13:03:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78340a1550 msgr2=0x7f78340a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78340a1550 0x7f78340a3a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7838009fd0 tx=0x7f7838005fd0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 msgr2=0x7f7848196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f7848196850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7840007ee0 tx=0x7f784000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 shutdown_connections 2023-10-08T13:03:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78340a1550 0x7f78340a3a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7848105600 0x7f7848196850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480ff540 0x7f784819c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 --2- 172.21.15.5:0/3150050213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480fff00 0x7f784819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 >> 172.21.15.5:0/3150050213 conn(0x7f78480fb010 msgr2=0x7f78480fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 shutdown_connections 2023-10-08T13:03:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:44.672+0000 7f784d7ac700 1 -- 172.21.15.5:0/3150050213 wait complete. 2023-10-08T13:03:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-10-08T13:03:44.675 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:03:44 smithi005 systemd[1]: Starting Ceph mds.j for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:45.198 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:45 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3150050213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:45.199 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:03:44 smithi005 podman[157680]: 2023-10-08T13:03:45.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:45 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3150050213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:45.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:45 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3150050213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:45.671 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:03:45 smithi005 bash[157680]: f8cf238a53809c0b50183ca50ca5e13430f3717d02824023af3f3fa48d49bb25 2023-10-08T13:03:45.672 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:03:45 smithi005 ceph-mds[157719]: -- 172.21.15.5:0/2776220076 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d96d0051e0 con 0x55d96cfdac00 2023-10-08T13:03:45.672 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:03:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-j[157695]: starting mds.j at 2023-10-08T13:03:45.672 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:03:45 smithi005 systemd[1]: Started Ceph mds.j for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:46.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:46.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:46.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:46.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:46.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: Deploying daemon mds.d on smithi005 2023-10-08T13:03:46.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.5:6834/164464134,v1:172.21.15.5:6835/164464134] up:boot 2023-10-08T13:03:46.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: fsmap 3 up:standby 2023-10-08T13:03:46.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T13:03:46.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: Deploying daemon mds.d on smithi005 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.5:6834/164464134,v1:172.21.15.5:6835/164464134] up:boot 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: fsmap 3 up:standby 2023-10-08T13:03:46.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T13:03:46.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:46.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: Deploying daemon mds.d on smithi005 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.5:6834/164464134,v1:172.21.15.5:6835/164464134] up:boot 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: fsmap 3 up:standby 2023-10-08T13:03:46.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T13:03:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 -- 172.21.15.5:0/2460864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f501049f0 msgr2=0x7f8f50104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2460864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f501049f0 0x7f8f50104ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800b0a0 tx=0x7f8f4800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:03:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 -- 172.21.15.5:0/2460864 shutdown_connections 2023-10-08T13:03:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2460864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f501049f0 0x7f8f50104ea0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2460864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f500ff5f0 0x7f8f500ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2460864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f500fff10 0x7f8f501043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 -- 172.21.15.5:0/2460864 >> 172.21.15.5:0/2460864 conn(0x7f8f500fb040 msgr2=0x7f8f500fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 -- 172.21.15.5:0/2460864 shutdown_connections 2023-10-08T13:03:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.842+0000 7f8f5512b700 1 -- 172.21.15.5:0/2460864 wait complete. 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.843+0000 7f8f5512b700 1 Processor -- start 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 -- start start 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 0x7f8f5019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f500fff10 0x7f8f5019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f501049f0 0x7f8f501a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501a2030 con 0x7f8f500ff5f0 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501a21a0 con 0x7f8f501049f0 2023-10-08T13:03:46.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f5512b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501a2360 con 0x7f8f500fff10 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f4ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 0x7f8f5019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f4ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 0x7f8f5019d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60364/0 (socket says 172.21.15.5:60364) 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f4ed9d700 1 -- 172.21.15.5:0/2437716628 learned_addr learned my addr 172.21.15.5:0/2437716628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f4e59c700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f500fff10 0x7f8f5019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.844+0000 7f8f4f59e700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f501049f0 0x7f8f501a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f4ed9d700 1 -- 172.21.15.5:0/2437716628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f500fff10 msgr2=0x7f8f5019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f4ed9d700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f500fff10 0x7f8f5019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f4ed9d700 1 -- 172.21.15.5:0/2437716628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f501049f0 msgr2=0x7f8f501a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f4ed9d700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f501049f0 0x7f8f501a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f4ed9d700 1 -- 172.21.15.5:0/2437716628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48009d00 con 0x7f8f500ff5f0 2023-10-08T13:03:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f4ed9d700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 0x7f8f5019d160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b550 tx=0x7f8f4000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40011830 con 0x7f8f500ff5f0 2023-10-08T13:03:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f40011e50 con 0x7f8f500ff5f0 2023-10-08T13:03:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f501a2640 con 0x7f8f500ff5f0 2023-10-08T13:03:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000f2e0 con 0x7f8f500ff5f0 2023-10-08T13:03:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.845+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f501a9e80 con 0x7f8f500ff5f0 2023-10-08T13:03:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.846+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f50068280 con 0x7f8f500ff5f0 2023-10-08T13:03:46.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.848+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f8f40010580 con 0x7f8f500ff5f0 2023-10-08T13:03:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.849+0000 7f8f37fff700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8f380a14d0 0x7f8f380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.849+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f8f400ccaa0 con 0x7f8f500ff5f0 2023-10-08T13:03:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.849+0000 7f8f4e59c700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8f380a14d0 0x7f8f380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:46.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.849+0000 7f8f4e59c700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8f380a14d0 0x7f8f380a3990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005950 tx=0x7f8f440058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:46.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:46.852+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f40096430 con 0x7f8f500ff5f0 2023-10-08T13:03:46.854 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:03:46 smithi005 systemd[1]: Starting Ceph mds.d for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:47.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.129+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f50067550 con 0x7f8f500ff5f0 2023-10-08T13:03:47.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.130+0000 7f8f37fff700 1 -- 172.21.15.5:0/2437716628 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2904 (secure 0 0 0) 0x7f8f40099a50 con 0x7f8f500ff5f0 2023-10-08T13:03:47.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:47.131 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8f380a14d0 msgr2=0x7f8f380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8f380a14d0 0x7f8f380a3990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005950 tx=0x7f8f440058e0 comp rx=0 tx=0).stop 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 msgr2=0x7f8f5019d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 0x7f8f5019d160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000b550 tx=0x7f8f4000b910 comp rx=0 tx=0).stop 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 shutdown_connections 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8f380a14d0 0x7f8f380a3990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f501049f0 0x7f8f501a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500ff5f0 0x7f8f5019d160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:47.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 --2- 172.21.15.5:0/2437716628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f500fff10 0x7f8f5019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 >> 172.21.15.5:0/2437716628 conn(0x7f8f500fb040 msgr2=0x7f8f501023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 shutdown_connections 2023-10-08T13:03:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:47.132+0000 7f8f5512b700 1 -- 172.21.15.5:0/2437716628 wait complete. 2023-10-08T13:03:47.134 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 4 2023-10-08T13:03:47.421 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:03:47 smithi005 podman[158060]: 2023-10-08T13:03:47.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:47 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2437716628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:47.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:47 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2437716628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:47.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:47 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2437716628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:47.922 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:03:47 smithi005 ceph-mds[158102]: -- 172.21.15.5:0/1411837565 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55632b7831e0 con 0x55632b758800 2023-10-08T13:03:47.922 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:03:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-d[158078]: starting mds.d at 2023-10-08T13:03:47.922 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:03:47 smithi005 bash[158060]: 506b09006e606b81b9d44bca34682e6cc9829e90f9c54b924713a2281fd62b4d 2023-10-08T13:03:47.922 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:03:47 smithi005 systemd[1]: Started Ceph mds.d for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:48.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:48.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: Deploying daemon mds.e on smithi060 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.5:6836/1597717069,v1:172.21.15.5:6837/1597717069] up:boot 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: fsmap 4 up:standby 2023-10-08T13:03:48.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:03:48.892 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:48.892 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.892 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: Deploying daemon mds.e on smithi060 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.5:6836/1597717069,v1:172.21.15.5:6837/1597717069] up:boot 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: fsmap 4 up:standby 2023-10-08T13:03:48.893 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: Deploying daemon mds.e on smithi060 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.5:6836/1597717069,v1:172.21.15.5:6837/1597717069] up:boot 2023-10-08T13:03:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: fsmap 4 up:standby 2023-10-08T13:03:48.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:03:49.142 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:03:49 smithi060 systemd[1]: Starting Ceph mds.e for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:49.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:49.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 -- 172.21.15.5:0/569424193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 msgr2=0x7f12500ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:49.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 --2- 172.21.15.5:0/569424193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12500ff9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f124c0099c0 tx=0x7f124c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 -- 172.21.15.5:0/569424193 shutdown_connections 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 --2- 172.21.15.5:0/569424193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12500fff10 0x7f125010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 --2- 172.21.15.5:0/569424193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 0x7f12501059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 --2- 172.21.15.5:0/569424193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12500ff9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 -- 172.21.15.5:0/569424193 >> 172.21.15.5:0/569424193 conn(0x7f12500fb040 msgr2=0x7f12500fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 -- 172.21.15.5:0/569424193 shutdown_connections 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.291+0000 7f1258141700 1 -- 172.21.15.5:0/569424193 wait complete. 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 Processor -- start 2023-10-08T13:03:49.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 -- start start 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12501011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12500fff10 0x7f1250101700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 0x7f1250101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a4eb0 con 0x7f12500ff550 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a5020 con 0x7f12500fff10 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1258141700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12501a51e0 con 0x7f1250105610 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12501011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12501011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60392/0 (socket says 172.21.15.5:60392) 2023-10-08T13:03:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 -- 172.21.15.5:0/4064309285 learned_addr learned my addr 172.21.15.5:0/4064309285 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f12556dc700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12500fff10 0x7f1250101700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f12566de700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 0x7f1250101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 -- 172.21.15.5:0/4064309285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 msgr2=0x7f1250101c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 0x7f1250101c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 -- 172.21.15.5:0/4064309285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12500fff10 msgr2=0x7f1250101700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12500fff10 0x7f1250101700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f1255edd700 1 -- 172.21.15.5:0/4064309285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c0095f0 con 0x7f12500ff550 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.292+0000 7f12566de700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 0x7f1250101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:03:49.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.293+0000 7f1255edd700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12501011c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f124000d950 tx=0x7f124000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.293+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240009940 con 0x7f12500ff550 2023-10-08T13:03:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.293+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1240010460 con 0x7f12500ff550 2023-10-08T13:03:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.293+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12501a54c0 con 0x7f12500ff550 2023-10-08T13:03:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.293+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000f620 con 0x7f12500ff550 2023-10-08T13:03:49.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.293+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12501a59a0 con 0x7f12500ff550 2023-10-08T13:03:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.294+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1250100c70 con 0x7f12500ff550 2023-10-08T13:03:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.295+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f12400108d0 con 0x7f12500ff550 2023-10-08T13:03:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.296+0000 7f1246ffd700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f123c0a14d0 0x7f123c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.296+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f12400ccdb0 con 0x7f12500ff550 2023-10-08T13:03:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.296+0000 7f12556dc700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f123c0a14d0 0x7f123c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:49.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.296+0000 7f12556dc700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f123c0a14d0 0x7f123c0a3990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f124c009990 tx=0x7f124c019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.299+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f12400967e0 con 0x7f12500ff550 2023-10-08T13:03:49.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.551+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1250067550 con 0x7f12500ff550 2023-10-08T13:03:49.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.551+0000 7f1246ffd700 1 -- 172.21.15.5:0/4064309285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f1240016e80 con 0x7f12500ff550 2023-10-08T13:03:49.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:49.553 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f123c0a14d0 msgr2=0x7f123c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f123c0a14d0 0x7f123c0a3990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f124c009990 tx=0x7f124c019040 comp rx=0 tx=0).stop 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 msgr2=0x7f12501011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12501011c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f124000d950 tx=0x7f124000dc60 comp rx=0 tx=0).stop 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 shutdown_connections 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f123c0a14d0 0x7f123c0a3990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1250105610 0x7f1250101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12500ff550 0x7f12501011c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 --2- 172.21.15.5:0/4064309285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12500fff10 0x7f1250101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.553+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 >> 172.21.15.5:0/4064309285 conn(0x7f12500fb040 msgr2=0x7f12500fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.554+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 shutdown_connections 2023-10-08T13:03:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:49.554+0000 7f1258141700 1 -- 172.21.15.5:0/4064309285 wait complete. 2023-10-08T13:03:49.556 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 5 2023-10-08T13:03:49.726 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:03:49 smithi060 podman[140373]: 2023-10-08T13:03:50.158 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:03:49 smithi060 bash[140373]: 7595a058a3b2773c4f783af995cafc1b05bc6c367852410a8b2f27eccd7d9fc9 2023-10-08T13:03:50.159 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:03:49 smithi060 ceph-mds[140413]: -- 172.21.15.60:0/4230957899 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5582b7c9b1e0 con 0x5582b7c70800 2023-10-08T13:03:50.159 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:03:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e[140389]: starting mds.e at 2023-10-08T13:03:50.159 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:03:49 smithi060 systemd[1]: Started Ceph mds.e for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:50.746 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4064309285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:50.747 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:50 smithi118 ceph-mon[104234]: Deploying daemon mds.f on smithi118 2023-10-08T13:03:50.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4064309285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:50.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:50.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:50.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:50 smithi060 ceph-mon[103190]: Deploying daemon mds.f on smithi118 2023-10-08T13:03:50.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4064309285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:50 smithi005 ceph-mon[99496]: Deploying daemon mds.f on smithi118 2023-10-08T13:03:51.508 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:03:51 smithi118 systemd[1]: Starting Ceph mds.f for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:51.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 -- 172.21.15.5:0/1512534222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848101000 msgr2=0x7f284810d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 --2- 172.21.15.5:0/1512534222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848101000 0x7f284810d510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f284000b0a0 tx=0x7f284000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 -- 172.21.15.5:0/1512534222 shutdown_connections 2023-10-08T13:03:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 --2- 172.21.15.5:0/1512534222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848101000 0x7f284810d510 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 --2- 172.21.15.5:0/1512534222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2848106650 0x7f2848106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 --2- 172.21.15.5:0/1512534222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2848100640 0x7f2848100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 -- 172.21.15.5:0/1512534222 >> 172.21.15.5:0/1512534222 conn(0x7f28480fc150 msgr2=0x7f28480fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 -- 172.21.15.5:0/1512534222 shutdown_connections 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 -- 172.21.15.5:0/1512534222 wait complete. 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 Processor -- start 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.708+0000 7f284e76c700 1 -- start start 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284e76c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2848100640 0x7f284819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284e76c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2848101000 0x7f284819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284e76c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 0x7f2848196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284e76c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848196ef0 con 0x7f2848106650 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284e76c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848197060 con 0x7f2848100640 2023-10-08T13:03:51.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284e76c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848197220 con 0x7f2848101000 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 0x7f2848196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f28477fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2848101000 0x7f284819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 0x7f2848196890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60408/0 (socket says 172.21.15.5:60408) 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 -- 172.21.15.5:0/1361747891 learned_addr learned my addr 172.21.15.5:0/1361747891 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f2847fff700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2848100640 0x7f284819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 -- 172.21.15.5:0/1361747891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2848101000 msgr2=0x7f284819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2848101000 0x7f284819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 -- 172.21.15.5:0/1361747891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2848100640 msgr2=0x7f284819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2848100640 0x7f284819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.709+0000 7f284cd09700 1 -- 172.21.15.5:0/1361747891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009d00 con 0x7f2848106650 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.710+0000 7f284cd09700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 0x7f2848196890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2840007b60 tx=0x7f2840005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:51.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.710+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000e040 con 0x7f2848106650 2023-10-08T13:03:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.710+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2840012dc0 con 0x7f2848106650 2023-10-08T13:03:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.710+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28481974a0 con 0x7f2848106650 2023-10-08T13:03:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.710+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284001b450 con 0x7f2848106650 2023-10-08T13:03:51.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.710+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28481a37a0 con 0x7f2848106650 2023-10-08T13:03:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.711+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848108c60 con 0x7f2848106650 2023-10-08T13:03:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.712+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f284001d680 con 0x7f2848106650 2023-10-08T13:03:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.712+0000 7f28457fa700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28340a14d0 0x7f28340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.713+0000 7f2847fff700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28340a14d0 0x7f28340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.713+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f28400cea50 con 0x7f2848106650 2023-10-08T13:03:51.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.713+0000 7f2847fff700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28340a14d0 0x7f28340a3990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28480fe220 tx=0x7f283000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:51.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.716+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2840098510 con 0x7f2848106650 2023-10-08T13:03:51.769 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:03:51 smithi118 podman[141939]: 2023-10-08T13:03:51.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:51 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6834/2434035326,v1:172.21.15.60:6835/2434035326] up:boot 2023-10-08T13:03:51.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:51 smithi118 ceph-mon[104234]: fsmap 5 up:standby 2023-10-08T13:03:51.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:51 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:03:51.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:51 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6834/2434035326,v1:172.21.15.60:6835/2434035326] up:boot 2023-10-08T13:03:51.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:51 smithi060 ceph-mon[103190]: fsmap 5 up:standby 2023-10-08T13:03:51.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:51 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:03:51.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:51 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6834/2434035326,v1:172.21.15.60:6835/2434035326] up:boot 2023-10-08T13:03:51.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:51 smithi005 ceph-mon[99496]: fsmap 5 up:standby 2023-10-08T13:03:51.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:51 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:03:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.965+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2848101d80 con 0x7f2848106650 2023-10-08T13:03:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.966+0000 7f28457fa700 1 -- 172.21.15.5:0/1361747891 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f284009bb30 con 0x7f2848106650 2023-10-08T13:03:51.967 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:51.967 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T13:03:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28340a14d0 msgr2=0x7f28340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28340a14d0 0x7f28340a3990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28480fe220 tx=0x7f283000b410 comp rx=0 tx=0).stop 2023-10-08T13:03:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 msgr2=0x7f2848196890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 0x7f2848196890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2840007b60 tx=0x7f2840005a60 comp rx=0 tx=0).stop 2023-10-08T13:03:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 shutdown_connections 2023-10-08T13:03:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28340a14d0 0x7f28340a3990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2848106650 0x7f2848196890 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2848100640 0x7f284819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 --2- 172.21.15.5:0/1361747891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2848101000 0x7f284819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 >> 172.21.15.5:0/1361747891 conn(0x7f28480fc150 msgr2=0x7f28480fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 shutdown_connections 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:51.968+0000 7f284e76c700 1 -- 172.21.15.5:0/1361747891 wait complete. 2023-10-08T13:03:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2023-10-08T13:03:52.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:03:51 smithi118 ceph-mds[141979]: -- 172.21.15.118:0/4000713227 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555e19b611e0 con 0x555e19b36800 2023-10-08T13:03:52.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:03:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f[141955]: starting mds.f at 2023-10-08T13:03:52.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:03:51 smithi118 bash[141939]: 4d420ad9e2d9bcd2a09c6a3179bd2638e608ac3329d97268d2c834f25a5da111 2023-10-08T13:03:52.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:03:51 smithi118 systemd[1]: Started Ceph mds.f for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1361747891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:52.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:52.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:52 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1361747891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:52.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:52.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:52.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:52 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:52.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1361747891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:52 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:53.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:53 smithi118 ceph-mon[104234]: Deploying daemon mds.c on smithi118 2023-10-08T13:03:53.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:53 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] up:boot 2023-10-08T13:03:53.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:53 smithi118 ceph-mon[104234]: fsmap 6 up:standby 2023-10-08T13:03:53.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:03:53.771 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:03:53 smithi118 systemd[1]: Starting Ceph mds.c for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:53.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:53 smithi060 ceph-mon[103190]: Deploying daemon mds.c on smithi118 2023-10-08T13:03:53.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:53 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] up:boot 2023-10-08T13:03:53.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:53 smithi060 ceph-mon[103190]: fsmap 6 up:standby 2023-10-08T13:03:53.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:03:53.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:53 smithi005 ceph-mon[99496]: Deploying daemon mds.c on smithi118 2023-10-08T13:03:53.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:53 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] up:boot 2023-10-08T13:03:53.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:53 smithi005 ceph-mon[99496]: fsmap 6 up:standby 2023-10-08T13:03:53.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:03:53.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/3979616657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 msgr2=0x7fd7c410c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/3979616657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c410c3e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009920 tx=0x7fd7bc009c30 comp rx=0 tx=0).stop 2023-10-08T13:03:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/3979616657 shutdown_connections 2023-10-08T13:03:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/3979616657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c410c3e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/3979616657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c4105620 0x7fd7c4105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/3979616657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c40ff560 0x7fd7c40ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.122+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/3979616657 >> 172.21.15.5:0/3979616657 conn(0x7fd7c40fb010 msgr2=0x7fd7c40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/3979616657 shutdown_connections 2023-10-08T13:03:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/3979616657 wait complete. 2023-10-08T13:03:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 Processor -- start 2023-10-08T13:03:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 -- start start 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c40ff560 0x7fd7c4197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c4197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c4105620 0x7fd7c41a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4198640 con 0x7fd7c40fff20 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.123+0000 7fd7cc7cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41a2e50 con 0x7fd7c40ff560 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7cc7cf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41a2f90 con 0x7fd7c4105620 2023-10-08T13:03:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c4197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c4197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60420/0 (socket says 172.21.15.5:60420) 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 -- 172.21.15.5:0/1651743100 learned_addr learned my addr 172.21.15.5:0/1651743100 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7cad6c700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c4105620 0x7fd7c41a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7ca56b700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c40ff560 0x7fd7c4197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 -- 172.21.15.5:0/1651743100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c4105620 msgr2=0x7fd7c41a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c4105620 0x7fd7c41a2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 -- 172.21.15.5:0/1651743100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c40ff560 msgr2=0x7fd7c4197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c40ff560 0x7fd7c4197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 -- 172.21.15.5:0/1651743100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009d00 con 0x7fd7c40fff20 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c9d6a700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c4197dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800c9b0 tx=0x7fd7b800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8007b00 con 0x7fd7c40fff20 2023-10-08T13:03:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7b8007c60 con 0x7fd7c40fff20 2023-10-08T13:03:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc009520 con 0x7fd7c40fff20 2023-10-08T13:03:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8018660 con 0x7fd7c40fff20 2023-10-08T13:03:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.124+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c41a35a0 con 0x7fd7c40fff20 2023-10-08T13:03:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.125+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4107ac0 con 0x7fd7c40fff20 2023-10-08T13:03:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.126+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd7b8018880 con 0x7fd7c40fff20 2023-10-08T13:03:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.127+0000 7fd7c37fe700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7ac0a14d0 0x7fd7ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.127+0000 7fd7ca56b700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7ac0a14d0 0x7fd7ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.127+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd7b80cca00 con 0x7fd7c40fff20 2023-10-08T13:03:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.127+0000 7fd7ca56b700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7ac0a14d0 0x7fd7ac0a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009fd0 tx=0x7fd7b400b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.131+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7b8096430 con 0x7fd7c40fff20 2023-10-08T13:03:54.150 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:03:53 smithi118 podman[142280]: 2023-10-08T13:03:54.150 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mds[142320]: -- 172.21.15.118:0/1094511950 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5614592e11e0 con 0x5614592b7000 2023-10-08T13:03:54.150 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-c[142296]: starting mds.c at 2023-10-08T13:03:54.150 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:03:54 smithi118 bash[142280]: a98f63566bc202233e261fdd8567087e6267af4be4e8b167b359e26faeb5e555 2023-10-08T13:03:54.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.399+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7c4100c80 con 0x7fd7c40fff20 2023-10-08T13:03:54.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.400+0000 7fd7c37fe700 1 -- 172.21.15.5:0/1651743100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5277 (secure 0 0 0) 0x7fd7b8099a50 con 0x7fd7c40fff20 2023-10-08T13:03:54.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:54.401 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-08T13:03:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7ac0a14d0 msgr2=0x7fd7ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7ac0a14d0 0x7fd7ac0a3990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009fd0 tx=0x7fd7b400b040 comp rx=0 tx=0).stop 2023-10-08T13:03:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 msgr2=0x7fd7c4197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c4197dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800c9b0 tx=0x7fd7b800cd70 comp rx=0 tx=0).stop 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 shutdown_connections 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7ac0a14d0 0x7fd7ac0a3990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7c4105620 0x7fd7c41a2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7c40ff560 0x7fd7c4197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 --2- 172.21.15.5:0/1651743100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7c40fff20 0x7fd7c4197dd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 >> 172.21.15.5:0/1651743100 conn(0x7fd7c40fb010 msgr2=0x7fd7c40fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 shutdown_connections 2023-10-08T13:03:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:54.402+0000 7fd7cc7cf700 1 -- 172.21.15.5:0/1651743100 wait complete. 2023-10-08T13:03:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-10-08T13:03:54.519 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:03:54 smithi118 systemd[1]: Started Ceph mds.c for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:54.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:54 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1651743100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:54.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:54 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1651743100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:54.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:54.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:54 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1651743100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:55.572 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:55 smithi060 ceph-mon[103190]: Deploying daemon mds.h on smithi060 2023-10-08T13:03:55.572 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:55 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] up:boot 2023-10-08T13:03:55.572 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:55 smithi060 ceph-mon[103190]: fsmap 7 up:standby 2023-10-08T13:03:55.572 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:03:55.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:55 smithi005 ceph-mon[99496]: Deploying daemon mds.h on smithi060 2023-10-08T13:03:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:55 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] up:boot 2023-10-08T13:03:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:55 smithi005 ceph-mon[99496]: fsmap 7 up:standby 2023-10-08T13:03:55.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:03:56.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:55 smithi118 ceph-mon[104234]: Deploying daemon mds.h on smithi060 2023-10-08T13:03:56.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:55 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] up:boot 2023-10-08T13:03:56.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:55 smithi118 ceph-mon[104234]: fsmap 7 up:standby 2023-10-08T13:03:56.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:03:56.159 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:03:55 smithi060 systemd[1]: Starting Ceph mds.h for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:56.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:56.507 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:03:56 smithi060 podman[140712]: 2023-10-08T13:03:56.508 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:03:56 smithi060 ceph-mds[140752]: -- 172.21.15.60:0/3514696041 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56352e9ad1e0 con 0x56352e983000 2023-10-08T13:03:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 -- 172.21.15.5:0/961825766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 msgr2=0x7fb5100ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 --2- 172.21.15.5:0/961825766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb5100ff9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb5040099c0 tx=0x7fb504009cd0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 -- 172.21.15.5:0/961825766 shutdown_connections 2023-10-08T13:03:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 --2- 172.21.15.5:0/961825766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5100fff10 0x7fb51010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 --2- 172.21.15.5:0/961825766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb510105610 0x7fb5101059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 --2- 172.21.15.5:0/961825766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb5100ff9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.559+0000 7fb517e94700 1 -- 172.21.15.5:0/961825766 >> 172.21.15.5:0/961825766 conn(0x7fb5100fb020 msgr2=0x7fb5100fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.560+0000 7fb517e94700 1 -- 172.21.15.5:0/961825766 shutdown_connections 2023-10-08T13:03:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.560+0000 7fb517e94700 1 -- 172.21.15.5:0/961825766 wait complete. 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.560+0000 7fb517e94700 1 Processor -- start 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.560+0000 7fb517e94700 1 -- start start 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb517e94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb51019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb517e94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5100fff10 0x7fb51019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb517e94700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb510105610 0x7fb5101957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb517e94700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510195e50 con 0x7fb5100ff550 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb517e94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510195fc0 con 0x7fb5100fff10 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb517e94700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510196180 con 0x7fb510105610 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb51019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb51019b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60432/0 (socket says 172.21.15.5:60432) 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 -- 172.21.15.5:0/2224552607 learned_addr learned my addr 172.21.15.5:0/2224552607 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb51542f700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5100fff10 0x7fb51019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb516431700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb510105610 0x7fb5101957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 -- 172.21.15.5:0/2224552607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb510105610 msgr2=0x7fb5101957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb510105610 0x7fb5101957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 -- 172.21.15.5:0/2224552607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5100fff10 msgr2=0x7fb51019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5100fff10 0x7fb51019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 -- 172.21.15.5:0/2224552607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040095f0 con 0x7fb5100ff550 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb515c30700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb51019b6b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e9a0 tx=0x7fb50c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.561+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c009790 con 0x7fb5100ff550 2023-10-08T13:03:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.562+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb510196460 con 0x7fb5100ff550 2023-10-08T13:03:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.562+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50c00cbd0 con 0x7fb5100ff550 2023-10-08T13:03:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.562+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c018680 con 0x7fb5100ff550 2023-10-08T13:03:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.562+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb510068a30 con 0x7fb5100ff550 2023-10-08T13:03:56.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.562+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb510100c70 con 0x7fb5100ff550 2023-10-08T13:03:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.564+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb50c00cd40 con 0x7fb5100ff550 2023-10-08T13:03:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.564+0000 7fb502ffd700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4fc0a14d0 0x7fb4fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.564+0000 7fb51542f700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4fc0a14d0 0x7fb4fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.564+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb50c014070 con 0x7fb5100ff550 2023-10-08T13:03:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.565+0000 7fb51542f700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4fc0a14d0 0x7fb4fc0a3990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb504009990 tx=0x7fb504019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:56.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.568+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb50c097000 con 0x7fb5100ff550 2023-10-08T13:03:56.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.820+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb510196650 con 0x7fb5100ff550 2023-10-08T13:03:56.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.821+0000 7fb502ffd700 1 -- 172.21.15.5:0/2224552607 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6859 (secure 0 0 0) 0x7fb510196650 con 0x7fb5100ff550 2023-10-08T13:03:56.822 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:56.822 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T13:03:56.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4fc0a14d0 msgr2=0x7fb4fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:56.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4fc0a14d0 0x7fb4fc0a3990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb504009990 tx=0x7fb504019040 comp rx=0 tx=0).stop 2023-10-08T13:03:56.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 msgr2=0x7fb51019b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:56.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb51019b6b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e9a0 tx=0x7fb50c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 shutdown_connections 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4fc0a14d0 0x7fb4fc0a3990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb510105610 0x7fb5101957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5100ff550 0x7fb51019b6b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 --2- 172.21.15.5:0/2224552607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5100fff10 0x7fb51019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 >> 172.21.15.5:0/2224552607 conn(0x7fb5100fb020 msgr2=0x7fb5100fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 shutdown_connections 2023-10-08T13:03:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:56.823+0000 7fb517e94700 1 -- 172.21.15.5:0/2224552607 wait complete. 2023-10-08T13:03:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-10-08T13:03:56.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:56 smithi005 ceph-mon[99496]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:56.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:56 smithi060 ceph-mon[103190]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:56.909 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:03:56 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h[140728]: starting mds.h at 2023-10-08T13:03:56.909 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:03:56 smithi060 bash[140712]: 843e1741a8c028a43e4454071546f1460a6905faf0aaa24bcfb08908ac201641 2023-10-08T13:03:56.909 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:03:56 smithi060 systemd[1]: Started Ceph mds.h for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:57.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:56 smithi118 ceph-mon[104234]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] up:boot 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: fsmap 8 up:standby 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:57.638 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:57.639 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:57.639 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: Deploying daemon mds.i on smithi118 2023-10-08T13:03:57.639 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:57 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2224552607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:57.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] up:boot 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: fsmap 8 up:standby 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: Deploying daemon mds.i on smithi118 2023-10-08T13:03:57.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:57 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2224552607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] up:boot 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: fsmap 8 up:standby 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:57.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:57.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: Deploying daemon mds.i on smithi118 2023-10-08T13:03:57.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:57 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2224552607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:58.263 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:03:58 smithi118 systemd[1]: Starting Ceph mds.i for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:03:58.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:03:58.844 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:58 smithi118 ceph-mon[104234]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:58.844 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:03:58 smithi118 podman[142621]: 2023-10-08T13:03:58.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:58 smithi005 ceph-mon[99496]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 -- 172.21.15.5:0/697256535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc105610 msgr2=0x7fc0fc1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 --2- 172.21.15.5:0/697256535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc105610 0x7fc0fc1059f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80099c0 tx=0x7fc0f8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 -- 172.21.15.5:0/697256535 shutdown_connections 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 --2- 172.21.15.5:0/697256535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc0fff10 0x7fc0fc10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 --2- 172.21.15.5:0/697256535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc105610 0x7fc0fc1059f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 --2- 172.21.15.5:0/697256535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0fc0ff550 0x7fc0fc0ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 -- 172.21.15.5:0/697256535 >> 172.21.15.5:0/697256535 conn(0x7fc0fc0fb040 msgr2=0x7fc0fc0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 -- 172.21.15.5:0/697256535 shutdown_connections 2023-10-08T13:03:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.976+0000 7fc103f56700 1 -- 172.21.15.5:0/697256535 wait complete. 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 Processor -- start 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 -- start start 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0fc0ff550 0x7fc0fc197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0fff10 0x7fc0fc197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 0x7fc0fc1a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc198620 con 0x7fc0fc105610 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc1a2e50 con 0x7fc0fc0fff10 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc103f56700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc1a2f90 con 0x7fc0fc0ff550 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc1024f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 0x7fc0fc1a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc1024f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 0x7fc0fc1a2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60450/0 (socket says 172.21.15.5:60450) 2023-10-08T13:03:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc1024f3700 1 -- 172.21.15.5:0/4253777634 learned_addr learned my addr 172.21.15.5:0/4253777634 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc101cf2700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0fc0ff550 0x7fc0fc197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.977+0000 7fc1014f1700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0fff10 0x7fc0fc197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc1024f3700 1 -- 172.21.15.5:0/4253777634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0fc0ff550 msgr2=0x7fc0fc197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc1024f3700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0fc0ff550 0x7fc0fc197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc1024f3700 1 -- 172.21.15.5:0/4253777634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0fff10 msgr2=0x7fc0fc197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc1024f3700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0fff10 0x7fc0fc197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc1024f3700 1 -- 172.21.15.5:0/4253777634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009c40 con 0x7fc0fc105610 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc1024f3700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 0x7fc0fc1a2910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400c3a0 tx=0x7fc0f400c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4017070 con 0x7fc0fc105610 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0f400f040 con 0x7fc0fc105610 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f80095f0 con 0x7fc0fc105610 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400e050 con 0x7fc0fc105610 2023-10-08T13:03:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.978+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc1a3510 con 0x7fc0fc105610 2023-10-08T13:03:58.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.979+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc107a90 con 0x7fc0fc105610 2023-10-08T13:03:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.981+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc0f40044c0 con 0x7fc0fc105610 2023-10-08T13:03:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.981+0000 7fc0f2ffd700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0e80a14d0 0x7fc0e80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:03:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.982+0000 7fc101cf2700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0e80a14d0 0x7fc0e80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:03:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.982+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc0f40cc9a0 con 0x7fc0fc105610 2023-10-08T13:03:58.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.982+0000 7fc101cf2700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0e80a14d0 0x7fc0e80a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009fd0 tx=0x7fc0f8019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:03:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:58.985+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc0f4096330 con 0x7fc0fc105610 2023-10-08T13:03:59.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:58 smithi060 ceph-mon[103190]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.258+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0fc067f40 con 0x7fc0fc105610 2023-10-08T13:03:59.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.259+0000 7fc0f2ffd700 1 -- 172.21.15.5:0/4253777634 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6859 (secure 0 0 0) 0x7fc0f4099950 con 0x7fc0fc105610 2023-10-08T13:03:59.260 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:03:59.260 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T13:03:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0e80a14d0 msgr2=0x7fc0e80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0e80a14d0 0x7fc0e80a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009fd0 tx=0x7fc0f8019040 comp rx=0 tx=0).stop 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 msgr2=0x7fc0fc1a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 0x7fc0fc1a2910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400c3a0 tx=0x7fc0f400c6b0 comp rx=0 tx=0).stop 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 shutdown_connections 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0e80a14d0 0x7fc0e80a3990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0fc105610 0x7fc0fc1a2910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc0fc0ff550 0x7fc0fc197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 --2- 172.21.15.5:0/4253777634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0fc0fff10 0x7fc0fc197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:03:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 >> 172.21.15.5:0/4253777634 conn(0x7fc0fc0fb040 msgr2=0x7fc0fc0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:03:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 shutdown_connections 2023-10-08T13:03:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:03:59.262+0000 7fc103f56700 1 -- 172.21.15.5:0/4253777634 wait complete. 2023-10-08T13:03:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-10-08T13:03:59.269 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:03:58 smithi118 ceph-mds[142661]: -- 172.21.15.118:0/1374043285 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c3e360b1e0 con 0x55c3e35e1000 2023-10-08T13:03:59.269 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:03:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: starting mds.i at 2023-10-08T13:03:59.270 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:03:58 smithi118 bash[142621]: 10bc09b08f28ef03689981e05ee424cf585c9b560ea946a60a19d7e1f7931241 2023-10-08T13:03:59.270 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:03:58 smithi118 systemd[1]: Started Ceph mds.i for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:03:59.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:59.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:59.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:03:59.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:03:59.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:03:59.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:03:59.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: Deploying daemon mds.g on smithi005 2023-10-08T13:03:59.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:03:59.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4253777634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:03:59.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] up:boot 2023-10-08T13:03:59.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: fsmap 9 up:standby 2023-10-08T13:03:59.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:03:59 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:04:00.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:00.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: Deploying daemon mds.g on smithi005 2023-10-08T13:04:00.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:00.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4253777634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:00.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] up:boot 2023-10-08T13:04:00.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: fsmap 9 up:standby 2023-10-08T13:04:00.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:03:59 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:04:00.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: Deploying daemon mds.g on smithi005 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4253777634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] up:boot 2023-10-08T13:04:00.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: fsmap 9 up:standby 2023-10-08T13:04:00.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:03:59 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:04:00.638 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:04:00 smithi005 systemd[1]: Starting Ceph mds.g for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:04:01.199 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:04:00 smithi005 podman[158626]: 2023-10-08T13:04:01.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 -- 172.21.15.5:0/76643030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ff410 msgr2=0x7f8db80ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 --2- 172.21.15.5:0/76643030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ff410 0x7f8db80ff7f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009990 tx=0x7f8da8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 -- 172.21.15.5:0/76643030 shutdown_connections 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 --2- 172.21.15.5:0/76643030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8db810cfc0 0x7f8db810f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 --2- 172.21.15.5:0/76643030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ff410 0x7f8db80ff7f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 --2- 172.21.15.5:0/76643030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8db80ffdc0 0x7f8db810c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 -- 172.21.15.5:0/76643030 >> 172.21.15.5:0/76643030 conn(0x7f8db80fb040 msgr2=0x7f8db80fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 -- 172.21.15.5:0/76643030 shutdown_connections 2023-10-08T13:04:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.410+0000 7f8dbe363700 1 -- 172.21.15.5:0/76643030 wait complete. 2023-10-08T13:04:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 Processor -- start 2023-10-08T13:04:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 -- start start 2023-10-08T13:04:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8db80ff410 0x7f8db8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 0x7f8db81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8db810cfc0 0x7f8db819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db819dda0 con 0x7f8db80ffdc0 2023-10-08T13:04:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db819df10 con 0x7f8db80ff410 2023-10-08T13:04:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8dbe363700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db819e0d0 con 0x7f8db810cfc0 2023-10-08T13:04:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.411+0000 7f8db77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 0x7f8db81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 0x7f8db81993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60472/0 (socket says 172.21.15.5:60472) 2023-10-08T13:04:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 -- 172.21.15.5:0/1849173570 learned_addr learned my addr 172.21.15.5:0/1849173570 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8dbc900700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8db810cfc0 0x7f8db819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db7fff700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8db80ff410 0x7f8db8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 -- 172.21.15.5:0/1849173570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8db810cfc0 msgr2=0x7f8db819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8db810cfc0 0x7f8db819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 -- 172.21.15.5:0/1849173570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8db80ff410 msgr2=0x7f8db8198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8db80ff410 0x7f8db8198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 -- 172.21.15.5:0/1849173570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da80095f0 con 0x7f8db80ffdc0 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db77fe700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 0x7f8db81993c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00b550 tx=0x7f8dac00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac011830 con 0x7f8db80ffdc0 2023-10-08T13:04:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dac011e50 con 0x7f8db80ffdc0 2023-10-08T13:04:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db819e3b0 con 0x7f8db80ffdc0 2023-10-08T13:04:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac00f2e0 con 0x7f8db80ffdc0 2023-10-08T13:04:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.412+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db81a5bf0 con 0x7f8db80ffdc0 2023-10-08T13:04:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.413+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db8108150 con 0x7f8db80ffdc0 2023-10-08T13:04:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.415+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f8dac011990 con 0x7f8db80ffdc0 2023-10-08T13:04:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.415+0000 7f8db57fa700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8da00a14d0 0x7f8da00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.415+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f8dac0cc990 con 0x7f8db80ffdc0 2023-10-08T13:04:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.415+0000 7f8db7fff700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8da00a14d0 0x7f8da00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.416+0000 7f8db7fff700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8da00a14d0 0x7f8da00a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8da8003800 tx=0x7f8da800b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.419+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8dac0963c0 con 0x7f8db80ffdc0 2023-10-08T13:04:01.671 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:04:01 smithi005 ceph-mds[158666]: -- 172.21.15.5:0/3363478154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562b4bed31e0 con 0x562b4bea8c00 2023-10-08T13:04:01.672 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:04:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g[158642]: starting mds.g at 2023-10-08T13:04:01.672 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:04:01 smithi005 bash[158626]: 63e51fcfc19f23da20d50a398c31e9dd9dcacce2ba0669b6c6b2c6311ac31311 2023-10-08T13:04:01.672 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:04:01 smithi005 systemd[1]: Started Ceph mds.g for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:04:01.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.675+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8db819a180 con 0x7f8db80ffdc0 2023-10-08T13:04:01.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.676+0000 7f8db57fa700 1 -- 172.21.15.5:0/1849173570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7f8dac0ade60 con 0x7f8db80ffdc0 2023-10-08T13:04:01.677 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:01.677 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8da00a14d0 msgr2=0x7f8da00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8da00a14d0 0x7f8da00a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8da8003800 tx=0x7f8da800b560 comp rx=0 tx=0).stop 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 msgr2=0x7f8db81993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 0x7f8db81993c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00b550 tx=0x7f8dac00b860 comp rx=0 tx=0).stop 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 shutdown_connections 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8da00a14d0 0x7f8da00a3990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8db810cfc0 0x7f8db819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8db80ff410 0x7f8db8198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 --2- 172.21.15.5:0/1849173570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db80ffdc0 0x7f8db81993c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 >> 172.21.15.5:0/1849173570 conn(0x7f8db80fb040 msgr2=0x7f8db80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 shutdown_connections 2023-10-08T13:04:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:01.678+0000 7f8dbe363700 1 -- 172.21.15.5:0/1849173570 wait complete. 2023-10-08T13:04:01.680 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 10 2023-10-08T13:04:02.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:02.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: Deploying daemon mds.a on smithi005 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1849173570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.5:6838/1016601603,v1:172.21.15.5:6839/1016601603] up:boot 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: fsmap 10 up:standby 2023-10-08T13:04:02.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:02 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: Deploying daemon mds.a on smithi005 2023-10-08T13:04:02.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1849173570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:02.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.5:6838/1016601603,v1:172.21.15.5:6839/1016601603] up:boot 2023-10-08T13:04:02.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: fsmap 10 up:standby 2023-10-08T13:04:02.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:02 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:04:02.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:02.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: Deploying daemon mds.a on smithi005 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1849173570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.5:6838/1016601603,v1:172.21.15.5:6839/1016601603] up:boot 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: fsmap 10 up:standby 2023-10-08T13:04:02.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:02 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:04:03.172 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:04:02 smithi005 systemd[1]: Starting Ceph mds.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:04:03.445 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:04:03 smithi005 podman[159012]: 2023-10-08T13:04:03.445 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:04:03 smithi005 bash[159012]: c30ae2b2d289df15434d3fe0187aece1467b1f6c5941499a2118761b2bd17e25 2023-10-08T13:04:03.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:04:03.722 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:04:03 smithi005 ceph-mds[159052]: -- 172.21.15.5:0/2685646834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd078551e0 con 0x55fd0782b000 2023-10-08T13:04:03.722 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:04:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a[159028]: starting mds.a at 2023-10-08T13:04:03.723 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:04:03 smithi005 systemd[1]: Started Ceph mds.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:04:03.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 -- 172.21.15.5:0/2227521022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700ff550 msgr2=0x7f5d700ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 --2- 172.21.15.5:0/2227521022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700ff550 0x7f5d700ff9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d600099c0 tx=0x7f5d60009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 -- 172.21.15.5:0/2227521022 shutdown_connections 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 --2- 172.21.15.5:0/2227521022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d700fff10 0x7f5d7010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 --2- 172.21.15.5:0/2227521022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d70105610 0x7f5d701059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 --2- 172.21.15.5:0/2227521022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700ff550 0x7f5d700ff9d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 -- 172.21.15.5:0/2227521022 >> 172.21.15.5:0/2227521022 conn(0x7f5d700fb040 msgr2=0x7f5d700fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 -- 172.21.15.5:0/2227521022 shutdown_connections 2023-10-08T13:04:03.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.824+0000 7f5d77def700 1 -- 172.21.15.5:0/2227521022 wait complete. 2023-10-08T13:04:03.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 Processor -- start 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 -- start start 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d700ff550 0x7f5d7019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 0x7f5d7019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d70105610 0x7f5d70195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70195dd0 con 0x7f5d700fff10 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70195f40 con 0x7f5d70105610 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.825+0000 7f5d77def700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70196100 con 0x7f5d700ff550 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 0x7f5d7019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 0x7f5d7019bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60500/0 (socket says 172.21.15.5:60500) 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 -- 172.21.15.5:0/408966505 learned_addr learned my addr 172.21.15.5:0/408966505 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:03.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d75b8b700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d700ff550 0x7f5d7019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7638c700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d70105610 0x7f5d70195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 -- 172.21.15.5:0/408966505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d700ff550 msgr2=0x7f5d7019b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d700ff550 0x7f5d7019b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 -- 172.21.15.5:0/408966505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d70105610 msgr2=0x7f5d70195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d70105610 0x7f5d70195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 -- 172.21.15.5:0/408966505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600095f0 con 0x7f5d700fff10 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7638c700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d70105610 0x7f5d70195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d7538a700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 0x7f5d7019bb80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000c010 tx=0x7f5d6000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6001c070 con 0x7f5d700fff10 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70196380 con 0x7f5d700fff10 2023-10-08T13:04:03.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d6000fe60 con 0x7f5d700fff10 2023-10-08T13:04:03.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60022d80 con 0x7f5d700fff10 2023-10-08T13:04:03.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.826+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d701a2630 con 0x7f5d700fff10 2023-10-08T13:04:03.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.827+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70107ab0 con 0x7f5d700fff10 2023-10-08T13:04:03.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.828+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5d60020070 con 0x7f5d700fff10 2023-10-08T13:04:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.829+0000 7f5d66ffd700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d5c0a14d0 0x7f5d5c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.829+0000 7f5d75b8b700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d5c0a14d0 0x7f5d5c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.829+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f5d600cd960 con 0x7f5d700fff10 2023-10-08T13:04:03.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.829+0000 7f5d75b8b700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d5c0a14d0 0x7f5d5c0a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005950 tx=0x7f5d6c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:03.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:03.834+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d60097540 con 0x7f5d700fff10 2023-10-08T13:04:04.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.084+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d70196c30 con 0x7f5d700fff10 2023-10-08T13:04:04.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.085+0000 7f5d66ffd700 1 -- 172.21.15.5:0/408966505 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8444 (secure 0 0 0) 0x7f5d6009ab60 con 0x7f5d700fff10 2023-10-08T13:04:04.086 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:04.086 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14793,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:04:04.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d5c0a14d0 msgr2=0x7f5d5c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:04.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d5c0a14d0 0x7f5d5c0a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005950 tx=0x7f5d6c00b410 comp rx=0 tx=0).stop 2023-10-08T13:04:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 msgr2=0x7f5d7019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 0x7f5d7019bb80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000c010 tx=0x7f5d6000f690 comp rx=0 tx=0).stop 2023-10-08T13:04:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 shutdown_connections 2023-10-08T13:04:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d5c0a14d0 0x7f5d5c0a3990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d70105610 0x7f5d70195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d700ff550 0x7f5d7019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 --2- 172.21.15.5:0/408966505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d700fff10 0x7f5d7019bb80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 >> 172.21.15.5:0/408966505 conn(0x7f5d700fb040 msgr2=0x7f5d700fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 shutdown_connections 2023-10-08T13:04:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:04.087+0000 7f5d77def700 1 -- 172.21.15.5:0/408966505 wait complete. 2023-10-08T13:04:04.091 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 11 2023-10-08T13:04:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:04.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:04.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: Deploying daemon mds.b on smithi060 2023-10-08T13:04:04.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/408966505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:04.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.5:6840/3855657162,v1:172.21.15.5:6841/3855657162] up:boot 2023-10-08T13:04:04.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: fsmap 11 up:standby 2023-10-08T13:04:04.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:04 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:04:04.829 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:04.830 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.830 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.830 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.830 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:04.831 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:04.831 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:04.831 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: Deploying daemon mds.b on smithi060 2023-10-08T13:04:04.831 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/408966505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:04.832 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.5:6840/3855657162,v1:172.21.15.5:6841/3855657162] up:boot 2023-10-08T13:04:04.832 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: fsmap 11 up:standby 2023-10-08T13:04:04.832 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:04 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:04:04.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: Deploying daemon mds.b on smithi060 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/408966505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.5:6840/3855657162,v1:172.21.15.5:6841/3855657162] up:boot 2023-10-08T13:04:04.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: fsmap 11 up:standby 2023-10-08T13:04:04.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:04 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:04:05.084 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:04:05 smithi060 systemd[1]: Starting Ceph mds.b for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:04:05.602 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:04:05 smithi060 podman[141058]: 2023-10-08T13:04:05.603 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:04:05 smithi060 ceph-mds[141098]: -- 172.21.15.60:0/3352997353 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55787a6d71e0 con 0x55787a6ad000 2023-10-08T13:04:05.603 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:04:05 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b[141074]: starting mds.b at 2023-10-08T13:04:05.908 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:04:05 smithi060 bash[141058]: 855007c1507b3031249a066b20755ebbdcf8043ae2552387c9e03b0895378a12 2023-10-08T13:04:05.908 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:04:05 smithi060 systemd[1]: Started Ceph mds.b for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:04:06.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:04:06.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 -- 172.21.15.5:0/977499047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 msgr2=0x7f52181059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 --2- 172.21.15.5:0/977499047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f52181059f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52080099c0 tx=0x7f5208009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 -- 172.21.15.5:0/977499047 shutdown_connections 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 --2- 172.21.15.5:0/977499047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52180fff10 0x7f521810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 --2- 172.21.15.5:0/977499047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f52181059f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 --2- 172.21.15.5:0/977499047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52180ff550 0x7f52180ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 -- 172.21.15.5:0/977499047 >> 172.21.15.5:0/977499047 conn(0x7f52180fb040 msgr2=0x7f52180fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 -- 172.21.15.5:0/977499047 shutdown_connections 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.231+0000 7f521dbff700 1 -- 172.21.15.5:0/977499047 wait complete. 2023-10-08T13:04:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 Processor -- start 2023-10-08T13:04:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 -- start start 2023-10-08T13:04:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52180ff550 0x7f521819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52180fff10 0x7f521819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f5218196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218196f80 con 0x7f5218105610 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52181970f0 con 0x7f52180fff10 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f521dbff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52181972b0 con 0x7f52180ff550 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f5217fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f5218196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f5217fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f5218196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60516/0 (socket says 172.21.15.5:60516) 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f5217fff700 1 -- 172.21.15.5:0/3812424334 learned_addr learned my addr 172.21.15.5:0/3812424334 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f52177fe700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52180ff550 0x7f521819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.232+0000 7f5216ffd700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52180fff10 0x7f521819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5217fff700 1 -- 172.21.15.5:0/3812424334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52180ff550 msgr2=0x7f521819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5217fff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52180ff550 0x7f521819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5217fff700 1 -- 172.21.15.5:0/3812424334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52180fff10 msgr2=0x7f521819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5217fff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52180fff10 0x7f521819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5217fff700 1 -- 172.21.15.5:0/3812424334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080095f0 con 0x7f5218105610 2023-10-08T13:04:06.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5217fff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f5218196920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f521000ef30 tx=0x7f521000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210018070 con 0x7f5218105610 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5218197530 con 0x7f5218105610 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f521000f040 con 0x7f5218105610 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000cdb0 con 0x7f5218105610 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.233+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52181a3790 con 0x7f5218105610 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.234+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5218100c70 con 0x7f5218105610 2023-10-08T13:04:06.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.235+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5210003a00 con 0x7f5218105610 2023-10-08T13:04:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.236+0000 7f5214ff9700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f52000a14d0 0x7f52000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.236+0000 7f52177fe700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f52000a14d0 0x7f52000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.236+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f52100cc580 con 0x7f5218105610 2023-10-08T13:04:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.236+0000 7f52177fe700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f52000a14d0 0x7f52000a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5208009fd0 tx=0x7f5208005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:06.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.240+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5210096040 con 0x7f5218105610 2023-10-08T13:04:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.505+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5218067550 con 0x7f5218105610 2023-10-08T13:04:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.506+0000 7f5214ff9700 1 -- 172.21.15.5:0/3812424334 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10025 (secure 0 0 0) 0x7f5210099660 con 0x7f5218105610 2023-10-08T13:04:06.507 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:06.508 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14793,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f52000a14d0 msgr2=0x7f52000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f52000a14d0 0x7f52000a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5208009fd0 tx=0x7f5208005fb0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 msgr2=0x7f5218196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f5218196920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f521000ef30 tx=0x7f521000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 shutdown_connections 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f52000a14d0 0x7f52000a3990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5218105610 0x7f5218196920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52180ff550 0x7f521819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 --2- 172.21.15.5:0/3812424334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52180fff10 0x7f521819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 >> 172.21.15.5:0/3812424334 conn(0x7f52180fb040 msgr2=0x7f5218103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 shutdown_connections 2023-10-08T13:04:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.508+0000 7f521dbff700 1 -- 172.21.15.5:0/3812424334 wait complete. 2023-10-08T13:04:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2023-10-08T13:04:06.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 -- 172.21.15.5:0/3333464343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180ff550 msgr2=0x7fb3180ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/3333464343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180ff550 0x7fb3180ff9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3040099c0 tx=0x7fb304009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 -- 172.21.15.5:0/3333464343 shutdown_connections 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/3333464343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3180fff10 0x7fb31810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/3333464343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb318105610 0x7fb3181059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/3333464343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180ff550 0x7fb3180ff9d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 -- 172.21.15.5:0/3333464343 >> 172.21.15.5:0/3333464343 conn(0x7fb3180fb020 msgr2=0x7fb3180fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 -- 172.21.15.5:0/3333464343 shutdown_connections 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.657+0000 7fb31ec1c700 1 -- 172.21.15.5:0/3333464343 wait complete. 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 Processor -- start 2023-10-08T13:04:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 -- start start 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3180ff550 0x7fb31819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 0x7fb31819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318105610 0x7fb318196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb318196f70 con 0x7fb3180fff10 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3181970e0 con 0x7fb318105610 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31ec1c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3181972a0 con 0x7fb3180ff550 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb317fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 0x7fb31819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31c9b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3180ff550 0x7fb31819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb317fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 0x7fb31819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60528/0 (socket says 172.21.15.5:60528) 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb317fff700 1 -- 172.21.15.5:0/1779157132 learned_addr learned my addr 172.21.15.5:0/1779157132 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31d1b9700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318105610 0x7fb318196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31c9b8700 1 -- 172.21.15.5:0/1779157132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318105610 msgr2=0x7fb318196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31c9b8700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318105610 0x7fb318196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31c9b8700 1 -- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 msgr2=0x7fb31819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.658+0000 7fb31c9b8700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 0x7fb31819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb31c9b8700 1 -- 172.21.15.5:0/1779157132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3040095f0 con 0x7fb3180ff550 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb317fff700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 0x7fb31819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb31c9b8700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3180ff550 0x7fb31819c790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00e9f0 tx=0x7fb30c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c00c9c0 con 0x7fb3180ff550 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb318197580 con 0x7fb3180ff550 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb30c010430 con 0x7fb3180ff550 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c018680 con 0x7fb3180ff550 2023-10-08T13:04:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.659+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3181a3780 con 0x7fb3180ff550 2023-10-08T13:04:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.660+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb318100c70 con 0x7fb3180ff550 2023-10-08T13:04:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.662+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb30c010860 con 0x7fb3180ff550 2023-10-08T13:04:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.663+0000 7fb315ffb700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3080a14d0 0x7fb3080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.663+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb30c014070 con 0x7fb3180ff550 2023-10-08T13:04:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.663+0000 7fb317fff700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3080a14d0 0x7fb3080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.663+0000 7fb317fff700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3080a14d0 0x7fb3080a3990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb318197a80 tx=0x7fb304005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:06.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.666+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb30c0964a0 con 0x7fb3180ff550 2023-10-08T13:04:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.886+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb318066cc0 con 0x7fb3180ff550 2023-10-08T13:04:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.888+0000 7fb315ffb700 1 -- 172.21.15.5:0/1779157132 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18632 (secure 0 0 0) 0x7fb318066cc0 con 0x7fb3180ff550 2023-10-08T13:04:06.889 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:06.889 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:03:29.115462+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3080a14d0 msgr2=0x7fb3080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3080a14d0 0x7fb3080a3990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb318197a80 tx=0x7fb304005fb0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3180ff550 msgr2=0x7fb31819c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3180ff550 0x7fb31819c790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00e9f0 tx=0x7fb30c00ed00 comp rx=0 tx=0).stop 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 shutdown_connections 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3080a14d0 0x7fb3080a3990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb318105610 0x7fb318196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3180ff550 0x7fb31819c790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 --2- 172.21.15.5:0/1779157132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3180fff10 0x7fb31819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 >> 172.21.15.5:0/1779157132 conn(0x7fb3180fb020 msgr2=0x7fb3180fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 shutdown_connections 2023-10-08T13:04:06.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:06.890+0000 7fb31ec1c700 1 -- 172.21.15.5:0/1779157132 wait complete. 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:04:06.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] up:boot 2023-10-08T13:04:06.903 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: fsmap 12 up:standby 2023-10-08T13:04:06.903 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:04:06.903 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:06 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3812424334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:04:06.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:04:07.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] up:boot 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: fsmap 12 up:standby 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:04:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:06 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3812424334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 -- 172.21.15.5:0/1813280392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400ff8e0 msgr2=0x7fbb4010f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 --2- 172.21.15.5:0/1813280392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400ff8e0 0x7fbb4010f6b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b0a0 tx=0x7fbb3800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 -- 172.21.15.5:0/1813280392 shutdown_connections 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 --2- 172.21.15.5:0/1813280392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400ff8e0 0x7fbb4010f6b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 --2- 172.21.15.5:0/1813280392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb401018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 --2- 172.21.15.5:0/1813280392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb400fef20 0x7fbb400ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 -- 172.21.15.5:0/1813280392 >> 172.21.15.5:0/1813280392 conn(0x7fbb400748d0 msgr2=0x7fbb40074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 -- 172.21.15.5:0/1813280392 shutdown_connections 2023-10-08T13:04:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.043+0000 7fbb455cb700 1 -- 172.21.15.5:0/1813280392 wait complete. 2023-10-08T13:04:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 Processor -- start 2023-10-08T13:04:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 -- start start 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400fef20 0x7fbb40198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb400ff8e0 0x7fbb40199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb4019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4019cb30 con 0x7fbb400fef20 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4019cca0 con 0x7fbb401014c0 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb455cb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4019ce60 con 0x7fbb400ff8e0 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb4019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb3effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400fef20 0x7fbb40198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.044+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb4019c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:55492/0 (socket says 172.21.15.5:55492) 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 -- 172.21.15.5:0/3302526831 learned_addr learned my addr 172.21.15.5:0/3302526831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 -- 172.21.15.5:0/3302526831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb400ff8e0 msgr2=0x7fbb40199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb400ff8e0 0x7fbb40199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 -- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400fef20 msgr2=0x7fbb40198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400fef20 0x7fbb40198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 -- 172.21.15.5:0/3302526831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38009d00 con 0x7fbb401014c0 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3effd700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400fef20 0x7fbb40198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb3f7fe700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb4019c530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b070 tx=0x7fbb380078e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800e040 con 0x7fbb401014c0 2023-10-08T13:04:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb3801d470 con 0x7fbb401014c0 2023-10-08T13:04:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380052a0 con 0x7fbb401014c0 2023-10-08T13:04:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.045+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4019d0e0 con 0x7fbb401014c0 2023-10-08T13:04:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.046+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb401a5aa0 con 0x7fbb401014c0 2023-10-08T13:04:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.048+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fbb3801d5e0 con 0x7fbb401014c0 2023-10-08T13:04:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.048+0000 7fbb37fff700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbb2c0a1550 0x7fbb2c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.049+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fbb380cde60 con 0x7fbb401014c0 2023-10-08T13:04:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.049+0000 7fbb3effd700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbb2c0a1550 0x7fbb2c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.049+0000 7fbb3effd700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbb2c0a1550 0x7fbb2c0a3a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb28011490 tx=0x7fbb28009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.055+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4010ae10 con 0x7fbb401014c0 2023-10-08T13:04:07.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.060+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb38097880 con 0x7fbb401014c0 2023-10-08T13:04:07.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:07.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] up:boot 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: fsmap 12 up:standby 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:04:07.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:06 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3812424334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.273+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb40199fc0 con 0x7fbb401014c0 2023-10-08T13:04:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.274+0000 7fbb37fff700 1 -- 172.21.15.5:0/3302526831 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb38021020 con 0x7fbb401014c0 2023-10-08T13:04:07.275 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:04:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbb2c0a1550 msgr2=0x7fbb2c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbb2c0a1550 0x7fbb2c0a3a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb28011490 tx=0x7fbb28009260 comp rx=0 tx=0).stop 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 msgr2=0x7fbb4019c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb4019c530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b070 tx=0x7fbb380078e0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 shutdown_connections 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbb2c0a1550 0x7fbb2c0a3a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb401014c0 0x7fbb4019c530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb400fef20 0x7fbb40198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 --2- 172.21.15.5:0/3302526831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb400ff8e0 0x7fbb40199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 >> 172.21.15.5:0/3302526831 conn(0x7fbb400748d0 msgr2=0x7fbb400fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 shutdown_connections 2023-10-08T13:04:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.276+0000 7fbb455cb700 1 -- 172.21.15.5:0/3302526831 wait complete. 2023-10-08T13:04:07.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T13:04:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 -- 172.21.15.5:0/3401557044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad8105610 msgr2=0x7f4ad81059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 --2- 172.21.15.5:0/3401557044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad8105610 0x7f4ad81059f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40099c0 tx=0x7f4ad4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 -- 172.21.15.5:0/3401557044 shutdown_connections 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 --2- 172.21.15.5:0/3401557044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ad80fff10 0x7f4ad810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 --2- 172.21.15.5:0/3401557044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad8105610 0x7f4ad81059f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 --2- 172.21.15.5:0/3401557044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ad80ff550 0x7f4ad80ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 -- 172.21.15.5:0/3401557044 >> 172.21.15.5:0/3401557044 conn(0x7f4ad80fb020 msgr2=0x7f4ad80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 -- 172.21.15.5:0/3401557044 shutdown_connections 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.431+0000 7f4adf445700 1 -- 172.21.15.5:0/3401557044 wait complete. 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 Processor -- start 2023-10-08T13:04:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 -- start start 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 0x7f4ad81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ad80fff10 0x7f4ad8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ad8105610 0x7f4ad81a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad81986e0 con 0x7f4ad80ff550 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad81a2e70 con 0x7f4ad8105610 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adf445700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad81a2fe0 con 0x7f4ad80fff10 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4add1e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 0x7f4ad81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4add1e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 0x7f4ad81978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60554/0 (socket says 172.21.15.5:60554) 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4add1e1700 1 -- 172.21.15.5:0/4047461813 learned_addr learned my addr 172.21.15.5:0/4047461813 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.432+0000 7f4adc9e0700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ad80fff10 0x7f4ad8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add9e2700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ad8105610 0x7f4ad81a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add1e1700 1 -- 172.21.15.5:0/4047461813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ad80fff10 msgr2=0x7f4ad8197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add1e1700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ad80fff10 0x7f4ad8197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add1e1700 1 -- 172.21.15.5:0/4047461813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ad8105610 msgr2=0x7f4ad81a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add1e1700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ad8105610 0x7f4ad81a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add1e1700 1 -- 172.21.15.5:0/4047461813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40095f0 con 0x7f4ad80ff550 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4add1e1700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 0x7f4ad81978b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400b580 tx=0x7f4ad4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad401d070 con 0x7f4ad80ff550 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ad400fb30 con 0x7f4ad80ff550 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad81a3260 con 0x7f4ad80ff550 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4022c80 con 0x7f4ad80ff550 2023-10-08T13:04:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.433+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad81a36e0 con 0x7f4ad80ff550 2023-10-08T13:04:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.434+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad8107a90 con 0x7f4ad80ff550 2023-10-08T13:04:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.435+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f4ad400fca0 con 0x7f4ad80ff550 2023-10-08T13:04:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.436+0000 7f4ace7fc700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4ac40a1550 0x7f4ac40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.436+0000 7f4adc9e0700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4ac40a1550 0x7f4ac40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.436+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f4ad40cd800 con 0x7f4ad80ff550 2023-10-08T13:04:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.436+0000 7f4adc9e0700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4ac40a1550 0x7f4ac40a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8069060 tx=0x7f4ac80073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.440+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ad4097220 con 0x7f4ad80ff550 2023-10-08T13:04:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.652+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4ad8068eb0 con 0x7f4ad80ff550 2023-10-08T13:04:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.652+0000 7f4ace7fc700 1 -- 172.21.15.5:0/4047461813 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4ad409a840 con 0x7f4ad80ff550 2023-10-08T13:04:07.653 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:07.653 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-10-08T13:04:07.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:04:07.654 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-10-08T13:04:07.654 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-10-08T13:04:07.654 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:04:07.654 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-10-08T13:04:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4ac40a1550 msgr2=0x7f4ac40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4ac40a1550 0x7f4ac40a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8069060 tx=0x7f4ac80073d0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 msgr2=0x7f4ad81978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 0x7f4ad81978b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400b580 tx=0x7f4ad4004730 comp rx=0 tx=0).stop 2023-10-08T13:04:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 shutdown_connections 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4ac40a1550 0x7f4ac40a3a10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ad8105610 0x7f4ad81a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad80ff550 0x7f4ad81978b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 --2- 172.21.15.5:0/4047461813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ad80fff10 0x7f4ad8197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 >> 172.21.15.5:0/4047461813 conn(0x7f4ad80fb020 msgr2=0x7f4ad80fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 shutdown_connections 2023-10-08T13:04:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.654+0000 7f4adf445700 1 -- 172.21.15.5:0/4047461813 wait complete. 2023-10-08T13:04:07.667 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T13:04:07.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T13:04:07.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 -- 172.21.15.5:0/286118198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ff530 msgr2=0x7f153c0ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 --2- 172.21.15.5:0/286118198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ff530 0x7f153c0ff9b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f152c0099c0 tx=0x7f152c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 -- 172.21.15.5:0/286118198 shutdown_connections 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 --2- 172.21.15.5:0/286118198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153c0ffef0 0x7f153c10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 --2- 172.21.15.5:0/286118198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 0x7f153c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 --2- 172.21.15.5:0/286118198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ff530 0x7f153c0ff9b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 -- 172.21.15.5:0/286118198 >> 172.21.15.5:0/286118198 conn(0x7f153c0fafc0 msgr2=0x7f153c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 -- 172.21.15.5:0/286118198 shutdown_connections 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.802+0000 7f15435a7700 1 -- 172.21.15.5:0/286118198 wait complete. 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 Processor -- start 2023-10-08T13:04:07.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 -- start start 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153c0ff530 0x7f153c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 0x7f153c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 0x7f153c195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c195e90 con 0x7f153c0ffef0 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c196000 con 0x7f153c1055f0 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f15435a7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1961c0 con 0x7f153c0ff530 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 0x7f153c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 0x7f153c19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60570/0 (socket says 172.21.15.5:60570) 2023-10-08T13:04:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1541b44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 0x7f153c195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 -- 172.21.15.5:0/1303904399 learned_addr learned my addr 172.21.15.5:0/1303904399 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1541343700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153c0ff530 0x7f153c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 -- 172.21.15.5:0/1303904399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153c0ff530 msgr2=0x7f153c19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153c0ff530 0x7f153c19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 -- 172.21.15.5:0/1303904399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 msgr2=0x7f153c195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 0x7f153c195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1540b42700 1 -- 172.21.15.5:0/1303904399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0095f0 con 0x7f153c0ffef0 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.803+0000 7f1541b44700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 0x7f153c195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.804+0000 7f1540b42700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 0x7f153c19bc30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f152c00b580 tx=0x7f152c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.804+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c01c070 con 0x7f153c0ffef0 2023-10-08T13:04:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.804+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f152c00fd40 con 0x7f153c0ffef0 2023-10-08T13:04:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.804+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c022b80 con 0x7f153c0ffef0 2023-10-08T13:04:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.804+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c196440 con 0x7f153c0ffef0 2023-10-08T13:04:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.804+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c1a26e0 con 0x7f153c0ffef0 2023-10-08T13:04:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.805+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c107a90 con 0x7f153c0ffef0 2023-10-08T13:04:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.806+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f152c020070 con 0x7f153c0ffef0 2023-10-08T13:04:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.807+0000 7f15327fc700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15280a1550 0x7f15280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.807+0000 7f1541343700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15280a1550 0x7f15280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.807+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f152c0cd6f0 con 0x7f153c0ffef0 2023-10-08T13:04:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.807+0000 7f1541343700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15280a1550 0x7f15280a3a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1538009be0 tx=0x7f1538009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:07.811+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f152c0971b0 con 0x7f153c0ffef0 2023-10-08T13:04:07.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:07 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1779157132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:07 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:07 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3302526831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:07 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4047461813' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T13:04:08.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:07 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1779157132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:08.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:07 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:08.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:07 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3302526831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:08.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:07 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4047461813' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T13:04:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.028+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f153c100c50 con 0x7f153c0ffef0 2023-10-08T13:04:08.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:07 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1779157132' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:08.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:07 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:08.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:07 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3302526831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:08.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:07 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4047461813' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T13:04:08.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.727+0000 7f15327fc700 1 -- 172.21.15.5:0/1303904399 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f152c09a7d0 con 0x7f153c0ffef0 2023-10-08T13:04:08.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15280a1550 msgr2=0x7f15280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:08.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15280a1550 0x7f15280a3a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1538009be0 tx=0x7f1538009260 comp rx=0 tx=0).stop 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 msgr2=0x7f153c19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 0x7f153c19bc30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f152c00b580 tx=0x7f152c00bfd0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 shutdown_connections 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15280a1550 0x7f15280a3a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153c1055f0 0x7f153c195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153c0ff530 0x7f153c19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 --2- 172.21.15.5:0/1303904399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153c0ffef0 0x7f153c19bc30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.730+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 >> 172.21.15.5:0/1303904399 conn(0x7f153c0fafc0 msgr2=0x7f153c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.731+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 shutdown_connections 2023-10-08T13:04:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.731+0000 7f15435a7700 1 -- 172.21.15.5:0/1303904399 wait complete. 2023-10-08T13:04:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-10-08T13:04:08.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-08T13:04:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/84097786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 msgr2=0x7fd4c010c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/84097786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c010c3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009f90 tx=0x7fd4b800b330 comp rx=0 tx=0).stop 2023-10-08T13:04:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/84097786 shutdown_connections 2023-10-08T13:04:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/84097786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c010c3b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/84097786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c01055f0 0x7fd4c01059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/84097786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c00ff530 0x7fd4c00ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/84097786 >> 172.21.15.5:0/84097786 conn(0x7fd4c00fafc0 msgr2=0x7fd4c00fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/84097786 shutdown_connections 2023-10-08T13:04:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.895+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/84097786 wait complete. 2023-10-08T13:04:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.896+0000 7fd4c6e4f700 1 Processor -- start 2023-10-08T13:04:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.896+0000 7fd4c6e4f700 1 -- start start 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 0x7fd4c01979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c0197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c01055f0 0x7fd4c01a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0198780 con 0x7fd4c00ff530 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01a2f90 con 0x7fd4c01055f0 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01a30d0 con 0x7fd4c00ffef0 2023-10-08T13:04:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c4beb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 0x7fd4c01979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c0197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c4beb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 0x7fd4c01979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60582/0 (socket says 172.21.15.5:60582) 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c4beb700 1 -- 172.21.15.5:0/4001942656 learned_addr learned my addr 172.21.15.5:0/4001942656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c53ec700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c01055f0 0x7fd4c01a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 -- 172.21.15.5:0/4001942656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c01055f0 msgr2=0x7fd4c01a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c01055f0 0x7fd4c01a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 -- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 msgr2=0x7fd4c01979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 0x7fd4c01979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 -- 172.21.15.5:0/4001942656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40095f0 con 0x7fd4c00ffef0 2023-10-08T13:04:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c53ec700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c01055f0 0x7fd4c01a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c4beb700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 0x7fd4c01979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bffff700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c0197f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00e9f0 tx=0x7fd4ac00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00c9c0 con 0x7fd4c00ffef0 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4ac010430 con 0x7fd4c00ffef0 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b8009c40 con 0x7fd4c00ffef0 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.897+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac018680 con 0x7fd4c00ffef0 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.898+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c01a3730 con 0x7fd4c00ffef0 2023-10-08T13:04:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.898+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c0107a90 con 0x7fd4c00ffef0 2023-10-08T13:04:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.900+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd4ac010860 con 0x7fd4c00ffef0 2023-10-08T13:04:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.900+0000 7fd4bdffb700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4b00a1550 0x7fd4b00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.900+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7712+0+0 (secure 0 0 0) 0x7fd4ac014070 con 0x7fd4c00ffef0 2023-10-08T13:04:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.900+0000 7fd4c4beb700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4b00a1550 0x7fd4b00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.901+0000 7fd4c4beb700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4b00a1550 0x7fd4b00a3a10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4005d10 tx=0x7fd4b4009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:08.904+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd4ac096440 con 0x7fd4c00ffef0 2023-10-08T13:04:09.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:08 smithi118 ceph-mon[104234]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:09.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:08 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1303904399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T13:04:09.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.108+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd4c0067f60 con 0x7fd4c00ffef0 2023-10-08T13:04:09.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:08 smithi060 ceph-mon[103190]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:09.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:08 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1303904399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T13:04:09.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:08 smithi005 ceph-mon[99496]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:09.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:08 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1303904399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T13:04:09.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.737+0000 7fd4bdffb700 1 -- 172.21.15.5:0/4001942656 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd4ac099a60 con 0x7fd4c00ffef0 2023-10-08T13:04:09.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.744+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4b00a1550 msgr2=0x7fd4b00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:09.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.744+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4b00a1550 0x7fd4b00a3a10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4005d10 tx=0x7fd4b4009310 comp rx=0 tx=0).stop 2023-10-08T13:04:09.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.744+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 msgr2=0x7fd4c0197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:09.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.744+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c0197f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00e9f0 tx=0x7fd4ac00ed00 comp rx=0 tx=0).stop 2023-10-08T13:04:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.748+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 shutdown_connections 2023-10-08T13:04:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.748+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4b00a1550 0x7fd4b00a3a10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.748+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4c01055f0 0x7fd4c01a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.748+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c00ff530 0x7fd4c01979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.748+0000 7fd4c6e4f700 1 --2- 172.21.15.5:0/4001942656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c00ffef0 0x7fd4c0197f10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.748+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 >> 172.21.15.5:0/4001942656 conn(0x7fd4c00fafc0 msgr2=0x7fd4c00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:09.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.752+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 shutdown_connections 2023-10-08T13:04:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.753+0000 7fd4c6e4f700 1 -- 172.21.15.5:0/4001942656 wait complete. 2023-10-08T13:04:09.757 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-10-08T13:04:09.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 -- 172.21.15.5:0/1991132387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 msgr2=0x7f3f5810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 --2- 172.21.15.5:0/1991132387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f5810d0b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b0a0 tx=0x7f3f5000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 -- 172.21.15.5:0/1991132387 shutdown_connections 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 --2- 172.21.15.5:0/1991132387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f5810d0b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 --2- 172.21.15.5:0/1991132387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f58101840 0x7f3f58101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 --2- 172.21.15.5:0/1991132387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58102160 0x7f3f5810a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 -- 172.21.15.5:0/1991132387 >> 172.21.15.5:0/1991132387 conn(0x7f3f580fafc0 msgr2=0x7f3f580fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 -- 172.21.15.5:0/1991132387 shutdown_connections 2023-10-08T13:04:09.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.911+0000 7f3f603bd700 1 -- 172.21.15.5:0/1991132387 wait complete. 2023-10-08T13:04:09.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.912+0000 7f3f603bd700 1 Processor -- start 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.912+0000 7f3f603bd700 1 -- start start 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58101840 0x7f3f5819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f58102160 0x7f3f5819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f58196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58197080 con 0x7f3f5810ac10 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581971f0 con 0x7f3f58102160 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581973b0 con 0x7f3f58101840 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f58196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f58196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60600/0 (socket says 172.21.15.5:60600) 2023-10-08T13:04:09.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 -- 172.21.15.5:0/3174025416 learned_addr learned my addr 172.21.15.5:0/3174025416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5d958700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f58102160 0x7f3f5819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e159700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58101840 0x7f3f5819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 -- 172.21.15.5:0/3174025416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58101840 msgr2=0x7f3f5819c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58101840 0x7f3f5819c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 -- 172.21.15.5:0/3174025416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f58102160 msgr2=0x7f3f5819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f58102160 0x7f3f5819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 -- 172.21.15.5:0/3174025416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54009520 con 0x7f3f5810ac10 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e159700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58101840 0x7f3f5819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f5e95a700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f58196a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b070 tx=0x7f3f500078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000e040 con 0x7f3f5810ac10 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f5001d470 con 0x7f3f5810ac10 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.913+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50009d00 con 0x7f3f5810ac10 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.914+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500052a0 con 0x7f3f5810ac10 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.914+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f581a3700 con 0x7f3f5810ac10 2023-10-08T13:04:09.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.915+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f58105d90 con 0x7f3f5810ac10 2023-10-08T13:04:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.916+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f3f5001d5e0 con 0x7f3f5810ac10 2023-10-08T13:04:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.916+0000 7f3f4f7fe700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3f440a14d0 0x7f3f440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.917+0000 7f3f5e159700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3f440a14d0 0x7f3f440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.917+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8094+0+0 (secure 0 0 0) 0x7f3f500cdee0 con 0x7f3f5810ac10 2023-10-08T13:04:09.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.917+0000 7f3f5e159700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3f440a14d0 0x7f3f440a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009fd0 tx=0x7f3f54009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:09.921+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3f500976b0 con 0x7f3f5810ac10 2023-10-08T13:04:10.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1303904399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4001942656' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:10.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:04:10.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:09 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1303904399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4001942656' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:04:10.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:04:10.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:10.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:04:10.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:09 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1303904399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T13:04:10.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4001942656' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:04:10.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:09 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:10.180+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3f58110560 con 0x7f3f5810ac10 2023-10-08T13:04:11.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: pgmap v234: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T13:04:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T13:04:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:04:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:04:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3174025416' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T13:04:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:10 smithi118 ceph-mon[104234]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-08T13:04:11.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.112+0000 7f3f4f7fe700 1 -- 172.21.15.5:0/3174025416 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3f5009acd0 con 0x7f3f5810ac10 2023-10-08T13:04:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3f440a14d0 msgr2=0x7f3f440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3f440a14d0 0x7f3f440a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009fd0 tx=0x7f3f54009260 comp rx=0 tx=0).stop 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 msgr2=0x7f3f58196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f58196a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b070 tx=0x7f3f500078e0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 shutdown_connections 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3f440a14d0 0x7f3f440a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5810ac10 0x7f3f58196a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3f58101840 0x7f3f5819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 --2- 172.21.15.5:0/3174025416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f58102160 0x7f3f5819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 >> 172.21.15.5:0/3174025416 conn(0x7f3f580fafc0 msgr2=0x7f3f580fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:11.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 shutdown_connections 2023-10-08T13:04:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.114+0000 7f3f603bd700 1 -- 172.21.15.5:0/3174025416 wait complete. 2023-10-08T13:04:11.117 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T13:04:11.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: pgmap v234: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:11.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T13:04:11.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T13:04:11.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:04:11.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:04:11.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3174025416' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T13:04:11.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:10 smithi005 ceph-mon[99496]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-08T13:04:11.131 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-08T13:04:11.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-08T13:04:11.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: pgmap v234: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:11.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T13:04:11.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T13:04:11.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:04:11.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:04:11.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3174025416' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T13:04:11.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:10 smithi060 ceph-mon[103190]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-08T13:04:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 -- 172.21.15.5:0/286568073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 msgr2=0x7f41a8106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 --2- 172.21.15.5:0/286568073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a8106a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41980099c0 tx=0x7f4198009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 -- 172.21.15.5:0/286568073 shutdown_connections 2023-10-08T13:04:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 --2- 172.21.15.5:0/286568073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a80ff540 0x7f41a810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 --2- 172.21.15.5:0/286568073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a8106a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 --2- 172.21.15.5:0/286568073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41a80feb80 0x7f41a80ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 -- 172.21.15.5:0/286568073 >> 172.21.15.5:0/286568073 conn(0x7f41a8075b10 msgr2=0x7f41a80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 -- 172.21.15.5:0/286568073 shutdown_connections 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 -- 172.21.15.5:0/286568073 wait complete. 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.268+0000 7f41ad818700 1 Processor -- start 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 -- start start 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41a80feb80 0x7f41a80ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a80ff540 0x7f41a81002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a81007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81a4eb0 con 0x7f41a8106640 2023-10-08T13:04:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81a5020 con 0x7f41a80feb80 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41ad818700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81a51e0 con 0x7f41a80ff540 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a81007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a81007e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60618/0 (socket says 172.21.15.5:60618) 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41a80feb80 0x7f41a80ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 -- 172.21.15.5:0/2855137291 learned_addr learned my addr 172.21.15.5:0/2855137291 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a67fc700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a80ff540 0x7f41a81002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 -- 172.21.15.5:0/2855137291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a80ff540 msgr2=0x7f41a81002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a80ff540 0x7f41a81002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 -- 172.21.15.5:0/2855137291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41a80feb80 msgr2=0x7f41a80ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41a80feb80 0x7f41a80ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.269+0000 7f41a77fe700 1 -- 172.21.15.5:0/2855137291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980095f0 con 0x7f41a8106640 2023-10-08T13:04:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.270+0000 7f41a77fe700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a81007e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f41a000ef90 tx=0x7f41a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.270+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0018070 con 0x7f41a8106640 2023-10-08T13:04:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.270+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41a000f040 con 0x7f41a8106640 2023-10-08T13:04:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.270+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a81a5460 con 0x7f41a8106640 2023-10-08T13:04:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.270+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a000cda0 con 0x7f41a8106640 2023-10-08T13:04:11.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.270+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a81a59c0 con 0x7f41a8106640 2023-10-08T13:04:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.271+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a8108c30 con 0x7f41a8106640 2023-10-08T13:04:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.272+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f41a0003a00 con 0x7f41a8106640 2023-10-08T13:04:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.273+0000 7f41ac816700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f41900a1550 0x7f41900a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.273+0000 7f41a6ffd700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f41900a1550 0x7f41900a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.273+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f41a00cc7e0 con 0x7f41a8106640 2023-10-08T13:04:11.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.273+0000 7f41a6ffd700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f41900a1550 0x7f41900a3a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4198009990 tx=0x7f4198019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.279+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f41a0095ef0 con 0x7f41a8106640 2023-10-08T13:04:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.503+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f41a8101240 con 0x7f41a8106640 2023-10-08T13:04:11.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.740+0000 7f41ac816700 1 -- 172.21.15.5:0/2855137291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v83) v1 ==== 157+0+0 (secure 0 0 0) 0x7f41a0099510 con 0x7f41a8106640 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f41900a1550 msgr2=0x7f41900a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f41900a1550 0x7f41900a3a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4198009990 tx=0x7f4198019040 comp rx=0 tx=0).stop 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 msgr2=0x7f41a81007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a81007e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f41a000ef90 tx=0x7f41a000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 shutdown_connections 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f41900a1550 0x7f41900a3a10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a8106640 0x7f41a81007e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41a80feb80 0x7f41a80ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 --2- 172.21.15.5:0/2855137291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41a80ff540 0x7f41a81002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 >> 172.21.15.5:0/2855137291 conn(0x7f41a8075b10 msgr2=0x7f41a80fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 shutdown_connections 2023-10-08T13:04:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.743+0000 7f41ad818700 1 -- 172.21.15.5:0/2855137291 wait complete. 2023-10-08T13:04:11.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 -- 172.21.15.5:0/4157995851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 msgr2=0x7f570410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 --2- 172.21.15.5:0/4157995851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f570410d500 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00b0a0 tx=0x7f56fc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 -- 172.21.15.5:0/4157995851 shutdown_connections 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 --2- 172.21.15.5:0/4157995851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f570410d500 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 --2- 172.21.15.5:0/4157995851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5704106640 0x7f5704106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 --2- 172.21.15.5:0/4157995851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5704100630 0x7f5704100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.900+0000 7f5708e1e700 1 -- 172.21.15.5:0/4157995851 >> 172.21.15.5:0/4157995851 conn(0x7f57040fc140 msgr2=0x7f57040fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 -- 172.21.15.5:0/4157995851 shutdown_connections 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 -- 172.21.15.5:0/4157995851 wait complete. 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 Processor -- start 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 -- start start 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5704100630 0x7f5704072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f5704073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5704106640 0x7f5704073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.901+0000 7f5708e1e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57041a4e40 con 0x7f5704100ff0 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5708e1e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57041a4fb0 con 0x7f5704100630 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5708e1e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57041a5170 con 0x7f5704106640 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f5704073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f5704073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60630/0 (socket says 172.21.15.5:60630) 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 -- 172.21.15.5:0/817888965 learned_addr learned my addr 172.21.15.5:0/817888965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f570259c700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5704100630 0x7f5704072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5702d9d700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5704106640 0x7f5704073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 -- 172.21.15.5:0/817888965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5704106640 msgr2=0x7f5704073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5704106640 0x7f5704073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 -- 172.21.15.5:0/817888965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5704100630 msgr2=0x7f5704072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5704100630 0x7f5704072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:11.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 -- 172.21.15.5:0/817888965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc009d00 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5701d9b700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f5704073030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00d950 tx=0x7f56ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00f890 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56ec010460 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57041a5450 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00e610 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.902+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57041a5960 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.903+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704108c50 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.904+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f56ec0108d0 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.905+0000 7f56fb7fe700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f56f00a14d0 0x7f56f00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.905+0000 7f570259c700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f56f00a14d0 0x7f56f00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.905+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8420+0+0 (secure 0 0 0) 0x7f56ec0ccbb0 con 0x7f5704100ff0 2023-10-08T13:04:11.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.906+0000 7f570259c700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f56f00a14d0 0x7f56f00a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009be0 tx=0x7f56f4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:11.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:11.910+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f56ec096150 con 0x7f5704100ff0 2023-10-08T13:04:12.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:11 smithi118 ceph-mon[104234]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T13:04:12.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:11 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3174025416' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T13:04:12.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:11 smithi118 ceph-mon[104234]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-08T13:04:12.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:11 smithi118 ceph-mon[104234]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-08T13:04:12.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:11 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2855137291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T13:04:12.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:12.115+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5704101d70 con 0x7f5704100ff0 2023-10-08T13:04:12.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:11 smithi060 ceph-mon[103190]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T13:04:12.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:11 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3174025416' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T13:04:12.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:11 smithi060 ceph-mon[103190]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-08T13:04:12.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:11 smithi060 ceph-mon[103190]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-08T13:04:12.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:11 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2855137291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T13:04:12.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:11 smithi005 ceph-mon[99496]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T13:04:12.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:11 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3174025416' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T13:04:12.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:11 smithi005 ceph-mon[99496]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-08T13:04:12.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:11 smithi005 ceph-mon[99496]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-08T13:04:12.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:11 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2855137291' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T13:04:13.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: pgmap v237: 97 pgs: 2 creating+activating, 9 creating+peering, 23 active+clean, 63 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2855137291' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] up:active 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/817888965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:04:13.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:12 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: pgmap v237: 97 pgs: 2 creating+activating, 9 creating+peering, 23 active+clean, 63 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2855137291' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] up:active 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/817888965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:04:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:12 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: pgmap v237: 97 pgs: 2 creating+activating, 9 creating+peering, 23 active+clean, 63 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2855137291' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] up:active 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/817888965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:04:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:04:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:12 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:04:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.120+0000 7f56fb7fe700 1 -- 172.21.15.5:0/817888965 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v85) v1 ==== 228+0+0 (secure 0 0 0) 0x7f56ec016100 con 0x7f5704100ff0 2023-10-08T13:04:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f56f00a14d0 msgr2=0x7f56f00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f56f00a14d0 0x7f56f00a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009be0 tx=0x7f56f4009260 comp rx=0 tx=0).stop 2023-10-08T13:04:14.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 msgr2=0x7f5704073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f5704073030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00d950 tx=0x7f56ec00dc60 comp rx=0 tx=0).stop 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 shutdown_connections 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f56f00a14d0 0x7f56f00a3990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5704106640 0x7f5704073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5704100630 0x7f5704072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 --2- 172.21.15.5:0/817888965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5704100ff0 0x7f5704073030 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.124+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 >> 172.21.15.5:0/817888965 conn(0x7f57040fc140 msgr2=0x7f57040fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:14.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.128+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 shutdown_connections 2023-10-08T13:04:14.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.132+0000 7f5708e1e700 1 -- 172.21.15.5:0/817888965 wait complete. 2023-10-08T13:04:14.134 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2023-10-08T13:04:14.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-08T13:04:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/1728272841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 msgr2=0x7fa5ec0ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/1728272841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec0ff9b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80099c0 tx=0x7fa5d8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/1728272841 shutdown_connections 2023-10-08T13:04:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/1728272841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec0ffef0 0x7fa5ec10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/1728272841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec1055f0 0x7fa5ec1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/1728272841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec0ff9b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/1728272841 >> 172.21.15.5:0/1728272841 conn(0x7fa5ec0fafc0 msgr2=0x7fa5ec0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/1728272841 shutdown_connections 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/1728272841 wait complete. 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.282+0000 7fa5f2dcf700 1 Processor -- start 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 -- start start 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0ffef0 0x7fa5ec19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec1055f0 0x7fa5ec195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec195e90 con 0x7fa5ec0ff530 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec196000 con 0x7fa5ec1055f0 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f2dcf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec1961c0 con 0x7fa5ec0ffef0 2023-10-08T13:04:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec19b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60646/0 (socket says 172.21.15.5:60646) 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 -- 172.21.15.5:0/3859989678 learned_addr learned my addr 172.21.15.5:0/3859989678 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5ebfff700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0ffef0 0x7fa5ec19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f136c700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec1055f0 0x7fa5ec195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 -- 172.21.15.5:0/3859989678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0ffef0 msgr2=0x7fa5ec19bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0ffef0 0x7fa5ec19bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 -- 172.21.15.5:0/3859989678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec1055f0 msgr2=0x7fa5ec195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec1055f0 0x7fa5ec195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 -- 172.21.15.5:0/3859989678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80095f0 con 0x7fa5ec0ff530 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.283+0000 7fa5f0b6b700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec19b6f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000c920 tx=0x7fa5e000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.284+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0007b00 con 0x7fa5ec0ff530 2023-10-08T13:04:14.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.284+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e000ce70 con 0x7fa5ec0ff530 2023-10-08T13:04:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.284+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec1964a0 con 0x7fa5ec0ff530 2023-10-08T13:04:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.284+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00054e0 con 0x7fa5ec0ff530 2023-10-08T13:04:14.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.284+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1a26e0 con 0x7fa5ec0ff530 2023-10-08T13:04:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.285+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec107a90 con 0x7fa5ec0ff530 2023-10-08T13:04:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.286+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fa5e0004750 con 0x7fa5ec0ff530 2023-10-08T13:04:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.287+0000 7fa5e9ffb700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5dc0a14d0 0x7fa5dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.287+0000 7fa5ebfff700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5dc0a14d0 0x7fa5dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.287+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8913+0+0 (secure 0 0 0) 0x7fa5e00ccb30 con 0x7fa5ec0ff530 2023-10-08T13:04:14.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.287+0000 7fa5ebfff700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5dc0a14d0 0x7fa5dc0a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009990 tx=0x7fa5d8005c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:14.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.292+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa5e0095ee0 con 0x7fa5ec0ff530 2023-10-08T13:04:14.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:14 smithi060 ceph-mon[103190]: pgmap v239: 97 pgs: 2 creating+activating, 9 creating+peering, 62 active+clean, 24 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s wr, 2 op/s 2023-10-08T13:04:14.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:14 smithi060 ceph-mon[103190]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T13:04:14.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:14 smithi005 ceph-mon[99496]: pgmap v239: 97 pgs: 2 creating+activating, 9 creating+peering, 62 active+clean, 24 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s wr, 2 op/s 2023-10-08T13:04:14.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:14 smithi005 ceph-mon[99496]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T13:04:14.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:14.494+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa5ec196d50 con 0x7fa5ec0ff530 2023-10-08T13:04:14.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:14 smithi118 ceph-mon[104234]: pgmap v239: 97 pgs: 2 creating+activating, 9 creating+peering, 62 active+clean, 24 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s wr, 2 op/s 2023-10-08T13:04:14.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:14 smithi118 ceph-mon[104234]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T13:04:15.019 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:04:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: 2023-10-08T13:04:14.678+0000 7fa092995700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T13:04:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.125+0000 7fa5e9ffb700 1 -- 172.21.15.5:0/3859989678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5e001d0c0 con 0x7fa5ec0ff530 2023-10-08T13:04:15.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5dc0a14d0 msgr2=0x7fa5dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:15.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5dc0a14d0 0x7fa5dc0a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009990 tx=0x7fa5d8005c60 comp rx=0 tx=0).stop 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 msgr2=0x7fa5ec19b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec19b6f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000c920 tx=0x7fa5e000cc30 comp rx=0 tx=0).stop 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 shutdown_connections 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5dc0a14d0 0x7fa5dc0a3990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5ec1055f0 0x7fa5ec195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5ec0ff530 0x7fa5ec19b6f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 --2- 172.21.15.5:0/3859989678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5ec0ffef0 0x7fa5ec19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.129+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 >> 172.21.15.5:0/3859989678 conn(0x7fa5ec0fafc0 msgr2=0x7fa5ec0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.130+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 shutdown_connections 2023-10-08T13:04:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.130+0000 7fa5f2dcf700 1 -- 172.21.15.5:0/3859989678 wait complete. 2023-10-08T13:04:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 4 allow_ec_overwrites to true 2023-10-08T13:04:15.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 -- 172.21.15.5:0/3265001271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100ff560 msgr2=0x7f5e100ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 --2- 172.21.15.5:0/3265001271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100ff560 0x7f5e100ff9e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5e040099c0 tx=0x7f5e04009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 -- 172.21.15.5:0/3265001271 shutdown_connections 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 --2- 172.21.15.5:0/3265001271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100fff20 0x7f5e1010c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 --2- 172.21.15.5:0/3265001271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e10105620 0x7f5e10105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 --2- 172.21.15.5:0/3265001271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100ff560 0x7f5e100ff9e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 -- 172.21.15.5:0/3265001271 >> 172.21.15.5:0/3265001271 conn(0x7f5e10075a40 msgr2=0x7f5e10075e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 -- 172.21.15.5:0/3265001271 shutdown_connections 2023-10-08T13:04:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.293+0000 7f5e15913700 1 -- 172.21.15.5:0/3265001271 wait complete. 2023-10-08T13:04:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.294+0000 7f5e15913700 1 Processor -- start 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.294+0000 7f5e15913700 1 -- start start 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100ff560 0x7f5e10197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 0x7f5e10197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e10105620 0x7f5e101a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e101986d0 con 0x7f5e100fff20 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e101a2ee0 con 0x7f5e100ff560 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e101a3020 con 0x7f5e10105620 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 0x7f5e10197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 0x7f5e10197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60668/0 (socket says 172.21.15.5:60668) 2023-10-08T13:04:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 -- 172.21.15.5:0/3649840763 learned_addr learned my addr 172.21.15.5:0/3649840763 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0effd700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100ff560 0x7f5e10197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0f7fe700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e10105620 0x7f5e101a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 -- 172.21.15.5:0/3649840763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e10105620 msgr2=0x7f5e101a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e10105620 0x7f5e101a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 -- 172.21.15.5:0/3649840763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100ff560 msgr2=0x7f5e10197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100ff560 0x7f5e10197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 -- 172.21.15.5:0/3649840763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040095f0 con 0x7f5e100fff20 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e0e7fc700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 0x7f5e10197e60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400b580 tx=0x7f5e04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0401d070 con 0x7f5e100fff20 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e101a3250 con 0x7f5e100fff20 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e0400fb30 con 0x7f5e100fff20 2023-10-08T13:04:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.295+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04022c60 con 0x7f5e100fff20 2023-10-08T13:04:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.296+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e101a36d0 con 0x7f5e100fff20 2023-10-08T13:04:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.296+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e10107ac0 con 0x7f5e100fff20 2023-10-08T13:04:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.298+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5e0400fca0 con 0x7f5e100fff20 2023-10-08T13:04:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.299+0000 7f5e14911700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5df80a14d0 0x7f5df80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.299+0000 7f5e0effd700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5df80a14d0 0x7f5df80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.299+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8913+0+0 (secure 0 0 0) 0x7f5e040ce510 con 0x7f5e100fff20 2023-10-08T13:04:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.299+0000 7f5e0effd700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5df80a14d0 0x7f5df80a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e00005950 tx=0x7f5e0000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.302+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e040978f0 con 0x7f5e100fff20 2023-10-08T13:04:15.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:15 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/817888965' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T13:04:15.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:15 smithi060 ceph-mon[103190]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T13:04:15.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:15 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3859989678' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T13:04:15.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:15 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/817888965' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T13:04:15.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:15 smithi005 ceph-mon[99496]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T13:04:15.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:15 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3859989678' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T13:04:15.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:15 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/817888965' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T13:04:15.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:15 smithi118 ceph-mon[104234]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T13:04:15.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:15 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3859989678' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T13:04:15.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:15.557+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f5e10069310 con 0x7f5e100fff20 2023-10-08T13:04:16.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.126+0000 7f5e14911700 1 -- 172.21.15.5:0/3649840763 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5e0409af10 con 0x7f5e100fff20 2023-10-08T13:04:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5df80a14d0 msgr2=0x7f5df80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5df80a14d0 0x7f5df80a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5e00005950 tx=0x7f5e0000b410 comp rx=0 tx=0).stop 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 msgr2=0x7f5e10197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 0x7f5e10197e60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400b580 tx=0x7f5e04004730 comp rx=0 tx=0).stop 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 shutdown_connections 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5df80a14d0 0x7f5df80a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e10105620 0x7f5e101a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100ff560 0x7f5e10197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 --2- 172.21.15.5:0/3649840763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100fff20 0x7f5e10197e60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 >> 172.21.15.5:0/3649840763 conn(0x7f5e10075a40 msgr2=0x7f5e100fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.130+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 shutdown_connections 2023-10-08T13:04:16.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.131+0000 7f5e15913700 1 -- 172.21.15.5:0/3649840763 wait complete. 2023-10-08T13:04:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 4 to fsmap 2023-10-08T13:04:16.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 -- 172.21.15.5:0/1351823449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700fff10 msgr2=0x7fbf7010c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1351823449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700fff10 0x7fbf7010c3d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800b0d0 tx=0x7fbf6800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 -- 172.21.15.5:0/1351823449 shutdown_connections 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1351823449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700fff10 0x7fbf7010c3d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1351823449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf70105610 0x7fbf701059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1351823449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf700ff550 0x7fbf700ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 -- 172.21.15.5:0/1351823449 >> 172.21.15.5:0/1351823449 conn(0x7fbf700fb040 msgr2=0x7fbf700fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 -- 172.21.15.5:0/1351823449 shutdown_connections 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 -- 172.21.15.5:0/1351823449 wait complete. 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 Processor -- start 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.281+0000 7fbf7773b700 1 -- start start 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf7773b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 0x7fbf7019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf7773b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf700fff10 0x7fbf7019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf7773b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf70105610 0x7fbf70196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf7773b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf70196fa0 con 0x7fbf700ff550 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf7773b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf70197110 con 0x7fbf70105610 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf7773b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf701972d0 con 0x7fbf700fff10 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 0x7fbf7019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 0x7fbf7019c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60680/0 (socket says 172.21.15.5:60680) 2023-10-08T13:04:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 -- 172.21.15.5:0/1706001212 learned_addr learned my addr 172.21.15.5:0/1706001212 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf74cd6700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf700fff10 0x7fbf7019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf75cd8700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf70105610 0x7fbf70196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 -- 172.21.15.5:0/1706001212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf700fff10 msgr2=0x7fbf7019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf700fff10 0x7fbf7019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 -- 172.21.15.5:0/1706001212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf70105610 msgr2=0x7fbf70196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf70105610 0x7fbf70196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 -- 172.21.15.5:0/1706001212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009d00 con 0x7fbf700ff550 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf754d7700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 0x7fbf7019c810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00d950 tx=0x7fbf6c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c009940 con 0x7fbf700ff550 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf6c010460 con 0x7fbf700ff550 2023-10-08T13:04:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.282+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00f620 con 0x7fbf700ff550 2023-10-08T13:04:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.283+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf701975b0 con 0x7fbf700ff550 2023-10-08T13:04:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.283+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf701a3800 con 0x7fbf700ff550 2023-10-08T13:04:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.283+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf70100c70 con 0x7fbf700ff550 2023-10-08T13:04:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.285+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fbf6c0108d0 con 0x7fbf700ff550 2023-10-08T13:04:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.285+0000 7fbf667fc700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbf5c0a14d0 0x7fbf5c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.285+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fbf6c0ccec0 con 0x7fbf700ff550 2023-10-08T13:04:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.285+0000 7fbf74cd6700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbf5c0a14d0 0x7fbf5c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.286+0000 7fbf74cd6700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbf5c0a14d0 0x7fbf5c0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf70197b00 tx=0x7fbf6000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:16.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.289+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbf6c096250 con 0x7fbf700ff550 2023-10-08T13:04:16.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:16 smithi060 ceph-mon[103190]: pgmap v242: 129 pgs: 2 creating+activating, 14 creating+peering, 89 active+clean, 24 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s wr, 3 op/s 2023-10-08T13:04:16.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:16 smithi060 ceph-mon[103190]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:04:16.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3859989678' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T13:04:16.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:16 smithi060 ceph-mon[103190]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T13:04:16.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3649840763' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T13:04:16.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:16 smithi005 ceph-mon[99496]: pgmap v242: 129 pgs: 2 creating+activating, 14 creating+peering, 89 active+clean, 24 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s wr, 3 op/s 2023-10-08T13:04:16.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:16 smithi005 ceph-mon[99496]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:04:16.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:16 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3859989678' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T13:04:16.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:16 smithi005 ceph-mon[99496]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T13:04:16.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:16 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3649840763' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T13:04:16.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:16 smithi118 ceph-mon[104234]: pgmap v242: 129 pgs: 2 creating+activating, 14 creating+peering, 89 active+clean, 24 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s wr, 3 op/s 2023-10-08T13:04:16.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:16 smithi118 ceph-mon[104234]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:04:16.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:16 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3859989678' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T13:04:16.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:16 smithi118 ceph-mon[104234]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T13:04:16.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:16 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3649840763' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T13:04:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.539+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf70067550 con 0x7fbf700ff550 2023-10-08T13:04:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.540+0000 7fbf667fc700 1 -- 172.21.15.5:0/1706001212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11243 (secure 0 0 0) 0x7fbf6c020090 con 0x7fbf700ff550 2023-10-08T13:04:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:16.541 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14793,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:15.559178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-08T13:04:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbf5c0a14d0 msgr2=0x7fbf5c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbf5c0a14d0 0x7fbf5c0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf70197b00 tx=0x7fbf6000b410 comp rx=0 tx=0).stop 2023-10-08T13:04:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 msgr2=0x7fbf7019c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 0x7fbf7019c810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00d950 tx=0x7fbf6c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 shutdown_connections 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbf5c0a14d0 0x7fbf5c0a3990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf70105610 0x7fbf70196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf700ff550 0x7fbf7019c810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 --2- 172.21.15.5:0/1706001212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf700fff10 0x7fbf7019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 >> 172.21.15.5:0/1706001212 conn(0x7fbf700fb040 msgr2=0x7fbf70103690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 shutdown_connections 2023-10-08T13:04:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.542+0000 7fbf7773b700 1 -- 172.21.15.5:0/1706001212 wait complete. 2023-10-08T13:04:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-10-08T13:04:16.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:16.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 -- 172.21.15.5:0/2242333599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 msgr2=0x7f112010d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 --2- 172.21.15.5:0/2242333599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112010d500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f111800b0a0 tx=0x7f111800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 -- 172.21.15.5:0/2242333599 shutdown_connections 2023-10-08T13:04:16.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 --2- 172.21.15.5:0/2242333599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112010d500 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 --2- 172.21.15.5:0/2242333599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1120106640 0x7f1120106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 --2- 172.21.15.5:0/2242333599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1120100630 0x7f1120100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 -- 172.21.15.5:0/2242333599 >> 172.21.15.5:0/2242333599 conn(0x7f11200fc160 msgr2=0x7f11200fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:16.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 -- 172.21.15.5:0/2242333599 shutdown_connections 2023-10-08T13:04:16.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.680+0000 7f11280d2700 1 -- 172.21.15.5:0/2242333599 wait complete. 2023-10-08T13:04:16.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.681+0000 7f11280d2700 1 Processor -- start 2023-10-08T13:04:16.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.681+0000 7f11280d2700 1 -- start start 2023-10-08T13:04:16.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.681+0000 7f11280d2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1120100630 0x7f112019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.681+0000 7f11280d2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.681+0000 7f11280d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1120106640 0x7f1120196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f11280d2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120196ea0 con 0x7f1120100ff0 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f11280d2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120197010 con 0x7f1120106640 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f11280d2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11201971d0 con 0x7f1120100630 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60696/0 (socket says 172.21.15.5:60696) 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 -- 172.21.15.5:0/2592149355 learned_addr learned my addr 172.21.15.5:0/2592149355 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f1125e6e700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1120100630 0x7f112019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112666f700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1120106640 0x7f1120196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 -- 172.21.15.5:0/2592149355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1120100630 msgr2=0x7f112019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1120100630 0x7f112019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 -- 172.21.15.5:0/2592149355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1120106640 msgr2=0x7f1120196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1120106640 0x7f1120196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 -- 172.21.15.5:0/2592149355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118009d00 con 0x7f1120100ff0 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f112566d700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112019cbf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f111000c9b0 tx=0x7f111000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110007b00 con 0x7f1120100ff0 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f111000ce50 con 0x7f1120100ff0 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11201974b0 con 0x7f1120100ff0 2023-10-08T13:04:16.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110018660 con 0x7f1120100ff0 2023-10-08T13:04:16.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.682+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11201a3750 con 0x7f1120100ff0 2023-10-08T13:04:16.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.683+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120108c50 con 0x7f1120100ff0 2023-10-08T13:04:16.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.684+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f111000f450 con 0x7f1120100ff0 2023-10-08T13:04:16.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.685+0000 7f1116ffd700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f110c0a1550 0x7f110c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:16.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.685+0000 7f1125e6e700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f110c0a1550 0x7f110c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:16.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.685+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f11100cd1b0 con 0x7f1120100ff0 2023-10-08T13:04:16.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.685+0000 7f1125e6e700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f110c0a1550 0x7f110c0a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11200fea20 tx=0x7f111c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:16.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.689+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f11100965f0 con 0x7f1120100ff0 2023-10-08T13:04:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.896+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1120101d70 con 0x7f1120100ff0 2023-10-08T13:04:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.898+0000 7f1116ffd700 1 -- 172.21.15.5:0/2592149355 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7f1110007e60 con 0x7f1120100ff0 2023-10-08T13:04:16.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:16.899 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f110c0a1550 msgr2=0x7f110c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f110c0a1550 0x7f110c0a3a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11200fea20 tx=0x7f111c00b410 comp rx=0 tx=0).stop 2023-10-08T13:04:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 msgr2=0x7f112019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112019cbf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f111000c9b0 tx=0x7f111000ccc0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 shutdown_connections 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f110c0a1550 0x7f110c0a3a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1120106640 0x7f1120196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1120100630 0x7f112019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 --2- 172.21.15.5:0/2592149355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1120100ff0 0x7f112019cbf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 >> 172.21.15.5:0/2592149355 conn(0x7f11200fc160 msgr2=0x7f11200fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 shutdown_connections 2023-10-08T13:04:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:16.900+0000 7f11280d2700 1 -- 172.21.15.5:0/2592149355 wait complete. 2023-10-08T13:04:16.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 -- 172.21.15.5:0/1855979750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 msgr2=0x7fc09010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 --2- 172.21.15.5:0/1855979750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09010d510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc08800b0d0 tx=0x7fc08800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 -- 172.21.15.5:0/1855979750 shutdown_connections 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 --2- 172.21.15.5:0/1855979750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09010d510 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 --2- 172.21.15.5:0/1855979750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc090106650 0x7fc090106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 --2- 172.21.15.5:0/1855979750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 0x7fc0900ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 -- 172.21.15.5:0/1855979750 >> 172.21.15.5:0/1855979750 conn(0x7fc090075b20 msgr2=0x7fc0900fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 -- 172.21.15.5:0/1855979750 shutdown_connections 2023-10-08T13:04:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.040+0000 7fc096888700 1 -- 172.21.15.5:0/1855979750 wait complete. 2023-10-08T13:04:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 Processor -- start 2023-10-08T13:04:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 -- start start 2023-10-08T13:04:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 0x7fc09019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc090106650 0x7fc090196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc090197060 con 0x7fc0900ff550 2023-10-08T13:04:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901971d0 con 0x7fc0900feb90 2023-10-08T13:04:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc096888700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc090197390 con 0x7fc090106650 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc08f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc08f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60710/0 (socket says 172.21.15.5:60710) 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc08ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 0x7fc09019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc08f7fe700 1 -- 172.21.15.5:0/3296561147 learned_addr learned my addr 172.21.15.5:0/3296561147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.041+0000 7fc094e25700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc090106650 0x7fc090196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08f7fe700 1 -- 172.21.15.5:0/3296561147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc090106650 msgr2=0x7fc090196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08f7fe700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc090106650 0x7fc090196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08f7fe700 1 -- 172.21.15.5:0/3296561147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 msgr2=0x7fc09019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08f7fe700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 0x7fc09019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08f7fe700 1 -- 172.21.15.5:0/3296561147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009d00 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08ffff700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 0x7fc09019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08f7fe700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09019cdc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc08400d950 tx=0x7fc08400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400f890 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc084010460 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc090197670 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400e610 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.042+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0901a3870 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.043+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc090108c40 con 0x7fc0900ff550 2023-10-08T13:04:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.044+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc0840108d0 con 0x7fc0900ff550 2023-10-08T13:04:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.045+0000 7fc08d7fa700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0780a1550 0x7fc0780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.045+0000 7fc08ffff700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0780a1550 0x7fc0780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.045+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fc0840ccd80 con 0x7fc0900ff550 2023-10-08T13:04:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.045+0000 7fc08ffff700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0780a1550 0x7fc0780a3a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc080005950 tx=0x7fc08000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.048+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc084096110 con 0x7fc0900ff550 2023-10-08T13:04:17.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:17 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3649840763' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T13:04:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:17 smithi005 ceph-mon[99496]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T13:04:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:17 smithi005 ceph-mon[99496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:17 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1706001212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:17 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2592149355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.258+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc090110640 con 0x7fc0900ff550 2023-10-08T13:04:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.259+0000 7fc08d7fa700 1 -- 172.21.15.5:0/3296561147 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7fc084020090 con 0x7fc0900ff550 2023-10-08T13:04:17.261 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:17.261 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.261+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0780a1550 msgr2=0x7fc0780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0780a1550 0x7fc0780a3a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc080005950 tx=0x7fc08000b410 comp rx=0 tx=0).stop 2023-10-08T13:04:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 msgr2=0x7fc09019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09019cdc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc08400d950 tx=0x7fc08400dc60 comp rx=0 tx=0).stop 2023-10-08T13:04:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 shutdown_connections 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc0780a1550 0x7fc0780a3a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc090106650 0x7fc090196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0900feb90 0x7fc09019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 --2- 172.21.15.5:0/3296561147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0900ff550 0x7fc09019cdc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 >> 172.21.15.5:0/3296561147 conn(0x7fc090075b20 msgr2=0x7fc0900fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 shutdown_connections 2023-10-08T13:04:17.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.262+0000 7fc096888700 1 -- 172.21.15.5:0/3296561147 wait complete. 2023-10-08T13:04:17.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:04:17.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:17 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3649840763' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T13:04:17.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:17 smithi060 ceph-mon[103190]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T13:04:17.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:17 smithi060 ceph-mon[103190]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:17.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:17 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1706001212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:17.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:17 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2592149355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 -- 172.21.15.5:0/1586407153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 msgr2=0x7f7250105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 --2- 172.21.15.5:0/1586407153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f7250105a90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f72440099c0 tx=0x7f7244009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 -- 172.21.15.5:0/1586407153 shutdown_connections 2023-10-08T13:04:17.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 --2- 172.21.15.5:0/1586407153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7250100680 0x7f725010c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 --2- 172.21.15.5:0/1586407153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f7250105a90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 --2- 172.21.15.5:0/1586407153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72500ffce0 0x7f7250100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 -- 172.21.15.5:0/1586407153 >> 172.21.15.5:0/1586407153 conn(0x7f7250075b20 msgr2=0x7f72500fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 -- 172.21.15.5:0/1586407153 shutdown_connections 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.415+0000 7f72571e4700 1 -- 172.21.15.5:0/1586407153 wait complete. 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 Processor -- start 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 -- start start 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72500ffce0 0x7f7250197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7250100680 0x7f7250197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f72501a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250198710 con 0x7f72501056b0 2023-10-08T13:04:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501a2f40 con 0x7f7250100680 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f72571e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501a3080 con 0x7f72500ffce0 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f7255781700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f72501a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f7255781700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f72501a2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60726/0 (socket says 172.21.15.5:60726) 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f7255781700 1 -- 172.21.15.5:0/851683129 learned_addr learned my addr 172.21.15.5:0/851683129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f7254f80700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72500ffce0 0x7f7250197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.416+0000 7f724ffff700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7250100680 0x7f7250197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f7255781700 1 -- 172.21.15.5:0/851683129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72500ffce0 msgr2=0x7f7250197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f7255781700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72500ffce0 0x7f7250197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f7255781700 1 -- 172.21.15.5:0/851683129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7250100680 msgr2=0x7f7250197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f7255781700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7250100680 0x7f7250197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f7255781700 1 -- 172.21.15.5:0/851683129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440095f0 con 0x7f72501056b0 2023-10-08T13:04:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f7255781700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f72501a2a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7248007f10 tx=0x7f724800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248017070 con 0x7f72501056b0 2023-10-08T13:04:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724800f040 con 0x7f72501056b0 2023-10-08T13:04:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248005610 con 0x7f72501056b0 2023-10-08T13:04:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72501a32e0 con 0x7f72501056b0 2023-10-08T13:04:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.417+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72501a37a0 con 0x7f72501056b0 2023-10-08T13:04:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.418+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250107a60 con 0x7f72501056b0 2023-10-08T13:04:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.419+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f7248004ad0 con 0x7f72501056b0 2023-10-08T13:04:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.420+0000 7f724dffb700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72400a14d0 0x7f72400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.420+0000 7f7254f80700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72400a14d0 0x7f72400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.420+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f72480cc780 con 0x7f72501056b0 2023-10-08T13:04:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.421+0000 7f7254f80700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72400a14d0 0x7f72400a3990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f724400b580 tx=0x7f7244005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.425+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7248095b10 con 0x7f72501056b0 2023-10-08T13:04:17.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:17 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3649840763' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T13:04:17.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:17 smithi118 ceph-mon[104234]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T13:04:17.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:17 smithi118 ceph-mon[104234]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:17.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:17 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1706001212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:17.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:17 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2592149355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:17.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.673+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72500ff170 con 0x7f72501056b0 2023-10-08T13:04:17.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.674+0000 7f724dffb700 1 -- 172.21.15.5:0/851683129 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11243 (secure 0 0 0) 0x7f7248099130 con 0x7f72501056b0 2023-10-08T13:04:17.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:17.676 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14793,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24650,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:15.559178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72400a14d0 msgr2=0x7f72400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72400a14d0 0x7f72400a3990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f724400b580 tx=0x7f7244005a90 comp rx=0 tx=0).stop 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 msgr2=0x7f72501a2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f72501a2a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7248007f10 tx=0x7f724800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 shutdown_connections 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72400a14d0 0x7f72400a3990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72501056b0 0x7f72501a2a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72500ffce0 0x7f7250197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 --2- 172.21.15.5:0/851683129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7250100680 0x7f7250197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 >> 172.21.15.5:0/851683129 conn(0x7f7250075b20 msgr2=0x7f72500fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 shutdown_connections 2023-10-08T13:04:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.676+0000 7f72571e4700 1 -- 172.21.15.5:0/851683129 wait complete. 2023-10-08T13:04:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-10-08T13:04:17.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 -- 172.21.15.5:0/2903945921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 msgr2=0x7f44c8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 --2- 172.21.15.5:0/2903945921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8105a90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f44b00099c0 tx=0x7f44b0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 -- 172.21.15.5:0/2903945921 shutdown_connections 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 --2- 172.21.15.5:0/2903945921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c8100660 0x7f44c810c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 --2- 172.21.15.5:0/2903945921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8105a90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 --2- 172.21.15.5:0/2903945921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c80ffca0 0x7f44c8100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 -- 172.21.15.5:0/2903945921 >> 172.21.15.5:0/2903945921 conn(0x7f44c8075b20 msgr2=0x7f44c80fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 -- 172.21.15.5:0/2903945921 shutdown_connections 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.817+0000 7f44ce577700 1 -- 172.21.15.5:0/2903945921 wait complete. 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 Processor -- start 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 -- start start 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c80ffca0 0x7f44c819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c8100660 0x7f44c819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8196dd0 con 0x7f44c81056b0 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8196f40 con 0x7f44c80ffca0 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ce577700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8197100 con 0x7f44c8100660 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ccb14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.818+0000 7f44ccb14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60738/0 (socket says 172.21.15.5:60738) 2023-10-08T13:04:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 -- 172.21.15.5:0/3641451511 learned_addr learned my addr 172.21.15.5:0/3641451511 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44c7fff700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c80ffca0 0x7f44c819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44c77fe700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c8100660 0x7f44c819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 -- 172.21.15.5:0/3641451511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c8100660 msgr2=0x7f44c819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c8100660 0x7f44c819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 -- 172.21.15.5:0/3641451511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c80ffca0 msgr2=0x7f44c819c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c80ffca0 0x7f44c819c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 -- 172.21.15.5:0/3641451511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00095f0 con 0x7f44c81056b0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ccb14700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8196770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f44c0007d70 tx=0x7f44c000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000ad40 con 0x7f44c81056b0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44c00128e0 con 0x7f44c81056b0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c81973e0 con 0x7f44c81056b0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00116b0 con 0x7f44c81056b0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.819+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c81a3630 con 0x7f44c81056b0 2023-10-08T13:04:17.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.820+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8100cb0 con 0x7f44c81056b0 2023-10-08T13:04:17.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.821+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f44c0012420 con 0x7f44c81056b0 2023-10-08T13:04:17.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.822+0000 7f44c57fa700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44b40a14d0 0x7f44b40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:17.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.822+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f44c00cd2a0 con 0x7f44c81056b0 2023-10-08T13:04:17.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.822+0000 7f44c7fff700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44b40a14d0 0x7f44b40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:17.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.822+0000 7f44c7fff700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44b40a14d0 0x7f44b40a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006010 tx=0x7f44b0005c40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:17.826+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f44c0096630 con 0x7f44c81056b0 2023-10-08T13:04:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.031+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44c8066cc0 con 0x7f44c81056b0 2023-10-08T13:04:18.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.033+0000 7f44c57fa700 1 -- 172.21.15.5:0/3641451511 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7f44c0099c50 con 0x7f44c81056b0 2023-10-08T13:04:18.034 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:18.034 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:18.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44b40a14d0 msgr2=0x7f44b40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44b40a14d0 0x7f44b40a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006010 tx=0x7f44b0005c40 comp rx=0 tx=0).stop 2023-10-08T13:04:18.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 msgr2=0x7f44c8196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8196770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f44c0007d70 tx=0x7f44c000a340 comp rx=0 tx=0).stop 2023-10-08T13:04:18.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 shutdown_connections 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44b40a14d0 0x7f44b40a3990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44c81056b0 0x7f44c8196770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44c80ffca0 0x7f44c819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 --2- 172.21.15.5:0/3641451511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c8100660 0x7f44c819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 >> 172.21.15.5:0/3641451511 conn(0x7f44c8075b20 msgr2=0x7f44c80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 shutdown_connections 2023-10-08T13:04:18.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.035+0000 7f44ce577700 1 -- 172.21.15.5:0/3641451511 wait complete. 2023-10-08T13:04:18.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T13:04:10.182813+0000', 'modified': '2023-10-08T13:04:15.559178+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.118:6839/3304365163', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 3304365163}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 3304365163}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-08T13:04:18.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T13:04:18.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T13:04:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 -- 172.21.15.5:0/2398563446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d600fff20 msgr2=0x7f5d6010c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 --2- 172.21.15.5:0/2398563446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d600fff20 0x7f5d6010c3e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800b0d0 tx=0x7f5d5800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 -- 172.21.15.5:0/2398563446 shutdown_connections 2023-10-08T13:04:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 --2- 172.21.15.5:0/2398563446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d600fff20 0x7f5d6010c3e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 --2- 172.21.15.5:0/2398563446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d60105620 0x7f5d60105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 --2- 172.21.15.5:0/2398563446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d600ff560 0x7f5d600ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 -- 172.21.15.5:0/2398563446 >> 172.21.15.5:0/2398563446 conn(0x7f5d600fb030 msgr2=0x7f5d600fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 -- 172.21.15.5:0/2398563446 shutdown_connections 2023-10-08T13:04:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.176+0000 7f5d67db5700 1 -- 172.21.15.5:0/2398563446 wait complete. 2023-10-08T13:04:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.177+0000 7f5d67db5700 1 Processor -- start 2023-10-08T13:04:18.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.177+0000 7f5d67db5700 1 -- start start 2023-10-08T13:04:18.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.177+0000 7f5d67db5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d600ff560 0x7f5d6019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.177+0000 7f5d67db5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d600fff20 0x7f5d6019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.177+0000 7f5d67db5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 0x7f5d601957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d67db5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60195e50 con 0x7f5d60105620 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d67db5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60195fc0 con 0x7f5d600ff560 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d67db5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60196180 con 0x7f5d600fff20 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 0x7f5d601957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 0x7f5d601957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60752/0 (socket says 172.21.15.5:60752) 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 -- 172.21.15.5:0/48947855 learned_addr learned my addr 172.21.15.5:0/48947855 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d65b51700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d600ff560 0x7f5d6019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d65350700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d600fff20 0x7f5d6019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 -- 172.21.15.5:0/48947855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d600fff20 msgr2=0x7f5d6019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d600fff20 0x7f5d6019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 -- 172.21.15.5:0/48947855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d600ff560 msgr2=0x7f5d6019b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d600ff560 0x7f5d6019b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 -- 172.21.15.5:0/48947855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d58009d00 con 0x7f5d60105620 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d65b51700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d600ff560 0x7f5d6019b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d66352700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 0x7f5d601957e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5d580094c0 tx=0x7f5d580095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d56ffd700 1 -- 172.21.15.5:0/48947855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800e040 con 0x7f5d60105620 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d60196400 con 0x7f5d60105620 2023-10-08T13:04:18.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d56ffd700 1 -- 172.21.15.5:0/48947855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d5801db40 con 0x7f5d60105620 2023-10-08T13:04:18.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d56ffd700 1 -- 172.21.15.5:0/48947855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5801baf0 con 0x7f5d60105620 2023-10-08T13:04:18.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.178+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d601a2650 con 0x7f5d60105620 2023-10-08T13:04:18.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.180+0000 7f5d56ffd700 1 -- 172.21.15.5:0/48947855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5d5801dcb0 con 0x7f5d60105620 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.181+0000 7f5d56ffd700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d4c0a14d0 0x7f5d4c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.181+0000 7f5d56ffd700 1 -- 172.21.15.5:0/48947855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5d580ce940 con 0x7f5d60105620 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.181+0000 7f5d65b51700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d4c0a14d0 0x7f5d4c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.181+0000 7f5d65b51700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d4c0a14d0 0x7f5d4c0a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005fd0 tx=0x7f5d5c005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 Processor -- start 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 -- start start 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc43210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc526c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc54ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccbac410 con 0x55e7ccc52c00 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb9dbd0 con 0x55e7ccc42e30 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb9b4f0 con 0x55e7ccc43750 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d66352700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc54ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d66352700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc54ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60760/0 (socket says 172.21.15.5:60760) 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d66352700 1 -- 172.21.15.5:0/1466673932 learned_addr learned my addr 172.21.15.5:0/1466673932 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.182+0000 7f5d65b51700 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc43210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d65350700 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d66352700 1 -- 172.21.15.5:0/1466673932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 msgr2=0x55e7ccc526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d66352700 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d66352700 1 -- 172.21.15.5:0/1466673932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 msgr2=0x55e7ccc43210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d66352700 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc43210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d66352700 1 -- 172.21.15.5:0/1466673932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7cc9c1d90 con 0x55e7ccc52c00 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d66352700 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc54ff0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5d58097f20 tx=0x7f5d5800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45335d33498b5752 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d4bfff700 1 -- 172.21.15.5:0/1466673932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5809ba20 con 0x55e7ccc52c00 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d4bfff700 1 -- 172.21.15.5:0/1466673932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d580b9e90 con 0x55e7ccc52c00 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.183+0000 7f5d4bfff700 1 -- 172.21.15.5:0/1466673932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58019c00 con 0x55e7ccc52c00 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1466673932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 msgr2=0x55e7ccc54ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc54ff0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5d58097f20 tx=0x7f5d5800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1466673932 shutdown_connections 2023-10-08T13:04:18.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc54ff0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc43210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1466673932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1466673932 >> 172.21.15.5:0/1466673932 conn(0x55e7ccbb8210 msgr2=0x55e7ccc3f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1466673932 shutdown_connections 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1466673932 wait complete. 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 -- start start 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.184+0000 7f5d73f9eb80 1 Processor -- start 2023-10-08T13:04:18.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc52fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc53520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc52c00 0x55e7ccc5e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb96de0 con 0x55e7ccc42e30 2023-10-08T13:04:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb336c0 con 0x55e7ccc52c00 2023-10-08T13:04:18.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb33360 con 0x55e7ccc43750 2023-10-08T13:04:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 10 client.0 _ll_register_callbacks cb 0x55e7cc9907b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:04:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc52fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc52fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60762/0 (socket says 172.21.15.5:60762) 2023-10-08T13:04:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 -- 172.21.15.5:0/3505246754 learned_addr learned my addr 172.21.15.5:0/3505246754 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65350700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc53520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d66352700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc52c00 0x55e7ccc5e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 -- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 msgr2=0x55e7ccc53520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc53520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 -- 172.21.15.5:0/3505246754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc52c00 msgr2=0x55e7ccc5e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc52c00 0x55e7ccc5e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 -- 172.21.15.5:0/3505246754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d601a2650 con 0x55e7ccc42e30 2023-10-08T13:04:18.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d66352700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc52c00 0x55e7ccc5e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:18.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d65b51700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc52fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00f010 tx=0x7f5d5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bf51995e11934d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:18.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d497fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:04:18.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d497fa700 1 -- 172.21.15.5:0/3505246754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00f850 con 0x55e7ccc42e30 2023-10-08T13:04:18.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d497fa700 1 -- 172.21.15.5:0/3505246754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5d5c00f9b0 con 0x55e7ccc42e30 2023-10-08T13:04:18.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7ccb5ee60 con 0x55e7ccc42e30 2023-10-08T13:04:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d497fa700 1 -- 172.21.15.5:0/3505246754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5c00fb70 con 0x55e7ccc42e30 2023-10-08T13:04:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 10 client.14922 fetch_fsmap learned FSMap version 17 2023-10-08T13:04:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.185+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x55e7cc9aac10 con 0x55e7ccc42e30 2023-10-08T13:04:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d497fa700 1 -- 172.21.15.5:0/3505246754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e7ccb5ee60 con 0x55e7ccc42e30 2023-10-08T13:04:18.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d497fa700 1 -- 172.21.15.5:0/3505246754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f5d5c024020 con 0x55e7ccc42e30 2023-10-08T13:04:18.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d73f9eb80 10 client.14922 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T13:04:18.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d73f9eb80 10 client.14922 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:04:18.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d73f9eb80 20 client.14922 populate_metadata read hostname 'smithi005' 2023-10-08T13:04:18.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7ccc62500 0x55e7ccc60fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d73f9eb80 4 client.14922 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:04:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7ccb8fdc0 con 0x55e7ccc62500 2023-10-08T13:04:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.186+0000 7f5d65350700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7ccc62500 0x55e7ccc60fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d65350700 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7ccc62500 0x55e7ccc60fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1b568a9330a376 server_cookie=cbfc574b97a0400d in_seq=0 out_seq=0 2023-10-08T13:04:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d497fa700 10 client.14922 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:04:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d497fa700 1 -- 172.21.15.5:0/3505246754 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7ccb8fdc0 con 0x55e7ccc62500 2023-10-08T13:04:18.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d497fa700 10 client.14922 handle_command_reply: tid=0 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d73f9eb80 1 client.14922 shutdown 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 msgr2=0x55e7ccc52fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.187+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc52fe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00f010 tx=0x7f5d5c004750 comp rx=0 tx=0).stop 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 shutdown_connections 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7ccc62500 0x55e7ccc60fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc52c00 0x55e7ccc5e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc52fe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/3505246754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc53520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d497fa700 0 client.14922 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:04:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 >> 172.21.15.5:0/3505246754 conn(0x55e7ccbb8210 msgr2=0x55e7ccc3ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 shutdown_connections 2023-10-08T13:04:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/3505246754 wait complete. 2023-10-08T13:04:18.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.188+0000 7f5d73f9eb80 20 client.14922 trim_cache size 0 max 16384 2023-10-08T13:04:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.205+0000 7f5d73f9eb80 1 Processor -- start 2023-10-08T13:04:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.205+0000 7f5d73f9eb80 1 -- start start 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.205+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc4d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc43750 0x55e7ccc4d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc52c00 0x55e7ccc50700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7cca178d0 con 0x55e7ccc42e30 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb8fdc0 con 0x55e7ccc43750 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc4d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccb5ee60 con 0x55e7ccc52c00 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc4d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60770/0 (socket says 172.21.15.5:60770) 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 -- 172.21.15.5:0/2400483419 learned_addr learned my addr 172.21.15.5:0/2400483419 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:18.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65350700 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc43750 0x55e7ccc4d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 -- 172.21.15.5:0/2400483419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc52c00 msgr2=0x55e7ccc50700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc52c00 0x55e7ccc50700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 -- 172.21.15.5:0/2400483419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc43750 msgr2=0x55e7ccc4d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc43750 0x55e7ccc4d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 -- 172.21.15.5:0/2400483419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7cc9e8200 con 0x55e7ccc42e30 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65350700 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc43750 0x55e7ccc4d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d65b51700 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc4d130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c013040 tx=0x7f5d5c005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d7ea37b546216a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d54ff9700 1 -- 172.21.15.5:0/2400483419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00f6a0 con 0x55e7ccc42e30 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d54ff9700 1 -- 172.21.15.5:0/2400483419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d5c004850 con 0x55e7ccc42e30 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.206+0000 7f5d54ff9700 1 -- 172.21.15.5:0/2400483419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c02bc90 con 0x55e7ccc42e30 2023-10-08T13:04:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/2400483419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 msgr2=0x55e7ccc4d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc4d130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c013040 tx=0x7f5d5c005cf0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/2400483419 shutdown_connections 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc52c00 0x55e7ccc50700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc42e30 0x55e7ccc4d130 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/2400483419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc43750 0x55e7ccc4d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/2400483419 >> 172.21.15.5:0/2400483419 conn(0x55e7ccbb8210 msgr2=0x55e7ccc52fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/2400483419 shutdown_connections 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/2400483419 wait complete. 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 -- start start 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.207+0000 7f5d73f9eb80 1 Processor -- start 2023-10-08T13:04:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc67900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccc67fe0 con 0x55e7ccc52c00 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7ccc68150 con 0x55e7ccc42e30 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7cccb5f00 con 0x55e7ccc43750 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 10 client.0 _ll_register_callbacks cb 0x7f5d5c00ef40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc67900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc67900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60780/0 (socket says 172.21.15.5:60780) 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 -- 172.21.15.5:0/1511179978 learned_addr learned my addr 172.21.15.5:0/1511179978 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d65350700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d65b51700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 -- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 msgr2=0x55e7ccc673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc673c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 -- 172.21.15.5:0/1511179978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 msgr2=0x55e7ccc6add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc6add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 -- 172.21.15.5:0/1511179978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7cc9aac10 con 0x55e7ccc52c00 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d65b51700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc6add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d66352700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc67900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d5809b720 tx=0x7f5d5801bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e4e475091556c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d497fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d497fa700 1 -- 172.21.15.5:0/1511179978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580a3d20 con 0x55e7ccc52c00 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d497fa700 1 -- 172.21.15.5:0/1511179978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5d5809fb70 con 0x55e7ccc52c00 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.208+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d580b9e90 con 0x55e7ccc52c00 2023-10-08T13:04:18.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d497fa700 1 -- 172.21.15.5:0/1511179978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d58019c00 con 0x55e7ccc52c00 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 10 client.14928 fetch_fsmap learned FSMap version 17 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x55e7cc9c0260 con 0x55e7ccc52c00 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d497fa700 1 -- 172.21.15.5:0/1511179978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d580b9e90 con 0x55e7ccc52c00 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d497fa700 1 -- 172.21.15.5:0/1511179978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f5d5809af10 con 0x55e7ccc52c00 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 10 client.14928 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 10 client.14928 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 20 client.14928 populate_metadata read hostname 'smithi005' 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7cccbabf0 0x55e7cccb7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 4 client.14928 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e7ccb8fae0 con 0x55e7cccbabf0 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.209+0000 7f5d65b51700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7cccbabf0 0x55e7cccb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d497fa700 10 client.14928 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d65b51700 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7cccbabf0 0x55e7cccb7180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954720780c2f2f5a server_cookie=683d90f0a2f8aa30 in_seq=0 out_seq=0 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d497fa700 1 -- 172.21.15.5:0/1511179978 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e7ccb8fae0 con 0x55e7cccbabf0 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d497fa700 10 client.14928 handle_command_reply: tid=0 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 client.14928 shutdown 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 msgr2=0x55e7ccc67900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc67900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d5809b720 tx=0x7f5d5801bfc0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 shutdown_connections 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7ccc52c00 0x55e7ccc67900 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e7cccbabf0 0x55e7cccb7180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e7ccc42e30 0x55e7ccc6add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 --2- 172.21.15.5:0/1511179978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e7ccc43750 0x55e7ccc673c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d497fa700 0 client.14928 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 >> 172.21.15.5:0/1511179978 conn(0x55e7ccbb8210 msgr2=0x55e7ccc4d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 shutdown_connections 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 1 -- 172.21.15.5:0/1511179978 wait complete. 2023-10-08T13:04:18.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.210+0000 7f5d73f9eb80 20 client.14928 trim_cache size 0 max 16384 2023-10-08T13:04:18.220 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:04:18.220 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:04:18.220 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-08T13:04:18.220 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24667, 2023-10-08T13:04:18.220 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:04:18.220 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 7.0971325380000003, 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 17, 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19.364504830000001 2023-10-08T13:04:18.221 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:04:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d4c0a14d0 msgr2=0x7f5d4c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d4c0a14d0 0x7f5d4c0a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005fd0 tx=0x7f5d5c005e30 comp rx=0 tx=0).stop 2023-10-08T13:04:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 msgr2=0x7f5d601957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 0x7f5d601957e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5d580094c0 tx=0x7f5d580095a0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 shutdown_connections 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5d4c0a14d0 0x7f5d4c0a3990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d60105620 0x7f5d601957e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d600ff560 0x7f5d6019b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 --2- 172.21.15.5:0/48947855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d600fff20 0x7f5d6019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 >> 172.21.15.5:0/48947855 conn(0x7f5d600fb030 msgr2=0x7f5d600fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 shutdown_connections 2023-10-08T13:04:18.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:18.211+0000 7f5d67db5700 1 -- 172.21.15.5:0/48947855 wait complete. 2023-10-08T13:04:18.224 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T13:04:18.224 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:18.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T13:04:18.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:18 smithi060 ceph-mon[103190]: pgmap v245: 129 pgs: 8 creating+peering, 112 active+clean, 9 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-08T13:04:18.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:18 smithi060 ceph-mon[103190]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:04:18.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:18 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T13:04:18.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:18 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3296561147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:18 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/851683129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:18 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3641451511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:18 smithi005 ceph-mon[99496]: pgmap v245: 129 pgs: 8 creating+peering, 112 active+clean, 9 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-08T13:04:18.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:18 smithi005 ceph-mon[99496]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:04:18.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:18 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T13:04:18.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:18 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3296561147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:18 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/851683129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:18 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3641451511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:18 smithi118 ceph-mon[104234]: pgmap v245: 129 pgs: 8 creating+peering, 112 active+clean, 9 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-08T13:04:18.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:18 smithi118 ceph-mon[104234]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:04:18.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:18 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T13:04:18.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:18 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3296561147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:18 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/851683129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:18 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3641451511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:18.784 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3166190910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc1056b0 msgr2=0x7f1ccc105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3166190910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc1056b0 0x7f1ccc105a90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009990 tx=0x7f1cc8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3166190910 shutdown_connections 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3166190910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ccc100110 0x7f1ccc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3166190910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc1056b0 0x7f1ccc105a90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3166190910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc0ff750 0x7f1ccc0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3166190910 >> 172.21.15.5:0/3166190910 conn(0x7f1ccc075790 msgr2=0x7f1ccc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3166190910 shutdown_connections 2023-10-08T13:04:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.017+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3166190910 wait complete. 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 Processor -- start 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 -- start start 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ccc0ff750 0x7f1ccc19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 0x7f1ccc19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc1056b0 0x7f1ccc195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc195f70 con 0x7f1ccc100110 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1960e0 con 0x7f1ccc0ff750 2023-10-08T13:04:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd3b63700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1962a0 con 0x7f1ccc1056b0 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd10fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 0x7f1ccc19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd10fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 0x7f1ccc19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60792/0 (socket says 172.21.15.5:60792) 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd10fe700 1 -- 172.21.15.5:0/3418472486 learned_addr learned my addr 172.21.15.5:0/3418472486 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.018+0000 7f1cd18ff700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ccc0ff750 0x7f1ccc19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd10fe700 1 -- 172.21.15.5:0/3418472486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc1056b0 msgr2=0x7f1ccc195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd10fe700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc1056b0 0x7f1ccc195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd10fe700 1 -- 172.21.15.5:0/3418472486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ccc0ff750 msgr2=0x7f1ccc19b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd10fe700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ccc0ff750 0x7f1ccc19b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd10fe700 1 -- 172.21.15.5:0/3418472486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80095f0 con 0x7f1ccc100110 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd10fe700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 0x7f1ccc19bd10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c920 tx=0x7f1cc000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0007b00 con 0x7f1ccc100110 2023-10-08T13:04:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cc000ce70 con 0x7f1ccc100110 2023-10-08T13:04:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc196580 con 0x7f1ccc100110 2023-10-08T13:04:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00054e0 con 0x7f1ccc100110 2023-10-08T13:04:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.019+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc1a27c0 con 0x7f1ccc100110 2023-10-08T13:04:20.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.020+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc107c40 con 0x7f1ccc100110 2023-10-08T13:04:20.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.021+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1cc0004750 con 0x7f1ccc100110 2023-10-08T13:04:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.022+0000 7f1cbeffd700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cb80a14d0 0x7f1cb80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.022+0000 7f1cd18ff700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cb80a14d0 0x7f1cb80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.022+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f1cc00ccc50 con 0x7f1ccc100110 2023-10-08T13:04:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.022+0000 7f1cd18ff700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cb80a14d0 0x7f1cb80a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b5c0 tx=0x7f1cc8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.026+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1cc0095f80 con 0x7f1ccc100110 2023-10-08T13:04:20.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.272+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ccc100df0 con 0x7f1ccc100110 2023-10-08T13:04:20.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.273+0000 7f1cbeffd700 1 -- 172.21.15.5:0/3418472486 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1cc001d070 con 0x7f1ccc100110 2023-10-08T13:04:20.273 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-08T13:04:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cb80a14d0 msgr2=0x7f1cb80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cb80a14d0 0x7f1cb80a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b5c0 tx=0x7f1cc8005960 comp rx=0 tx=0).stop 2023-10-08T13:04:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 msgr2=0x7f1ccc19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 0x7f1ccc19bd10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c920 tx=0x7f1cc000cc30 comp rx=0 tx=0).stop 2023-10-08T13:04:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 shutdown_connections 2023-10-08T13:04:20.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cb80a14d0 0x7f1cb80a3990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ccc1056b0 0x7f1ccc195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ccc0ff750 0x7f1ccc19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 --2- 172.21.15.5:0/3418472486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ccc100110 0x7f1ccc19bd10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 >> 172.21.15.5:0/3418472486 conn(0x7f1ccc075790 msgr2=0x7f1ccc0fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 shutdown_connections 2023-10-08T13:04:20.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:20.275+0000 7f1cd3b63700 1 -- 172.21.15.5:0/3418472486 wait complete. 2023-10-08T13:04:20.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:20 smithi005 ceph-mon[99496]: pgmap v246: 129 pgs: 8 creating+peering, 121 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2023-10-08T13:04:20.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:20 smithi060 ceph-mon[103190]: pgmap v246: 129 pgs: 8 creating+peering, 121 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2023-10-08T13:04:20.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:20 smithi118 ceph-mon[104234]: pgmap v246: 129 pgs: 8 creating+peering, 121 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T13:04:20.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T13:04:20.646 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T13:04:20.646 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-08T13:04:20.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:20.646 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:04:20.665 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41731sec preferred_lft 41731sec 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-08T13:04:20.666 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:04:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:04:20.667 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T13:04:20.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:20.667 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:04:20.667 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:04:20.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-10-08T13:04:20.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-10-08T13:04:20.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-10-08T13:04:20.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T13:04:20.668 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:04:20.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:20.834 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T13:04:20.863 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-08T13:04:20.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:20.864 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-08T13:04:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-08T13:04:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T13:04:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T13:04:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T13:04:20.937 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T13:04:20.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:20.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:04:20.938 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:04:20.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T13:04:20.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T13:04:20.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T13:04:20.938 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:04:21.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:21.195 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-08T13:04:21.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:21.214 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-10-08T13:04:21.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:21.271 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:04:21.271 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:04:21.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:04:21.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-08T13:04:21.272 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:04:21.352 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:21 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3418472486' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:04:21.369 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-08T13:04:21.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:21.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:04:21.369 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:04:21.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-08T13:04:21.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T13:04:21.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-08T13:04:21.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-08T13:04:21.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-08T13:04:21.370 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:04:21.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:21 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3418472486' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:04:21.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:21 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3418472486' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:04:21.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:21.656 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:04:21.656 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:04:21.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-08T13:04:21.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T13:04:21.656 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:04:21.756 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-08T13:04:21.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:04:21.756 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:21.773 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-08T13:04:21.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:04:21.773 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:21.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-10-08T13:04:21.899 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2023-10-08T13:04:21.958 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/systemd 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/blkio 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/freezer 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/pids 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/memory 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpuset 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/devices 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T13:04:21.959 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/rdma 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/perf_event 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T13:04:21.960 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/89ea50559ba3f00a84bc64a9475b0a29c0ec66105cb53ca57f4c2c877416d603/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/4650ba622401249fbc016748fd635c6b0f6ba701182afb3962d7b69c16d56a3d/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/6768a6eafb7925e36bab467b47423a8cf089cabac8571490072c726f6573f493/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/8b838192c46ed45a2418458ff02459f181da6ab6a37a93f068d529dce71b613f/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c880f1073cb945c54572db7601ee1f5ab85a7c67e00dcd36a37121201effb976/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/eefc85f07e9afd8a932ae0ea55ae91b05d7f0ce4c722f6e38e62ef6be8abe648/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/eabd3e9374507eba9e5e8882c0664186fa2d7c4718d1b0a6936c7c73e7f12733/merged 2023-10-08T13:04:21.961 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c2cac870d40f3604db5fe4d5db68390cdec261a06f9118b75302ad2d1c14a448/merged 2023-10-08T13:04:21.962 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2e3f221ff0ebe3585efe5fb3a2df657829a65cbbc7ab3864802a97d479ab5c9e/merged 2023-10-08T13:04:21.962 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c22c70321e826387a78f57e978118a94b8c041dd0c0c68c97ffb44dd1ef7bf06/merged 2023-10-08T13:04:21.962 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2023-10-08T13:04:21.962 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:04:21.962 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:04:21.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:21.962 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-10-08T13:04:22.015 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T13:04:22.015 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-08T13:04:22.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-10-08T13:04:22.085 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T13:04:22.144 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2023-10-08T13:04:22.144 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2023-10-08T13:04:22.144 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2023-10-08T13:04:22.144 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/systemd 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2023-10-08T13:04:22.145 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/blkio 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/freezer 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/pids 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/memory 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/cpuset 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/devices 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T13:04:22.146 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/rdma 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup/perf_event 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2023-10-08T13:04:22.147 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2023-10-08T13:04:22.148 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/89ea50559ba3f00a84bc64a9475b0a29c0ec66105cb53ca57f4c2c877416d603/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/4650ba622401249fbc016748fd635c6b0f6ba701182afb3962d7b69c16d56a3d/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/6768a6eafb7925e36bab467b47423a8cf089cabac8571490072c726f6573f493/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/8b838192c46ed45a2418458ff02459f181da6ab6a37a93f068d529dce71b613f/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c880f1073cb945c54572db7601ee1f5ab85a7c67e00dcd36a37121201effb976/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/eefc85f07e9afd8a932ae0ea55ae91b05d7f0ce4c722f6e38e62ef6be8abe648/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/eabd3e9374507eba9e5e8882c0664186fa2d7c4718d1b0a6936c7c73e7f12733/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c2cac870d40f3604db5fe4d5db68390cdec261a06f9118b75302ad2d1c14a448/merged 2023-10-08T13:04:22.149 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2e3f221ff0ebe3585efe5fb3a2df657829a65cbbc7ab3864802a97d479ab5c9e/merged 2023-10-08T13:04:22.150 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/c22c70321e826387a78f57e978118a94b8c041dd0c0c68c97ffb44dd1ef7bf06/merged 2023-10-08T13:04:22.150 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2023-10-08T13:04:22.150 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:04:22.150 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:04:22.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:22.150 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-10-08T13:04:22.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2023-10-08T13:04:22.164+0000 7f187622a5c0 -1 init, newargv = 0x55b525dc59e0 newargc=15 2023-10-08T13:04:22.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[161592]: starting ceph client 2023-10-08T13:04:22.170 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[161592]: starting fuse 2023-10-08T13:04:22.181 INFO:teuthology.orchestra.run.smithi005.stdout:124 2023-10-08T13:04:22.182 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-10-08T13:04:22.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2023-10-08T13:04:22.182 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2023-10-08T13:04:22.182 DEBUG:teuthology.orchestra.run.smithi005:> import re 2023-10-08T13:04:22.182 DEBUG:teuthology.orchestra.run.smithi005:> import os 2023-10-08T13:04:22.182 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2023-10-08T13:04:22.182 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T13:04:22.183 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> return f 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2023-10-08T13:04:22.184 DEBUG:teuthology.orchestra.run.smithi005:> ' 2023-10-08T13:04:22.308 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.161592.asok 2023-10-08T13:04:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T13:04:22.317 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.161592.asok 2023-10-08T13:04:22.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:22.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.161592.asok status 2023-10-08T13:04:22.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:22 smithi060 ceph-mon[103190]: pgmap v247: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-10-08T13:04:22.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:22 smithi005 ceph-mon[99496]: pgmap v247: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-10-08T13:04:22.479 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:04:22.479 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2023-10-08T13:04:22.479 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "7b3143bae3b6870a749bfb9810ed6e7d0e89d7de", 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "161592", 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 14940, 2023-10-08T13:04:22.480 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 14940 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-10-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1863807000 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1863807000 2023-10-08T13:04:22.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.14940 192.168.0.1:0/1863807000", 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/1863807000", 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 17, 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 87, 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2023-10-08T13:04:22.483 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:04:22.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:22.490 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2023-10-08T13:04:22.490 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:22.507 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2023-10-08T13:04:22.508 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:22.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:22.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:22.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:22 smithi118 ceph-mon[104234]: pgmap v247: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-10-08T13:04:22.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:22.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-08T13:04:22.685 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2023-10-08T13:04:22.685 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-08T13:04:22.685 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:22.685 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:04:22.685 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:04:22.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 -- 172.21.15.5:0/2270931426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc844105610 msgr2=0x7fc8441059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 --2- 172.21.15.5:0/2270931426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc844105610 0x7fc8441059f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc8340099c0 tx=0x7fc834009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 -- 172.21.15.5:0/2270931426 shutdown_connections 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 --2- 172.21.15.5:0/2270931426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8440fff10 0x7fc84410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 --2- 172.21.15.5:0/2270931426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc844105610 0x7fc8441059f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 --2- 172.21.15.5:0/2270931426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 0x7fc8440ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 -- 172.21.15.5:0/2270931426 >> 172.21.15.5:0/2270931426 conn(0x7fc8440fb040 msgr2=0x7fc8440fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 -- 172.21.15.5:0/2270931426 shutdown_connections 2023-10-08T13:04:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.869+0000 7fc849ee3700 1 -- 172.21.15.5:0/2270931426 wait complete. 2023-10-08T13:04:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 Processor -- start 2023-10-08T13:04:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 -- start start 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 0x7fc844196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 0x7fc844196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc844105610 0x7fc84419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84419b920 con 0x7fc8440fff10 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84419ba90 con 0x7fc844105610 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc849ee3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84419bc50 con 0x7fc8440ff550 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 0x7fc844196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 0x7fc844196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60820/0 (socket says 172.21.15.5:60820) 2023-10-08T13:04:22.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.870+0000 7fc842ffd700 1 -- 172.21.15.5:0/3983207707 learned_addr learned my addr 172.21.15.5:0/3983207707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc8437fe700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 0x7fc844196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc843fff700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc844105610 0x7fc84419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc842ffd700 1 -- 172.21.15.5:0/3983207707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 msgr2=0x7fc844196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc842ffd700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 0x7fc844196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc842ffd700 1 -- 172.21.15.5:0/3983207707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc844105610 msgr2=0x7fc84419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc842ffd700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc844105610 0x7fc84419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc842ffd700 1 -- 172.21.15.5:0/3983207707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340095f0 con 0x7fc8440fff10 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc8437fe700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 0x7fc844196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc842ffd700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 0x7fc844196f80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc83800d950 tx=0x7fc83800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838009b40 con 0x7fc8440fff10 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc838009ca0 con 0x7fc8440fff10 2023-10-08T13:04:22.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800f620 con 0x7fc8440fff10 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84419bf30 con 0x7fc8440fff10 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.871+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8441a37e0 con 0x7fc8440fff10 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.872+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc844100c70 con 0x7fc8440fff10 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.873+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc838010460 con 0x7fc8440fff10 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.874+0000 7fc840ff9700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc82c0a14d0 0x7fc82c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.874+0000 7fc8437fe700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc82c0a14d0 0x7fc82c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.874+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fc8380cd420 con 0x7fc8440fff10 2023-10-08T13:04:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.875+0000 7fc8437fe700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc82c0a14d0 0x7fc82c0a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc834009fd0 tx=0x7fc834005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:22.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:22.878+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc8380967b0 con 0x7fc8440fff10 2023-10-08T13:04:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.081+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc84410f470 con 0x7fc8440fff10 2023-10-08T13:04:23.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.083+0000 7fc840ff9700 1 -- 172.21.15.5:0/3983207707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7fc838016090 con 0x7fc8440fff10 2023-10-08T13:04:23.083 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:23.083 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:23.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc82c0a14d0 msgr2=0x7fc82c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc82c0a14d0 0x7fc82c0a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc834009fd0 tx=0x7fc834005fd0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 msgr2=0x7fc844196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 0x7fc844196f80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc83800d950 tx=0x7fc83800dd10 comp rx=0 tx=0).stop 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 shutdown_connections 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc82c0a14d0 0x7fc82c0a3990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc844105610 0x7fc84419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440ff550 0x7fc844196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 --2- 172.21.15.5:0/3983207707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fff10 0x7fc844196f80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 >> 172.21.15.5:0/3983207707 conn(0x7fc8440fb040 msgr2=0x7fc8440fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 shutdown_connections 2023-10-08T13:04:23.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.085+0000 7fc849ee3700 1 -- 172.21.15.5:0/3983207707 wait complete. 2023-10-08T13:04:23.098 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:04:23.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:04:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/667563450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80ff590 msgr2=0x7ff2b80ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/667563450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80ff590 0x7ff2b80ffa10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00099c0 tx=0x7ff2a0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/667563450 shutdown_connections 2023-10-08T13:04:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/667563450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2b80fff50 0x7ff2b810c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/667563450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b8105650 0x7ff2b8105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/667563450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80ff590 0x7ff2b80ffa10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/667563450 >> 172.21.15.5:0/667563450 conn(0x7ff2b80fb020 msgr2=0x7ff2b80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/667563450 shutdown_connections 2023-10-08T13:04:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.232+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/667563450 wait complete. 2023-10-08T13:04:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 Processor -- start 2023-10-08T13:04:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 -- start start 2023-10-08T13:04:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b80ff590 0x7ff2b8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 0x7ff2b8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2b8105650 0x7ff2b81a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81986e0 con 0x7ff2b80fff50 2023-10-08T13:04:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81a2ef0 con 0x7ff2b8105650 2023-10-08T13:04:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2bcdd3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81a3030 con 0x7ff2b80ff590 2023-10-08T13:04:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 0x7ff2b8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 0x7ff2b8197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60852/0 (socket says 172.21.15.5:60852) 2023-10-08T13:04:23.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 -- 172.21.15.5:0/834937609 learned_addr learned my addr 172.21.15.5:0/834937609 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2b6d9d700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2b8105650 0x7ff2b81a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2b659c700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b80ff590 0x7ff2b8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 -- 172.21.15.5:0/834937609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b80ff590 msgr2=0x7ff2b8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b80ff590 0x7ff2b8197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 -- 172.21.15.5:0/834937609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2b8105650 msgr2=0x7ff2b81a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2b8105650 0x7ff2b81a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2affff700 1 -- 172.21.15.5:0/834937609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00095f0 con 0x7ff2b80fff50 2023-10-08T13:04:23.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.233+0000 7ff2b659c700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b80ff590 0x7ff2b8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:23.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.234+0000 7ff2affff700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 0x7ff2b8197e70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000f690 tx=0x7ff2a000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:23.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.234+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a001c070 con 0x7ff2b80fff50 2023-10-08T13:04:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.234+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b81a3260 con 0x7ff2b80fff50 2023-10-08T13:04:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.234+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2a000fe50 con 0x7ff2b80fff50 2023-10-08T13:04:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.234+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0022db0 con 0x7ff2b80fff50 2023-10-08T13:04:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.234+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b81a3680 con 0x7ff2b80fff50 2023-10-08T13:04:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.235+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b8107af0 con 0x7ff2b80fff50 2023-10-08T13:04:23.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.236+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7ff2a0020070 con 0x7ff2b80fff50 2023-10-08T13:04:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.236+0000 7ff2af7fe700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff2a40a14d0 0x7ff2a40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.237+0000 7ff2b659c700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff2a40a14d0 0x7ff2a40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.237+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7ff2a00cdfe0 con 0x7ff2b80fff50 2023-10-08T13:04:23.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.237+0000 7ff2b659c700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff2a40a14d0 0x7ff2a40a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009bc0 tx=0x7ff2a8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.241+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff2a0097520 con 0x7ff2b80fff50 2023-10-08T13:04:23.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:23 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3983207707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:23.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:23 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3983207707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:23.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.440+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2b8100cb0 con 0x7ff2b80fff50 2023-10-08T13:04:23.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.440+0000 7ff2af7fe700 1 -- 172.21.15.5:0/834937609 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2a009ab40 con 0x7ff2b80fff50 2023-10-08T13:04:23.441 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:04:23.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff2a40a14d0 msgr2=0x7ff2a40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff2a40a14d0 0x7ff2a40a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009bc0 tx=0x7ff2a8009260 comp rx=0 tx=0).stop 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 msgr2=0x7ff2b8197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 0x7ff2b8197e70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000f690 tx=0x7ff2a000bfd0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 shutdown_connections 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff2a40a14d0 0x7ff2a40a3990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2b8105650 0x7ff2b81a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2b80ff590 0x7ff2b8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 --2- 172.21.15.5:0/834937609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2b80fff50 0x7ff2b8197e70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.442+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 >> 172.21.15.5:0/834937609 conn(0x7ff2b80fb020 msgr2=0x7ff2b80fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:23.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.443+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 shutdown_connections 2023-10-08T13:04:23.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.443+0000 7ff2bcdd3700 1 -- 172.21.15.5:0/834937609 wait complete. 2023-10-08T13:04:23.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:04:23.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:23 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3983207707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 -- 172.21.15.5:0/583528731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c102100 msgr2=0x7fd22c10a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 --2- 172.21.15.5:0/583528731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c102100 0x7fd22c10a5e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd220009990 tx=0x7fd220009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 -- 172.21.15.5:0/583528731 shutdown_connections 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 --2- 172.21.15.5:0/583528731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c10ac00 0x7fd22c10d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 --2- 172.21.15.5:0/583528731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd22c1017e0 0x7fd22c101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 --2- 172.21.15.5:0/583528731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c102100 0x7fd22c10a5e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 -- 172.21.15.5:0/583528731 >> 172.21.15.5:0/583528731 conn(0x7fd22c0fafc0 msgr2=0x7fd22c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 -- 172.21.15.5:0/583528731 shutdown_connections 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.584+0000 7fd231609700 1 -- 172.21.15.5:0/583528731 wait complete. 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 Processor -- start 2023-10-08T13:04:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 -- start start 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c1017e0 0x7fd22c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd22c102100 0x7fd22c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 0x7fd22c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1970d0 con 0x7fd22c10ac00 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c197240 con 0x7fd22c102100 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.585+0000 7fd231609700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c197400 con 0x7fd22c1017e0 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 0x7fd22c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 0x7fd22c196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60868/0 (socket says 172.21.15.5:60868) 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 -- 172.21.15.5:0/469953963 learned_addr learned my addr 172.21.15.5:0/469953963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22a7fc700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd22c102100 0x7fd22c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22affd700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c1017e0 0x7fd22c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 -- 172.21.15.5:0/469953963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c1017e0 msgr2=0x7fd22c19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c1017e0 0x7fd22c19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 -- 172.21.15.5:0/469953963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd22c102100 msgr2=0x7fd22c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd22c102100 0x7fd22c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 -- 172.21.15.5:0/469953963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200095f0 con 0x7fd22c10ac00 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd22b7fe700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 0x7fd22c196900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd224007d70 tx=0x7fd22400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400ac90 con 0x7fd22c10ac00 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd22400adf0 con 0x7fd22c10ac00 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c1976e0 con 0x7fd22c10ac00 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240115e0 con 0x7fd22c10ac00 2023-10-08T13:04:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.586+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c1a37e0 con 0x7fd22c10ac00 2023-10-08T13:04:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.587+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c105cd0 con 0x7fd22c10ac00 2023-10-08T13:04:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.588+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd224012420 con 0x7fd22c10ac00 2023-10-08T13:04:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.589+0000 7fd213fff700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2140a14d0 0x7fd2140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.589+0000 7fd22affd700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2140a14d0 0x7fd2140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.589+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd2240cd210 con 0x7fd22c10ac00 2023-10-08T13:04:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.590+0000 7fd22affd700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2140a14d0 0x7fd2140a3990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009a10 tx=0x7fd21c009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.594+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd2240965a0 con 0x7fd22c10ac00 2023-10-08T13:04:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.798+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd22c197de0 con 0x7fd22c10ac00 2023-10-08T13:04:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.798+0000 7fd213fff700 1 -- 172.21.15.5:0/469953963 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd224099bc0 con 0x7fd22c10ac00 2023-10-08T13:04:23.798 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:04:23.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2140a14d0 msgr2=0x7fd2140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2140a14d0 0x7fd2140a3990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009a10 tx=0x7fd21c009190 comp rx=0 tx=0).stop 2023-10-08T13:04:23.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 msgr2=0x7fd22c196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 0x7fd22c196900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd224007d70 tx=0x7fd22400a340 comp rx=0 tx=0).stop 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 shutdown_connections 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2140a14d0 0x7fd2140a3990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c10ac00 0x7fd22c196900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd22c1017e0 0x7fd22c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 --2- 172.21.15.5:0/469953963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd22c102100 0x7fd22c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 >> 172.21.15.5:0/469953963 conn(0x7fd22c0fafc0 msgr2=0x7fd22c0fbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 shutdown_connections 2023-10-08T13:04:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.800+0000 7fd231609700 1 -- 172.21.15.5:0/469953963 wait complete. 2023-10-08T13:04:23.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 -- 172.21.15.5:0/2371302580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c34100650 msgr2=0x7f6c3410c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/2371302580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c34100650 0x7f6c3410c420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b0d0 tx=0x7f6c2c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 -- 172.21.15.5:0/2371302580 shutdown_connections 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/2371302580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c34100650 0x7f6c3410c420 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/2371302580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c341056a0 0x7f6c34105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/2371302580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c340ffc90 0x7f6c34100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 -- 172.21.15.5:0/2371302580 >> 172.21.15.5:0/2371302580 conn(0x7f6c34075b10 msgr2=0x7f6c340fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.941+0000 7f6c3c28d700 1 -- 172.21.15.5:0/2371302580 shutdown_connections 2023-10-08T13:04:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 -- 172.21.15.5:0/2371302580 wait complete. 2023-10-08T13:04:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 Processor -- start 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 -- start start 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 0x7f6c3419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c34100650 0x7f6c3419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c341056a0 0x7f6c34196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34196f90 con 0x7f6c340ffc90 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34197100 con 0x7f6c341056a0 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3c28d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341972c0 con 0x7f6c34100650 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3a029700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 0x7f6c3419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.942+0000 7f6c3a029700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 0x7f6c3419c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60878/0 (socket says 172.21.15.5:60878) 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 -- 172.21.15.5:0/3063944486 learned_addr learned my addr 172.21.15.5:0/3063944486 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a82a700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c341056a0 0x7f6c34196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c39828700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c34100650 0x7f6c3419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 -- 172.21.15.5:0/3063944486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c34100650 msgr2=0x7f6c3419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c34100650 0x7f6c3419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 -- 172.21.15.5:0/3063944486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c341056a0 msgr2=0x7f6c34196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c341056a0 0x7f6c34196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 -- 172.21.15.5:0/3063944486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009d00 con 0x7f6c340ffc90 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3a029700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 0x7f6c3419c730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c970 tx=0x7f6c2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24004220 con 0x7f6c340ffc90 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c24004380 con 0x7f6c340ffc90 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24003b50 con 0x7f6c340ffc90 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c341975a0 con 0x7f6c340ffc90 2023-10-08T13:04:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.943+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c341a37d0 con 0x7f6c340ffc90 2023-10-08T13:04:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.944+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34100ca0 con 0x7f6c340ffc90 2023-10-08T13:04:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.945+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6c24003cf0 con 0x7f6c340ffc90 2023-10-08T13:04:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.946+0000 7f6c2b7fe700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c200a1550 0x7f6c200a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.946+0000 7f6c39828700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c200a1550 0x7f6c200a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.946+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f6c240cca50 con 0x7f6c340ffc90 2023-10-08T13:04:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.946+0000 7f6c39828700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c200a1550 0x7f6c200a3a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c340fdec0 tx=0x7f6c3000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:23.950+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c24095de0 con 0x7f6c340ffc90 2023-10-08T13:04:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.151+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c3410f4e0 con 0x7f6c340ffc90 2023-10-08T13:04:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.151+0000 7f6c2b7fe700 1 -- 172.21.15.5:0/3063944486 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c24099400 con 0x7f6c340ffc90 2023-10-08T13:04:24.152 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.153+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c200a1550 msgr2=0x7f6c200a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.153+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c200a1550 0x7f6c200a3a10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c340fdec0 tx=0x7f6c3000a380 comp rx=0 tx=0).stop 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.153+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 msgr2=0x7f6c3419c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.153+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 0x7f6c3419c730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c970 tx=0x7f6c2400cc80 comp rx=0 tx=0).stop 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 shutdown_connections 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c200a1550 0x7f6c200a3a10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c341056a0 0x7f6c34196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c340ffc90 0x7f6c3419c730 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 --2- 172.21.15.5:0/3063944486 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c34100650 0x7f6c3419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 >> 172.21.15.5:0/3063944486 conn(0x7f6c34075b10 msgr2=0x7f6c340fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 shutdown_connections 2023-10-08T13:04:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.154+0000 7f6c3c28d700 1 -- 172.21.15.5:0/3063944486 wait complete. 2023-10-08T13:04:24.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:04:24.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 -- 172.21.15.5:0/2000263910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 msgr2=0x7f5e88101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 --2- 172.21.15.5:0/2000263910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e88101bc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009990 tx=0x7f5e78009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 -- 172.21.15.5:0/2000263910 shutdown_connections 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 --2- 172.21.15.5:0/2000263910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8810ac00 0x7f5e8810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 --2- 172.21.15.5:0/2000263910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e88101bc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 --2- 172.21.15.5:0/2000263910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e88102100 0x7f5e8810a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 -- 172.21.15.5:0/2000263910 >> 172.21.15.5:0/2000263910 conn(0x7f5e880fafc0 msgr2=0x7f5e880fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 -- 172.21.15.5:0/2000263910 shutdown_connections 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.295+0000 7f5e9059b700 1 -- 172.21.15.5:0/2000263910 wait complete. 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 Processor -- start 2023-10-08T13:04:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 -- start start 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e8819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e88102100 0x7f5e8819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8810ac00 0x7f5e88196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88196ed0 con 0x7f5e881017e0 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88197040 con 0x7f5e8810ac00 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e9059b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88197200 con 0x7f5e88102100 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e8819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e8819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60892/0 (socket says 172.21.15.5:60892) 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 -- 172.21.15.5:0/4083246227 learned_addr learned my addr 172.21.15.5:0/4083246227 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8eb38700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8810ac00 0x7f5e88196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8db36700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e88102100 0x7f5e8819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 -- 172.21.15.5:0/4083246227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e88102100 msgr2=0x7f5e8819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e88102100 0x7f5e8819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 -- 172.21.15.5:0/4083246227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8810ac00 msgr2=0x7f5e88196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8810ac00 0x7f5e88196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.296+0000 7f5e8e337700 1 -- 172.21.15.5:0/4083246227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780095f0 con 0x7f5e881017e0 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.297+0000 7f5e8e337700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e8819c6e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800f6a0 tx=0x7f5e7800f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.297+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7801d070 con 0x7f5e881017e0 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.297+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e78022470 con 0x7f5e881017e0 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.297+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e88197480 con 0x7f5e881017e0 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.297+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78017650 con 0x7f5e881017e0 2023-10-08T13:04:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.297+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e881a36d0 con 0x7f5e881017e0 2023-10-08T13:04:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.298+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e88105d30 con 0x7f5e881017e0 2023-10-08T13:04:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.299+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5e7800fb40 con 0x7f5e881017e0 2023-10-08T13:04:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.300+0000 7f5e7f7fe700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e740a1550 0x7f5e740a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.300+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5e780ce430 con 0x7f5e881017e0 2023-10-08T13:04:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.300+0000 7f5e8db36700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e740a1550 0x7f5e740a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.300+0000 7f5e8db36700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e740a1550 0x7f5e740a3a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e88197c30 tx=0x7f5e8400a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.303+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e78097850 con 0x7f5e881017e0 2023-10-08T13:04:24.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:24 smithi060 ceph-mon[103190]: pgmap v248: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2023-10-08T13:04:24.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:24 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/834937609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:24 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/469953963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:24 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3063944486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:24 smithi005 ceph-mon[99496]: pgmap v248: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2023-10-08T13:04:24.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:24 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/834937609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:24 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/469953963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:24 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3063944486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.503+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5e88197cd0 con 0x7f5e881017e0 2023-10-08T13:04:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.504+0000 7f5e7f7fe700 1 -- 172.21.15.5:0/4083246227 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5e78027020 con 0x7f5e881017e0 2023-10-08T13:04:24.504 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:04:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e740a1550 msgr2=0x7f5e740a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e740a1550 0x7f5e740a3a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e88197c30 tx=0x7f5e8400a2d0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 msgr2=0x7f5e8819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e8819c6e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800f6a0 tx=0x7f5e7800f6d0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 shutdown_connections 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e740a1550 0x7f5e740a3a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e8810ac00 0x7f5e88196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e881017e0 0x7f5e8819c6e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 --2- 172.21.15.5:0/4083246227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e88102100 0x7f5e8819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 >> 172.21.15.5:0/4083246227 conn(0x7f5e880fafc0 msgr2=0x7f5e880fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 shutdown_connections 2023-10-08T13:04:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.506+0000 7f5e9059b700 1 -- 172.21.15.5:0/4083246227 wait complete. 2023-10-08T13:04:24.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:04:24.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:24 smithi118 ceph-mon[104234]: pgmap v248: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 3 op/s 2023-10-08T13:04:24.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:24 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/834937609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:24 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/469953963' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:24 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3063944486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 -- 172.21.15.5:0/2205990905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 msgr2=0x7fca8410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 --2- 172.21.15.5:0/2205990905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca8410d500 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00b0d0 tx=0x7fca7c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 -- 172.21.15.5:0/2205990905 shutdown_connections 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 --2- 172.21.15.5:0/2205990905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca8410d500 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 --2- 172.21.15.5:0/2205990905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca84106640 0x7fca84106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 --2- 172.21.15.5:0/2205990905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca840feb80 0x7fca840ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 -- 172.21.15.5:0/2205990905 >> 172.21.15.5:0/2205990905 conn(0x7fca84075b10 msgr2=0x7fca840fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 -- 172.21.15.5:0/2205990905 shutdown_connections 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.646+0000 7fca8be55700 1 -- 172.21.15.5:0/2205990905 wait complete. 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 Processor -- start 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 -- start start 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca840feb80 0x7fca840ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca841002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca84106640 0x7fca841007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca841a4f70 con 0x7fca840ff540 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca841a50e0 con 0x7fca840feb80 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca8be55700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca841a52a0 con 0x7fca84106640 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca893f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca841002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca893f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca841002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60908/0 (socket says 172.21.15.5:60908) 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca893f0700 1 -- 172.21.15.5:0/3468012852 learned_addr learned my addr 172.21.15.5:0/3468012852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.647+0000 7fca89bf1700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca840feb80 0x7fca840ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca893f0700 1 -- 172.21.15.5:0/3468012852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca84106640 msgr2=0x7fca841007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca893f0700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca84106640 0x7fca841007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca893f0700 1 -- 172.21.15.5:0/3468012852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca840feb80 msgr2=0x7fca840ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca893f0700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca840feb80 0x7fca840ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca893f0700 1 -- 172.21.15.5:0/3468012852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009d00 con 0x7fca840ff540 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca893f0700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca841002a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca8000d950 tx=0x7fca8000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80009940 con 0x7fca840ff540 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca80010460 con 0x7fca840ff540 2023-10-08T13:04:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000f620 con 0x7fca840ff540 2023-10-08T13:04:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca841a5580 con 0x7fca840ff540 2023-10-08T13:04:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.648+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca841a5a40 con 0x7fca840ff540 2023-10-08T13:04:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.649+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca84108c30 con 0x7fca840ff540 2023-10-08T13:04:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.650+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fca800108d0 con 0x7fca840ff540 2023-10-08T13:04:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.651+0000 7fca7affd700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca700a14d0 0x7fca700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.651+0000 7fca89bf1700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca700a14d0 0x7fca700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.651+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fca800ccf00 con 0x7fca840ff540 2023-10-08T13:04:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.651+0000 7fca89bf1700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca700a14d0 0x7fca700a3990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca74005950 tx=0x7fca7400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:24.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.655+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fca80096230 con 0x7fca840ff540 2023-10-08T13:04:24.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.873+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca84101f20 con 0x7fca840ff540 2023-10-08T13:04:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.873+0000 7fca7affd700 1 -- 172.21.15.5:0/3468012852 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v87) v1 ==== 81+0+864 (secure 0 0 0) 0x7fca80020370 con 0x7fca840ff540 2023-10-08T13:04:24.873 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1305686479 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:24.873 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3348591021 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/13143194 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/13143194 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1012844185 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3669045265 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/734152753 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1953950903 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1305686479 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3309153845 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/735752727 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/632293354 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:24.874 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4243429015 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:24.875 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/632293354 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:24.875 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/363889719 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca700a14d0 msgr2=0x7fca700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca700a14d0 0x7fca700a3990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca74005950 tx=0x7fca7400b410 comp rx=0 tx=0).stop 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 msgr2=0x7fca841002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca841002a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca8000d950 tx=0x7fca8000dc60 comp rx=0 tx=0).stop 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 shutdown_connections 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca700a14d0 0x7fca700a3990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca84106640 0x7fca841007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca840feb80 0x7fca840ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 --2- 172.21.15.5:0/3468012852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca840ff540 0x7fca841002a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 >> 172.21.15.5:0/3468012852 conn(0x7fca84075b10 msgr2=0x7fca840fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.875+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 shutdown_connections 2023-10-08T13:04:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:24.876+0000 7fca8be55700 1 -- 172.21.15.5:0/3468012852 wait complete. 2023-10-08T13:04:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:listed 15 entries 2023-10-08T13:04:24.887 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:04:24.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:04:24.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 -- 172.21.15.5:0/3837216909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 msgr2=0x7f5fe01059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/3837216909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe01059f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0099c0 tx=0x7f5fdc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 -- 172.21.15.5:0/3837216909 shutdown_connections 2023-10-08T13:04:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/3837216909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 0x7f5fe010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/3837216909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe01059f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/3837216909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00ff550 0x7f5fe00ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 -- 172.21.15.5:0/3837216909 >> 172.21.15.5:0/3837216909 conn(0x7f5fe00fb040 msgr2=0x7f5fe00fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 -- 172.21.15.5:0/3837216909 shutdown_connections 2023-10-08T13:04:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.072+0000 7f5fe81c0700 1 -- 172.21.15.5:0/3837216909 wait complete. 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 Processor -- start 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 -- start start 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00ff550 0x7f5fe019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 0x7f5fe019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe0196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0196e90 con 0x7f5fe0105610 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0197000 con 0x7f5fe00fff10 2023-10-08T13:04:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe81c0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01971c0 con 0x7f5fe00ff550 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe0196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe0196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60924/0 (socket says 172.21.15.5:60924) 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 -- 172.21.15.5:0/1171486598 learned_addr learned my addr 172.21.15.5:0/1171486598 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe5f5c700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00ff550 0x7f5fe019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe575b700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 0x7f5fe019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 -- 172.21.15.5:0/1171486598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00ff550 msgr2=0x7f5fe019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00ff550 0x7f5fe019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 -- 172.21.15.5:0/1171486598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 msgr2=0x7f5fe019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 0x7f5fe019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe675d700 1 -- 172.21.15.5:0/1171486598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0095f0 con 0x7f5fe0105610 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.073+0000 7f5fe575b700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 0x7f5fe019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.074+0000 7f5fe675d700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe0196820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007d70 tx=0x7f5fd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.074+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800ad40 con 0x7f5fe0105610 2023-10-08T13:04:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.074+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fd80128e0 con 0x7f5fe0105610 2023-10-08T13:04:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.074+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe01974a0 con 0x7f5fe0105610 2023-10-08T13:04:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.074+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80116b0 con 0x7f5fe0105610 2023-10-08T13:04:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.074+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe01a36e0 con 0x7f5fe0105610 2023-10-08T13:04:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.075+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0100c70 con 0x7f5fe0105610 2023-10-08T13:04:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.076+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5fd8012420 con 0x7f5fe0105610 2023-10-08T13:04:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.076+0000 7f5fd6ffd700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fcc0a14d0 0x7f5fcc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.076+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5fd80cd2a0 con 0x7f5fe0105610 2023-10-08T13:04:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.076+0000 7f5fe5f5c700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fcc0a14d0 0x7f5fcc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.077+0000 7f5fe5f5c700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fcc0a14d0 0x7f5fcc0a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009990 tx=0x7f5fdc003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.081+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5fd8096630 con 0x7f5fe0105610 2023-10-08T13:04:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.287+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fe010f470 con 0x7f5fe0105610 2023-10-08T13:04:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.289+0000 7f5fd6ffd700 1 -- 172.21.15.5:0/1171486598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7f5fd8099c50 con 0x7f5fe0105610 2023-10-08T13:04:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:25.289 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fcc0a14d0 msgr2=0x7f5fcc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fcc0a14d0 0x7f5fcc0a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009990 tx=0x7f5fdc003680 comp rx=0 tx=0).stop 2023-10-08T13:04:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 msgr2=0x7f5fe0196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe0196820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007d70 tx=0x7f5fd800a340 comp rx=0 tx=0).stop 2023-10-08T13:04:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 shutdown_connections 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fcc0a14d0 0x7f5fcc0a3990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fe0105610 0x7f5fe0196820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe00ff550 0x7f5fe019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 --2- 172.21.15.5:0/1171486598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5fe00fff10 0x7f5fe019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 >> 172.21.15.5:0/1171486598 conn(0x7f5fe00fb040 msgr2=0x7f5fe0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 shutdown_connections 2023-10-08T13:04:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.291+0000 7f5fe81c0700 1 -- 172.21.15.5:0/1171486598 wait complete. 2023-10-08T13:04:25.304 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:04:25.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:04:25.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4083246227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:04:25.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3468012852' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 -- 172.21.15.5:0/1170771214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb40ff560 msgr2=0x7f8bb40ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 --2- 172.21.15.5:0/1170771214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb40ff560 0x7f8bb40ff9e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40099c0 tx=0x7f8ba4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 -- 172.21.15.5:0/1170771214 shutdown_connections 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 --2- 172.21.15.5:0/1170771214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb40fff20 0x7f8bb410c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 --2- 172.21.15.5:0/1170771214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bb4105620 0x7f8bb4105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 --2- 172.21.15.5:0/1170771214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb40ff560 0x7f8bb40ff9e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 -- 172.21.15.5:0/1170771214 >> 172.21.15.5:0/1170771214 conn(0x7f8bb4075a40 msgr2=0x7f8bb4075e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 -- 172.21.15.5:0/1170771214 shutdown_connections 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.433+0000 7f8bbb943700 1 -- 172.21.15.5:0/1170771214 wait complete. 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 Processor -- start 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 -- start start 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bb40ff560 0x7f8bb419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb40fff20 0x7f8bb419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 0x7f8bb41968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41970a0 con 0x7f8bb4105620 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4197210 con 0x7f8bb40ff560 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bbb943700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41973d0 con 0x7f8bb40fff20 2023-10-08T13:04:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 0x7f8bb41968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 0x7f8bb41968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60938/0 (socket says 172.21.15.5:60938) 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 -- 172.21.15.5:0/3425453141 learned_addr learned my addr 172.21.15.5:0/3425453141 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb96df700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bb40ff560 0x7f8bb419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb8ede700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb40fff20 0x7f8bb419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 -- 172.21.15.5:0/3425453141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb40fff20 msgr2=0x7f8bb419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb40fff20 0x7f8bb419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 -- 172.21.15.5:0/3425453141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bb40ff560 msgr2=0x7f8bb419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bb40ff560 0x7f8bb419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 -- 172.21.15.5:0/3425453141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba40095f0 con 0x7f8bb4105620 2023-10-08T13:04:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.434+0000 7f8bb9ee0700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 0x7f8bb41968d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8bac007ee0 tx=0x7f8bac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.435+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac017070 con 0x7f8bb4105620 2023-10-08T13:04:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.435+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bac00f040 con 0x7f8bb4105620 2023-10-08T13:04:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.435+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb41976b0 con 0x7f8bb4105620 2023-10-08T13:04:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.435+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac005580 con 0x7f8bb4105620 2023-10-08T13:04:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.435+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41a37b0 con 0x7f8bb4105620 2023-10-08T13:04:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.436+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4100c80 con 0x7f8bb4105620 2023-10-08T13:04:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.437+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f8bac00db20 con 0x7f8bb4105620 2023-10-08T13:04:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.437+0000 7f8baa7fc700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8ba00a14d0 0x7f8ba00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.437+0000 7f8bb96df700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8ba00a14d0 0x7f8ba00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.437+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f8bac0cce00 con 0x7f8bb4105620 2023-10-08T13:04:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.438+0000 7f8bb96df700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8ba00a14d0 0x7f8ba00a3990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0005950 tx=0x7f8bb000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:25.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.441+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8bac096190 con 0x7f8bb4105620 2023-10-08T13:04:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4083246227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:04:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3468012852' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:04:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.641+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bb410f480 con 0x7f8bb4105620 2023-10-08T13:04:25.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.641+0000 7f8baa7fc700 1 -- 172.21.15.5:0/3425453141 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bac0997b0 con 0x7f8bb4105620 2023-10-08T13:04:25.642 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8ba00a14d0 msgr2=0x7f8ba00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8ba00a14d0 0x7f8ba00a3990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0005950 tx=0x7f8bb000b410 comp rx=0 tx=0).stop 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 msgr2=0x7f8bb41968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 0x7f8bb41968d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8bac007ee0 tx=0x7f8bac00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 shutdown_connections 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8ba00a14d0 0x7f8ba00a3990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bb4105620 0x7f8bb41968d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bb40ff560 0x7f8bb419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 --2- 172.21.15.5:0/3425453141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bb40fff20 0x7f8bb419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 >> 172.21.15.5:0/3425453141 conn(0x7f8bb4075a40 msgr2=0x7f8bb40fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 shutdown_connections 2023-10-08T13:04:25.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.644+0000 7f8bbb943700 1 -- 172.21.15.5:0/3425453141 wait complete. 2023-10-08T13:04:25.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:04:25.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4083246227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:04:25.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3468012852' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:04:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 -- 172.21.15.5:0/707839499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4101840 msgr2=0x7f91d4101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 --2- 172.21.15.5:0/707839499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4101840 0x7f91d4101c20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009990 tx=0x7f91d0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 -- 172.21.15.5:0/707839499 shutdown_connections 2023-10-08T13:04:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 --2- 172.21.15.5:0/707839499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d410ac10 0x7f91d410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 --2- 172.21.15.5:0/707839499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4101840 0x7f91d4101c20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 --2- 172.21.15.5:0/707839499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91d4102160 0x7f91d410a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 -- 172.21.15.5:0/707839499 >> 172.21.15.5:0/707839499 conn(0x7f91d40fafc0 msgr2=0x7f91d40fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:25.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 -- 172.21.15.5:0/707839499 shutdown_connections 2023-10-08T13:04:25.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.786+0000 7f91db721700 1 -- 172.21.15.5:0/707839499 wait complete. 2023-10-08T13:04:25.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.787+0000 7f91db721700 1 Processor -- start 2023-10-08T13:04:25.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.787+0000 7f91db721700 1 -- start start 2023-10-08T13:04:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d4101840 0x7f91d419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 0x7f91d419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91d410ac10 0x7f91d4196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4196fe0 con 0x7f91d4102160 2023-10-08T13:04:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4197150 con 0x7f91d4101840 2023-10-08T13:04:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4197310 con 0x7f91d410ac10 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 0x7f91d419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 0x7f91d419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60954/0 (socket says 172.21.15.5:60954) 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 -- 172.21.15.5:0/4184716739 learned_addr learned my addr 172.21.15.5:0/4184716739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d94bd700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d4101840 0x7f91d419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d9cbe700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91d410ac10 0x7f91d4196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 -- 172.21.15.5:0/4184716739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91d410ac10 msgr2=0x7f91d4196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91d410ac10 0x7f91d4196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 -- 172.21.15.5:0/4184716739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d4101840 msgr2=0x7f91d419c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d4101840 0x7f91d419c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 -- 172.21.15.5:0/4184716739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00095f0 con 0x7f91d4102160 2023-10-08T13:04:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91d8cbc700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 0x7f91d419cd40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91c800e9a0 tx=0x7f91c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8009790 con 0x7f91d4102160 2023-10-08T13:04:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91c8010430 con 0x7f91d4102160 2023-10-08T13:04:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d41975f0 con 0x7f91d4102160 2023-10-08T13:04:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8018680 con 0x7f91d4102160 2023-10-08T13:04:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.788+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d41a37f0 con 0x7f91d4102160 2023-10-08T13:04:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.789+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d4105d90 con 0x7f91d4102160 2023-10-08T13:04:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.791+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f91c80105a0 con 0x7f91d4102160 2023-10-08T13:04:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.791+0000 7f91c67fc700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f91c00a14d0 0x7f91c00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.792+0000 7f91d94bd700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f91c00a14d0 0x7f91c00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.792+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f91c8014070 con 0x7f91d4102160 2023-10-08T13:04:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.792+0000 7f91d94bd700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f91c00a14d0 0x7f91c00a3990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b2e0 tx=0x7f91d0005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.795+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f91c8096760 con 0x7f91d4102160 2023-10-08T13:04:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.997+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91d4197df0 con 0x7f91d4102160 2023-10-08T13:04:25.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:25.998+0000 7f91c67fc700 1 -- 172.21.15.5:0/4184716739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91c8099d80 con 0x7f91d4102160 2023-10-08T13:04:25.998 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f91c00a14d0 msgr2=0x7f91c00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f91c00a14d0 0x7f91c00a3990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b2e0 tx=0x7f91d0005fd0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 msgr2=0x7f91d419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 0x7f91d419cd40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91c800e9a0 tx=0x7f91c800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 shutdown_connections 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f91c00a14d0 0x7f91c00a3990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91d410ac10 0x7f91d4196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d4101840 0x7f91d419c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 --2- 172.21.15.5:0/4184716739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91d4102160 0x7f91d419cd40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 >> 172.21.15.5:0/4184716739 conn(0x7f91d40fafc0 msgr2=0x7f91d40fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 shutdown_connections 2023-10-08T13:04:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.000+0000 7f91db721700 1 -- 172.21.15.5:0/4184716739 wait complete. 2023-10-08T13:04:26.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:04:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/2113522355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e80ff530 msgr2=0x7fe5e80ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/2113522355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e80ff530 0x7fe5e80ff9b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00099c0 tx=0x7fe5d0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/2113522355 shutdown_connections 2023-10-08T13:04:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/2113522355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e80ffef0 0x7fe5e810c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/2113522355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5e81055f0 0x7fe5e81059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/2113522355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e80ff530 0x7fe5e80ff9b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/2113522355 >> 172.21.15.5:0/2113522355 conn(0x7fe5e80fafc0 msgr2=0x7fe5e80fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/2113522355 shutdown_connections 2023-10-08T13:04:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.141+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/2113522355 wait complete. 2023-10-08T13:04:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 Processor -- start 2023-10-08T13:04:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 -- start start 2023-10-08T13:04:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e80ff530 0x7fe5e819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5e80ffef0 0x7fe5e819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 0x7fe5e8196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8196e70 con 0x7fe5e81055f0 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8196fe0 con 0x7fe5e80ffef0 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5ed0ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e81971a0 con 0x7fe5e80ff530 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 0x7fe5e8196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 0x7fe5e8196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60970/0 (socket says 172.21.15.5:60970) 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 -- 172.21.15.5:0/1187217739 learned_addr learned my addr 172.21.15.5:0/1187217739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e659c700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5e80ffef0 0x7fe5e819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e6d9d700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e80ff530 0x7fe5e819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 -- 172.21.15.5:0/1187217739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e80ff530 msgr2=0x7fe5e819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e80ff530 0x7fe5e819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 -- 172.21.15.5:0/1187217739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5e80ffef0 msgr2=0x7fe5e819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.142+0000 7fe5e759e700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5e80ffef0 0x7fe5e819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5e759e700 1 -- 172.21.15.5:0/1187217739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d00095f0 con 0x7fe5e81055f0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5e759e700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 0x7fe5e8196800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0007ee0 tx=0x7fe5e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0017070 con 0x7fe5e81055f0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e8197480 con 0x7fe5e81055f0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5e000f040 con 0x7fe5e81055f0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0005580 con 0x7fe5e81055f0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.143+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e81a36c0 con 0x7fe5e81055f0 2023-10-08T13:04:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.144+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e8107a90 con 0x7fe5e81055f0 2023-10-08T13:04:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.145+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fe5e000db20 con 0x7fe5e81055f0 2023-10-08T13:04:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.146+0000 7fe5dffff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5d40a14d0 0x7fe5d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.146+0000 7fe5e6d9d700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5d40a14d0 0x7fe5d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.146+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fe5e00cce60 con 0x7fe5e81055f0 2023-10-08T13:04:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.146+0000 7fe5e6d9d700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5d40a14d0 0x7fe5d40a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800ac50 tx=0x7fe5d800a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.149+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe5e0096190 con 0x7fe5e81055f0 2023-10-08T13:04:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.350+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5e8100c50 con 0x7fe5e81055f0 2023-10-08T13:04:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.350+0000 7fe5dffff700 1 -- 172.21.15.5:0/1187217739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5e00997b0 con 0x7fe5e81055f0 2023-10-08T13:04:26.350 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:04:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5d40a14d0 msgr2=0x7fe5d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5d40a14d0 0x7fe5d40a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800ac50 tx=0x7fe5d800a380 comp rx=0 tx=0).stop 2023-10-08T13:04:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 msgr2=0x7fe5e8196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 0x7fe5e8196800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0007ee0 tx=0x7fe5e000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 shutdown_connections 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5d40a14d0 0x7fe5d40a3990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e81055f0 0x7fe5e8196800 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5e80ff530 0x7fe5e819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 --2- 172.21.15.5:0/1187217739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5e80ffef0 0x7fe5e819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 >> 172.21.15.5:0/1187217739 conn(0x7fe5e80fafc0 msgr2=0x7fe5e80fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 shutdown_connections 2023-10-08T13:04:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.352+0000 7fe5ed0ff700 1 -- 172.21.15.5:0/1187217739 wait complete. 2023-10-08T13:04:26.363 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:26 smithi005 ceph-mon[99496]: pgmap v249: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2023-10-08T13:04:26.363 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:26 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1171486598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:26.363 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:26 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3425453141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:26.364 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:26 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4184716739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:04:26.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:04:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 -- 172.21.15.5:0/3762900194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 msgr2=0x7f80fc100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 --2- 172.21.15.5:0/3762900194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc100ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009990 tx=0x7f80e8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 -- 172.21.15.5:0/3762900194 shutdown_connections 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 --2- 172.21.15.5:0/3762900194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80fc101000 0x7f80fc10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 --2- 172.21.15.5:0/3762900194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc106650 0x7f80fc106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 --2- 172.21.15.5:0/3762900194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc100ac0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 -- 172.21.15.5:0/3762900194 >> 172.21.15.5:0/3762900194 conn(0x7f80fc0fc110 msgr2=0x7f80fc0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 -- 172.21.15.5:0/3762900194 shutdown_connections 2023-10-08T13:04:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.493+0000 7f810322f700 1 -- 172.21.15.5:0/3762900194 wait complete. 2023-10-08T13:04:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 Processor -- start 2023-10-08T13:04:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 -- start start 2023-10-08T13:04:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc101000 0x7f80fc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80fc106650 0x7f80fc196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc196f70 con 0x7f80fc100640 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1970e0 con 0x7f80fc101000 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f810322f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1972a0 con 0x7f80fc106650 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f8100fcb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f8100fcb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc19c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60982/0 (socket says 172.21.15.5:60982) 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f8100fcb700 1 -- 172.21.15.5:0/1925538060 learned_addr learned my addr 172.21.15.5:0/1925538060 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f81017cc700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80fc106650 0x7f80fc196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.494+0000 7f80fbfff700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc101000 0x7f80fc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f8100fcb700 1 -- 172.21.15.5:0/1925538060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80fc106650 msgr2=0x7f80fc196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f8100fcb700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80fc106650 0x7f80fc196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f8100fcb700 1 -- 172.21.15.5:0/1925538060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc101000 msgr2=0x7f80fc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f8100fcb700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc101000 0x7f80fc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f8100fcb700 1 -- 172.21.15.5:0/1925538060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80095f0 con 0x7f80fc100640 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f80fbfff700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc101000 0x7f80fc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f8100fcb700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc19c790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80f000d950 tx=0x7f80f000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0009b40 con 0x7f80fc100640 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80f0009ca0 con 0x7f80fc100640 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc197580 con 0x7f80fc100640 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f000f620 con 0x7f80fc100640 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.495+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc1a3780 con 0x7f80fc100640 2023-10-08T13:04:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.496+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc108bd0 con 0x7f80fc100640 2023-10-08T13:04:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.497+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f80f0010460 con 0x7f80fc100640 2023-10-08T13:04:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.497+0000 7f80f9ffb700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f80ec0a14d0 0x7f80ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.498+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f80f00cd3a0 con 0x7f80fc100640 2023-10-08T13:04:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.498+0000 7f80fbfff700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f80ec0a14d0 0x7f80ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.498+0000 7f80fbfff700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f80ec0a14d0 0x7f80ec0a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f80e800b5c0 tx=0x7f80e8005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.502+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f80f00966d0 con 0x7f80fc100640 2023-10-08T13:04:26.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:26 smithi118 ceph-mon[104234]: pgmap v249: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2023-10-08T13:04:26.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:26 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1171486598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:26.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:26 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3425453141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:26.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:26 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4184716739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:04:26.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:26 smithi060 ceph-mon[103190]: pgmap v249: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2023-10-08T13:04:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:26 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1171486598' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:26 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3425453141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:04:26.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:26 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4184716739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:04:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.702+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f80fc197d80 con 0x7f80fc100640 2023-10-08T13:04:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.703+0000 7f80f9ffb700 1 -- 172.21.15.5:0/1925538060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f80f0099cf0 con 0x7f80fc100640 2023-10-08T13:04:26.703 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:04:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f80ec0a14d0 msgr2=0x7f80ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f80ec0a14d0 0x7f80ec0a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f80e800b5c0 tx=0x7f80e8005fb0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 msgr2=0x7f80fc19c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc19c790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80f000d950 tx=0x7f80f000dd10 comp rx=0 tx=0).stop 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 shutdown_connections 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f80ec0a14d0 0x7f80ec0a3990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80fc106650 0x7f80fc196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80fc100640 0x7f80fc19c790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 --2- 172.21.15.5:0/1925538060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80fc101000 0x7f80fc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 >> 172.21.15.5:0/1925538060 conn(0x7f80fc0fc110 msgr2=0x7f80fc0fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.705+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 shutdown_connections 2023-10-08T13:04:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.706+0000 7f810322f700 1 -- 172.21.15.5:0/1925538060 wait complete. 2023-10-08T13:04:26.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:04:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 -- 172.21.15.5:0/4282125763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e10105630 msgr2=0x7f3e10105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 --2- 172.21.15.5:0/4282125763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e10105630 0x7f3e10105a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0099c0 tx=0x7f3e0c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 -- 172.21.15.5:0/4282125763 shutdown_connections 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 --2- 172.21.15.5:0/4282125763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100fff30 0x7f3e1010c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 --2- 172.21.15.5:0/4282125763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e10105630 0x7f3e10105a10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 --2- 172.21.15.5:0/4282125763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100ff570 0x7f3e100ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 -- 172.21.15.5:0/4282125763 >> 172.21.15.5:0/4282125763 conn(0x7f3e100fb020 msgr2=0x7f3e100fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 -- 172.21.15.5:0/4282125763 shutdown_connections 2023-10-08T13:04:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.847+0000 7f3e17354700 1 -- 172.21.15.5:0/4282125763 wait complete. 2023-10-08T13:04:26.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 Processor -- start 2023-10-08T13:04:26.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 -- start start 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 0x7f3e10197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100fff30 0x7f3e10197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e10105630 0x7f3e101a2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10198690 con 0x7f3e100ff570 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101a2dd0 con 0x7f3e100fff30 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e17354700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101a2f90 con 0x7f3e10105630 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.848+0000 7f3e150f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 0x7f3e10197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 0x7f3e10197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60996/0 (socket says 172.21.15.5:60996) 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 -- 172.21.15.5:0/3788168948 learned_addr learned my addr 172.21.15.5:0/3788168948 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e148ef700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100fff30 0x7f3e10197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e158f1700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e10105630 0x7f3e101a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 -- 172.21.15.5:0/3788168948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e10105630 msgr2=0x7f3e101a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e10105630 0x7f3e101a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 -- 172.21.15.5:0/3788168948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100fff30 msgr2=0x7f3e10197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100fff30 0x7f3e10197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 -- 172.21.15.5:0/3788168948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c0095f0 con 0x7f3e100ff570 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e148ef700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100fff30 0x7f3e10197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e150f0700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 0x7f3e10197810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0098e0 tx=0x7f3e0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c01d070 con 0x7f3e100ff570 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e0c00fcb0 con 0x7f3e100ff570 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e101a3210 con 0x7f3e100ff570 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c022e40 con 0x7f3e100ff570 2023-10-08T13:04:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.849+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e101a3630 con 0x7f3e100ff570 2023-10-08T13:04:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.850+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e10107ab0 con 0x7f3e100ff570 2023-10-08T13:04:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.852+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f3e0c022570 con 0x7f3e100ff570 2023-10-08T13:04:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.852+0000 7f3e067fc700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dfc0a14d0 0x7f3dfc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.852+0000 7f3e148ef700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dfc0a14d0 0x7f3dfc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.852+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f3e0c0ce740 con 0x7f3e100ff570 2023-10-08T13:04:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.853+0000 7f3e148ef700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dfc0a14d0 0x7f3dfc0a3990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e100690a0 tx=0x7f3e00005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:26.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:26.856+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e0c097b60 con 0x7f3e100ff570 2023-10-08T13:04:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.075+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e10100c90 con 0x7f3e100ff570 2023-10-08T13:04:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.075+0000 7f3e067fc700 1 -- 172.21.15.5:0/3788168948 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v87) v1 ==== 81+0+864 (secure 0 0 0) 0x7f3e0c09b180 con 0x7f3e100ff570 2023-10-08T13:04:27.077 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1305686479 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:27.077 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3348591021 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:27.077 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/13143194 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/13143194 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1012844185 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3669045265 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/734152753 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1953950903 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:27.078 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1305686479 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:27.079 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3309153845 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:27.079 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/735752727 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:27.079 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/632293354 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:27.079 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4243429015 2023-10-09T12:58:37.011176+0000 2023-10-08T13:04:27.079 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/632293354 2023-10-09T12:57:01.763270+0000 2023-10-08T13:04:27.079 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/363889719 2023-10-09T12:57:28.615187+0000 2023-10-08T13:04:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dfc0a14d0 msgr2=0x7f3dfc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dfc0a14d0 0x7f3dfc0a3990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e100690a0 tx=0x7f3e00005f50 comp rx=0 tx=0).stop 2023-10-08T13:04:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 msgr2=0x7f3e10197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 0x7f3e10197810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0098e0 tx=0x7f3e0c0057f0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 shutdown_connections 2023-10-08T13:04:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dfc0a14d0 0x7f3dfc0a3990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e10105630 0x7f3e101a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e100ff570 0x7f3e10197810 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 --2- 172.21.15.5:0/3788168948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100fff30 0x7f3e10197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 >> 172.21.15.5:0/3788168948 conn(0x7f3e100fb020 msgr2=0x7f3e100fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 shutdown_connections 2023-10-08T13:04:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.078+0000 7f3e17354700 1 -- 172.21.15.5:0/3788168948 wait complete. 2023-10-08T13:04:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:listed 15 entries 2023-10-08T13:04:27.091 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2023-10-08T13:04:27.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:27.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:04:27.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[161592]: fuse finished with error 0 and tester_r 0 2023-10-08T13:04:27.138 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:04:27.153 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:04:27.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:04:27.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-08T13:04:27.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 -- 172.21.15.5:0/1745322941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 msgr2=0x7fb80410c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 --2- 172.21.15.5:0/1745322941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb80410c430 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00b0d0 tx=0x7fb7fc00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 -- 172.21.15.5:0/1745322941 shutdown_connections 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 --2- 172.21.15.5:0/1745322941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb80410c430 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 --2- 172.21.15.5:0/1745322941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8041056b0 0x7fb804105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 --2- 172.21.15.5:0/1745322941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8040ffca0 0x7fb804100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 -- 172.21.15.5:0/1745322941 >> 172.21.15.5:0/1745322941 conn(0x7fb804075b20 msgr2=0x7fb8040fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 -- 172.21.15.5:0/1745322941 shutdown_connections 2023-10-08T13:04:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 -- 172.21.15.5:0/1745322941 wait complete. 2023-10-08T13:04:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 Processor -- start 2023-10-08T13:04:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.381+0000 7fb809d61700 1 -- start start 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb809d61700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8040ffca0 0x7fb804101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb809d61700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb804101740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb809d61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8041056b0 0x7fb804101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb809d61700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041a4f10 con 0x7fb804100660 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb809d61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041a5080 con 0x7fb8041056b0 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb809d61700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041a5240 con 0x7fb8040ffca0 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb804101740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb804101740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32780/0 (socket says 172.21.15.5:32780) 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 -- 172.21.15.5:0/3414957405 learned_addr learned my addr 172.21.15.5:0/3414957405 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb8037fe700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8040ffca0 0x7fb804101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb803fff700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8041056b0 0x7fb804101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 -- 172.21.15.5:0/3414957405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8040ffca0 msgr2=0x7fb804101200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8040ffca0 0x7fb804101200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 -- 172.21.15.5:0/3414957405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8041056b0 msgr2=0x7fb804101c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8041056b0 0x7fb804101c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 -- 172.21.15.5:0/3414957405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009d00 con 0x7fb804100660 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.382+0000 7fb802ffd700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb804101740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800d950 tx=0x7fb7f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.383+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8009940 con 0x7fb804100660 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.383+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7f8010460 con 0x7fb804100660 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.383+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800f620 con 0x7fb804100660 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.383+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8041a5520 con 0x7fb804100660 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.383+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041a5a30 con 0x7fb804100660 2023-10-08T13:04:27.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.384+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb804100cb0 con 0x7fb804100660 2023-10-08T13:04:27.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.385+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb7f80108d0 con 0x7fb804100660 2023-10-08T13:04:27.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.385+0000 7fb800ff9700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb7ec0a1550 0x7fb7ec0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.385+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fb7f80cce00 con 0x7fb804100660 2023-10-08T13:04:27.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.385+0000 7fb8037fe700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb7ec0a1550 0x7fb7ec0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.386+0000 7fb8037fe700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb7ec0a1550 0x7fb7ec0a3a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb804072c50 tx=0x7fb7f400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:27.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.390+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb7f8096190 con 0x7fb804100660 2023-10-08T13:04:27.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:27 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1187217739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:04:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:27 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1925538060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:04:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:27 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3788168948' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:04:27.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:27 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1187217739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:04:27.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:27 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1925538060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:04:27.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:27 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3788168948' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:04:27.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.595+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb80410f4a0 con 0x7fb804100660 2023-10-08T13:04:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.597+0000 7fb800ff9700 1 -- 172.21.15.5:0/3414957405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7fb7f8016090 con 0x7fb804100660 2023-10-08T13:04:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:27.598 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb7ec0a1550 msgr2=0x7fb7ec0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb7ec0a1550 0x7fb7ec0a3a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb804072c50 tx=0x7fb7f400a380 comp rx=0 tx=0).stop 2023-10-08T13:04:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 msgr2=0x7fb804101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb804101740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800d950 tx=0x7fb7f800dc60 comp rx=0 tx=0).stop 2023-10-08T13:04:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 shutdown_connections 2023-10-08T13:04:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb7ec0a1550 0x7fb7ec0a3a10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8041056b0 0x7fb804101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8040ffca0 0x7fb804101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 --2- 172.21.15.5:0/3414957405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb804100660 0x7fb804101740 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 >> 172.21.15.5:0/3414957405 conn(0x7fb804075b20 msgr2=0x7fb8040fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 shutdown_connections 2023-10-08T13:04:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.599+0000 7fb809d61700 1 -- 172.21.15.5:0/3414957405 wait complete. 2023-10-08T13:04:27.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:27.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:27 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1187217739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:04:27.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:27 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1925538060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:04:27.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:27 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3788168948' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 -- 172.21.15.5:0/976918788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1968105610 msgr2=0x7f19681059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 --2- 172.21.15.5:0/976918788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1968105610 0x7f19681059f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19580099c0 tx=0x7f1958009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 -- 172.21.15.5:0/976918788 shutdown_connections 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 --2- 172.21.15.5:0/976918788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19680fff10 0x7f196810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 --2- 172.21.15.5:0/976918788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1968105610 0x7f19681059f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 --2- 172.21.15.5:0/976918788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19680ff550 0x7f19680ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 -- 172.21.15.5:0/976918788 >> 172.21.15.5:0/976918788 conn(0x7f19680fb040 msgr2=0x7f19680fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 -- 172.21.15.5:0/976918788 shutdown_connections 2023-10-08T13:04:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 -- 172.21.15.5:0/976918788 wait complete. 2023-10-08T13:04:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 Processor -- start 2023-10-08T13:04:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.738+0000 7f196df1c700 1 -- start start 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 0x7f19681011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19680fff10 0x7f1968101700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968105610 0x7f1968101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19681a4ed0 con 0x7f19680ff550 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19681a5040 con 0x7f19680fff10 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19681a5200 con 0x7f1968105610 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 0x7f19681011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 0x7f19681011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32792/0 (socket says 172.21.15.5:32792) 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 -- 172.21.15.5:0/115772389 learned_addr learned my addr 172.21.15.5:0/115772389 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f1967fff700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968105610 0x7f1968101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f1966ffd700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19680fff10 0x7f1968101700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 -- 172.21.15.5:0/115772389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968105610 msgr2=0x7f1968101c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968105610 0x7f1968101c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 -- 172.21.15.5:0/115772389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19680fff10 msgr2=0x7f1968101700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19680fff10 0x7f1968101700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 -- 172.21.15.5:0/115772389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580095f0 con 0x7f19680ff550 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f19677fe700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 0x7f19681011c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f195800b580 tx=0x7f195800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195801c070 con 0x7f19680ff550 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19681a5480 con 0x7f19680ff550 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f195800fd40 con 0x7f19680ff550 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.739+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958022b80 con 0x7f19680ff550 2023-10-08T13:04:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.740+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19681a58a0 con 0x7f19680ff550 2023-10-08T13:04:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.741+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1968100c70 con 0x7f19680ff550 2023-10-08T13:04:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.742+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1958020070 con 0x7f19680ff550 2023-10-08T13:04:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.742+0000 7f1964ff9700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f19500a14d0 0x7f19500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.743+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f19580ce380 con 0x7f19680ff550 2023-10-08T13:04:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.743+0000 7f1966ffd700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f19500a14d0 0x7f19500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.743+0000 7f1966ffd700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f19500a14d0 0x7f19500a3990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19681028f0 tx=0x7f195c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.746+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1958097740 con 0x7f19680ff550 2023-10-08T13:04:27.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.951+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1968067550 con 0x7f19680ff550 2023-10-08T13:04:27.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.953+0000 7f1964ff9700 1 -- 172.21.15.5:0/115772389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7f1958027090 con 0x7f19680ff550 2023-10-08T13:04:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:27.954 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f19500a14d0 msgr2=0x7f19500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f19500a14d0 0x7f19500a3990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19681028f0 tx=0x7f195c009260 comp rx=0 tx=0).stop 2023-10-08T13:04:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 msgr2=0x7f19681011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 0x7f19681011c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f195800b580 tx=0x7f195800bfd0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 shutdown_connections 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f19500a14d0 0x7f19500a3990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1968105610 0x7f1968101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19680ff550 0x7f19681011c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 --2- 172.21.15.5:0/115772389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19680fff10 0x7f1968101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 >> 172.21.15.5:0/115772389 conn(0x7f19680fb040 msgr2=0x7f19680fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 shutdown_connections 2023-10-08T13:04:27.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:27.955+0000 7f196df1c700 1 -- 172.21.15.5:0/115772389 wait complete. 2023-10-08T13:04:27.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T13:04:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 -- 172.21.15.5:0/299026584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63001056a0 msgr2=0x7f6300105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 --2- 172.21.15.5:0/299026584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63001056a0 0x7f6300105a80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f62f00099c0 tx=0x7f62f0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 -- 172.21.15.5:0/299026584 shutdown_connections 2023-10-08T13:04:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 --2- 172.21.15.5:0/299026584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6300100650 0x7f630010c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 --2- 172.21.15.5:0/299026584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63001056a0 0x7f6300105a80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 --2- 172.21.15.5:0/299026584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63000ffc90 0x7f6300100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 -- 172.21.15.5:0/299026584 >> 172.21.15.5:0/299026584 conn(0x7f6300075b10 msgr2=0x7f63000fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 -- 172.21.15.5:0/299026584 shutdown_connections 2023-10-08T13:04:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.097+0000 7f63062d8700 1 -- 172.21.15.5:0/299026584 wait complete. 2023-10-08T13:04:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 Processor -- start 2023-10-08T13:04:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 -- start start 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 0x7f63001956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6300100650 0x7f6300195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63001056a0 0x7f6300196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001a4e70 con 0x7f63000ffc90 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001a4fe0 con 0x7f6300100650 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.098+0000 7f63062d8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001a51a0 con 0x7f63001056a0 2023-10-08T13:04:28.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 0x7f63001956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 0x7f63001956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32806/0 (socket says 172.21.15.5:32806) 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 -- 172.21.15.5:0/3848606267 learned_addr learned my addr 172.21.15.5:0/3848606267 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62ff7fe700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6300100650 0x7f6300195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f6304875700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63001056a0 0x7f6300196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 -- 172.21.15.5:0/3848606267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63001056a0 msgr2=0x7f6300196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63001056a0 0x7f6300196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 -- 172.21.15.5:0/3848606267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6300100650 msgr2=0x7f6300195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6300100650 0x7f6300195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 -- 172.21.15.5:0/3848606267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00095f0 con 0x7f63000ffc90 2023-10-08T13:04:28.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f6304875700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63001056a0 0x7f6300196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fffff700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 0x7f63001956d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009f50 tx=0x7f62f0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f001d070 con 0x7f63000ffc90 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63001a5420 con 0x7f63000ffc90 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62f000fc30 con 0x7f63000ffc90 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0022e70 con 0x7f63000ffc90 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.099+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63001a58a0 con 0x7f63000ffc90 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.100+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6300107b70 con 0x7f63000ffc90 2023-10-08T13:04:28.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.101+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f62f0022570 con 0x7f63000ffc90 2023-10-08T13:04:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.102+0000 7f62fd7fa700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f62e80a14d0 0x7f62e80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.102+0000 7f62ff7fe700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f62e80a14d0 0x7f62e80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.102+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f62f00ce610 con 0x7f63000ffc90 2023-10-08T13:04:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.103+0000 7f62ff7fe700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f62e80a14d0 0x7f62e80a3990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63000ff420 tx=0x7f62f400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.106+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62f0097a30 con 0x7f63000ffc90 2023-10-08T13:04:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:28.360+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f63000ff1c0 con 0x7f63000ffc90 2023-10-08T13:04:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:28 smithi005 ceph-mon[99496]: pgmap v250: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 93 B/s wr, 0 op/s 2023-10-08T13:04:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3414957405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:28.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/115772389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:28.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:28 smithi118 ceph-mon[104234]: pgmap v250: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 93 B/s wr, 0 op/s 2023-10-08T13:04:28.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3414957405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:28.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/115772389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:28.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:28 smithi060 ceph-mon[103190]: pgmap v250: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 93 B/s wr, 0 op/s 2023-10-08T13:04:28.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3414957405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:28.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/115772389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.171+0000 7f62fd7fa700 1 -- 172.21.15.5:0/3848606267 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f62f009b050 con 0x7f63000ffc90 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.174+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f62e80a14d0 msgr2=0x7f62e80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.174+0000 7f63062d8700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f62e80a14d0 0x7f62e80a3990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63000ff420 tx=0x7f62f400a380 comp rx=0 tx=0).stop 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.174+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 msgr2=0x7f63001956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.174+0000 7f63062d8700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 0x7f63001956d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009f50 tx=0x7f62f0004710 comp rx=0 tx=0).stop 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 shutdown_connections 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f62e80a14d0 0x7f62e80a3990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f63001056a0 0x7f6300196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63000ffc90 0x7f63001956d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 --2- 172.21.15.5:0/3848606267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6300100650 0x7f6300195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 >> 172.21.15.5:0/3848606267 conn(0x7f6300075b10 msgr2=0x7f63000fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 shutdown_connections 2023-10-08T13:04:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.175+0000 7f63062d8700 1 -- 172.21.15.5:0/3848606267 wait complete. 2023-10-08T13:04:29.191 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-08T13:04:29.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 -- 172.21.15.5:0/1868391420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 msgr2=0x7f5e3c100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/1868391420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c100110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5e300099c0 tx=0x7f5e30009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 -- 172.21.15.5:0/1868391420 shutdown_connections 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/1868391420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c100650 0x7f5e3c10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/1868391420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c1056a0 0x7f5e3c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/1868391420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c100110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 -- 172.21.15.5:0/1868391420 >> 172.21.15.5:0/1868391420 conn(0x7f5e3c075b10 msgr2=0x7f5e3c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 -- 172.21.15.5:0/1868391420 shutdown_connections 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.326+0000 7f5e40fb4700 1 -- 172.21.15.5:0/1868391420 wait complete. 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 Processor -- start 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 -- start start 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100650 0x7f5e3c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c1056a0 0x7f5e3c1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1a4dc0 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1a4f30 con 0x7f5e3c100650 2023-10-08T13:04:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e40fb4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1a50f0 con 0x7f5e3c1056a0 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32820/0 (socket says 172.21.15.5:32820) 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 -- 172.21.15.5:0/2828367262 learned_addr learned my addr 172.21.15.5:0/2828367262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e39d9b700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100650 0x7f5e3c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3ad9d700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c1056a0 0x7f5e3c1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 -- 172.21.15.5:0/2828367262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c1056a0 msgr2=0x7f5e3c1960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c1056a0 0x7f5e3c1960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 -- 172.21.15.5:0/2828367262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100650 msgr2=0x7f5e3c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100650 0x7f5e3c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3a59c700 1 -- 172.21.15.5:0/2828367262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300095f0 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.327+0000 7f5e3ad9d700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c1056a0 0x7f5e3c1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.328+0000 7f5e3a59c700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c195620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c970 tx=0x7f5e2c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.328+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c004220 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.328+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e2c007d60 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.328+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c1a53d0 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.328+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c003c90 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.328+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c1a58b0 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.329+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c107b70 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.330+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5e2c004380 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.331+0000 7f5e2b7fe700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e240a14d0 0x7f5e240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.331+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5e2c0ccb80 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.331+0000 7f5e39d9b700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e240a14d0 0x7f5e240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.331+0000 7f5e39d9b700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e240a14d0 0x7f5e240a3990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009990 tx=0x7f5e30005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.335+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e2c095f10 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:29 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3848606267' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T13:04:29.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:29 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3848606267' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T13:04:29.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:29.585+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f5e3c0ff1c0 con 0x7f5e3c0ffc90 2023-10-08T13:04:29.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:29 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3848606267' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T13:04:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.117+0000 7f5e2b7fe700 1 -- 172.21.15.5:0/2828367262 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5e2c099530 con 0x7f5e3c0ffc90 2023-10-08T13:04:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e240a14d0 msgr2=0x7f5e240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e240a14d0 0x7f5e240a3990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009990 tx=0x7f5e30005bc0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 msgr2=0x7f5e3c195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c195620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c970 tx=0x7f5e2c00cc80 comp rx=0 tx=0).stop 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 shutdown_connections 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e240a14d0 0x7f5e240a3990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e3c1056a0 0x7f5e3c1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e3c0ffc90 0x7f5e3c195620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 --2- 172.21.15.5:0/2828367262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c100650 0x7f5e3c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 >> 172.21.15.5:0/2828367262 conn(0x7f5e3c075b10 msgr2=0x7f5e3c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 shutdown_connections 2023-10-08T13:04:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.120+0000 7f5e40fb4700 1 -- 172.21.15.5:0/2828367262 wait complete. 2023-10-08T13:04:30.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-08T13:04:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 -- 172.21.15.5:0/1089472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4100400 msgr2=0x7fe8e410c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 --2- 172.21.15.5:0/1089472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4100400 0x7fe8e410c370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b0a0 tx=0x7fe8dc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 -- 172.21.15.5:0/1089472575 shutdown_connections 2023-10-08T13:04:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 --2- 172.21.15.5:0/1089472575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4100400 0x7fe8e410c370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 --2- 172.21.15.5:0/1089472575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e4105660 0x7fe8e4105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 --2- 172.21.15.5:0/1089472575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e40ffa40 0x7fe8e40ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 -- 172.21.15.5:0/1089472575 >> 172.21.15.5:0/1089472575 conn(0x7fe8e4076460 msgr2=0x7fe8e4076870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 -- 172.21.15.5:0/1089472575 shutdown_connections 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.276+0000 7fe8e9652700 1 -- 172.21.15.5:0/1089472575 wait complete. 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.277+0000 7fe8e9652700 1 Processor -- start 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.277+0000 7fe8e9652700 1 -- start start 2023-10-08T13:04:30.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.277+0000 7fe8e9652700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 0x7fe8e419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.277+0000 7fe8e9652700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e4100400 0x7fe8e419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e9652700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e4105660 0x7fe8e4196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e9652700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41970c0 con 0x7fe8e40ffa40 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e9652700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4197230 con 0x7fe8e4105660 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e9652700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41973f0 con 0x7fe8e4100400 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 0x7fe8e419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 0x7fe8e419c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32834/0 (socket says 172.21.15.5:32834) 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 -- 172.21.15.5:0/3696780723 learned_addr learned my addr 172.21.15.5:0/3696780723 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e27fc700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e4100400 0x7fe8e419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:30.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e37fe700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e4105660 0x7fe8e4196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 -- 172.21.15.5:0/3696780723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e4100400 msgr2=0x7fe8e419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e4100400 0x7fe8e419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 -- 172.21.15.5:0/3696780723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e4105660 msgr2=0x7fe8e4196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e4105660 0x7fe8e4196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 -- 172.21.15.5:0/3696780723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009d00 con 0x7fe8e40ffa40 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e27fc700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e4100400 0x7fe8e419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e2ffd700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 0x7fe8e419c930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c920 tx=0x7fe8d800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8007b00 con 0x7fe8e40ffa40 2023-10-08T13:04:30.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8d8004cf0 con 0x7fe8e40ffa40 2023-10-08T13:04:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e41976d0 con 0x7fe8e40ffa40 2023-10-08T13:04:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8005610 con 0x7fe8e40ffa40 2023-10-08T13:04:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.278+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e41a3920 con 0x7fe8e40ffa40 2023-10-08T13:04:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.279+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e4100c60 con 0x7fe8e40ffa40 2023-10-08T13:04:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.281+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fe8d8004750 con 0x7fe8e40ffa40 2023-10-08T13:04:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.282+0000 7fe8cbfff700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe8cc0a14d0 0x7fe8cc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.282+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fe8d80cd030 con 0x7fe8e40ffa40 2023-10-08T13:04:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.282+0000 7fe8e27fc700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe8cc0a14d0 0x7fe8cc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:30.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.282+0000 7fe8e27fc700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe8cc0a14d0 0x7fe8cc0a3990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4005fd0 tx=0x7fe8d4005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:30.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.285+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe8d80963c0 con 0x7fe8e40ffa40 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: pgmap v251: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3848606267' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2828367262' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T13:04:30.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2828367262' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T13:04:30.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2023-10-08T13:04:30.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:30 smithi005 ceph-mon[99496]: daemon mds.b is now active in filesystem cephfs as rank 1 2023-10-08T13:04:30.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: pgmap v251: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3848606267' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2828367262' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2828367262' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2023-10-08T13:04:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:30 smithi118 ceph-mon[104234]: daemon mds.b is now active in filesystem cephfs as rank 1 2023-10-08T13:04:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:30.533+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fe8e4067a20 con 0x7fe8e40ffa40 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: pgmap v251: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3848606267' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2828367262' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2828367262' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2023-10-08T13:04:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:30 smithi060 ceph-mon[103190]: daemon mds.b is now active in filesystem cephfs as rank 1 2023-10-08T13:04:31.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.123+0000 7fe8cbfff700 1 -- 172.21.15.5:0/3696780723 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe8d801d020 con 0x7fe8e40ffa40 2023-10-08T13:04:31.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe8cc0a14d0 msgr2=0x7fe8cc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:31.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe8cc0a14d0 0x7fe8cc0a3990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4005fd0 tx=0x7fe8d4005ee0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 msgr2=0x7fe8e419c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:31.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 0x7fe8e419c930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c920 tx=0x7fe8d800cce0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 shutdown_connections 2023-10-08T13:04:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe8cc0a14d0 0x7fe8cc0a3990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e4105660 0x7fe8e4196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e40ffa40 0x7fe8e419c930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 --2- 172.21.15.5:0/3696780723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8e4100400 0x7fe8e419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 >> 172.21.15.5:0/3696780723 conn(0x7fe8e4076460 msgr2=0x7fe8e4068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:31.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.127+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 shutdown_connections 2023-10-08T13:04:31.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.128+0000 7fe8e9652700 1 -- 172.21.15.5:0/3696780723 wait complete. 2023-10-08T13:04:31.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-08T13:04:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 -- 172.21.15.5:0/1013318478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700100ff0 msgr2=0x7f370010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 --2- 172.21.15.5:0/1013318478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700100ff0 0x7f370010d610 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36f800b0a0 tx=0x7f36f800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 -- 172.21.15.5:0/1013318478 shutdown_connections 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 --2- 172.21.15.5:0/1013318478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700100ff0 0x7f370010d610 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 --2- 172.21.15.5:0/1013318478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700106750 0x7f3700106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 --2- 172.21.15.5:0/1013318478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3700100630 0x7f3700100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 -- 172.21.15.5:0/1013318478 >> 172.21.15.5:0/1013318478 conn(0x7f37000fc100 msgr2=0x7f37000fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 -- 172.21.15.5:0/1013318478 shutdown_connections 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 -- 172.21.15.5:0/1013318478 wait complete. 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.286+0000 7f3707f98700 1 Processor -- start 2023-10-08T13:04:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 -- start start 2023-10-08T13:04:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700100630 0x7f370019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3700100ff0 0x7f370019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 0x7f37001968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700196f20 con 0x7f3700106750 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700197090 con 0x7f3700100ff0 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3707f98700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700197250 con 0x7f3700100630 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 0x7f37001968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 0x7f37001968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32852/0 (socket says 172.21.15.5:32852) 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 -- 172.21.15.5:0/3840892033 learned_addr learned my addr 172.21.15.5:0/3840892033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3705533700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3700100ff0 0x7f370019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3705d34700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700100630 0x7f370019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 -- 172.21.15.5:0/3840892033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700100630 msgr2=0x7f370019c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700100630 0x7f370019c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 -- 172.21.15.5:0/3840892033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3700100ff0 msgr2=0x7f370019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3700100ff0 0x7f370019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 -- 172.21.15.5:0/3840892033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009d00 con 0x7f3700106750 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3705d34700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700100630 0x7f370019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.287+0000 7f3706535700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 0x7f37001968c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f36f800b830 tx=0x7f36f8005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.288+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800e040 con 0x7f3700106750 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.288+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36f8012e40 con 0x7f3700106750 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.288+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37001974d0 con 0x7f3700106750 2023-10-08T13:04:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.288+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f801b450 con 0x7f3700106750 2023-10-08T13:04:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.288+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001a3780 con 0x7f3700106750 2023-10-08T13:04:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.289+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700108d40 con 0x7f3700106750 2023-10-08T13:04:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.290+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f36f8012980 con 0x7f3700106750 2023-10-08T13:04:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.290+0000 7f36f6ffd700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36ec0a14d0 0x7f36ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.290+0000 7f3705d34700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36ec0a14d0 0x7f36ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.290+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f36f80cf0d0 con 0x7f3700106750 2023-10-08T13:04:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.291+0000 7f3705d34700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36ec0a14d0 0x7f36ec0a3990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f36fc005fd0 tx=0x7f36fc005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.295+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36f80984f0 con 0x7f3700106750 2023-10-08T13:04:31.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3696780723' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T13:04:31.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3696780723' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T13:04:31.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] up:active 2023-10-08T13:04:31.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T13:04:31.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2023-10-08T13:04:31.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2023-10-08T13:04:31.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:31 smithi005 ceph-mon[99496]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-08T13:04:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3696780723' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T13:04:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3696780723' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T13:04:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] up:active 2023-10-08T13:04:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T13:04:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2023-10-08T13:04:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2023-10-08T13:04:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:31 smithi118 ceph-mon[104234]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-08T13:04:31.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:31.548+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f37001976c0 con 0x7f3700106750 2023-10-08T13:04:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3696780723' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T13:04:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3696780723' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T13:04:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] up:active 2023-10-08T13:04:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T13:04:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2023-10-08T13:04:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2023-10-08T13:04:31.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:31 smithi060 ceph-mon[103190]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-08T13:04:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.131+0000 7f36f6ffd700 1 -- 172.21.15.5:0/3840892033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f36f809bb10 con 0x7f3700106750 2023-10-08T13:04:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36ec0a14d0 msgr2=0x7f36ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36ec0a14d0 0x7f36ec0a3990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f36fc005fd0 tx=0x7f36fc005db0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 msgr2=0x7f37001968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 0x7f37001968c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f36f800b830 tx=0x7f36f8005ad0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 shutdown_connections 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36ec0a14d0 0x7f36ec0a3990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3700106750 0x7f37001968c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3700100630 0x7f370019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 --2- 172.21.15.5:0/3840892033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3700100ff0 0x7f370019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 >> 172.21.15.5:0/3840892033 conn(0x7f37000fc100 msgr2=0x7f37000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 shutdown_connections 2023-10-08T13:04:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.135+0000 7f3707f98700 1 -- 172.21.15.5:0/3840892033 wait complete. 2023-10-08T13:04:32.155 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-08T13:04:32.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-08T13:04:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 -- 172.21.15.5:0/3855297745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 msgr2=0x7fc9a8106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3855297745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8106b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc990009990 tx=0x7fc990009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 -- 172.21.15.5:0/3855297745 shutdown_connections 2023-10-08T13:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3855297745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8100ff0 0x7fc9a810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3855297745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8106b30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3855297745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a8100630 0x7fc9a8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 -- 172.21.15.5:0/3855297745 >> 172.21.15.5:0/3855297745 conn(0x7fc9a80fc100 msgr2=0x7fc9a80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 -- 172.21.15.5:0/3855297745 shutdown_connections 2023-10-08T13:04:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.292+0000 7fc9ac855700 1 -- 172.21.15.5:0/3855297745 wait complete. 2023-10-08T13:04:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 Processor -- start 2023-10-08T13:04:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 -- start start 2023-10-08T13:04:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a8100630 0x7fc9a8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8100ff0 0x7fc9a8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:32.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81a4f90 con 0x7fc9a8106750 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81a5100 con 0x7fc9a8100630 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9ac855700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a81a52c0 con 0x7fc9a8100ff0 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9a6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9a6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32866/0 (socket says 172.21.15.5:32866) 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.293+0000 7fc9a6d9d700 1 -- 172.21.15.5:0/3080415448 learned_addr learned my addr 172.21.15.5:0/3080415448 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a659c700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a8100630 0x7fc9a8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a5d9b700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8100ff0 0x7fc9a8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a6d9d700 1 -- 172.21.15.5:0/3080415448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8100ff0 msgr2=0x7fc9a8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a6d9d700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8100ff0 0x7fc9a8073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a6d9d700 1 -- 172.21.15.5:0/3080415448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a8100630 msgr2=0x7fc9a8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a6d9d700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a8100630 0x7fc9a8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a6d9d700 1 -- 172.21.15.5:0/3080415448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900095f0 con 0x7fc9a8106750 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9a6d9d700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8073570 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000ada0 tx=0x7fc9a000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000f070 con 0x7fc9a8106750 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a81a55a0 con 0x7fc9a8106750 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9a0007b30 con 0x7fc9a8106750 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005440 con 0x7fc9a8106750 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.294+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a81a5ab0 con 0x7fc9a8106750 2023-10-08T13:04:32.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.295+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a8108d40 con 0x7fc9a8106750 2023-10-08T13:04:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.297+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc9a0004ad0 con 0x7fc9a8106750 2023-10-08T13:04:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.297+0000 7fc99f7fe700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc9940a14d0 0x7fc9940a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.297+0000 7fc9a659c700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc9940a14d0 0x7fc9940a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.297+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fc9a00ccc20 con 0x7fc9a8106750 2023-10-08T13:04:32.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.298+0000 7fc9a659c700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc9940a14d0 0x7fc9940a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b5c0 tx=0x7fc99001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:32.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.301+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9a0096040 con 0x7fc9a8106750 2023-10-08T13:04:32.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: pgmap v252: 129 pgs: 129 active+clean; 582 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3840892033' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3840892033' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] up:active 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-08T13:04:32.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-mon[99496]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T13:04:32.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: pgmap v252: 129 pgs: 129 active+clean; 582 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2023-10-08T13:04:32.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3840892033' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T13:04:32.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3840892033' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T13:04:32.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] up:active 2023-10-08T13:04:32.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T13:04:32.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2023-10-08T13:04:32.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-08T13:04:32.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:32 smithi118 ceph-mon[104234]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T13:04:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:32.537+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9a8101d70 con 0x7fc9940a14d0 2023-10-08T13:04:32.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: pgmap v252: 129 pgs: 129 active+clean; 582 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2023-10-08T13:04:32.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3840892033' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T13:04:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3840892033' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T13:04:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] up:active 2023-10-08T13:04:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T13:04:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2023-10-08T13:04:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-08T13:04:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:32 smithi060 ceph-mon[103190]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T13:04:32.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:04:32.542+0000 7f1c9a0aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:04:32.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:04:32.542+0000 7f1c9a0aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:04:32.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:04:32.542+0000 7f1c9a0aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:04:32.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:04:32.542+0000 7f1c9a0aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:04:32.922 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:04:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:04:32.542+0000 7f1c9a0aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:04:33.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] up:active 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T13:04:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:33 smithi118 ceph-mon[104234]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-08T13:04:33.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:33.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] up:active 2023-10-08T13:04:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T13:04:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T13:04:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T13:04:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-10-08T13:04:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T13:04:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:33 smithi060 ceph-mon[103190]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] up:active 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T13:04:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:33 smithi005 ceph-mon[99496]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-08T13:04:34.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.186+0000 7fc99f7fe700 1 -- 172.21.15.5:0/3080415448 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc9a8101d70 con 0x7fc9940a14d0 2023-10-08T13:04:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc9940a14d0 msgr2=0x7fc9940a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc9940a14d0 0x7fc9940a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b5c0 tx=0x7fc99001a040 comp rx=0 tx=0).stop 2023-10-08T13:04:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 msgr2=0x7fc9a8073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8073570 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000ada0 tx=0x7fc9a000c330 comp rx=0 tx=0).stop 2023-10-08T13:04:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 shutdown_connections 2023-10-08T13:04:34.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc9940a14d0 0x7fc9940a3990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a8106750 0x7fc9a8073570 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a8100630 0x7fc9a8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 --2- 172.21.15.5:0/3080415448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9a8100ff0 0x7fc9a8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.189+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 >> 172.21.15.5:0/3080415448 conn(0x7fc9a80fc100 msgr2=0x7fc9a80fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.190+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 shutdown_connections 2023-10-08T13:04:34.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.190+0000 7fc9ac855700 1 -- 172.21.15.5:0/3080415448 wait complete. 2023-10-08T13:04:34.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-08T13:04:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 -- 172.21.15.5:0/3962190954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc0ff570 msgr2=0x7f85dc0ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 --2- 172.21.15.5:0/3962190954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc0ff570 0x7f85dc0ff9f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0099c0 tx=0x7f85cc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 -- 172.21.15.5:0/3962190954 shutdown_connections 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 --2- 172.21.15.5:0/3962190954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc0fff30 0x7f85dc10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 --2- 172.21.15.5:0/3962190954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85dc105630 0x7f85dc105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 --2- 172.21.15.5:0/3962190954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc0ff570 0x7f85dc0ff9f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 -- 172.21.15.5:0/3962190954 >> 172.21.15.5:0/3962190954 conn(0x7f85dc0fb020 msgr2=0x7f85dc0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 -- 172.21.15.5:0/3962190954 shutdown_connections 2023-10-08T13:04:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.342+0000 7f85e0f05700 1 -- 172.21.15.5:0/3962190954 wait complete. 2023-10-08T13:04:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 Processor -- start 2023-10-08T13:04:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 -- start start 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85dc0ff570 0x7f85dc197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc0fff30 0x7f85dc197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 0x7f85dc1a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc198600 con 0x7f85dc105630 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1a2e10 con 0x7f85dc0ff570 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.343+0000 7f85e0f05700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1a2f50 con 0x7f85dc0fff30 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 0x7f85dc1a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 0x7f85dc1a28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32926/0 (socket says 172.21.15.5:32926) 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 -- 172.21.15.5:0/131718581 learned_addr learned my addr 172.21.15.5:0/131718581 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85da59c700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85dc0ff570 0x7f85dc197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85d9d9b700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc0fff30 0x7f85dc197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 -- 172.21.15.5:0/131718581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc0fff30 msgr2=0x7f85dc197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc0fff30 0x7f85dc197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 -- 172.21.15.5:0/131718581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85dc0ff570 msgr2=0x7f85dc197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85dc0ff570 0x7f85dc197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 -- 172.21.15.5:0/131718581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0095f0 con 0x7f85dc105630 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85dad9d700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 0x7f85dc1a28d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f85d400ada0 tx=0x7f85d400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400f070 con 0x7f85dc105630 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc1a31e0 con 0x7f85dc105630 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85d4007b30 con 0x7f85dc105630 2023-10-08T13:04:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4005280 con 0x7f85dc105630 2023-10-08T13:04:34.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.344+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc1a36c0 con 0x7f85dc105630 2023-10-08T13:04:34.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.345+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc107ad0 con 0x7f85dc105630 2023-10-08T13:04:34.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.346+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f85d400a090 con 0x7f85dc105630 2023-10-08T13:04:34.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.347+0000 7f85d37fe700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f85c80a14d0 0x7f85c80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.347+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f85d40ccb50 con 0x7f85dc105630 2023-10-08T13:04:34.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.347+0000 7f85da59c700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f85c80a14d0 0x7f85c80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.348+0000 7f85da59c700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f85c80a14d0 0x7f85c80a3990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85c400ac50 tx=0x7f85c400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:34.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.351+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f85d4099a00 con 0x7f85dc105630 2023-10-08T13:04:34.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-mon[104234]: pgmap v253: 129 pgs: 129 active+clean; 583 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 4 op/s 2023-10-08T13:04:34.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] up:active 2023-10-08T13:04:34.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-mon[104234]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-08T13:04:34.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:04:34.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.586+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f85dc100c90 con 0x7f85c80a14d0 2023-10-08T13:04:34.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.591+0000 7f85d37fe700 1 -- 172.21.15.5:0/131718581 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f85dc100c90 con 0x7f85c80a14d0 2023-10-08T13:04:34.592 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/_nogroup/sv_0/b8c97e45-9788-4001-ae0e-2a6d6988107f 2023-10-08T13:04:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f85c80a14d0 msgr2=0x7f85c80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f85c80a14d0 0x7f85c80a3990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85c400ac50 tx=0x7f85c400a380 comp rx=0 tx=0).stop 2023-10-08T13:04:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 msgr2=0x7f85dc1a28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 0x7f85dc1a28d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f85d400ada0 tx=0x7f85d400c330 comp rx=0 tx=0).stop 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 shutdown_connections 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f85c80a14d0 0x7f85c80a3990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85dc105630 0x7f85dc1a28d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85dc0ff570 0x7f85dc197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 --2- 172.21.15.5:0/131718581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85dc0fff30 0x7f85dc197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 >> 172.21.15.5:0/131718581 conn(0x7f85dc0fb020 msgr2=0x7f85dc0fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 shutdown_connections 2023-10-08T13:04:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.593+0000 7f85e0f05700 1 -- 172.21.15.5:0/131718581 wait complete. 2023-10-08T13:04:34.605 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:34 smithi005 ceph-mon[99496]: pgmap v253: 129 pgs: 129 active+clean; 583 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 4 op/s 2023-10-08T13:04:34.605 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] up:active 2023-10-08T13:04:34.605 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:34 smithi005 ceph-mon[99496]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-08T13:04:34.606 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:34 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:04:34.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-08T13:04:34.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:34 smithi060 ceph-mon[103190]: pgmap v253: 129 pgs: 129 active+clean; 583 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 4 op/s 2023-10-08T13:04:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] up:active 2023-10-08T13:04:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:34 smithi060 ceph-mon[103190]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-08T13:04:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:34 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:04:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 -- 172.21.15.5:0/2781611869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe26010cf70 msgr2=0x7fe26010f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 --2- 172.21.15.5:0/2781611869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe26010cf70 0x7fe26010f360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe25800b0a0 tx=0x7fe25800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 -- 172.21.15.5:0/2781611869 shutdown_connections 2023-10-08T13:04:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 --2- 172.21.15.5:0/2781611869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe26010cf70 0x7fe26010f360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 --2- 172.21.15.5:0/2781611869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ff3c0 0x7fe2600ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 --2- 172.21.15.5:0/2781611869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2600ffd70 0x7fe26010ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.735+0000 7fe2665ca700 1 -- 172.21.15.5:0/2781611869 >> 172.21.15.5:0/2781611869 conn(0x7fe2600fafc0 msgr2=0x7fe2600fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.736+0000 7fe2665ca700 1 -- 172.21.15.5:0/2781611869 shutdown_connections 2023-10-08T13:04:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.736+0000 7fe2665ca700 1 -- 172.21.15.5:0/2781611869 wait complete. 2023-10-08T13:04:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.736+0000 7fe2665ca700 1 Processor -- start 2023-10-08T13:04:34.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.736+0000 7fe2665ca700 1 -- start start 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 0x7fe260198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ffd70 0x7fe260199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe26010cf70 0x7fe26019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26019dd30 con 0x7fe2600ff3c0 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26019dea0 con 0x7fe26010cf70 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26019e060 con 0x7fe2600ffd70 2023-10-08T13:04:34.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 0x7fe260198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 0x7fe260198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32936/0 (socket says 172.21.15.5:32936) 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 -- 172.21.15.5:0/3167221136 learned_addr learned my addr 172.21.15.5:0/3167221136 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe264b67700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe26010cf70 0x7fe26019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25f7fe700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ffd70 0x7fe260199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 -- 172.21.15.5:0/3167221136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ffd70 msgr2=0x7fe260199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ffd70 0x7fe260199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 -- 172.21.15.5:0/3167221136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe26010cf70 msgr2=0x7fe26019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe26010cf70 0x7fe26019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 -- 172.21.15.5:0/3167221136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009d00 con 0x7fe2600ff3c0 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe264b67700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe26010cf70 0x7fe26019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:34.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25f7fe700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ffd70 0x7fe260199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25ffff700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 0x7fe260198e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe25000d950 tx=0x7fe25000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250009b40 con 0x7fe2600ff3c0 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe250009ca0 con 0x7fe2600ff3c0 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26019e340 con 0x7fe2600ff3c0 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000f620 con 0x7fe2600ff3c0 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.737+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2601a5b80 con 0x7fe2600ff3c0 2023-10-08T13:04:34.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.738+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260108190 con 0x7fe2600ff3c0 2023-10-08T13:04:34.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.740+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fe250010460 con 0x7fe2600ff3c0 2023-10-08T13:04:34.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.741+0000 7fe25d7fa700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe2480a14d0 0x7fe2480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:34.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.741+0000 7fe25f7fe700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe2480a14d0 0x7fe2480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:34.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.741+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fe2500cd3f0 con 0x7fe2600ff3c0 2023-10-08T13:04:34.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.741+0000 7fe25f7fe700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe2480a14d0 0x7fe2480a3990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe254005e10 tx=0x7fe254005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.744+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe250096780 con 0x7fe2600ff3c0 2023-10-08T13:04:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:34.982+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fe26019a180 con 0x7fe2480a14d0 2023-10-08T13:04:35.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.009+0000 7fe25d7fa700 1 -- 172.21.15.5:0/3167221136 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe26019a180 con 0x7fe2480a14d0 2023-10-08T13:04:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe2480a14d0 msgr2=0x7fe2480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe2480a14d0 0x7fe2480a3990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe254005e10 tx=0x7fe254005d60 comp rx=0 tx=0).stop 2023-10-08T13:04:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 msgr2=0x7fe260198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 0x7fe260198e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe25000d950 tx=0x7fe25000dd10 comp rx=0 tx=0).stop 2023-10-08T13:04:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 shutdown_connections 2023-10-08T13:04:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe2480a14d0 0x7fe2480a3990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe26010cf70 0x7fe26019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2600ff3c0 0x7fe260198e10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 --2- 172.21.15.5:0/3167221136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2600ffd70 0x7fe260199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 >> 172.21.15.5:0/3167221136 conn(0x7fe2600fafc0 msgr2=0x7fe2600fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 shutdown_connections 2023-10-08T13:04:35.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.011+0000 7fe2665ca700 1 -- 172.21.15.5:0/3167221136 wait complete. 2023-10-08T13:04:35.019 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: 2023-10-08T13:04:34.680+0000 7fa092995700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-10-08T13:04:35.019 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: 2023-10-08T13:04:34.680+0000 7fa092995700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-08T13:04:35.019 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:04:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: 2023-10-08T13:04:34.680+0000 7fa092995700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-08T13:04:35.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-08T13:04:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 -- 172.21.15.5:0/2361377055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 msgr2=0x7f9c3010c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 --2- 172.21.15.5:0/2361377055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3010c3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800b0d0 tx=0x7f9c2800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 -- 172.21.15.5:0/2361377055 shutdown_connections 2023-10-08T13:04:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 --2- 172.21.15.5:0/2361377055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3010c3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 --2- 172.21.15.5:0/2361377055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c301055f0 0x7f9c301059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 --2- 172.21.15.5:0/2361377055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c300ff530 0x7f9c300ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 -- 172.21.15.5:0/2361377055 >> 172.21.15.5:0/2361377055 conn(0x7f9c300fafc0 msgr2=0x7f9c300fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 -- 172.21.15.5:0/2361377055 shutdown_connections 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 -- 172.21.15.5:0/2361377055 wait complete. 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.154+0000 7f9c36931700 1 Processor -- start 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 -- start start 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c300ff530 0x7f9c3019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c301055f0 0x7f9c30196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30197110 con 0x7f9c300ffef0 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30197280 con 0x7f9c300ff530 2023-10-08T13:04:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c36931700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30197440 con 0x7f9c301055f0 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32954/0 (socket says 172.21.15.5:32954) 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 -- 172.21.15.5:0/2004894536 learned_addr learned my addr 172.21.15.5:0/2004894536 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c34ece700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c301055f0 0x7f9c30196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2ffff700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c300ff530 0x7f9c3019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 -- 172.21.15.5:0/2004894536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c301055f0 msgr2=0x7f9c30196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c301055f0 0x7f9c30196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 -- 172.21.15.5:0/2004894536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c300ff530 msgr2=0x7f9c3019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c300ff530 0x7f9c3019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2f7fe700 1 -- 172.21.15.5:0/2004894536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009d00 con 0x7f9c300ffef0 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.155+0000 7f9c2ffff700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c300ff530 0x7f9c3019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.156+0000 7f9c2f7fe700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3019cd90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d950 tx=0x7f9c1800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.156+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18009b40 con 0x7f9c300ffef0 2023-10-08T13:04:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.156+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c30197720 con 0x7f9c300ffef0 2023-10-08T13:04:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.156+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c18009ca0 con 0x7f9c300ffef0 2023-10-08T13:04:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.156+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800f620 con 0x7f9c300ffef0 2023-10-08T13:04:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.156+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c301a37d0 con 0x7f9c300ffef0 2023-10-08T13:04:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.157+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c30100c50 con 0x7f9c300ffef0 2023-10-08T13:04:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.158+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f9c18010460 con 0x7f9c300ffef0 2023-10-08T13:04:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.158+0000 7f9c2d7fa700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9c1c0a14d0 0x7f9c1c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.158+0000 7f9c2ffff700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9c1c0a14d0 0x7f9c1c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.158+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f9c180cd420 con 0x7f9c300ffef0 2023-10-08T13:04:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.159+0000 7f9c2ffff700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9c1c0a14d0 0x7f9c1c0a3990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c20005d90 tx=0x7f9c20005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.162+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c180967b0 con 0x7f9c300ffef0 2023-10-08T13:04:35.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.200+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9c18096b80 con 0x7f9c300ffef0 2023-10-08T13:04:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.403+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3010f450 con 0x7f9c1c0a14d0 2023-10-08T13:04:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.407+0000 7f9c2d7fa700 1 -- 172.21.15.5:0/2004894536 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f9c3010f450 con 0x7f9c1c0a14d0 2023-10-08T13:04:35.408 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/_nogroup/sv_1/f1ebe893-7572-4cde-a2d6-a4b7940d5d5a 2023-10-08T13:04:35.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9c1c0a14d0 msgr2=0x7f9c1c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9c1c0a14d0 0x7f9c1c0a3990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c20005d90 tx=0x7f9c20005d00 comp rx=0 tx=0).stop 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 msgr2=0x7f9c3019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3019cd90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d950 tx=0x7f9c1800dd10 comp rx=0 tx=0).stop 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 shutdown_connections 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9c1c0a14d0 0x7f9c1c0a3990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c301055f0 0x7f9c30196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c300ff530 0x7f9c3019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 --2- 172.21.15.5:0/2004894536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c300ffef0 0x7f9c3019cd90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.409+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 >> 172.21.15.5:0/2004894536 conn(0x7f9c300fafc0 msgr2=0x7f9c300fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.410+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 shutdown_connections 2023-10-08T13:04:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.410+0000 7f9c36931700 1 -- 172.21.15.5:0/2004894536 wait complete. 2023-10-08T13:04:35.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:35 smithi005 ceph-mon[99496]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:35.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:04:35.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:35 smithi118 ceph-mon[104234]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/1364012684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b941056b0 msgr2=0x7f9b94105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/1364012684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b941056b0 0x7f9b94105a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9b840099c0 tx=0x7f9b84009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/1364012684 shutdown_connections 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/1364012684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 0x7f9b9410c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/1364012684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b941056b0 0x7f9b94105a90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/1364012684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b940ffca0 0x7f9b94100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/1364012684 >> 172.21.15.5:0/1364012684 conn(0x7f9b94075b20 msgr2=0x7f9b940fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/1364012684 shutdown_connections 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/1364012684 wait complete. 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 Processor -- start 2023-10-08T13:04:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.548+0000 7f9b9a8d3700 1 -- start start 2023-10-08T13:04:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b9a8d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 0x7f9b9419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b9a8d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 0x7f9b9419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b9a8d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b941056b0 0x7f9b941956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b9a8d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94195d10 con 0x7f9b940ffca0 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b9a8d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94195e80 con 0x7f9b94100660 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b9a8d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94196040 con 0x7f9b941056b0 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 0x7f9b9419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 0x7f9b9419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32966/0 (socket says 172.21.15.5:32966) 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 -- 172.21.15.5:0/655231792 learned_addr learned my addr 172.21.15.5:0/655231792 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b98e70700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b941056b0 0x7f9b941956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b937fe700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 0x7f9b9419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 -- 172.21.15.5:0/655231792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b941056b0 msgr2=0x7f9b941956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b941056b0 0x7f9b941956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 -- 172.21.15.5:0/655231792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 msgr2=0x7f9b9419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 0x7f9b9419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 -- 172.21.15.5:0/655231792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840095f0 con 0x7f9b940ffca0 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b98e70700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b941056b0 0x7f9b941956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b937fe700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 0x7f9b9419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.549+0000 7f9b93fff700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 0x7f9b9419b580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009f50 tx=0x7f9b840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.550+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8401f070 con 0x7f9b940ffca0 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.550+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b8401ac80 con 0x7f9b940ffca0 2023-10-08T13:04:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.550+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b941962c0 con 0x7f9b940ffca0 2023-10-08T13:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.550+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8400fe30 con 0x7f9b940ffca0 2023-10-08T13:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.550+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b940fed70 con 0x7f9b940ffca0 2023-10-08T13:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.551+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b94100cb0 con 0x7f9b940ffca0 2023-10-08T13:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.552+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9b84023070 con 0x7f9b940ffca0 2023-10-08T13:04:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.552+0000 7f9b917fa700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9b7c0a1560 0x7f9b7c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.552+0000 7f9b937fe700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9b7c0a1560 0x7f9b7c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.552+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f9b840d0270 con 0x7f9b940ffca0 2023-10-08T13:04:35.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.553+0000 7f9b937fe700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9b7c0a1560 0x7f9b7c0a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9b88005fd0 tx=0x7f9b88005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:35.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.557+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9b840995d0 con 0x7f9b940ffca0 2023-10-08T13:04:35.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:35 smithi060 ceph-mon[103190]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:35.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.806+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b94196bd0 con 0x7f9b940ffca0 2023-10-08T13:04:35.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.807+0000 7f9b917fa700 1 -- 172.21.15.5:0/655231792 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7f9b8409cbf0 con 0x7f9b940ffca0 2023-10-08T13:04:35.808 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:35.808 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:04:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9b7c0a1560 msgr2=0x7f9b7c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9b7c0a1560 0x7f9b7c0a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9b88005fd0 tx=0x7f9b88005e20 comp rx=0 tx=0).stop 2023-10-08T13:04:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 msgr2=0x7f9b9419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 0x7f9b9419b580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009f50 tx=0x7f9b840047c0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 shutdown_connections 2023-10-08T13:04:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9b7c0a1560 0x7f9b7c0a3a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b941056b0 0x7f9b941956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940ffca0 0x7f9b9419b580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 --2- 172.21.15.5:0/655231792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94100660 0x7f9b9419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 >> 172.21.15.5:0/655231792 conn(0x7f9b94075b20 msgr2=0x7f9b940fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 shutdown_connections 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.809+0000 7f9b9a8d3700 1 -- 172.21.15.5:0/655231792 wait complete. 2023-10-08T13:04:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:04:35.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:04:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 -- 172.21.15.5:0/2161557676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 msgr2=0x7fe9481059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/2161557676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481059e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe9380099c0 tx=0x7fe938009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 -- 172.21.15.5:0/2161557676 shutdown_connections 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/2161557676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9480fff00 0x7fe94810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/2161557676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481059e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/2161557676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9480ff540 0x7fe9480ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 -- 172.21.15.5:0/2161557676 >> 172.21.15.5:0/2161557676 conn(0x7fe9480fb010 msgr2=0x7fe9480fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 -- 172.21.15.5:0/2161557676 shutdown_connections 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.947+0000 7fe94e4b2700 1 -- 172.21.15.5:0/2161557676 wait complete. 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 Processor -- start 2023-10-08T13:04:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 -- start start 2023-10-08T13:04:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9480ff540 0x7fe94819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9480fff00 0x7fe94819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948195d20 con 0x7fe948105600 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948195e90 con 0x7fe9480fff00 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94e4b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948196050 con 0x7fe9480ff540 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94ca4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe947fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9480ff540 0x7fe94819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94ca4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32984/0 (socket says 172.21.15.5:32984) 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe94ca4f700 1 -- 172.21.15.5:0/3663427998 learned_addr learned my addr 172.21.15.5:0/3663427998 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.948+0000 7fe9477fe700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9480fff00 0x7fe94819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94ca4f700 1 -- 172.21.15.5:0/3663427998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9480ff540 msgr2=0x7fe94819b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94ca4f700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9480ff540 0x7fe94819b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94ca4f700 1 -- 172.21.15.5:0/3663427998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9480fff00 msgr2=0x7fe94819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94ca4f700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9480fff00 0x7fe94819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94ca4f700 1 -- 172.21.15.5:0/3663427998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9380095f0 con 0x7fe948105600 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94ca4f700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481956c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe94000cfb0 tx=0x7fe94000e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940011070 con 0x7fe948105600 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948196330 con 0x7fe948105600 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe940007b30 con 0x7fe948105600 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94000adf0 con 0x7fe948105600 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.949+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe948068e50 con 0x7fe948105600 2023-10-08T13:04:35.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.950+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe948100c60 con 0x7fe948105600 2023-10-08T13:04:35.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.951+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe94000e980 con 0x7fe948105600 2023-10-08T13:04:35.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.951+0000 7fe9457fa700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe9300a1560 0x7fe9300a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:35.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.952+0000 7fe947fff700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe9300a1560 0x7fe9300a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:35.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.952+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fe9400ced00 con 0x7fe948105600 2023-10-08T13:04:35.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.952+0000 7fe947fff700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe9300a1560 0x7fe9300a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe938009990 tx=0x7fe938005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:35.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:35.956+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe940097ed0 con 0x7fe948105600 2023-10-08T13:04:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.162+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9480679a0 con 0x7fe948105600 2023-10-08T13:04:36.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.164+0000 7fe9457fa700 1 -- 172.21.15.5:0/3663427998 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24170 (secure 0 0 0) 0x7fe940086020 con 0x7fe948105600 2023-10-08T13:04:36.166 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:36.166 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:15.558995+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe9300a1560 msgr2=0x7fe9300a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe9300a1560 0x7fe9300a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe938009990 tx=0x7fe938005bc0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 msgr2=0x7fe9481956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481956c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe94000cfb0 tx=0x7fe94000e330 comp rx=0 tx=0).stop 2023-10-08T13:04:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 shutdown_connections 2023-10-08T13:04:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe9300a1560 0x7fe9300a3a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe948105600 0x7fe9481956c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9480ff540 0x7fe94819b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 --2- 172.21.15.5:0/3663427998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9480fff00 0x7fe94819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 >> 172.21.15.5:0/3663427998 conn(0x7fe9480fb010 msgr2=0x7fe9480fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 shutdown_connections 2023-10-08T13:04:36.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.166+0000 7fe94e4b2700 1 -- 172.21.15.5:0/3663427998 wait complete. 2023-10-08T13:04:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T13:04:36.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:04:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.305+0000 7f96f5562700 1 -- 172.21.15.5:0/824109493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 msgr2=0x7f96f010c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 --2- 172.21.15.5:0/824109493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f010c3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f96e800b0d0 tx=0x7f96e800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 -- 172.21.15.5:0/824109493 shutdown_connections 2023-10-08T13:04:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 --2- 172.21.15.5:0/824109493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f010c3e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 --2- 172.21.15.5:0/824109493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96f0105620 0x7f96f0105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 --2- 172.21.15.5:0/824109493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f00ff560 0x7f96f00ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 -- 172.21.15.5:0/824109493 >> 172.21.15.5:0/824109493 conn(0x7f96f00fb010 msgr2=0x7f96f00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 -- 172.21.15.5:0/824109493 shutdown_connections 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 -- 172.21.15.5:0/824109493 wait complete. 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 Processor -- start 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.306+0000 7f96f5562700 1 -- start start 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f00ff560 0x7f96f0195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f0195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96f0105620 0x7f96f01961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a4ef0 con 0x7f96f00fff20 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a5060 con 0x7f96f00ff560 2023-10-08T13:04:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a5220 con 0x7f96f0105620 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f0195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f0195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32998/0 (socket says 172.21.15.5:32998) 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 -- 172.21.15.5:0/867102305 learned_addr learned my addr 172.21.15.5:0/867102305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ef7fe700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96f0105620 0x7f96f01961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96eeffd700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f00ff560 0x7f96f0195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 -- 172.21.15.5:0/867102305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96f0105620 msgr2=0x7f96f01961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96f0105620 0x7f96f01961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 -- 172.21.15.5:0/867102305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f00ff560 msgr2=0x7f96f0195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f00ff560 0x7f96f0195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 -- 172.21.15.5:0/867102305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009d00 con 0x7f96f00fff20 2023-10-08T13:04:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96ee7fc700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f0195c90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f96e400e9a0 tx=0x7f96e400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:36.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4009790 con 0x7f96f00fff20 2023-10-08T13:04:36.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f01a5500 con 0x7f96f00fff20 2023-10-08T13:04:36.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96e400cbd0 con 0x7f96f00fff20 2023-10-08T13:04:36.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4018680 con 0x7f96f00fff20 2023-10-08T13:04:36.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.307+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f01a5a60 con 0x7f96f00fff20 2023-10-08T13:04:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.308+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f0107ac0 con 0x7f96f00fff20 2023-10-08T13:04:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.309+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f96e400cd40 con 0x7f96f00fff20 2023-10-08T13:04:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.310+0000 7f96d7fff700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f96d80a1560 0x7f96d80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.310+0000 7f96eeffd700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f96d80a1560 0x7f96d80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.310+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f96e4014070 con 0x7f96f00fff20 2023-10-08T13:04:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.311+0000 7f96eeffd700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f96d80a1560 0x7f96d80a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e0005fd0 tx=0x7f96e0005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:36.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.313+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f96e4096c10 con 0x7f96f00fff20 2023-10-08T13:04:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.513+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96f0069270 con 0x7f96d80a1560 2023-10-08T13:04:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:36 smithi118 ceph-mon[104234]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:36 smithi118 ceph-mon[104234]: pgmap v254: 129 pgs: 129 active+clean; 584 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.1 KiB/s wr, 8 op/s 2023-10-08T13:04:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:36 smithi118 ceph-mon[104234]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T13:04:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:36 smithi118 ceph-mon[104234]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/655231792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:36.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3663427998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:36.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.529+0000 7f96d7fff700 1 -- 172.21.15.5:0/867102305 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422646 (secure 0 0 0) 0x7f96f0069270 con 0x7f96d80a1560 2023-10-08T13:04:36.537 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:36.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f96d80a1560 msgr2=0x7f96d80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f96d80a1560 0x7f96d80a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e0005fd0 tx=0x7f96e0005f60 comp rx=0 tx=0).stop 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 msgr2=0x7f96f0195c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f0195c90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f96e400e9a0 tx=0x7f96e400ed60 comp rx=0 tx=0).stop 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 shutdown_connections 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f96d80a1560 0x7f96d80a3a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96f0105620 0x7f96f01961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96f00ff560 0x7f96f0195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 --2- 172.21.15.5:0/867102305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96f00fff20 0x7f96f0195c90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.533+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 >> 172.21.15.5:0/867102305 conn(0x7f96f00fb010 msgr2=0x7f96f00fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.534+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 shutdown_connections 2023-10-08T13:04:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.534+0000 7f96f5562700 1 -- 172.21.15.5:0/867102305 wait complete. 2023-10-08T13:04:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:04:36.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:36 smithi005 ceph-mon[99496]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:36.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:36 smithi005 ceph-mon[99496]: pgmap v254: 129 pgs: 129 active+clean; 584 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.1 KiB/s wr, 8 op/s 2023-10-08T13:04:36.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:36 smithi005 ceph-mon[99496]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T13:04:36.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:36 smithi005 ceph-mon[99496]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:36.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/655231792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:36.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3663427998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:36.548 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2023-10-08T13:04:35.090879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598373,"num_objects":65,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":145,"num_read_kb":127,"num_write":321,"num_write_kb":2978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259,"ondisk_log_size":259,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337500,"kb_used_data":13304,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604324,"statfs":{"total":1151940427776,"available":1151594827776,"internally_reserved":0,"allocated":13623296,"data_stored":7550132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5146,"num_objects":41,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":94,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003661"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135566+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:04:15.135566+0000","last_peered":"2023-10-08T13:04:15.135566+0000","last_clean":"2023-10-08T13:04:15.135566+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:04:15.135566+0000","last_undegraded":"2023-10-08T13:04:15.135566+0000","last_fullsized":"2023-10-08T13:04:15.135566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139329+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:04:15.139329+0000","last_peered":"2023-10-08T13:04:15.139329+0000","last_clean":"2023-10-08T13:04:15.139329+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:15.139329+0000","last_undegraded":"2023-10-08T13:04:15.139329+0000","last_fullsized":"2023-10-08T13:04:15.139329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139265+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:04:15.139265+0000","last_peered":"2023-10-08T13:04:15.139265+0000","last_clean":"2023-10-08T13:04:15.139265+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:04:15.139265+0000","last_undegraded":"2023-10-08T13:04:15.139265+0000","last_fullsized":"2023-10-08T13:04:15.139265+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.137105+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:04:15.137105+0000","last_peered":"2023-10-08T13:04:15.137105+0000","last_clean":"2023-10-08T13:04:15.137105+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:04:15.137105+0000","last_undegraded":"2023-10-08T13:04:15.137105+0000","last_fullsized":"2023-10-08T13:04:15.137105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133597+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:04:15.133597+0000","last_peered":"2023-10-08T13:04:15.133597+0000","last_clean":"2023-10-08T13:04:15.133597+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:04:15.133597+0000","last_undegraded":"2023-10-08T13:04:15.133597+0000","last_fullsized":"2023-10-08T13:04:15.133597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.504662+0000","last_change":"2023-10-08T13:04:10.751550+0000","last_active":"2023-10-08T13:04:15.504662+0000","last_peered":"2023-10-08T13:04:15.504662+0000","last_clean":"2023-10-08T13:04:15.504662+0000","last_became_active":"2023-10-08T13:04:10.751196+0000","last_became_peered":"2023-10-08T13:04:10.751196+0000","last_unstale":"2023-10-08T13:04:15.504662+0000","last_undegraded":"2023-10-08T13:04:15.504662+0000","last_fullsized":"2023-10-08T13:04:15.504662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:24.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135362+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:04:15.135362+0000","last_peered":"2023-10-08T13:04:15.135362+0000","last_clean":"2023-10-08T13:04:15.135362+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:04:15.135362+0000","last_undegraded":"2023-10-08T13:04:15.135362+0000","last_fullsized":"2023-10-08T13:04:15.135362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.141744+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:04:15.141744+0000","last_peered":"2023-10-08T13:04:15.141744+0000","last_clean":"2023-10-08T13:04:15.141744+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:04:15.141744+0000","last_undegraded":"2023-10-08T13:04:15.141744+0000","last_fullsized":"2023-10-08T13:04:15.141744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.130066+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:04:15.130066+0000","last_peered":"2023-10-08T13:04:15.130066+0000","last_clean":"2023-10-08T13:04:15.130066+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:04:15.130066+0000","last_undegraded":"2023-10-08T13:04:15.130066+0000","last_fullsized":"2023-10-08T13:04:15.130066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.505564+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:04:15.505564+0000","last_peered":"2023-10-08T13:04:15.505564+0000","last_clean":"2023-10-08T13:04:15.505564+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:04:15.505564+0000","last_undegraded":"2023-10-08T13:04:15.505564+0000","last_fullsized":"2023-10-08T13:04:15.505564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135092+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:04:15.135092+0000","last_peered":"2023-10-08T13:04:15.135092+0000","last_clean":"2023-10-08T13:04:15.135092+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:04:15.135092+0000","last_undegraded":"2023-10-08T13:04:15.135092+0000","last_fullsized":"2023-10-08T13:04:15.135092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.137036+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:04:15.137036+0000","last_peered":"2023-10-08T13:04:15.137036+0000","last_clean":"2023-10-08T13:04:15.137036+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:04:15.137036+0000","last_undegraded":"2023-10-08T13:04:15.137036+0000","last_fullsized":"2023-10-08T13:04:15.137036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129373+0000","last_change":"2023-10-08T13:04:10.749890+0000","last_active":"2023-10-08T13:04:15.129373+0000","last_peered":"2023-10-08T13:04:15.129373+0000","last_clean":"2023-10-08T13:04:15.129373+0000","last_became_active":"2023-10-08T13:04:10.749514+0000","last_became_peered":"2023-10-08T13:04:10.749514+0000","last_unstale":"2023-10-08T13:04:15.129373+0000","last_undegraded":"2023-10-08T13:04:15.129373+0000","last_fullsized":"2023-10-08T13:04:15.129373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.192335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138899+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:04:15.138899+0000","last_peered":"2023-10-08T13:04:15.138899+0000","last_clean":"2023-10-08T13:04:15.138899+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:15.138899+0000","last_undegraded":"2023-10-08T13:04:15.138899+0000","last_fullsized":"2023-10-08T13:04:15.138899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138723+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:04:15.138723+0000","last_peered":"2023-10-08T13:04:15.138723+0000","last_clean":"2023-10-08T13:04:15.138723+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:04:15.138723+0000","last_undegraded":"2023-10-08T13:04:15.138723+0000","last_fullsized":"2023-10-08T13:04:15.138723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129007+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:04:15.129007+0000","last_peered":"2023-10-08T13:04:15.129007+0000","last_clean":"2023-10-08T13:04:15.129007+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:04:15.129007+0000","last_undegraded":"2023-10-08T13:04:15.129007+0000","last_fullsized":"2023-10-08T13:04:15.129007+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135341+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:04:15.135341+0000","last_peered":"2023-10-08T13:04:15.135341+0000","last_clean":"2023-10-08T13:04:15.135341+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:04:15.135341+0000","last_undegraded":"2023-10-08T13:04:15.135341+0000","last_fullsized":"2023-10-08T13:04:15.135341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.147489+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:04:15.147489+0000","last_peered":"2023-10-08T13:04:15.147489+0000","last_clean":"2023-10-08T13:04:15.147489+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:04:15.147489+0000","last_undegraded":"2023-10-08T13:04:15.147489+0000","last_fullsized":"2023-10-08T13:04:15.147489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129896+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:04:15.129896+0000","last_peered":"2023-10-08T13:04:15.129896+0000","last_clean":"2023-10-08T13:04:15.129896+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:04:15.129896+0000","last_undegraded":"2023-10-08T13:04:15.129896+0000","last_fullsized":"2023-10-08T13:04:15.129896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246961+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:04:16.246961+0000","last_peered":"2023-10-08T13:04:16.246961+0000","last_clean":"2023-10-08T13:04:16.246961+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:04:16.246961+0000","last_undegraded":"2023-10-08T13:04:16.246961+0000","last_fullsized":"2023-10-08T13:04:16.246961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142909+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:04:31.142909+0000","last_peered":"2023-10-08T13:04:31.142909+0000","last_clean":"2023-10-08T13:04:31.142909+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:04:31.142909+0000","last_undegraded":"2023-10-08T13:04:31.142909+0000","last_fullsized":"2023-10-08T13:04:31.142909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138390+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:04:15.138390+0000","last_peered":"2023-10-08T13:04:15.138390+0000","last_clean":"2023-10-08T13:04:15.138390+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:04:15.138390+0000","last_undegraded":"2023-10-08T13:04:15.138390+0000","last_fullsized":"2023-10-08T13:04:15.138390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130641+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:04:16.130641+0000","last_peered":"2023-10-08T13:04:16.130641+0000","last_clean":"2023-10-08T13:04:16.130641+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:04:16.130641+0000","last_undegraded":"2023-10-08T13:04:16.130641+0000","last_fullsized":"2023-10-08T13:04:16.130641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131635+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:04:16.131635+0000","last_peered":"2023-10-08T13:04:16.131635+0000","last_clean":"2023-10-08T13:04:16.131635+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:04:16.131635+0000","last_undegraded":"2023-10-08T13:04:16.131635+0000","last_fullsized":"2023-10-08T13:04:16.131635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139387+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:04:15.139387+0000","last_peered":"2023-10-08T13:04:15.139387+0000","last_clean":"2023-10-08T13:04:15.139387+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:04:15.139387+0000","last_undegraded":"2023-10-08T13:04:15.139387+0000","last_fullsized":"2023-10-08T13:04:15.139387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130916+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:04:16.130916+0000","last_peered":"2023-10-08T13:04:16.130916+0000","last_clean":"2023-10-08T13:04:16.130916+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:04:16.130916+0000","last_undegraded":"2023-10-08T13:04:16.130916+0000","last_fullsized":"2023-10-08T13:04:16.130916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135214+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:04:15.135214+0000","last_peered":"2023-10-08T13:04:15.135214+0000","last_clean":"2023-10-08T13:04:15.135214+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:04:15.135214+0000","last_undegraded":"2023-10-08T13:04:15.135214+0000","last_fullsized":"2023-10-08T13:04:15.135214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129180+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:04:15.129180+0000","last_peered":"2023-10-08T13:04:15.129180+0000","last_clean":"2023-10-08T13:04:15.129180+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:04:15.129180+0000","last_undegraded":"2023-10-08T13:04:15.129180+0000","last_fullsized":"2023-10-08T13:04:15.129180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130768+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:04:16.130768+0000","last_peered":"2023-10-08T13:04:16.130768+0000","last_clean":"2023-10-08T13:04:16.130768+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:04:16.130768+0000","last_undegraded":"2023-10-08T13:04:16.130768+0000","last_fullsized":"2023-10-08T13:04:16.130768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134878+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:04:15.134878+0000","last_peered":"2023-10-08T13:04:15.134878+0000","last_clean":"2023-10-08T13:04:15.134878+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:04:15.134878+0000","last_undegraded":"2023-10-08T13:04:15.134878+0000","last_fullsized":"2023-10-08T13:04:15.134878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135845+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:04:15.135845+0000","last_peered":"2023-10-08T13:04:15.135845+0000","last_clean":"2023-10-08T13:04:15.135845+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:04:15.135845+0000","last_undegraded":"2023-10-08T13:04:15.135845+0000","last_fullsized":"2023-10-08T13:04:15.135845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247510+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:04:16.247510+0000","last_peered":"2023-10-08T13:04:16.247510+0000","last_clean":"2023-10-08T13:04:16.247510+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:04:16.247510+0000","last_undegraded":"2023-10-08T13:04:16.247510+0000","last_fullsized":"2023-10-08T13:04:16.247510+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.133656+0000","last_change":"2023-10-08T13:04:09.752715+0000","last_active":"2023-10-08T13:04:30.133656+0000","last_peered":"2023-10-08T13:04:30.133656+0000","last_clean":"2023-10-08T13:04:30.133656+0000","last_became_active":"2023-10-08T13:04:09.752343+0000","last_became_peered":"2023-10-08T13:04:09.752343+0000","last_unstale":"2023-10-08T13:04:30.133656+0000","last_undegraded":"2023-10-08T13:04:30.133656+0000","last_fullsized":"2023-10-08T13:04:30.133656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:08.548171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135730+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:04:15.135730+0000","last_peered":"2023-10-08T13:04:15.135730+0000","last_clean":"2023-10-08T13:04:15.135730+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:04:15.135730+0000","last_undegraded":"2023-10-08T13:04:15.135730+0000","last_fullsized":"2023-10-08T13:04:15.135730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247203+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:04:16.247203+0000","last_peered":"2023-10-08T13:04:16.247203+0000","last_clean":"2023-10-08T13:04:16.247203+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:04:16.247203+0000","last_undegraded":"2023-10-08T13:04:16.247203+0000","last_fullsized":"2023-10-08T13:04:16.247203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:32.147966+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:04:32.147966+0000","last_peered":"2023-10-08T13:04:32.147966+0000","last_clean":"2023-10-08T13:04:32.147966+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:04:32.147966+0000","last_undegraded":"2023-10-08T13:04:32.147966+0000","last_fullsized":"2023-10-08T13:04:32.147966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134551+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:04:15.134551+0000","last_peered":"2023-10-08T13:04:15.134551+0000","last_clean":"2023-10-08T13:04:15.134551+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:04:15.134551+0000","last_undegraded":"2023-10-08T13:04:15.134551+0000","last_fullsized":"2023-10-08T13:04:15.134551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247556+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:04:16.247556+0000","last_peered":"2023-10-08T13:04:16.247556+0000","last_clean":"2023-10-08T13:04:16.247556+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:04:16.247556+0000","last_undegraded":"2023-10-08T13:04:16.247556+0000","last_fullsized":"2023-10-08T13:04:16.247556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.141910+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:04:31.141910+0000","last_peered":"2023-10-08T13:04:31.141910+0000","last_clean":"2023-10-08T13:04:31.141910+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:04:31.141910+0000","last_undegraded":"2023-10-08T13:04:31.141910+0000","last_fullsized":"2023-10-08T13:04:31.141910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.141871+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:04:15.141871+0000","last_peered":"2023-10-08T13:04:15.141871+0000","last_clean":"2023-10-08T13:04:15.141871+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:04:15.141871+0000","last_undegraded":"2023-10-08T13:04:15.141871+0000","last_fullsized":"2023-10-08T13:04:15.141871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247141+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:04:16.247141+0000","last_peered":"2023-10-08T13:04:16.247141+0000","last_clean":"2023-10-08T13:04:16.247141+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:04:16.247141+0000","last_undegraded":"2023-10-08T13:04:16.247141+0000","last_fullsized":"2023-10-08T13:04:16.247141+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130845+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:04:16.130845+0000","last_peered":"2023-10-08T13:04:16.130845+0000","last_clean":"2023-10-08T13:04:16.130845+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:04:16.130845+0000","last_undegraded":"2023-10-08T13:04:16.130845+0000","last_fullsized":"2023-10-08T13:04:16.130845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135673+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:04:15.135673+0000","last_peered":"2023-10-08T13:04:15.135673+0000","last_clean":"2023-10-08T13:04:15.135673+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:04:15.135673+0000","last_undegraded":"2023-10-08T13:04:15.135673+0000","last_fullsized":"2023-10-08T13:04:15.135673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130797+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:04:16.130797+0000","last_peered":"2023-10-08T13:04:16.130797+0000","last_clean":"2023-10-08T13:04:16.130797+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:04:16.130797+0000","last_undegraded":"2023-10-08T13:04:16.130797+0000","last_fullsized":"2023-10-08T13:04:16.130797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131911+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:04:30.131911+0000","last_peered":"2023-10-08T13:04:30.131911+0000","last_clean":"2023-10-08T13:04:30.131911+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:04:30.131911+0000","last_undegraded":"2023-10-08T13:04:30.131911+0000","last_fullsized":"2023-10-08T13:04:30.131911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129691+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:04:15.129691+0000","last_peered":"2023-10-08T13:04:15.129691+0000","last_clean":"2023-10-08T13:04:15.129691+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:04:15.129691+0000","last_undegraded":"2023-10-08T13:04:15.129691+0000","last_fullsized":"2023-10-08T13:04:15.129691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246617+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:04:16.246617+0000","last_peered":"2023-10-08T13:04:16.246617+0000","last_clean":"2023-10-08T13:04:16.246617+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:04:16.246617+0000","last_undegraded":"2023-10-08T13:04:16.246617+0000","last_fullsized":"2023-10-08T13:04:16.246617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:33.156691+0000","last_change":"2023-10-08T13:04:09.754360+0000","last_active":"2023-10-08T13:04:33.156691+0000","last_peered":"2023-10-08T13:04:33.156691+0000","last_clean":"2023-10-08T13:04:33.156691+0000","last_became_active":"2023-10-08T13:04:09.754047+0000","last_became_peered":"2023-10-08T13:04:09.754047+0000","last_unstale":"2023-10-08T13:04:33.156691+0000","last_undegraded":"2023-10-08T13:04:33.156691+0000","last_fullsized":"2023-10-08T13:04:33.156691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:11.616693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139483+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:04:15.139483+0000","last_peered":"2023-10-08T13:04:15.139483+0000","last_clean":"2023-10-08T13:04:15.139483+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:04:15.139483+0000","last_undegraded":"2023-10-08T13:04:15.139483+0000","last_fullsized":"2023-10-08T13:04:15.139483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131182+0000","last_change":"2023-10-08T13:04:15.151758+0000","last_active":"2023-10-08T13:04:16.131182+0000","last_peered":"2023-10-08T13:04:16.131182+0000","last_clean":"2023-10-08T13:04:16.131182+0000","last_became_active":"2023-10-08T13:04:15.151253+0000","last_became_peered":"2023-10-08T13:04:15.151253+0000","last_unstale":"2023-10-08T13:04:16.131182+0000","last_undegraded":"2023-10-08T13:04:16.131182+0000","last_fullsized":"2023-10-08T13:04:16.131182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:43.125206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131384+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:04:16.131384+0000","last_peered":"2023-10-08T13:04:16.131384+0000","last_clean":"2023-10-08T13:04:16.131384+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:04:16.131384+0000","last_undegraded":"2023-10-08T13:04:16.131384+0000","last_fullsized":"2023-10-08T13:04:16.131384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129394+0000","last_change":"2023-10-08T13:04:10.753807+0000","last_active":"2023-10-08T13:04:15.129394+0000","last_peered":"2023-10-08T13:04:15.129394+0000","last_clean":"2023-10-08T13:04:15.129394+0000","last_became_active":"2023-10-08T13:04:10.753030+0000","last_became_peered":"2023-10-08T13:04:10.753030+0000","last_unstale":"2023-10-08T13:04:15.129394+0000","last_undegraded":"2023-10-08T13:04:15.129394+0000","last_fullsized":"2023-10-08T13:04:15.129394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:06.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247249+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:04:16.247249+0000","last_peered":"2023-10-08T13:04:16.247249+0000","last_clean":"2023-10-08T13:04:16.247249+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:04:16.247249+0000","last_undegraded":"2023-10-08T13:04:16.247249+0000","last_fullsized":"2023-10-08T13:04:16.247249+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'12","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131105+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:04:30.131105+0000","last_peered":"2023-10-08T13:04:30.131105+0000","last_clean":"2023-10-08T13:04:30.131105+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:04:30.131105+0000","last_undegraded":"2023-10-08T13:04:30.131105+0000","last_fullsized":"2023-10-08T13:04:30.131105+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134926+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:04:15.134926+0000","last_peered":"2023-10-08T13:04:15.134926+0000","last_clean":"2023-10-08T13:04:15.134926+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:04:15.134926+0000","last_undegraded":"2023-10-08T13:04:15.134926+0000","last_fullsized":"2023-10-08T13:04:15.134926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131657+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:04:16.131657+0000","last_peered":"2023-10-08T13:04:16.131657+0000","last_clean":"2023-10-08T13:04:16.131657+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:04:16.131657+0000","last_undegraded":"2023-10-08T13:04:16.131657+0000","last_fullsized":"2023-10-08T13:04:16.131657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131409+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:04:30.131409+0000","last_peered":"2023-10-08T13:04:30.131409+0000","last_clean":"2023-10-08T13:04:30.131409+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:04:30.131409+0000","last_undegraded":"2023-10-08T13:04:30.131409+0000","last_fullsized":"2023-10-08T13:04:30.131409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128886+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:04:15.128886+0000","last_peered":"2023-10-08T13:04:15.128886+0000","last_clean":"2023-10-08T13:04:15.128886+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:04:15.128886+0000","last_undegraded":"2023-10-08T13:04:15.128886+0000","last_fullsized":"2023-10-08T13:04:15.128886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247288+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:04:16.247288+0000","last_peered":"2023-10-08T13:04:16.247288+0000","last_clean":"2023-10-08T13:04:16.247288+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:04:16.247288+0000","last_undegraded":"2023-10-08T13:04:16.247288+0000","last_fullsized":"2023-10-08T13:04:16.247288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.133422+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:04:30.133422+0000","last_peered":"2023-10-08T13:04:30.133422+0000","last_clean":"2023-10-08T13:04:30.133422+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:04:30.133422+0000","last_undegraded":"2023-10-08T13:04:30.133422+0000","last_fullsized":"2023-10-08T13:04:30.133422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133771+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:04:15.133771+0000","last_peered":"2023-10-08T13:04:15.133771+0000","last_clean":"2023-10-08T13:04:15.133771+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:04:15.133771+0000","last_undegraded":"2023-10-08T13:04:15.133771+0000","last_fullsized":"2023-10-08T13:04:15.133771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246804+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:04:16.246804+0000","last_peered":"2023-10-08T13:04:16.246804+0000","last_clean":"2023-10-08T13:04:16.246804+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:04:16.246804+0000","last_undegraded":"2023-10-08T13:04:16.246804+0000","last_fullsized":"2023-10-08T13:04:16.246804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:34.160615+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:04:34.160615+0000","last_peered":"2023-10-08T13:04:34.160615+0000","last_clean":"2023-10-08T13:04:34.160615+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:04:34.160615+0000","last_undegraded":"2023-10-08T13:04:34.160615+0000","last_fullsized":"2023-10-08T13:04:34.160615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135448+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:04:15.135448+0000","last_peered":"2023-10-08T13:04:15.135448+0000","last_clean":"2023-10-08T13:04:15.135448+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:04:15.135448+0000","last_undegraded":"2023-10-08T13:04:15.135448+0000","last_fullsized":"2023-10-08T13:04:15.135448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247479+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:04:16.247479+0000","last_peered":"2023-10-08T13:04:16.247479+0000","last_clean":"2023-10-08T13:04:16.247479+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:04:16.247479+0000","last_undegraded":"2023-10-08T13:04:16.247479+0000","last_fullsized":"2023-10-08T13:04:16.247479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.129067+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:04:30.129067+0000","last_peered":"2023-10-08T13:04:30.129067+0000","last_clean":"2023-10-08T13:04:30.129067+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:04:30.129067+0000","last_undegraded":"2023-10-08T13:04:30.129067+0000","last_fullsized":"2023-10-08T13:04:30.129067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136155+0000","last_change":"2023-10-08T13:04:10.755107+0000","last_active":"2023-10-08T13:04:15.136155+0000","last_peered":"2023-10-08T13:04:15.136155+0000","last_clean":"2023-10-08T13:04:15.136155+0000","last_became_active":"2023-10-08T13:04:10.754779+0000","last_became_peered":"2023-10-08T13:04:10.754779+0000","last_unstale":"2023-10-08T13:04:15.136155+0000","last_undegraded":"2023-10-08T13:04:15.136155+0000","last_fullsized":"2023-10-08T13:04:15.136155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:28:20.765315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130840+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:04:16.130840+0000","last_peered":"2023-10-08T13:04:16.130840+0000","last_clean":"2023-10-08T13:04:16.130840+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:04:16.130840+0000","last_undegraded":"2023-10-08T13:04:16.130840+0000","last_fullsized":"2023-10-08T13:04:16.130840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134442+0000","last_change":"2023-10-08T13:04:09.753810+0000","last_active":"2023-10-08T13:04:15.134442+0000","last_peered":"2023-10-08T13:04:15.134442+0000","last_clean":"2023-10-08T13:04:15.134442+0000","last_became_active":"2023-10-08T13:04:09.753497+0000","last_became_peered":"2023-10-08T13:04:09.753497+0000","last_unstale":"2023-10-08T13:04:15.134442+0000","last_undegraded":"2023-10-08T13:04:15.134442+0000","last_fullsized":"2023-10-08T13:04:15.134442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:11.309476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134660+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:04:15.134660+0000","last_peered":"2023-10-08T13:04:15.134660+0000","last_clean":"2023-10-08T13:04:15.134660+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:04:15.134660+0000","last_undegraded":"2023-10-08T13:04:15.134660+0000","last_fullsized":"2023-10-08T13:04:15.134660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.822838+0000","last_change":"2023-10-08T13:04:15.506195+0000","last_active":"2023-10-08T13:04:16.822838+0000","last_peered":"2023-10-08T13:04:16.822838+0000","last_clean":"2023-10-08T13:04:16.822838+0000","last_became_active":"2023-10-08T13:04:15.505424+0000","last_became_peered":"2023-10-08T13:04:15.505424+0000","last_unstale":"2023-10-08T13:04:16.822838+0000","last_undegraded":"2023-10-08T13:04:16.822838+0000","last_fullsized":"2023-10-08T13:04:16.822838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:54.231192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.140526+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:04:15.140526+0000","last_peered":"2023-10-08T13:04:15.140526+0000","last_clean":"2023-10-08T13:04:15.140526+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:04:15.140526+0000","last_undegraded":"2023-10-08T13:04:15.140526+0000","last_fullsized":"2023-10-08T13:04:15.140526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.505276+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:04:15.505276+0000","last_peered":"2023-10-08T13:04:15.505276+0000","last_clean":"2023-10-08T13:04:15.505276+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:04:15.505276+0000","last_undegraded":"2023-10-08T13:04:15.505276+0000","last_fullsized":"2023-10-08T13:04:15.505276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.248052+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:04:16.248052+0000","last_peered":"2023-10-08T13:04:16.248052+0000","last_clean":"2023-10-08T13:04:16.248052+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:04:16.248052+0000","last_undegraded":"2023-10-08T13:04:16.248052+0000","last_fullsized":"2023-10-08T13:04:16.248052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:33.157427+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:04:33.157427+0000","last_peered":"2023-10-08T13:04:33.157427+0000","last_clean":"2023-10-08T13:04:33.157427+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:04:33.157427+0000","last_undegraded":"2023-10-08T13:04:33.157427+0000","last_fullsized":"2023-10-08T13:04:33.157427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.504951+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:04:15.504951+0000","last_peered":"2023-10-08T13:04:15.504951+0000","last_clean":"2023-10-08T13:04:15.504951+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:04:15.504951+0000","last_undegraded":"2023-10-08T13:04:15.504951+0000","last_fullsized":"2023-10-08T13:04:15.504951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247623+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:04:16.247623+0000","last_peered":"2023-10-08T13:04:16.247623+0000","last_clean":"2023-10-08T13:04:16.247623+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:04:16.247623+0000","last_undegraded":"2023-10-08T13:04:16.247623+0000","last_fullsized":"2023-10-08T13:04:16.247623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134584+0000","last_change":"2023-10-08T13:04:10.752999+0000","last_active":"2023-10-08T13:04:15.134584+0000","last_peered":"2023-10-08T13:04:15.134584+0000","last_clean":"2023-10-08T13:04:15.134584+0000","last_became_active":"2023-10-08T13:04:10.752639+0000","last_became_peered":"2023-10-08T13:04:10.752639+0000","last_unstale":"2023-10-08T13:04:15.134584+0000","last_undegraded":"2023-10-08T13:04:15.134584+0000","last_fullsized":"2023-10-08T13:04:15.134584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:20.038674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142497+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:04:31.142497+0000","last_peered":"2023-10-08T13:04:31.142497+0000","last_clean":"2023-10-08T13:04:31.142497+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:04:31.142497+0000","last_undegraded":"2023-10-08T13:04:31.142497+0000","last_fullsized":"2023-10-08T13:04:31.142497+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.248293+0000","last_change":"2023-10-08T13:04:15.151726+0000","last_active":"2023-10-08T13:04:16.248293+0000","last_peered":"2023-10-08T13:04:16.248293+0000","last_clean":"2023-10-08T13:04:16.248293+0000","last_became_active":"2023-10-08T13:04:15.151312+0000","last_became_peered":"2023-10-08T13:04:15.151312+0000","last_unstale":"2023-10-08T13:04:16.248293+0000","last_undegraded":"2023-10-08T13:04:16.248293+0000","last_fullsized":"2023-10-08T13:04:16.248293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:52.256863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136824+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:04:15.136824+0000","last_peered":"2023-10-08T13:04:15.136824+0000","last_clean":"2023-10-08T13:04:15.136824+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:04:15.136824+0000","last_undegraded":"2023-10-08T13:04:15.136824+0000","last_fullsized":"2023-10-08T13:04:15.136824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:34.158703+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:04:34.158703+0000","last_peered":"2023-10-08T13:04:34.158703+0000","last_clean":"2023-10-08T13:04:34.158703+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:04:34.158703+0000","last_undegraded":"2023-10-08T13:04:34.158703+0000","last_fullsized":"2023-10-08T13:04:34.158703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135132+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:04:15.135132+0000","last_peered":"2023-10-08T13:04:15.135132+0000","last_clean":"2023-10-08T13:04:15.135132+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:04:15.135132+0000","last_undegraded":"2023-10-08T13:04:15.135132+0000","last_fullsized":"2023-10-08T13:04:15.135132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131512+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:04:16.131512+0000","last_peered":"2023-10-08T13:04:16.131512+0000","last_clean":"2023-10-08T13:04:16.131512+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:04:16.131512+0000","last_undegraded":"2023-10-08T13:04:16.131512+0000","last_fullsized":"2023-10-08T13:04:16.131512+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128612+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:04:15.128612+0000","last_peered":"2023-10-08T13:04:15.128612+0000","last_clean":"2023-10-08T13:04:15.128612+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:04:15.128612+0000","last_undegraded":"2023-10-08T13:04:15.128612+0000","last_fullsized":"2023-10-08T13:04:15.128612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142145+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:04:31.142145+0000","last_peered":"2023-10-08T13:04:31.142145+0000","last_clean":"2023-10-08T13:04:31.142145+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:04:31.142145+0000","last_undegraded":"2023-10-08T13:04:31.142145+0000","last_fullsized":"2023-10-08T13:04:31.142145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247250+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:04:16.247250+0000","last_peered":"2023-10-08T13:04:16.247250+0000","last_clean":"2023-10-08T13:04:16.247250+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:04:16.247250+0000","last_undegraded":"2023-10-08T13:04:16.247250+0000","last_fullsized":"2023-10-08T13:04:16.247250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.823032+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:04:16.823032+0000","last_peered":"2023-10-08T13:04:16.823032+0000","last_clean":"2023-10-08T13:04:16.823032+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:04:16.823032+0000","last_undegraded":"2023-10-08T13:04:16.823032+0000","last_fullsized":"2023-10-08T13:04:16.823032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128983+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:04:15.128983+0000","last_peered":"2023-10-08T13:04:15.128983+0000","last_clean":"2023-10-08T13:04:15.128983+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:04:15.128983+0000","last_undegraded":"2023-10-08T13:04:15.128983+0000","last_fullsized":"2023-10-08T13:04:15.128983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130545+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:04:16.130545+0000","last_peered":"2023-10-08T13:04:16.130545+0000","last_clean":"2023-10-08T13:04:16.130545+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:04:16.130545+0000","last_undegraded":"2023-10-08T13:04:16.130545+0000","last_fullsized":"2023-10-08T13:04:16.130545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142189+0000","last_change":"2023-10-08T13:04:09.752541+0000","last_active":"2023-10-08T13:04:31.142189+0000","last_peered":"2023-10-08T13:04:31.142189+0000","last_clean":"2023-10-08T13:04:31.142189+0000","last_became_active":"2023-10-08T13:04:09.751993+0000","last_became_peered":"2023-10-08T13:04:09.751993+0000","last_unstale":"2023-10-08T13:04:31.142189+0000","last_undegraded":"2023-10-08T13:04:31.142189+0000","last_fullsized":"2023-10-08T13:04:31.142189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:02.681384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136516+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:04:15.136516+0000","last_peered":"2023-10-08T13:04:15.136516+0000","last_clean":"2023-10-08T13:04:15.136516+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:04:15.136516+0000","last_undegraded":"2023-10-08T13:04:15.136516+0000","last_fullsized":"2023-10-08T13:04:15.136516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246617+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:04:16.246617+0000","last_peered":"2023-10-08T13:04:16.246617+0000","last_clean":"2023-10-08T13:04:16.246617+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:04:16.246617+0000","last_undegraded":"2023-10-08T13:04:16.246617+0000","last_fullsized":"2023-10-08T13:04:16.246617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:33.156981+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:04:33.156981+0000","last_peered":"2023-10-08T13:04:33.156981+0000","last_clean":"2023-10-08T13:04:33.156981+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:04:33.156981+0000","last_undegraded":"2023-10-08T13:04:33.156981+0000","last_fullsized":"2023-10-08T13:04:33.156981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139388+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:04:15.139388+0000","last_peered":"2023-10-08T13:04:15.139388+0000","last_clean":"2023-10-08T13:04:15.139388+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:04:15.139388+0000","last_undegraded":"2023-10-08T13:04:15.139388+0000","last_fullsized":"2023-10-08T13:04:15.139388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131309+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:16.131309+0000","last_peered":"2023-10-08T13:04:16.131309+0000","last_clean":"2023-10-08T13:04:16.131309+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:04:16.131309+0000","last_undegraded":"2023-10-08T13:04:16.131309+0000","last_fullsized":"2023-10-08T13:04:16.131309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.129438+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:04:30.129438+0000","last_peered":"2023-10-08T13:04:30.129438+0000","last_clean":"2023-10-08T13:04:30.129438+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:04:30.129438+0000","last_undegraded":"2023-10-08T13:04:30.129438+0000","last_fullsized":"2023-10-08T13:04:30.129438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133477+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:04:15.133477+0000","last_peered":"2023-10-08T13:04:15.133477+0000","last_clean":"2023-10-08T13:04:15.133477+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:04:15.133477+0000","last_undegraded":"2023-10-08T13:04:15.133477+0000","last_fullsized":"2023-10-08T13:04:15.133477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247055+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:04:16.247055+0000","last_peered":"2023-10-08T13:04:16.247055+0000","last_clean":"2023-10-08T13:04:16.247055+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:04:16.247055+0000","last_undegraded":"2023-10-08T13:04:16.247055+0000","last_fullsized":"2023-10-08T13:04:16.247055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.133019+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:04:30.133019+0000","last_peered":"2023-10-08T13:04:30.133019+0000","last_clean":"2023-10-08T13:04:30.133019+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:04:30.133019+0000","last_undegraded":"2023-10-08T13:04:30.133019+0000","last_fullsized":"2023-10-08T13:04:30.133019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135127+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:04:15.135127+0000","last_peered":"2023-10-08T13:04:15.135127+0000","last_clean":"2023-10-08T13:04:15.135127+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:04:15.135127+0000","last_undegraded":"2023-10-08T13:04:15.135127+0000","last_fullsized":"2023-10-08T13:04:15.135127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130915+0000","last_change":"2023-10-08T13:04:15.154280+0000","last_active":"2023-10-08T13:04:16.130915+0000","last_peered":"2023-10-08T13:04:16.130915+0000","last_clean":"2023-10-08T13:04:16.130915+0000","last_became_active":"2023-10-08T13:04:15.153890+0000","last_became_peered":"2023-10-08T13:04:15.153890+0000","last_unstale":"2023-10-08T13:04:16.130915+0000","last_undegraded":"2023-10-08T13:04:16.130915+0000","last_fullsized":"2023-10-08T13:04:16.130915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:21:55.919457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129056+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:04:15.129056+0000","last_peered":"2023-10-08T13:04:15.129056+0000","last_clean":"2023-10-08T13:04:15.129056+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:04:15.129056+0000","last_undegraded":"2023-10-08T13:04:15.129056+0000","last_fullsized":"2023-10-08T13:04:15.129056+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135496+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:04:15.135496+0000","last_peered":"2023-10-08T13:04:15.135496+0000","last_clean":"2023-10-08T13:04:15.135496+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:04:15.135496+0000","last_undegraded":"2023-10-08T13:04:15.135496+0000","last_fullsized":"2023-10-08T13:04:15.135496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131202+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:16.131202+0000","last_peered":"2023-10-08T13:04:16.131202+0000","last_clean":"2023-10-08T13:04:16.131202+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:04:16.131202+0000","last_undegraded":"2023-10-08T13:04:16.131202+0000","last_fullsized":"2023-10-08T13:04:16.131202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131776+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:04:30.131776+0000","last_peered":"2023-10-08T13:04:30.131776+0000","last_clean":"2023-10-08T13:04:30.131776+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:04:30.131776+0000","last_undegraded":"2023-10-08T13:04:30.131776+0000","last_fullsized":"2023-10-08T13:04:30.131776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135282+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:04:15.135282+0000","last_peered":"2023-10-08T13:04:15.135282+0000","last_clean":"2023-10-08T13:04:15.135282+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:04:15.135282+0000","last_undegraded":"2023-10-08T13:04:15.135282+0000","last_fullsized":"2023-10-08T13:04:15.135282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247719+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:04:16.247719+0000","last_peered":"2023-10-08T13:04:16.247719+0000","last_clean":"2023-10-08T13:04:16.247719+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:04:16.247719+0000","last_undegraded":"2023-10-08T13:04:16.247719+0000","last_fullsized":"2023-10-08T13:04:16.247719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129503+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:04:15.129503+0000","last_peered":"2023-10-08T13:04:15.129503+0000","last_clean":"2023-10-08T13:04:15.129503+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:04:15.129503+0000","last_undegraded":"2023-10-08T13:04:15.129503+0000","last_fullsized":"2023-10-08T13:04:15.129503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135140+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:04:15.135140+0000","last_peered":"2023-10-08T13:04:15.135140+0000","last_clean":"2023-10-08T13:04:15.135140+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:04:15.135140+0000","last_undegraded":"2023-10-08T13:04:15.135140+0000","last_fullsized":"2023-10-08T13:04:15.135140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247509+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:04:16.247509+0000","last_peered":"2023-10-08T13:04:16.247509+0000","last_clean":"2023-10-08T13:04:16.247509+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:04:16.247509+0000","last_undegraded":"2023-10-08T13:04:16.247509+0000","last_fullsized":"2023-10-08T13:04:16.247509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135975+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:04:15.135975+0000","last_peered":"2023-10-08T13:04:15.135975+0000","last_clean":"2023-10-08T13:04:15.135975+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:04:15.135975+0000","last_undegraded":"2023-10-08T13:04:15.135975+0000","last_fullsized":"2023-10-08T13:04:15.135975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133600+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:04:15.133600+0000","last_peered":"2023-10-08T13:04:15.133600+0000","last_clean":"2023-10-08T13:04:15.133600+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:04:15.133600+0000","last_undegraded":"2023-10-08T13:04:15.133600+0000","last_fullsized":"2023-10-08T13:04:15.133600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130661+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:04:16.130661+0000","last_peered":"2023-10-08T13:04:16.130661+0000","last_clean":"2023-10-08T13:04:16.130661+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:04:16.130661+0000","last_undegraded":"2023-10-08T13:04:16.130661+0000","last_fullsized":"2023-10-08T13:04:16.130661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247583+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:04:16.247583+0000","last_peered":"2023-10-08T13:04:16.247583+0000","last_clean":"2023-10-08T13:04:16.247583+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:04:16.247583+0000","last_undegraded":"2023-10-08T13:04:16.247583+0000","last_fullsized":"2023-10-08T13:04:16.247583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133946+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:04:15.133946+0000","last_peered":"2023-10-08T13:04:15.133946+0000","last_clean":"2023-10-08T13:04:15.133946+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:04:15.133946+0000","last_undegraded":"2023-10-08T13:04:15.133946+0000","last_fullsized":"2023-10-08T13:04:15.133946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135221+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:04:15.135221+0000","last_peered":"2023-10-08T13:04:15.135221+0000","last_clean":"2023-10-08T13:04:15.135221+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:04:15.135221+0000","last_undegraded":"2023-10-08T13:04:15.135221+0000","last_fullsized":"2023-10-08T13:04:15.135221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.130229+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:04:15.130229+0000","last_peered":"2023-10-08T13:04:15.130229+0000","last_clean":"2023-10-08T13:04:15.130229+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:04:15.130229+0000","last_undegraded":"2023-10-08T13:04:15.130229+0000","last_fullsized":"2023-10-08T13:04:15.130229+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128911+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:04:15.128911+0000","last_peered":"2023-10-08T13:04:15.128911+0000","last_clean":"2023-10-08T13:04:15.128911+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:04:15.128911+0000","last_undegraded":"2023-10-08T13:04:15.128911+0000","last_fullsized":"2023-10-08T13:04:15.128911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139071+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:04:15.139071+0000","last_peered":"2023-10-08T13:04:15.139071+0000","last_clean":"2023-10-08T13:04:15.139071+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:04:15.139071+0000","last_undegraded":"2023-10-08T13:04:15.139071+0000","last_fullsized":"2023-10-08T13:04:15.139071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129086+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:04:15.129086+0000","last_peered":"2023-10-08T13:04:15.129086+0000","last_clean":"2023-10-08T13:04:15.129086+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:04:15.129086+0000","last_undegraded":"2023-10-08T13:04:15.129086+0000","last_fullsized":"2023-10-08T13:04:15.129086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136199+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:04:15.136199+0000","last_peered":"2023-10-08T13:04:15.136199+0000","last_clean":"2023-10-08T13:04:15.136199+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:04:15.136199+0000","last_undegraded":"2023-10-08T13:04:15.136199+0000","last_fullsized":"2023-10-08T13:04:15.136199+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129519+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:04:15.129519+0000","last_peered":"2023-10-08T13:04:15.129519+0000","last_clean":"2023-10-08T13:04:15.129519+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:04:15.129519+0000","last_undegraded":"2023-10-08T13:04:15.129519+0000","last_fullsized":"2023-10-08T13:04:15.129519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.137991+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:04:15.137991+0000","last_peered":"2023-10-08T13:04:15.137991+0000","last_clean":"2023-10-08T13:04:15.137991+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:04:15.137991+0000","last_undegraded":"2023-10-08T13:04:15.137991+0000","last_fullsized":"2023-10-08T13:04:15.137991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134489+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:04:15.134489+0000","last_peered":"2023-10-08T13:04:15.134489+0000","last_clean":"2023-10-08T13:04:15.134489+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:04:15.134489+0000","last_undegraded":"2023-10-08T13:04:15.134489+0000","last_fullsized":"2023-10-08T13:04:15.134489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138144+0000","last_change":"2023-10-08T13:04:10.755869+0000","last_active":"2023-10-08T13:04:15.138144+0000","last_peered":"2023-10-08T13:04:15.138144+0000","last_clean":"2023-10-08T13:04:15.138144+0000","last_became_active":"2023-10-08T13:04:10.755558+0000","last_became_peered":"2023-10-08T13:04:10.755558+0000","last_unstale":"2023-10-08T13:04:15.138144+0000","last_undegraded":"2023-10-08T13:04:15.138144+0000","last_fullsized":"2023-10-08T13:04:15.138144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:43.855459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129795+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:04:15.129795+0000","last_peered":"2023-10-08T13:04:15.129795+0000","last_clean":"2023-10-08T13:04:15.129795+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:04:15.129795+0000","last_undegraded":"2023-10-08T13:04:15.129795+0000","last_fullsized":"2023-10-08T13:04:15.129795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129269+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:04:15.129269+0000","last_peered":"2023-10-08T13:04:15.129269+0000","last_clean":"2023-10-08T13:04:15.129269+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:04:15.129269+0000","last_undegraded":"2023-10-08T13:04:15.129269+0000","last_fullsized":"2023-10-08T13:04:15.129269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134204+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:04:15.134204+0000","last_peered":"2023-10-08T13:04:15.134204+0000","last_clean":"2023-10-08T13:04:15.134204+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:04:15.134204+0000","last_undegraded":"2023-10-08T13:04:15.134204+0000","last_fullsized":"2023-10-08T13:04:15.134204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7882,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":139,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":44213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449103,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":480810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.443}]},{"osd":1,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.747},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.85699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.877}]},{"osd":10,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.81999999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678035,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1075530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.36399999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67400000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.66900000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.73499999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.749}]}]},{"osd":9,"up_from":66,"seq":283467841560,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.433}]},{"osd":3,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.373}]},{"osd":4,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65500000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68300000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.62}]},{"osd":10,"last update":"Sun Oct 8 13:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":8,"up_from":58,"seq":249108103196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":479913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.82099999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.752,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.502},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60599999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71399999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.127},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.75}]},{"osd":5,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.32600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.81999999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.90700000000000003,"5min":1.127,"15min":1.127},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":1.048,"15min":1.048},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.873},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.88700000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.90000000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":7,"up_from":51,"seq":219043332128,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1072177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.31,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84199999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81399999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.751,"15min":0.749},"min":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.93700000000000006,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.64600000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.998,"5min":1.23,"15min":1.23},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67500000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.72599999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.746},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.628}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495653,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":479708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.39800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.626},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.42199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82199999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.89000000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.874},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.98299999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77900000000000003,"15min":0.78000000000000003},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.80600000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71499999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:04:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":485602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.78600000000000003,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.51500000000000001},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.745,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.97899999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77400000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58399999999999996,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.88800000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48199999999999998,"15min":0.47199999999999998},"min":{"1min":0.377,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.55900000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.65400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.747},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.47899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.86799999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.03,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.501,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.71099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.038},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0529999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.022},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.0760000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":481096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.377,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.51400000000000001,"15min":0.496},"min":{"1min":0.36299999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.755}]},{"osd":2,"last update":"Sun Oct 8 13:04:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77100000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.83299999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.40600000000000003},"min":{"1min":0.32500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.45900000000000002,"15min":0.44900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57999999999999996,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94899999999999995,"5min":1.387,"15min":1.387},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.373,"15min":0.373},"max":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69499999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.621},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.997,"5min":1.01,"15min":1.01},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0209999999999999,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.86199999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76200000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.95699999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93500000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.81999999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98099999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":484116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69199999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.496}]},{"osd":1,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83999999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.52900000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1930000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2729999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65300000000000002,"5min":1.72,"15min":1.72},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.91300000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0469999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.88600000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.872},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.95099999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":479902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.27700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.34100000000000003},"min":{"1min":0.27900000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.56899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.34599999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.41099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.40899999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.44700000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.751},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77500000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.61699999999999999,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90000000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.64000000000000001},"min":{"1min":0.51100000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.83999999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.70799999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73099999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":4,"up_from":33,"seq":141733920814,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":480708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.35099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.42799999999999999},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.47599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.627}]},{"osd":3,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.378,"15min":0.378},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.83599999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.88300000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0409999999999999,"5min":1.071,"15min":1.071},"last":0.93899999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.82399999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757288,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1572864,"data_stored":1070168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77300000000000002,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.505,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":1.899,"15min":1.899},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.628}]},{"osd":2,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40899999999999997,"15min":0.38500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.35399999999999998},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.317}]},{"osd":3,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.872,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75900000000000001,"5min":2.085,"15min":2.085},"last":0.53800000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.55600000000000005},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":1.962,"15min":1.962},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.622,"15min":0.59199999999999997},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.66400000000000003,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.73799999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.50700000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.70499999999999996}]},{"osd":10,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.751},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":23365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":5544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:04:36.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:04:36.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:36 smithi060 ceph-mon[103190]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:36.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:36 smithi060 ceph-mon[103190]: pgmap v254: 129 pgs: 129 active+clean; 584 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.1 KiB/s wr, 8 op/s 2023-10-08T13:04:36.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:36 smithi060 ceph-mon[103190]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T13:04:36.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:36 smithi060 ceph-mon[103190]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:04:36.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/655231792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:04:36.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3663427998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:36.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 -- 172.21.15.5:0/3170568958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75740fff00 msgr2=0x7f757410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 --2- 172.21.15.5:0/3170568958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75740fff00 0x7f757410c3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f756c00b0d0 tx=0x7f756c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 -- 172.21.15.5:0/3170568958 shutdown_connections 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 --2- 172.21.15.5:0/3170568958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75740fff00 0x7f757410c3c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 --2- 172.21.15.5:0/3170568958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7574105600 0x7f75741059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 --2- 172.21.15.5:0/3170568958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75740ff540 0x7f75740ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 -- 172.21.15.5:0/3170568958 >> 172.21.15.5:0/3170568958 conn(0x7f75740fb010 msgr2=0x7f75740fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 -- 172.21.15.5:0/3170568958 shutdown_connections 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 -- 172.21.15.5:0/3170568958 wait complete. 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.713+0000 7f7579ded700 1 Processor -- start 2023-10-08T13:04:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 -- start start 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75740ff540 0x7f757419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75740fff00 0x7f757419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 0x7f7574196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574196fa0 con 0x7f7574105600 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574197110 con 0x7f75740fff00 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7579ded700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741972d0 con 0x7f75740ff540 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 0x7f7574196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 0x7f7574196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33012/0 (socket says 172.21.15.5:33012) 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 -- 172.21.15.5:0/2534327652 learned_addr learned my addr 172.21.15.5:0/2534327652 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7572ffd700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75740fff00 0x7f757419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f75737fe700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75740ff540 0x7f757419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 -- 172.21.15.5:0/2534327652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75740ff540 msgr2=0x7f757419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75740ff540 0x7f757419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 -- 172.21.15.5:0/2534327652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75740fff00 msgr2=0x7f757419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75740fff00 0x7f757419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.714+0000 7f7573fff700 1 -- 172.21.15.5:0/2534327652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009d00 con 0x7f7574105600 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.715+0000 7f7573fff700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 0x7f7574196940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f756c00bd50 tx=0x7f756c00bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.715+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00e040 con 0x7f7574105600 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.715+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574197550 con 0x7f7574105600 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.715+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f756c01b8e0 con 0x7f7574105600 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.715+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0128f0 con 0x7f7574105600 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.715+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75741a3800 con 0x7f7574105600 2023-10-08T13:04:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.716+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574100c60 con 0x7f7574105600 2023-10-08T13:04:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.717+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f756c01ba50 con 0x7f7574105600 2023-10-08T13:04:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.717+0000 7f7570ff9700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75600a1560 0x7f75600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.718+0000 7f75737fe700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75600a1560 0x7f75600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.718+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f756c0ce9d0 con 0x7f7574105600 2023-10-08T13:04:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.718+0000 7f75737fe700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75600a1560 0x7f75600a3a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7564007be0 tx=0x7f75640073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.721+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f756c097c30 con 0x7f7574105600 2023-10-08T13:04:36.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.917+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f757410f460 con 0x7f75600a1560 2023-10-08T13:04:36.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.933+0000 7f7570ff9700 1 -- 172.21.15.5:0/2534327652 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422646 (secure 0 0 0) 0x7f757410f460 con 0x7f75600a1560 2023-10-08T13:04:36.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75600a1560 msgr2=0x7f75600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75600a1560 0x7f75600a3a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7564007be0 tx=0x7f75640073d0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 msgr2=0x7f7574196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 0x7f7574196940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f756c00bd50 tx=0x7f756c00bd80 comp rx=0 tx=0).stop 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 shutdown_connections 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75600a1560 0x7f75600a3a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7574105600 0x7f7574196940 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75740ff540 0x7f757419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 --2- 172.21.15.5:0/2534327652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75740fff00 0x7f757419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:36.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 >> 172.21.15.5:0/2534327652 conn(0x7f75740fb010 msgr2=0x7f75740fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:36.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 shutdown_connections 2023-10-08T13:04:36.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:36.936+0000 7f7579ded700 1 -- 172.21.15.5:0/2534327652 wait complete. 2023-10-08T13:04:36.944 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:04:36.950 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2023-10-08T13:04:35.090879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598373,"num_objects":65,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":145,"num_read_kb":127,"num_write":321,"num_write_kb":2978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259,"ondisk_log_size":259,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337500,"kb_used_data":13304,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604324,"statfs":{"total":1151940427776,"available":1151594827776,"internally_reserved":0,"allocated":13623296,"data_stored":7550132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5146,"num_objects":41,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":94,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003661"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135566+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:04:15.135566+0000","last_peered":"2023-10-08T13:04:15.135566+0000","last_clean":"2023-10-08T13:04:15.135566+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:04:15.135566+0000","last_undegraded":"2023-10-08T13:04:15.135566+0000","last_fullsized":"2023-10-08T13:04:15.135566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139329+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:04:15.139329+0000","last_peered":"2023-10-08T13:04:15.139329+0000","last_clean":"2023-10-08T13:04:15.139329+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:15.139329+0000","last_undegraded":"2023-10-08T13:04:15.139329+0000","last_fullsized":"2023-10-08T13:04:15.139329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139265+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:04:15.139265+0000","last_peered":"2023-10-08T13:04:15.139265+0000","last_clean":"2023-10-08T13:04:15.139265+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:04:15.139265+0000","last_undegraded":"2023-10-08T13:04:15.139265+0000","last_fullsized":"2023-10-08T13:04:15.139265+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.137105+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:04:15.137105+0000","last_peered":"2023-10-08T13:04:15.137105+0000","last_clean":"2023-10-08T13:04:15.137105+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:04:15.137105+0000","last_undegraded":"2023-10-08T13:04:15.137105+0000","last_fullsized":"2023-10-08T13:04:15.137105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133597+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:04:15.133597+0000","last_peered":"2023-10-08T13:04:15.133597+0000","last_clean":"2023-10-08T13:04:15.133597+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:04:15.133597+0000","last_undegraded":"2023-10-08T13:04:15.133597+0000","last_fullsized":"2023-10-08T13:04:15.133597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.504662+0000","last_change":"2023-10-08T13:04:10.751550+0000","last_active":"2023-10-08T13:04:15.504662+0000","last_peered":"2023-10-08T13:04:15.504662+0000","last_clean":"2023-10-08T13:04:15.504662+0000","last_became_active":"2023-10-08T13:04:10.751196+0000","last_became_peered":"2023-10-08T13:04:10.751196+0000","last_unstale":"2023-10-08T13:04:15.504662+0000","last_undegraded":"2023-10-08T13:04:15.504662+0000","last_fullsized":"2023-10-08T13:04:15.504662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:24.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135362+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:04:15.135362+0000","last_peered":"2023-10-08T13:04:15.135362+0000","last_clean":"2023-10-08T13:04:15.135362+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:04:15.135362+0000","last_undegraded":"2023-10-08T13:04:15.135362+0000","last_fullsized":"2023-10-08T13:04:15.135362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.141744+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:04:15.141744+0000","last_peered":"2023-10-08T13:04:15.141744+0000","last_clean":"2023-10-08T13:04:15.141744+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:04:15.141744+0000","last_undegraded":"2023-10-08T13:04:15.141744+0000","last_fullsized":"2023-10-08T13:04:15.141744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.130066+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:04:15.130066+0000","last_peered":"2023-10-08T13:04:15.130066+0000","last_clean":"2023-10-08T13:04:15.130066+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:04:15.130066+0000","last_undegraded":"2023-10-08T13:04:15.130066+0000","last_fullsized":"2023-10-08T13:04:15.130066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.505564+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:04:15.505564+0000","last_peered":"2023-10-08T13:04:15.505564+0000","last_clean":"2023-10-08T13:04:15.505564+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:04:15.505564+0000","last_undegraded":"2023-10-08T13:04:15.505564+0000","last_fullsized":"2023-10-08T13:04:15.505564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135092+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:04:15.135092+0000","last_peered":"2023-10-08T13:04:15.135092+0000","last_clean":"2023-10-08T13:04:15.135092+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:04:15.135092+0000","last_undegraded":"2023-10-08T13:04:15.135092+0000","last_fullsized":"2023-10-08T13:04:15.135092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.137036+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:04:15.137036+0000","last_peered":"2023-10-08T13:04:15.137036+0000","last_clean":"2023-10-08T13:04:15.137036+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:04:15.137036+0000","last_undegraded":"2023-10-08T13:04:15.137036+0000","last_fullsized":"2023-10-08T13:04:15.137036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129373+0000","last_change":"2023-10-08T13:04:10.749890+0000","last_active":"2023-10-08T13:04:15.129373+0000","last_peered":"2023-10-08T13:04:15.129373+0000","last_clean":"2023-10-08T13:04:15.129373+0000","last_became_active":"2023-10-08T13:04:10.749514+0000","last_became_peered":"2023-10-08T13:04:10.749514+0000","last_unstale":"2023-10-08T13:04:15.129373+0000","last_undegraded":"2023-10-08T13:04:15.129373+0000","last_fullsized":"2023-10-08T13:04:15.129373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:56.192335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138899+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:04:15.138899+0000","last_peered":"2023-10-08T13:04:15.138899+0000","last_clean":"2023-10-08T13:04:15.138899+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:15.138899+0000","last_undegraded":"2023-10-08T13:04:15.138899+0000","last_fullsized":"2023-10-08T13:04:15.138899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138723+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:04:15.138723+0000","last_peered":"2023-10-08T13:04:15.138723+0000","last_clean":"2023-10-08T13:04:15.138723+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:04:15.138723+0000","last_undegraded":"2023-10-08T13:04:15.138723+0000","last_fullsized":"2023-10-08T13:04:15.138723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129007+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:04:15.129007+0000","last_peered":"2023-10-08T13:04:15.129007+0000","last_clean":"2023-10-08T13:04:15.129007+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:04:15.129007+0000","last_undegraded":"2023-10-08T13:04:15.129007+0000","last_fullsized":"2023-10-08T13:04:15.129007+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135341+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:04:15.135341+0000","last_peered":"2023-10-08T13:04:15.135341+0000","last_clean":"2023-10-08T13:04:15.135341+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:04:15.135341+0000","last_undegraded":"2023-10-08T13:04:15.135341+0000","last_fullsized":"2023-10-08T13:04:15.135341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.147489+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:04:15.147489+0000","last_peered":"2023-10-08T13:04:15.147489+0000","last_clean":"2023-10-08T13:04:15.147489+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:04:15.147489+0000","last_undegraded":"2023-10-08T13:04:15.147489+0000","last_fullsized":"2023-10-08T13:04:15.147489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129896+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:04:15.129896+0000","last_peered":"2023-10-08T13:04:15.129896+0000","last_clean":"2023-10-08T13:04:15.129896+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:04:15.129896+0000","last_undegraded":"2023-10-08T13:04:15.129896+0000","last_fullsized":"2023-10-08T13:04:15.129896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246961+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:04:16.246961+0000","last_peered":"2023-10-08T13:04:16.246961+0000","last_clean":"2023-10-08T13:04:16.246961+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:04:16.246961+0000","last_undegraded":"2023-10-08T13:04:16.246961+0000","last_fullsized":"2023-10-08T13:04:16.246961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142909+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:04:31.142909+0000","last_peered":"2023-10-08T13:04:31.142909+0000","last_clean":"2023-10-08T13:04:31.142909+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:04:31.142909+0000","last_undegraded":"2023-10-08T13:04:31.142909+0000","last_fullsized":"2023-10-08T13:04:31.142909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138390+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:04:15.138390+0000","last_peered":"2023-10-08T13:04:15.138390+0000","last_clean":"2023-10-08T13:04:15.138390+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:04:15.138390+0000","last_undegraded":"2023-10-08T13:04:15.138390+0000","last_fullsized":"2023-10-08T13:04:15.138390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130641+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:04:16.130641+0000","last_peered":"2023-10-08T13:04:16.130641+0000","last_clean":"2023-10-08T13:04:16.130641+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:04:16.130641+0000","last_undegraded":"2023-10-08T13:04:16.130641+0000","last_fullsized":"2023-10-08T13:04:16.130641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131635+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:04:16.131635+0000","last_peered":"2023-10-08T13:04:16.131635+0000","last_clean":"2023-10-08T13:04:16.131635+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:04:16.131635+0000","last_undegraded":"2023-10-08T13:04:16.131635+0000","last_fullsized":"2023-10-08T13:04:16.131635+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139387+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:04:15.139387+0000","last_peered":"2023-10-08T13:04:15.139387+0000","last_clean":"2023-10-08T13:04:15.139387+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:04:15.139387+0000","last_undegraded":"2023-10-08T13:04:15.139387+0000","last_fullsized":"2023-10-08T13:04:15.139387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130916+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:04:16.130916+0000","last_peered":"2023-10-08T13:04:16.130916+0000","last_clean":"2023-10-08T13:04:16.130916+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:04:16.130916+0000","last_undegraded":"2023-10-08T13:04:16.130916+0000","last_fullsized":"2023-10-08T13:04:16.130916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135214+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:04:15.135214+0000","last_peered":"2023-10-08T13:04:15.135214+0000","last_clean":"2023-10-08T13:04:15.135214+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:04:15.135214+0000","last_undegraded":"2023-10-08T13:04:15.135214+0000","last_fullsized":"2023-10-08T13:04:15.135214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129180+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:04:15.129180+0000","last_peered":"2023-10-08T13:04:15.129180+0000","last_clean":"2023-10-08T13:04:15.129180+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:04:15.129180+0000","last_undegraded":"2023-10-08T13:04:15.129180+0000","last_fullsized":"2023-10-08T13:04:15.129180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130768+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:04:16.130768+0000","last_peered":"2023-10-08T13:04:16.130768+0000","last_clean":"2023-10-08T13:04:16.130768+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:04:16.130768+0000","last_undegraded":"2023-10-08T13:04:16.130768+0000","last_fullsized":"2023-10-08T13:04:16.130768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134878+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:04:15.134878+0000","last_peered":"2023-10-08T13:04:15.134878+0000","last_clean":"2023-10-08T13:04:15.134878+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:04:15.134878+0000","last_undegraded":"2023-10-08T13:04:15.134878+0000","last_fullsized":"2023-10-08T13:04:15.134878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135845+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:04:15.135845+0000","last_peered":"2023-10-08T13:04:15.135845+0000","last_clean":"2023-10-08T13:04:15.135845+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:04:15.135845+0000","last_undegraded":"2023-10-08T13:04:15.135845+0000","last_fullsized":"2023-10-08T13:04:15.135845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247510+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:04:16.247510+0000","last_peered":"2023-10-08T13:04:16.247510+0000","last_clean":"2023-10-08T13:04:16.247510+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:04:16.247510+0000","last_undegraded":"2023-10-08T13:04:16.247510+0000","last_fullsized":"2023-10-08T13:04:16.247510+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.133656+0000","last_change":"2023-10-08T13:04:09.752715+0000","last_active":"2023-10-08T13:04:30.133656+0000","last_peered":"2023-10-08T13:04:30.133656+0000","last_clean":"2023-10-08T13:04:30.133656+0000","last_became_active":"2023-10-08T13:04:09.752343+0000","last_became_peered":"2023-10-08T13:04:09.752343+0000","last_unstale":"2023-10-08T13:04:30.133656+0000","last_undegraded":"2023-10-08T13:04:30.133656+0000","last_fullsized":"2023-10-08T13:04:30.133656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:08.548171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135730+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:04:15.135730+0000","last_peered":"2023-10-08T13:04:15.135730+0000","last_clean":"2023-10-08T13:04:15.135730+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:04:15.135730+0000","last_undegraded":"2023-10-08T13:04:15.135730+0000","last_fullsized":"2023-10-08T13:04:15.135730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247203+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:04:16.247203+0000","last_peered":"2023-10-08T13:04:16.247203+0000","last_clean":"2023-10-08T13:04:16.247203+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:04:16.247203+0000","last_undegraded":"2023-10-08T13:04:16.247203+0000","last_fullsized":"2023-10-08T13:04:16.247203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:32.147966+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:04:32.147966+0000","last_peered":"2023-10-08T13:04:32.147966+0000","last_clean":"2023-10-08T13:04:32.147966+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:04:32.147966+0000","last_undegraded":"2023-10-08T13:04:32.147966+0000","last_fullsized":"2023-10-08T13:04:32.147966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134551+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:04:15.134551+0000","last_peered":"2023-10-08T13:04:15.134551+0000","last_clean":"2023-10-08T13:04:15.134551+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:04:15.134551+0000","last_undegraded":"2023-10-08T13:04:15.134551+0000","last_fullsized":"2023-10-08T13:04:15.134551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247556+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:04:16.247556+0000","last_peered":"2023-10-08T13:04:16.247556+0000","last_clean":"2023-10-08T13:04:16.247556+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:04:16.247556+0000","last_undegraded":"2023-10-08T13:04:16.247556+0000","last_fullsized":"2023-10-08T13:04:16.247556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.141910+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:04:31.141910+0000","last_peered":"2023-10-08T13:04:31.141910+0000","last_clean":"2023-10-08T13:04:31.141910+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:04:31.141910+0000","last_undegraded":"2023-10-08T13:04:31.141910+0000","last_fullsized":"2023-10-08T13:04:31.141910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.141871+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:04:15.141871+0000","last_peered":"2023-10-08T13:04:15.141871+0000","last_clean":"2023-10-08T13:04:15.141871+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:04:15.141871+0000","last_undegraded":"2023-10-08T13:04:15.141871+0000","last_fullsized":"2023-10-08T13:04:15.141871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247141+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:04:16.247141+0000","last_peered":"2023-10-08T13:04:16.247141+0000","last_clean":"2023-10-08T13:04:16.247141+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:04:16.247141+0000","last_undegraded":"2023-10-08T13:04:16.247141+0000","last_fullsized":"2023-10-08T13:04:16.247141+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130845+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:04:16.130845+0000","last_peered":"2023-10-08T13:04:16.130845+0000","last_clean":"2023-10-08T13:04:16.130845+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:04:16.130845+0000","last_undegraded":"2023-10-08T13:04:16.130845+0000","last_fullsized":"2023-10-08T13:04:16.130845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135673+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:04:15.135673+0000","last_peered":"2023-10-08T13:04:15.135673+0000","last_clean":"2023-10-08T13:04:15.135673+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:04:15.135673+0000","last_undegraded":"2023-10-08T13:04:15.135673+0000","last_fullsized":"2023-10-08T13:04:15.135673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130797+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:04:16.130797+0000","last_peered":"2023-10-08T13:04:16.130797+0000","last_clean":"2023-10-08T13:04:16.130797+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:04:16.130797+0000","last_undegraded":"2023-10-08T13:04:16.130797+0000","last_fullsized":"2023-10-08T13:04:16.130797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131911+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:04:30.131911+0000","last_peered":"2023-10-08T13:04:30.131911+0000","last_clean":"2023-10-08T13:04:30.131911+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:04:30.131911+0000","last_undegraded":"2023-10-08T13:04:30.131911+0000","last_fullsized":"2023-10-08T13:04:30.131911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129691+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:04:15.129691+0000","last_peered":"2023-10-08T13:04:15.129691+0000","last_clean":"2023-10-08T13:04:15.129691+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:04:15.129691+0000","last_undegraded":"2023-10-08T13:04:15.129691+0000","last_fullsized":"2023-10-08T13:04:15.129691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246617+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:04:16.246617+0000","last_peered":"2023-10-08T13:04:16.246617+0000","last_clean":"2023-10-08T13:04:16.246617+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:04:16.246617+0000","last_undegraded":"2023-10-08T13:04:16.246617+0000","last_fullsized":"2023-10-08T13:04:16.246617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:33.156691+0000","last_change":"2023-10-08T13:04:09.754360+0000","last_active":"2023-10-08T13:04:33.156691+0000","last_peered":"2023-10-08T13:04:33.156691+0000","last_clean":"2023-10-08T13:04:33.156691+0000","last_became_active":"2023-10-08T13:04:09.754047+0000","last_became_peered":"2023-10-08T13:04:09.754047+0000","last_unstale":"2023-10-08T13:04:33.156691+0000","last_undegraded":"2023-10-08T13:04:33.156691+0000","last_fullsized":"2023-10-08T13:04:33.156691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:11.616693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139483+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:04:15.139483+0000","last_peered":"2023-10-08T13:04:15.139483+0000","last_clean":"2023-10-08T13:04:15.139483+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:04:15.139483+0000","last_undegraded":"2023-10-08T13:04:15.139483+0000","last_fullsized":"2023-10-08T13:04:15.139483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131182+0000","last_change":"2023-10-08T13:04:15.151758+0000","last_active":"2023-10-08T13:04:16.131182+0000","last_peered":"2023-10-08T13:04:16.131182+0000","last_clean":"2023-10-08T13:04:16.131182+0000","last_became_active":"2023-10-08T13:04:15.151253+0000","last_became_peered":"2023-10-08T13:04:15.151253+0000","last_unstale":"2023-10-08T13:04:16.131182+0000","last_undegraded":"2023-10-08T13:04:16.131182+0000","last_fullsized":"2023-10-08T13:04:16.131182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:43.125206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131384+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:04:16.131384+0000","last_peered":"2023-10-08T13:04:16.131384+0000","last_clean":"2023-10-08T13:04:16.131384+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:04:16.131384+0000","last_undegraded":"2023-10-08T13:04:16.131384+0000","last_fullsized":"2023-10-08T13:04:16.131384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129394+0000","last_change":"2023-10-08T13:04:10.753807+0000","last_active":"2023-10-08T13:04:15.129394+0000","last_peered":"2023-10-08T13:04:15.129394+0000","last_clean":"2023-10-08T13:04:15.129394+0000","last_became_active":"2023-10-08T13:04:10.753030+0000","last_became_peered":"2023-10-08T13:04:10.753030+0000","last_unstale":"2023-10-08T13:04:15.129394+0000","last_undegraded":"2023-10-08T13:04:15.129394+0000","last_fullsized":"2023-10-08T13:04:15.129394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:06.036531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247249+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:04:16.247249+0000","last_peered":"2023-10-08T13:04:16.247249+0000","last_clean":"2023-10-08T13:04:16.247249+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:04:16.247249+0000","last_undegraded":"2023-10-08T13:04:16.247249+0000","last_fullsized":"2023-10-08T13:04:16.247249+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'12","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131105+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:04:30.131105+0000","last_peered":"2023-10-08T13:04:30.131105+0000","last_clean":"2023-10-08T13:04:30.131105+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:04:30.131105+0000","last_undegraded":"2023-10-08T13:04:30.131105+0000","last_fullsized":"2023-10-08T13:04:30.131105+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134926+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:04:15.134926+0000","last_peered":"2023-10-08T13:04:15.134926+0000","last_clean":"2023-10-08T13:04:15.134926+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:04:15.134926+0000","last_undegraded":"2023-10-08T13:04:15.134926+0000","last_fullsized":"2023-10-08T13:04:15.134926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131657+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:04:16.131657+0000","last_peered":"2023-10-08T13:04:16.131657+0000","last_clean":"2023-10-08T13:04:16.131657+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:04:16.131657+0000","last_undegraded":"2023-10-08T13:04:16.131657+0000","last_fullsized":"2023-10-08T13:04:16.131657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131409+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:04:30.131409+0000","last_peered":"2023-10-08T13:04:30.131409+0000","last_clean":"2023-10-08T13:04:30.131409+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:04:30.131409+0000","last_undegraded":"2023-10-08T13:04:30.131409+0000","last_fullsized":"2023-10-08T13:04:30.131409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128886+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:04:15.128886+0000","last_peered":"2023-10-08T13:04:15.128886+0000","last_clean":"2023-10-08T13:04:15.128886+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:04:15.128886+0000","last_undegraded":"2023-10-08T13:04:15.128886+0000","last_fullsized":"2023-10-08T13:04:15.128886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247288+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:04:16.247288+0000","last_peered":"2023-10-08T13:04:16.247288+0000","last_clean":"2023-10-08T13:04:16.247288+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:04:16.247288+0000","last_undegraded":"2023-10-08T13:04:16.247288+0000","last_fullsized":"2023-10-08T13:04:16.247288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.133422+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:04:30.133422+0000","last_peered":"2023-10-08T13:04:30.133422+0000","last_clean":"2023-10-08T13:04:30.133422+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:04:30.133422+0000","last_undegraded":"2023-10-08T13:04:30.133422+0000","last_fullsized":"2023-10-08T13:04:30.133422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133771+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:04:15.133771+0000","last_peered":"2023-10-08T13:04:15.133771+0000","last_clean":"2023-10-08T13:04:15.133771+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:04:15.133771+0000","last_undegraded":"2023-10-08T13:04:15.133771+0000","last_fullsized":"2023-10-08T13:04:15.133771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246804+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:04:16.246804+0000","last_peered":"2023-10-08T13:04:16.246804+0000","last_clean":"2023-10-08T13:04:16.246804+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:04:16.246804+0000","last_undegraded":"2023-10-08T13:04:16.246804+0000","last_fullsized":"2023-10-08T13:04:16.246804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:34.160615+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:04:34.160615+0000","last_peered":"2023-10-08T13:04:34.160615+0000","last_clean":"2023-10-08T13:04:34.160615+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:04:34.160615+0000","last_undegraded":"2023-10-08T13:04:34.160615+0000","last_fullsized":"2023-10-08T13:04:34.160615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135448+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:04:15.135448+0000","last_peered":"2023-10-08T13:04:15.135448+0000","last_clean":"2023-10-08T13:04:15.135448+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:04:15.135448+0000","last_undegraded":"2023-10-08T13:04:15.135448+0000","last_fullsized":"2023-10-08T13:04:15.135448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247479+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:04:16.247479+0000","last_peered":"2023-10-08T13:04:16.247479+0000","last_clean":"2023-10-08T13:04:16.247479+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:04:16.247479+0000","last_undegraded":"2023-10-08T13:04:16.247479+0000","last_fullsized":"2023-10-08T13:04:16.247479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.129067+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:04:30.129067+0000","last_peered":"2023-10-08T13:04:30.129067+0000","last_clean":"2023-10-08T13:04:30.129067+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:04:30.129067+0000","last_undegraded":"2023-10-08T13:04:30.129067+0000","last_fullsized":"2023-10-08T13:04:30.129067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136155+0000","last_change":"2023-10-08T13:04:10.755107+0000","last_active":"2023-10-08T13:04:15.136155+0000","last_peered":"2023-10-08T13:04:15.136155+0000","last_clean":"2023-10-08T13:04:15.136155+0000","last_became_active":"2023-10-08T13:04:10.754779+0000","last_became_peered":"2023-10-08T13:04:10.754779+0000","last_unstale":"2023-10-08T13:04:15.136155+0000","last_undegraded":"2023-10-08T13:04:15.136155+0000","last_fullsized":"2023-10-08T13:04:15.136155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:28:20.765315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130840+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:04:16.130840+0000","last_peered":"2023-10-08T13:04:16.130840+0000","last_clean":"2023-10-08T13:04:16.130840+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:04:16.130840+0000","last_undegraded":"2023-10-08T13:04:16.130840+0000","last_fullsized":"2023-10-08T13:04:16.130840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134442+0000","last_change":"2023-10-08T13:04:09.753810+0000","last_active":"2023-10-08T13:04:15.134442+0000","last_peered":"2023-10-08T13:04:15.134442+0000","last_clean":"2023-10-08T13:04:15.134442+0000","last_became_active":"2023-10-08T13:04:09.753497+0000","last_became_peered":"2023-10-08T13:04:09.753497+0000","last_unstale":"2023-10-08T13:04:15.134442+0000","last_undegraded":"2023-10-08T13:04:15.134442+0000","last_fullsized":"2023-10-08T13:04:15.134442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:11.309476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134660+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:04:15.134660+0000","last_peered":"2023-10-08T13:04:15.134660+0000","last_clean":"2023-10-08T13:04:15.134660+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:04:15.134660+0000","last_undegraded":"2023-10-08T13:04:15.134660+0000","last_fullsized":"2023-10-08T13:04:15.134660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.822838+0000","last_change":"2023-10-08T13:04:15.506195+0000","last_active":"2023-10-08T13:04:16.822838+0000","last_peered":"2023-10-08T13:04:16.822838+0000","last_clean":"2023-10-08T13:04:16.822838+0000","last_became_active":"2023-10-08T13:04:15.505424+0000","last_became_peered":"2023-10-08T13:04:15.505424+0000","last_unstale":"2023-10-08T13:04:16.822838+0000","last_undegraded":"2023-10-08T13:04:16.822838+0000","last_fullsized":"2023-10-08T13:04:16.822838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:54.231192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.140526+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:04:15.140526+0000","last_peered":"2023-10-08T13:04:15.140526+0000","last_clean":"2023-10-08T13:04:15.140526+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:04:15.140526+0000","last_undegraded":"2023-10-08T13:04:15.140526+0000","last_fullsized":"2023-10-08T13:04:15.140526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.505276+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:04:15.505276+0000","last_peered":"2023-10-08T13:04:15.505276+0000","last_clean":"2023-10-08T13:04:15.505276+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:04:15.505276+0000","last_undegraded":"2023-10-08T13:04:15.505276+0000","last_fullsized":"2023-10-08T13:04:15.505276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.248052+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:04:16.248052+0000","last_peered":"2023-10-08T13:04:16.248052+0000","last_clean":"2023-10-08T13:04:16.248052+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:04:16.248052+0000","last_undegraded":"2023-10-08T13:04:16.248052+0000","last_fullsized":"2023-10-08T13:04:16.248052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:33.157427+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:04:33.157427+0000","last_peered":"2023-10-08T13:04:33.157427+0000","last_clean":"2023-10-08T13:04:33.157427+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:04:33.157427+0000","last_undegraded":"2023-10-08T13:04:33.157427+0000","last_fullsized":"2023-10-08T13:04:33.157427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.504951+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:04:15.504951+0000","last_peered":"2023-10-08T13:04:15.504951+0000","last_clean":"2023-10-08T13:04:15.504951+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:04:15.504951+0000","last_undegraded":"2023-10-08T13:04:15.504951+0000","last_fullsized":"2023-10-08T13:04:15.504951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247623+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:04:16.247623+0000","last_peered":"2023-10-08T13:04:16.247623+0000","last_clean":"2023-10-08T13:04:16.247623+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:04:16.247623+0000","last_undegraded":"2023-10-08T13:04:16.247623+0000","last_fullsized":"2023-10-08T13:04:16.247623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134584+0000","last_change":"2023-10-08T13:04:10.752999+0000","last_active":"2023-10-08T13:04:15.134584+0000","last_peered":"2023-10-08T13:04:15.134584+0000","last_clean":"2023-10-08T13:04:15.134584+0000","last_became_active":"2023-10-08T13:04:10.752639+0000","last_became_peered":"2023-10-08T13:04:10.752639+0000","last_unstale":"2023-10-08T13:04:15.134584+0000","last_undegraded":"2023-10-08T13:04:15.134584+0000","last_fullsized":"2023-10-08T13:04:15.134584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:20.038674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142497+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:04:31.142497+0000","last_peered":"2023-10-08T13:04:31.142497+0000","last_clean":"2023-10-08T13:04:31.142497+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:04:31.142497+0000","last_undegraded":"2023-10-08T13:04:31.142497+0000","last_fullsized":"2023-10-08T13:04:31.142497+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.248293+0000","last_change":"2023-10-08T13:04:15.151726+0000","last_active":"2023-10-08T13:04:16.248293+0000","last_peered":"2023-10-08T13:04:16.248293+0000","last_clean":"2023-10-08T13:04:16.248293+0000","last_became_active":"2023-10-08T13:04:15.151312+0000","last_became_peered":"2023-10-08T13:04:15.151312+0000","last_unstale":"2023-10-08T13:04:16.248293+0000","last_undegraded":"2023-10-08T13:04:16.248293+0000","last_fullsized":"2023-10-08T13:04:16.248293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:52.256863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136824+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:04:15.136824+0000","last_peered":"2023-10-08T13:04:15.136824+0000","last_clean":"2023-10-08T13:04:15.136824+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:04:15.136824+0000","last_undegraded":"2023-10-08T13:04:15.136824+0000","last_fullsized":"2023-10-08T13:04:15.136824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:34.158703+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:04:34.158703+0000","last_peered":"2023-10-08T13:04:34.158703+0000","last_clean":"2023-10-08T13:04:34.158703+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:04:34.158703+0000","last_undegraded":"2023-10-08T13:04:34.158703+0000","last_fullsized":"2023-10-08T13:04:34.158703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135132+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:04:15.135132+0000","last_peered":"2023-10-08T13:04:15.135132+0000","last_clean":"2023-10-08T13:04:15.135132+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:04:15.135132+0000","last_undegraded":"2023-10-08T13:04:15.135132+0000","last_fullsized":"2023-10-08T13:04:15.135132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131512+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:04:16.131512+0000","last_peered":"2023-10-08T13:04:16.131512+0000","last_clean":"2023-10-08T13:04:16.131512+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:04:16.131512+0000","last_undegraded":"2023-10-08T13:04:16.131512+0000","last_fullsized":"2023-10-08T13:04:16.131512+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128612+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:04:15.128612+0000","last_peered":"2023-10-08T13:04:15.128612+0000","last_clean":"2023-10-08T13:04:15.128612+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:04:15.128612+0000","last_undegraded":"2023-10-08T13:04:15.128612+0000","last_fullsized":"2023-10-08T13:04:15.128612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142145+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:04:31.142145+0000","last_peered":"2023-10-08T13:04:31.142145+0000","last_clean":"2023-10-08T13:04:31.142145+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:04:31.142145+0000","last_undegraded":"2023-10-08T13:04:31.142145+0000","last_fullsized":"2023-10-08T13:04:31.142145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247250+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:04:16.247250+0000","last_peered":"2023-10-08T13:04:16.247250+0000","last_clean":"2023-10-08T13:04:16.247250+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:04:16.247250+0000","last_undegraded":"2023-10-08T13:04:16.247250+0000","last_fullsized":"2023-10-08T13:04:16.247250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.823032+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:04:16.823032+0000","last_peered":"2023-10-08T13:04:16.823032+0000","last_clean":"2023-10-08T13:04:16.823032+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:04:16.823032+0000","last_undegraded":"2023-10-08T13:04:16.823032+0000","last_fullsized":"2023-10-08T13:04:16.823032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128983+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:04:15.128983+0000","last_peered":"2023-10-08T13:04:15.128983+0000","last_clean":"2023-10-08T13:04:15.128983+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:04:15.128983+0000","last_undegraded":"2023-10-08T13:04:15.128983+0000","last_fullsized":"2023-10-08T13:04:15.128983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130545+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:04:16.130545+0000","last_peered":"2023-10-08T13:04:16.130545+0000","last_clean":"2023-10-08T13:04:16.130545+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:04:16.130545+0000","last_undegraded":"2023-10-08T13:04:16.130545+0000","last_fullsized":"2023-10-08T13:04:16.130545+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:31.142189+0000","last_change":"2023-10-08T13:04:09.752541+0000","last_active":"2023-10-08T13:04:31.142189+0000","last_peered":"2023-10-08T13:04:31.142189+0000","last_clean":"2023-10-08T13:04:31.142189+0000","last_became_active":"2023-10-08T13:04:09.751993+0000","last_became_peered":"2023-10-08T13:04:09.751993+0000","last_unstale":"2023-10-08T13:04:31.142189+0000","last_undegraded":"2023-10-08T13:04:31.142189+0000","last_fullsized":"2023-10-08T13:04:31.142189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:02.681384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136516+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:04:15.136516+0000","last_peered":"2023-10-08T13:04:15.136516+0000","last_clean":"2023-10-08T13:04:15.136516+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:04:15.136516+0000","last_undegraded":"2023-10-08T13:04:15.136516+0000","last_fullsized":"2023-10-08T13:04:15.136516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.246617+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:04:16.246617+0000","last_peered":"2023-10-08T13:04:16.246617+0000","last_clean":"2023-10-08T13:04:16.246617+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:04:16.246617+0000","last_undegraded":"2023-10-08T13:04:16.246617+0000","last_fullsized":"2023-10-08T13:04:16.246617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:33.156981+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:04:33.156981+0000","last_peered":"2023-10-08T13:04:33.156981+0000","last_clean":"2023-10-08T13:04:33.156981+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:04:33.156981+0000","last_undegraded":"2023-10-08T13:04:33.156981+0000","last_fullsized":"2023-10-08T13:04:33.156981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139388+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:04:15.139388+0000","last_peered":"2023-10-08T13:04:15.139388+0000","last_clean":"2023-10-08T13:04:15.139388+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:04:15.139388+0000","last_undegraded":"2023-10-08T13:04:15.139388+0000","last_fullsized":"2023-10-08T13:04:15.139388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131309+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:16.131309+0000","last_peered":"2023-10-08T13:04:16.131309+0000","last_clean":"2023-10-08T13:04:16.131309+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:04:16.131309+0000","last_undegraded":"2023-10-08T13:04:16.131309+0000","last_fullsized":"2023-10-08T13:04:16.131309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.129438+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:04:30.129438+0000","last_peered":"2023-10-08T13:04:30.129438+0000","last_clean":"2023-10-08T13:04:30.129438+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:04:30.129438+0000","last_undegraded":"2023-10-08T13:04:30.129438+0000","last_fullsized":"2023-10-08T13:04:30.129438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133477+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:04:15.133477+0000","last_peered":"2023-10-08T13:04:15.133477+0000","last_clean":"2023-10-08T13:04:15.133477+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:04:15.133477+0000","last_undegraded":"2023-10-08T13:04:15.133477+0000","last_fullsized":"2023-10-08T13:04:15.133477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247055+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:04:16.247055+0000","last_peered":"2023-10-08T13:04:16.247055+0000","last_clean":"2023-10-08T13:04:16.247055+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:04:16.247055+0000","last_undegraded":"2023-10-08T13:04:16.247055+0000","last_fullsized":"2023-10-08T13:04:16.247055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.133019+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:04:30.133019+0000","last_peered":"2023-10-08T13:04:30.133019+0000","last_clean":"2023-10-08T13:04:30.133019+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:04:30.133019+0000","last_undegraded":"2023-10-08T13:04:30.133019+0000","last_fullsized":"2023-10-08T13:04:30.133019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135127+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:04:15.135127+0000","last_peered":"2023-10-08T13:04:15.135127+0000","last_clean":"2023-10-08T13:04:15.135127+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:04:15.135127+0000","last_undegraded":"2023-10-08T13:04:15.135127+0000","last_fullsized":"2023-10-08T13:04:15.135127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130915+0000","last_change":"2023-10-08T13:04:15.154280+0000","last_active":"2023-10-08T13:04:16.130915+0000","last_peered":"2023-10-08T13:04:16.130915+0000","last_clean":"2023-10-08T13:04:16.130915+0000","last_became_active":"2023-10-08T13:04:15.153890+0000","last_became_peered":"2023-10-08T13:04:15.153890+0000","last_unstale":"2023-10-08T13:04:16.130915+0000","last_undegraded":"2023-10-08T13:04:16.130915+0000","last_fullsized":"2023-10-08T13:04:16.130915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:21:55.919457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129056+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:04:15.129056+0000","last_peered":"2023-10-08T13:04:15.129056+0000","last_clean":"2023-10-08T13:04:15.129056+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:04:15.129056+0000","last_undegraded":"2023-10-08T13:04:15.129056+0000","last_fullsized":"2023-10-08T13:04:15.129056+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135496+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:04:15.135496+0000","last_peered":"2023-10-08T13:04:15.135496+0000","last_clean":"2023-10-08T13:04:15.135496+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:04:15.135496+0000","last_undegraded":"2023-10-08T13:04:15.135496+0000","last_fullsized":"2023-10-08T13:04:15.135496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.131202+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:16.131202+0000","last_peered":"2023-10-08T13:04:16.131202+0000","last_clean":"2023-10-08T13:04:16.131202+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:04:16.131202+0000","last_undegraded":"2023-10-08T13:04:16.131202+0000","last_fullsized":"2023-10-08T13:04:16.131202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:30.131776+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:04:30.131776+0000","last_peered":"2023-10-08T13:04:30.131776+0000","last_clean":"2023-10-08T13:04:30.131776+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:04:30.131776+0000","last_undegraded":"2023-10-08T13:04:30.131776+0000","last_fullsized":"2023-10-08T13:04:30.131776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135282+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:04:15.135282+0000","last_peered":"2023-10-08T13:04:15.135282+0000","last_clean":"2023-10-08T13:04:15.135282+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:04:15.135282+0000","last_undegraded":"2023-10-08T13:04:15.135282+0000","last_fullsized":"2023-10-08T13:04:15.135282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247719+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:04:16.247719+0000","last_peered":"2023-10-08T13:04:16.247719+0000","last_clean":"2023-10-08T13:04:16.247719+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:04:16.247719+0000","last_undegraded":"2023-10-08T13:04:16.247719+0000","last_fullsized":"2023-10-08T13:04:16.247719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129503+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:04:15.129503+0000","last_peered":"2023-10-08T13:04:15.129503+0000","last_clean":"2023-10-08T13:04:15.129503+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:04:15.129503+0000","last_undegraded":"2023-10-08T13:04:15.129503+0000","last_fullsized":"2023-10-08T13:04:15.129503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135140+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:04:15.135140+0000","last_peered":"2023-10-08T13:04:15.135140+0000","last_clean":"2023-10-08T13:04:15.135140+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:04:15.135140+0000","last_undegraded":"2023-10-08T13:04:15.135140+0000","last_fullsized":"2023-10-08T13:04:15.135140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247509+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:04:16.247509+0000","last_peered":"2023-10-08T13:04:16.247509+0000","last_clean":"2023-10-08T13:04:16.247509+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:04:16.247509+0000","last_undegraded":"2023-10-08T13:04:16.247509+0000","last_fullsized":"2023-10-08T13:04:16.247509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135975+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:04:15.135975+0000","last_peered":"2023-10-08T13:04:15.135975+0000","last_clean":"2023-10-08T13:04:15.135975+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:04:15.135975+0000","last_undegraded":"2023-10-08T13:04:15.135975+0000","last_fullsized":"2023-10-08T13:04:15.135975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133600+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:04:15.133600+0000","last_peered":"2023-10-08T13:04:15.133600+0000","last_clean":"2023-10-08T13:04:15.133600+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:04:15.133600+0000","last_undegraded":"2023-10-08T13:04:15.133600+0000","last_fullsized":"2023-10-08T13:04:15.133600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.130661+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:04:16.130661+0000","last_peered":"2023-10-08T13:04:16.130661+0000","last_clean":"2023-10-08T13:04:16.130661+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:04:16.130661+0000","last_undegraded":"2023-10-08T13:04:16.130661+0000","last_fullsized":"2023-10-08T13:04:16.130661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:04:16.247583+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:04:16.247583+0000","last_peered":"2023-10-08T13:04:16.247583+0000","last_clean":"2023-10-08T13:04:16.247583+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:04:16.247583+0000","last_undegraded":"2023-10-08T13:04:16.247583+0000","last_fullsized":"2023-10-08T13:04:16.247583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.133946+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:04:15.133946+0000","last_peered":"2023-10-08T13:04:15.133946+0000","last_clean":"2023-10-08T13:04:15.133946+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:04:15.133946+0000","last_undegraded":"2023-10-08T13:04:15.133946+0000","last_fullsized":"2023-10-08T13:04:15.133946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.135221+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:04:15.135221+0000","last_peered":"2023-10-08T13:04:15.135221+0000","last_clean":"2023-10-08T13:04:15.135221+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:04:15.135221+0000","last_undegraded":"2023-10-08T13:04:15.135221+0000","last_fullsized":"2023-10-08T13:04:15.135221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.130229+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:04:15.130229+0000","last_peered":"2023-10-08T13:04:15.130229+0000","last_clean":"2023-10-08T13:04:15.130229+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:04:15.130229+0000","last_undegraded":"2023-10-08T13:04:15.130229+0000","last_fullsized":"2023-10-08T13:04:15.130229+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.128911+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:04:15.128911+0000","last_peered":"2023-10-08T13:04:15.128911+0000","last_clean":"2023-10-08T13:04:15.128911+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:04:15.128911+0000","last_undegraded":"2023-10-08T13:04:15.128911+0000","last_fullsized":"2023-10-08T13:04:15.128911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.139071+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:04:15.139071+0000","last_peered":"2023-10-08T13:04:15.139071+0000","last_clean":"2023-10-08T13:04:15.139071+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:04:15.139071+0000","last_undegraded":"2023-10-08T13:04:15.139071+0000","last_fullsized":"2023-10-08T13:04:15.139071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129086+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:04:15.129086+0000","last_peered":"2023-10-08T13:04:15.129086+0000","last_clean":"2023-10-08T13:04:15.129086+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:04:15.129086+0000","last_undegraded":"2023-10-08T13:04:15.129086+0000","last_fullsized":"2023-10-08T13:04:15.129086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.136199+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:04:15.136199+0000","last_peered":"2023-10-08T13:04:15.136199+0000","last_clean":"2023-10-08T13:04:15.136199+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:04:15.136199+0000","last_undegraded":"2023-10-08T13:04:15.136199+0000","last_fullsized":"2023-10-08T13:04:15.136199+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129519+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:04:15.129519+0000","last_peered":"2023-10-08T13:04:15.129519+0000","last_clean":"2023-10-08T13:04:15.129519+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:04:15.129519+0000","last_undegraded":"2023-10-08T13:04:15.129519+0000","last_fullsized":"2023-10-08T13:04:15.129519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.137991+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:04:15.137991+0000","last_peered":"2023-10-08T13:04:15.137991+0000","last_clean":"2023-10-08T13:04:15.137991+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:04:15.137991+0000","last_undegraded":"2023-10-08T13:04:15.137991+0000","last_fullsized":"2023-10-08T13:04:15.137991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134489+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:04:15.134489+0000","last_peered":"2023-10-08T13:04:15.134489+0000","last_clean":"2023-10-08T13:04:15.134489+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:04:15.134489+0000","last_undegraded":"2023-10-08T13:04:15.134489+0000","last_fullsized":"2023-10-08T13:04:15.134489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.138144+0000","last_change":"2023-10-08T13:04:10.755869+0000","last_active":"2023-10-08T13:04:15.138144+0000","last_peered":"2023-10-08T13:04:15.138144+0000","last_clean":"2023-10-08T13:04:15.138144+0000","last_became_active":"2023-10-08T13:04:10.755558+0000","last_became_peered":"2023-10-08T13:04:10.755558+0000","last_unstale":"2023-10-08T13:04:15.138144+0000","last_undegraded":"2023-10-08T13:04:15.138144+0000","last_fullsized":"2023-10-08T13:04:15.138144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:43.855459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129795+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:04:15.129795+0000","last_peered":"2023-10-08T13:04:15.129795+0000","last_clean":"2023-10-08T13:04:15.129795+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:04:15.129795+0000","last_undegraded":"2023-10-08T13:04:15.129795+0000","last_fullsized":"2023-10-08T13:04:15.129795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.129269+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:04:15.129269+0000","last_peered":"2023-10-08T13:04:15.129269+0000","last_clean":"2023-10-08T13:04:15.129269+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:04:15.129269+0000","last_undegraded":"2023-10-08T13:04:15.129269+0000","last_fullsized":"2023-10-08T13:04:15.129269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:04:15.134204+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:04:15.134204+0000","last_peered":"2023-10-08T13:04:15.134204+0000","last_clean":"2023-10-08T13:04:15.134204+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:04:15.134204+0000","last_undegraded":"2023-10-08T13:04:15.134204+0000","last_fullsized":"2023-10-08T13:04:15.134204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7882,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":139,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":44213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449103,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":480810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.443}]},{"osd":1,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.747},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.85699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.877}]},{"osd":10,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.81999999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678035,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1613824,"data_stored":1075530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.36399999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67400000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.66900000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.73499999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.749}]}]},{"osd":9,"up_from":66,"seq":283467841560,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.433}]},{"osd":3,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.373}]},{"osd":4,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65500000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68300000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.62}]},{"osd":10,"last update":"Sun Oct 8 13:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":8,"up_from":58,"seq":249108103196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":479913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.82099999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.752,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.502},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.60599999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71399999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.127},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.75}]},{"osd":5,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.32600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.81999999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.90700000000000003,"5min":1.127,"15min":1.127},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":1.048,"15min":1.048},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.873},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.88700000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.90000000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":7,"up_from":51,"seq":219043332128,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1072177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.31,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58999999999999997,"15min":0.59299999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84199999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60099999999999998,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77900000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.51700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.81399999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.751,"15min":0.749},"min":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.93700000000000006,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.72099999999999997,"15min":0.71699999999999997},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.64600000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.998,"5min":1.23,"15min":1.23},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67500000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.72599999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.746},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.628}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495653,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":479708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.39800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.626},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.42199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.79400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.46000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60299999999999998,"15min":0.59599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82199999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:03:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.89000000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72999999999999998,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.874},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.98299999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77900000000000003,"15min":0.78000000000000003},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.80600000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71499999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:04:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":485602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.50900000000000001},"min":{"1min":0.36699999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.78600000000000003,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.51500000000000001},"min":{"1min":0.42899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.745,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.97899999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77400000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58399999999999996,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.88800000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48199999999999998,"15min":0.47199999999999998},"min":{"1min":0.377,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.55900000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.65900000000000003,"15min":0.65400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.747},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.47899999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.86799999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.03,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.501,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.71099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.038},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0529999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.022},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.0760000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":481096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.377,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.51400000000000001,"15min":0.496},"min":{"1min":0.36299999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.755}]},{"osd":2,"last update":"Sun Oct 8 13:04:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77100000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.83299999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.40600000000000003},"min":{"1min":0.32500000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.45900000000000002,"15min":0.44900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57999999999999996,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94899999999999995,"5min":1.387,"15min":1.387},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.373,"15min":0.373},"max":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69499999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.314,"5min":0.31,"15min":0.31},"max":{"1min":0.747,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.621},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.997,"5min":1.01,"15min":1.01},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0209999999999999,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.86199999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76200000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.95699999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93500000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.81999999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.98099999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":484116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69199999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.496}]},{"osd":1,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83999999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.52900000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.45400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1930000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2729999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65300000000000002,"5min":1.72,"15min":1.72},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.379},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.91300000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0469999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.88600000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.83799999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.872},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.95099999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149744,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":479902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"min":{"1min":0.27700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.51900000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.36099999999999999,"15min":0.34100000000000003},"min":{"1min":0.27900000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.56899999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.34599999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.41099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.40899999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.44700000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.751},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77500000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.61699999999999999,"15min":0.58899999999999997},"min":{"1min":0.40600000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90000000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.66800000000000004,"15min":0.64000000000000001},"min":{"1min":0.51100000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96199999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.83999999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.70799999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73099999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":4,"up_from":33,"seq":141733920814,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":480708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.40999999999999998},"min":{"1min":0.35099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.42799999999999999},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78200000000000003,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.47599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.627}]},{"osd":3,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.442,"5min":0.378,"15min":0.378},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.83599999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.67100000000000004,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.88300000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0409999999999999,"5min":1.071,"15min":1.071},"last":0.93899999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.82399999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:04:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757288,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1572864,"data_stored":1070168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77300000000000002,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.505,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":1.899,"15min":1.899},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.628}]},{"osd":2,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40899999999999997,"15min":0.38500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.35399999999999998},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.317}]},{"osd":3,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.872,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75900000000000001,"5min":2.085,"15min":2.085},"last":0.53800000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.55600000000000005},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":1.962,"15min":1.962},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.622,"15min":0.59199999999999997},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.58499999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.66400000000000003,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.42199999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.73799999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.50700000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.70499999999999996}]},{"osd":10,"last update":"Sun Oct 8 13:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.751},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":23365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":5544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:04:36.959 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T13:04:36.960 INFO:tasks.cephadm:Setting up client nodes... 2023-10-08T13:04:36.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-08T13:04:37.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:04:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:04:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2023-10-08T13:04:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2023-10-08T13:04:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-10-08T13:04:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2023-10-08T13:04:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-10-08T13:04:37.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-10-08T13:04:37.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2023-10-08T13:04:37.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2023-10-08T13:04:37.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-08T13:04:37.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-10-08T13:04:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:37.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:04:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:04:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2023-10-08T13:04:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2023-10-08T13:04:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-10-08T13:04:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2023-10-08T13:04:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-10-08T13:04:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-10-08T13:04:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2023-10-08T13:04:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2023-10-08T13:04:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-08T13:04:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-10-08T13:04:37.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-08T13:04:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: pgmap v255: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-10-08T13:04:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-10-08T13:04:38.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2023-10-08T13:04:38.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2023-10-08T13:04:38.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-08T13:04:38.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-10-08T13:04:38.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:38 smithi005 ceph-mon[99496]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T13:04:38.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: pgmap v255: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-10-08T13:04:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:38 smithi118 ceph-mon[104234]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T13:04:38.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: pgmap v255: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-10-08T13:04:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:38 smithi060 ceph-mon[103190]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 -- 172.21.15.5:0/2216538320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 msgr2=0x7f030c104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2216538320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c104920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f03080099c0 tx=0x7f0308009cd0 comp rx=0 tx=0).stop 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 -- 172.21.15.5:0/2216538320 shutdown_connections 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2216538320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 0x7f030c10c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2216538320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c104920 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2216538320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c0ff720 0x7f030c0ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 -- 172.21.15.5:0/2216538320 >> 172.21.15.5:0/2216538320 conn(0x7f030c075710 msgr2=0x7f030c075b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 -- 172.21.15.5:0/2216538320 shutdown_connections 2023-10-08T13:04:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 -- 172.21.15.5:0/2216538320 wait complete. 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 Processor -- start 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.842+0000 7f0313dd9700 1 -- start start 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0313dd9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c0ff720 0x7f030c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0313dd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 0x7f030c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0313dd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0313dd9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c197140 con 0x7f030c104540 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0313dd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c1972b0 con 0x7f030c1000e0 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0313dd9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c197470 con 0x7f030c0ff720 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33026/0 (socket says 172.21.15.5:33026) 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 -- 172.21.15.5:0/2522051399 learned_addr learned my addr 172.21.15.5:0/2522051399 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0311b75700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c0ff720 0x7f030c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0311374700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 0x7f030c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 -- 172.21.15.5:0/2522051399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c0ff720 msgr2=0x7f030c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c0ff720 0x7f030c19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 -- 172.21.15.5:0/2522051399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 msgr2=0x7f030c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 0x7f030c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 -- 172.21.15.5:0/2522051399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080095f0 con 0x7f030c104540 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0311374700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 0x7f030c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:38.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f0312376700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c196ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0304007ee0 tx=0x7f030400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304017070 con 0x7f030c104540 2023-10-08T13:04:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.843+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f030400f040 con 0x7f030c104540 2023-10-08T13:04:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.844+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304005740 con 0x7f030c104540 2023-10-08T13:04:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.844+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c197750 con 0x7f030c104540 2023-10-08T13:04:38.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.844+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c1a3940 con 0x7f030c104540 2023-10-08T13:04:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.844+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c108bf0 con 0x7f030c104540 2023-10-08T13:04:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.846+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f030400dc60 con 0x7f030c104540 2023-10-08T13:04:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.846+0000 7f02feffd700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02f80a1560 0x7f02f80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.846+0000 7f0311b75700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02f80a1560 0x7f02f80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.847+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f03040ccac0 con 0x7f030c104540 2023-10-08T13:04:38.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.847+0000 7f0311b75700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02f80a1560 0x7f02f80a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0308009990 tx=0x7f0308003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:38.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:38.851+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0304095bd0 con 0x7f030c104540 2023-10-08T13:04:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.135+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f030c100db0 con 0x7f030c104540 2023-10-08T13:04:39.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.137+0000 7f02feffd700 1 -- 172.21.15.5:0/2522051399 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f03040991f0 con 0x7f030c104540 2023-10-08T13:04:39.138 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-10-08T13:04:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDnqCJlyNUnCBAAm5A0cHRlrikxkRCGNkVnaA== 2023-10-08T13:04:39.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02f80a1560 msgr2=0x7f02f80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02f80a1560 0x7f02f80a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0308009990 tx=0x7f0308003680 comp rx=0 tx=0).stop 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 msgr2=0x7f030c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c196ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0304007ee0 tx=0x7f030400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 shutdown_connections 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f02f80a1560 0x7f02f80a3a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030c104540 0x7f030c196ae0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c0ff720 0x7f030c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 --2- 172.21.15.5:0/2522051399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f030c1000e0 0x7f030c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.140+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 >> 172.21.15.5:0/2522051399 conn(0x7f030c075710 msgr2=0x7f030c068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:39.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.141+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 shutdown_connections 2023-10-08T13:04:39.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:39.141+0000 7f0313dd9700 1 -- 172.21.15.5:0/2522051399 wait complete. 2023-10-08T13:04:39.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:39 smithi005 ceph-mon[99496]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T13:04:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2522051399' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T13:04:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2522051399' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T13:04:39.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:39 smithi118 ceph-mon[104234]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T13:04:39.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2522051399' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T13:04:39.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2522051399' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T13:04:39.532 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:04:39.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-08T13:04:39.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T13:04:39.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-08T13:04:39.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:39 smithi060 ceph-mon[103190]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T13:04:39.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2522051399' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T13:04:39.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2522051399' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T13:04:40.179 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:40.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:40 smithi118 ceph-mon[104234]: pgmap v258: 129 pgs: 2 peering, 127 active+clean; 622 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 27 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:04:40.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:40 smithi005 ceph-mon[99496]: pgmap v258: 129 pgs: 2 peering, 127 active+clean; 622 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 27 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:04:40.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:40 smithi060 ceph-mon[103190]: pgmap v258: 129 pgs: 2 peering, 127 active+clean; 622 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 27 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 -- 172.21.15.5:0/349399535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 msgr2=0x7f93b8106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 --2- 172.21.15.5:0/349399535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8106ba0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009990 tx=0x7f93ac009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 -- 172.21.15.5:0/349399535 shutdown_connections 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 --2- 172.21.15.5:0/349399535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b8068b30 0x7f93b810d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 --2- 172.21.15.5:0/349399535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8106ba0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 --2- 172.21.15.5:0/349399535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b8068190 0x7f93b80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 -- 172.21.15.5:0/349399535 >> 172.21.15.5:0/349399535 conn(0x7f93b8075790 msgr2=0x7f93b8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 -- 172.21.15.5:0/349399535 shutdown_connections 2023-10-08T13:04:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.492+0000 7f93bd67b700 1 -- 172.21.15.5:0/349399535 wait complete. 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 Processor -- start 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 -- start start 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b8068190 0x7f93b819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b8068b30 0x7f93b819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8197130 con 0x7f93b81067c0 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b81972a0 con 0x7f93b8068190 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.493+0000 7f93bd67b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8197460 con 0x7f93b8068b30 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33040/0 (socket says 172.21.15.5:33040) 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 -- 172.21.15.5:0/3570012407 learned_addr learned my addr 172.21.15.5:0/3570012407 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b67fc700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b8068b30 0x7f93b819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b6ffd700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b8068190 0x7f93b819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 -- 172.21.15.5:0/3570012407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b8068b30 msgr2=0x7f93b819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b8068b30 0x7f93b819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 -- 172.21.15.5:0/3570012407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b8068190 msgr2=0x7f93b819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b8068190 0x7f93b819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 -- 172.21.15.5:0/3570012407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0095f0 con 0x7f93b81067c0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93b77fe700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8196ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f93b0007ee0 tx=0x7f93b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0017070 con 0x7f93b81067c0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8197740 con 0x7f93b81067c0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93b000f040 con 0x7f93b81067c0 2023-10-08T13:04:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0005580 con 0x7f93b81067c0 2023-10-08T13:04:41.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.494+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b80ff920 con 0x7f93b81067c0 2023-10-08T13:04:41.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.495+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b8108dc0 con 0x7f93b81067c0 2023-10-08T13:04:41.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.496+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f93b000db20 con 0x7f93b81067c0 2023-10-08T13:04:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.497+0000 7f939ffff700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f93a00a1560 0x7f93a00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.497+0000 7f93b6ffd700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f93a00a1560 0x7f93a00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.497+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f93b00cc3e0 con 0x7f93b81067c0 2023-10-08T13:04:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.498+0000 7f93b6ffd700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f93a00a1560 0x7f93a00a3a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b2e0 tx=0x7f93ac005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:41.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.502+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93b00954f0 con 0x7f93b81067c0 2023-10-08T13:04:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.702+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f93b8197f90 con 0x7f93b81067c0 2023-10-08T13:04:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.702+0000 7f939ffff700 1 -- 172.21.15.5:0/3570012407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7f93b0098b10 con 0x7f93b81067c0 2023-10-08T13:04:41.704 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.704+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f93a00a1560 msgr2=0x7f93a00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.704+0000 7f93bd67b700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f93a00a1560 0x7f93a00a3a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b2e0 tx=0x7f93ac005960 comp rx=0 tx=0).stop 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.704+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 msgr2=0x7f93b8196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.704+0000 7f93bd67b700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8196ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f93b0007ee0 tx=0x7f93b000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 shutdown_connections 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f93a00a1560 0x7f93a00a3a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93b81067c0 0x7f93b8196ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b8068190 0x7f93b819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 --2- 172.21.15.5:0/3570012407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b8068b30 0x7f93b819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 >> 172.21.15.5:0/3570012407 conn(0x7f93b8075790 msgr2=0x7f93b80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 shutdown_connections 2023-10-08T13:04:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:41.705+0000 7f93bd67b700 1 -- 172.21.15.5:0/3570012407 wait complete. 2023-10-08T13:04:42.139 INFO:teuthology.orchestra.run.smithi005.stdout:[{"version":46,"timestamp":"2023-10-08T13:04:05.776944+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-08T13:04:42.139 INFO:tasks.ceph_manager:config epoch is 46 2023-10-08T13:04:42.140 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T13:04:42.140 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-08T13:04:42.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-08T13:04:42.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:42 smithi005 ceph-mon[99496]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 622 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 25 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:42.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:42 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3570012407' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T13:04:42.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:42 smithi118 ceph-mon[104234]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 622 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 25 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:42.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:42 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3570012407' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T13:04:42.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:42 smithi060 ceph-mon[103190]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 622 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 25 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:42.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:42 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3570012407' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T13:04:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 -- 172.21.15.5:0/3895603198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4100110 msgr2=0x7faea410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 --2- 172.21.15.5:0/3895603198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4100110 0x7faea410c580 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00b0a0 tx=0x7fae9c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 -- 172.21.15.5:0/3895603198 shutdown_connections 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 --2- 172.21.15.5:0/3895603198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4100110 0x7faea410c580 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 --2- 172.21.15.5:0/3895603198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faea41056b0 0x7faea4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 --2- 172.21.15.5:0/3895603198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 0x7faea40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 -- 172.21.15.5:0/3895603198 >> 172.21.15.5:0/3895603198 conn(0x7faea4075790 msgr2=0x7faea4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 -- 172.21.15.5:0/3895603198 shutdown_connections 2023-10-08T13:04:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 -- 172.21.15.5:0/3895603198 wait complete. 2023-10-08T13:04:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.030+0000 7faeaa113700 1 Processor -- start 2023-10-08T13:04:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 -- start start 2023-10-08T13:04:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 0x7faea4197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faea4100110 0x7faea41980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 0x7faea41a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea4198960 con 0x7faea41056b0 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea41a3120 con 0x7faea40ff750 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faeaa113700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea41a3260 con 0x7faea4100110 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 0x7faea4197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 0x7faea41a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 0x7faea4197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:56232/0 (socket says 172.21.15.5:56232) 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 0x7faea41a2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33054/0 (socket says 172.21.15.5:33054) 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea37fe700 1 -- 172.21.15.5:0/3176357376 learned_addr learned my addr 172.21.15.5:0/3176357376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea2ffd700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faea4100110 0x7faea41980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 -- 172.21.15.5:0/3176357376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faea4100110 msgr2=0x7faea41980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faea4100110 0x7faea41980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 -- 172.21.15.5:0/3176357376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 msgr2=0x7faea4197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 0x7faea4197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.031+0000 7faea3fff700 1 -- 172.21.15.5:0/3176357376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c009d00 con 0x7faea41056b0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.032+0000 7faea3fff700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 0x7faea41a2be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00b0a0 tx=0x7fae9c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.032+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00e040 con 0x7faea41056b0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.032+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae9c00cec0 con 0x7faea41056b0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.032+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea41a3480 con 0x7faea41056b0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.032+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c01b450 con 0x7faea41056b0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.032+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea41a38f0 con 0x7faea41056b0 2023-10-08T13:04:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.033+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4107cb0 con 0x7faea41056b0 2023-10-08T13:04:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.034+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fae9c01d480 con 0x7faea41056b0 2023-10-08T13:04:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.035+0000 7faea0ff9700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae8c0a15e0 0x7fae8c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.035+0000 7faea37fe700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae8c0a15e0 0x7fae8c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.035+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fae9c0cf350 con 0x7faea41056b0 2023-10-08T13:04:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.036+0000 7faea37fe700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae8c0a15e0 0x7fae8c0a3aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae94005950 tx=0x7fae9400b500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.038+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae9c060100 con 0x7faea41056b0 2023-10-08T13:04:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.299+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7faea4100df0 con 0x7faea41056b0 2023-10-08T13:04:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.304+0000 7faea0ff9700 1 -- 172.21.15.5:0/3176357376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+260412 (secure 0 0 0) 0x7fae9c021090 con 0x7faea41056b0 2023-10-08T13:04:44.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae8c0a15e0 msgr2=0x7fae8c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae8c0a15e0 0x7fae8c0a3aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae94005950 tx=0x7fae9400b500 comp rx=0 tx=0).stop 2023-10-08T13:04:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 msgr2=0x7faea41a2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 0x7faea41a2be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00b0a0 tx=0x7fae9c007870 comp rx=0 tx=0).stop 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 shutdown_connections 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae8c0a15e0 0x7fae8c0a3aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea41056b0 0x7faea41a2be0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faea40ff750 0x7faea4197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 --2- 172.21.15.5:0/3176357376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faea4100110 0x7faea41980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 >> 172.21.15.5:0/3176357376 conn(0x7faea4075790 msgr2=0x7faea40fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 shutdown_connections 2023-10-08T13:04:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:44.307+0000 7faeaa113700 1 -- 172.21.15.5:0/3176357376 wait complete. 2023-10-08T13:04:44.491 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:44 smithi005 ceph-mon[99496]: pgmap v260: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 23 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:44.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:44 smithi118 ceph-mon[104234]: pgmap v260: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 23 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:44.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:44 smithi060 ceph-mon[103190]: pgmap v260: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 23 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:44.765 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"active_gid":14217,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":706171785},{"type":"v1","addr":"172.21.15.5:6801","nonce":706171785}]},"active_addr":"172.21.15.5:6801/706171785","active_change":"2023-10-08T12:58:37.011294+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24151,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24175,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2979951482}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1032558415}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3631922598}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1246176566}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3055312895}]}]} 2023-10-08T13:04:44.773 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-08T13:04:44.773 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-08T13:04:44.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T13:04:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:45.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:45 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3176357376' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T13:04:45.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:45 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3176357376' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T13:04:45.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:45 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3176357376' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T13:04:46.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:46 smithi118 ceph-mon[104234]: pgmap v261: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 14 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 -- 172.21.15.5:0/3473784285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 msgr2=0x7f32a810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3473784285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a810c580 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f32a000b0a0 tx=0x7f32a000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 -- 172.21.15.5:0/3473784285 shutdown_connections 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3473784285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a810c580 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3473784285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32a81056b0 0x7f32a8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3473784285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a80ff750 0x7f32a80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 -- 172.21.15.5:0/3473784285 >> 172.21.15.5:0/3473784285 conn(0x7f32a8075790 msgr2=0x7f32a8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 -- 172.21.15.5:0/3473784285 shutdown_connections 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.538+0000 7f32ac90c700 1 -- 172.21.15.5:0/3473784285 wait complete. 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 Processor -- start 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 -- start start 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32a80ff750 0x7f32a8101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a81017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a81056b0 0x7f32a8101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a81a5140 con 0x7f32a8100110 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a81a52b0 con 0x7f32a81056b0 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32ac90c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a81a5470 con 0x7f32a80ff750 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32a5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a81017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32a5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a81017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33064/0 (socket says 172.21.15.5:33064) 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32a5d9b700 1 -- 172.21.15.5:0/3418385069 learned_addr learned my addr 172.21.15.5:0/3418385069 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32a6d9d700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a81056b0 0x7f32a8101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.539+0000 7f32a659c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32a80ff750 0x7f32a8101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32a5d9b700 1 -- 172.21.15.5:0/3418385069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32a80ff750 msgr2=0x7f32a8101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32a5d9b700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32a80ff750 0x7f32a8101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32a5d9b700 1 -- 172.21.15.5:0/3418385069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a81056b0 msgr2=0x7f32a8101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32a5d9b700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a81056b0 0x7f32a8101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32a5d9b700 1 -- 172.21.15.5:0/3418385069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0009d00 con 0x7f32a8100110 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32a5d9b700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a81017c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f329c00d950 tx=0x7f329c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c00f890 con 0x7f32a8100110 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a81a5750 con 0x7f32a8100110 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f329c010460 con 0x7f32a8100110 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c00e610 con 0x7f32a8100110 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.540+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a81a5c50 con 0x7f32a8100110 2023-10-08T13:04:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.541+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a8108cc0 con 0x7f32a8100110 2023-10-08T13:04:46.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.542+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f329c0108d0 con 0x7f32a8100110 2023-10-08T13:04:46.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.543+0000 7f32977fe700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f32900a1560 0x7f32900a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:46.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.543+0000 7f32a659c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f32900a1560 0x7f32900a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:46.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.543+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f329c0cd400 con 0x7f32a8100110 2023-10-08T13:04:46.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.543+0000 7f32a659c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f32900a1560 0x7f32900a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3298005950 tx=0x7f329800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:46.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.547+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f329c096510 con 0x7f32a8100110 2023-10-08T13:04:46.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:46 smithi060 ceph-mon[103190]: pgmap v261: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 14 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:46.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:46 smithi005 ceph-mon[99496]: pgmap v261: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 14 op/s; 30 B/s, 0 objects/s recovering 2023-10-08T13:04:46.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.749+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32a8100df0 con 0x7f32a8100110 2023-10-08T13:04:46.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.750+0000 7f32977fe700 1 -- 172.21.15.5:0/3418385069 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24639 (secure 0 0 0) 0x7f329c099b30 con 0x7f32a8100110 2023-10-08T13:04:46.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:38.199053+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f32900a1560 msgr2=0x7f32900a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f32900a1560 0x7f32900a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3298005950 tx=0x7f329800a300 comp rx=0 tx=0).stop 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 msgr2=0x7f32a81017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a81017c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f329c00d950 tx=0x7f329c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 shutdown_connections 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f32900a1560 0x7f32900a3a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a81056b0 0x7f32a8101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32a80ff750 0x7f32a8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 --2- 172.21.15.5:0/3418385069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32a8100110 0x7f32a81017c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 >> 172.21.15.5:0/3418385069 conn(0x7f32a8075790 msgr2=0x7f32a8068570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 shutdown_connections 2023-10-08T13:04:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:46.753+0000 7f32ac90c700 1 -- 172.21.15.5:0/3418385069 wait complete. 2023-10-08T13:04:47.196 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-08T13:04:47.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T13:04:47.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:47 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3418385069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:47.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:47 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3418385069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:47.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:47 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3418385069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:48.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:48 smithi005 ceph-mon[99496]: pgmap v262: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.3 KiB/s wr, 13 op/s; 24 B/s, 0 objects/s recovering 2023-10-08T13:04:48.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:48 smithi118 ceph-mon[104234]: pgmap v262: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.3 KiB/s wr, 13 op/s; 24 B/s, 0 objects/s recovering 2023-10-08T13:04:48.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:48 smithi060 ceph-mon[103190]: pgmap v262: 129 pgs: 129 active+clean; 626 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.3 KiB/s wr, 13 op/s; 24 B/s, 0 objects/s recovering 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 -- 172.21.15.5:0/3217316796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c100110 msgr2=0x7fdd6c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 --2- 172.21.15.5:0/3217316796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c100110 0x7fdd6c10c580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400b0a0 tx=0x7fdd6400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 -- 172.21.15.5:0/3217316796 shutdown_connections 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 --2- 172.21.15.5:0/3217316796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c100110 0x7fdd6c10c580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 --2- 172.21.15.5:0/3217316796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 --2- 172.21.15.5:0/3217316796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd6c0ff750 0x7fdd6c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 -- 172.21.15.5:0/3217316796 >> 172.21.15.5:0/3217316796 conn(0x7fdd6c075790 msgr2=0x7fdd6c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 -- 172.21.15.5:0/3217316796 shutdown_connections 2023-10-08T13:04:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.162+0000 7fdd70afe700 1 -- 172.21.15.5:0/3217316796 wait complete. 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 Processor -- start 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 -- start start 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd6c0ff750 0x7fdd6c197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd6c100110 0x7fdd6c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c1a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c198a10 con 0x7fdd6c1056b0 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1a31a0 con 0x7fdd6c100110 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd70afe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1a3310 con 0x7fdd6c0ff750 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c1a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c1a2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33080/0 (socket says 172.21.15.5:33080) 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 -- 172.21.15.5:0/1575955252 learned_addr learned my addr 172.21.15.5:0/1575955252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6a59c700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd6c0ff750 0x7fdd6c197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd69d9b700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd6c100110 0x7fdd6c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 -- 172.21.15.5:0/1575955252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd6c0ff750 msgr2=0x7fdd6c197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd6c0ff750 0x7fdd6c197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 -- 172.21.15.5:0/1575955252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd6c100110 msgr2=0x7fdd6c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd6c100110 0x7fdd6c198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.163+0000 7fdd6ad9d700 1 -- 172.21.15.5:0/1575955252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd64009d00 con 0x7fdd6c1056b0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.164+0000 7fdd6ad9d700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c1a2c60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400b830 tx=0x7fdd640077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.164+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400e040 con 0x7fdd6c1056b0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.164+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd64004e60 con 0x7fdd6c1056b0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.164+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640053c0 con 0x7fdd6c1056b0 2023-10-08T13:04:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.164+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c195a90 con 0x7fdd6c1056b0 2023-10-08T13:04:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.164+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c195f40 con 0x7fdd6c1056b0 2023-10-08T13:04:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.165+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c107cd0 con 0x7fdd6c1056b0 2023-10-08T13:04:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.166+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fdd6401b450 con 0x7fdd6c1056b0 2023-10-08T13:04:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.167+0000 7fdd5b7fe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdd540a1560 0x7fdd540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.167+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdd640cf0b0 con 0x7fdd6c1056b0 2023-10-08T13:04:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.167+0000 7fdd6a59c700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdd540a1560 0x7fdd540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:49.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.167+0000 7fdd6a59c700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdd540a1560 0x7fdd540a3a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a10 tx=0x7fdd5c009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.170+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdd64098250 con 0x7fdd6c1056b0 2023-10-08T13:04:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.369+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd6c068750 con 0x7fdd6c1056b0 2023-10-08T13:04:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.371+0000 7fdd5b7fe700 1 -- 172.21.15.5:0/1575955252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24639 (secure 0 0 0) 0x7fdd6409b870 con 0x7fdd6c1056b0 2023-10-08T13:04:49.372 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:04:49.373 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:38.199053+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:04:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdd540a1560 msgr2=0x7fdd540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdd540a1560 0x7fdd540a3a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a10 tx=0x7fdd5c009190 comp rx=0 tx=0).stop 2023-10-08T13:04:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 msgr2=0x7fdd6c1a2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c1a2c60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400b830 tx=0x7fdd640077f0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 shutdown_connections 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdd540a1560 0x7fdd540a3a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6c1056b0 0x7fdd6c1a2c60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd6c0ff750 0x7fdd6c197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 --2- 172.21.15.5:0/1575955252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd6c100110 0x7fdd6c198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 >> 172.21.15.5:0/1575955252 conn(0x7fdd6c075790 msgr2=0x7fdd6c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 shutdown_connections 2023-10-08T13:04:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:49.373+0000 7fdd70afe700 1 -- 172.21.15.5:0/1575955252 wait complete. 2023-10-08T13:04:49.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-08T13:04:49.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-08T13:04:49.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-08T13:04:49.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-08T13:04:49.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-08T13:04:49.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-08T13:04:49.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-08T13:04:49.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-08T13:04:49.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-08T13:04:49.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-08T13:04:49.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-08T13:04:49.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-08T13:04:50.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:50 smithi118 ceph-mon[104234]: pgmap v263: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s; 22 B/s, 0 objects/s recovering 2023-10-08T13:04:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1575955252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:50.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:50 smithi060 ceph-mon[103190]: pgmap v263: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s; 22 B/s, 0 objects/s recovering 2023-10-08T13:04:50.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1575955252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:50.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:50 smithi005 ceph-mon[99496]: pgmap v263: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s; 22 B/s, 0 objects/s recovering 2023-10-08T13:04:50.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1575955252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:04:50.902 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.069 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.369 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:51.613 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:52.047 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:52.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:52 smithi118 ceph-mon[104234]: pgmap v264: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T13:04:52.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:52 smithi005 ceph-mon[99496]: pgmap v264: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T13:04:52.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:52 smithi060 ceph-mon[103190]: pgmap v264: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T13:04:52.727 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:04:54.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:54 smithi118 ceph-mon[104234]: pgmap v265: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-08T13:04:54.568 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:54 smithi005 ceph-mon[99496]: pgmap v265: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-08T13:04:54.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:54 smithi060 ceph-mon[103190]: pgmap v265: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-08T13:04:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 -- 172.21.15.5:0/1545702594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 msgr2=0x7f2c7c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 --2- 172.21.15.5:0/1545702594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c105a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009990 tx=0x7f2c6c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 -- 172.21.15.5:0/1545702594 shutdown_connections 2023-10-08T13:04:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 --2- 172.21.15.5:0/1545702594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c7c100110 0x7f2c7c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 --2- 172.21.15.5:0/1545702594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c105a90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 --2- 172.21.15.5:0/1545702594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c7c0ff750 0x7f2c7c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 -- 172.21.15.5:0/1545702594 >> 172.21.15.5:0/1545702594 conn(0x7f2c7c075790 msgr2=0x7f2c7c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 -- 172.21.15.5:0/1545702594 shutdown_connections 2023-10-08T13:04:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.920+0000 7f2c816e6700 1 -- 172.21.15.5:0/1545702594 wait complete. 2023-10-08T13:04:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 Processor -- start 2023-10-08T13:04:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 -- start start 2023-10-08T13:04:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c7c0ff750 0x7f2c7c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c7c100110 0x7f2c7c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c1a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c198800 con 0x7f2c7c1056b0 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1a3030 con 0x7f2c7c100110 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c816e6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1a3170 con 0x7f2c7c0ff750 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c7b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c1a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c7b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c1a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33092/0 (socket says 172.21.15.5:33092) 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c7a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c7c100110 0x7f2c7c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c7b7fe700 1 -- 172.21.15.5:0/527014163 learned_addr learned my addr 172.21.15.5:0/527014163 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.921+0000 7f2c7affd700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c7c0ff750 0x7f2c7c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7b7fe700 1 -- 172.21.15.5:0/527014163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c7c0ff750 msgr2=0x7f2c7c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7b7fe700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c7c0ff750 0x7f2c7c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7b7fe700 1 -- 172.21.15.5:0/527014163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c7c100110 msgr2=0x7f2c7c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7b7fe700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c7c100110 0x7f2c7c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7b7fe700 1 -- 172.21.15.5:0/527014163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0095f0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7a7fc700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c7c100110 0x7f2c7c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c7b7fe700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c1a2af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2c74007d40 tx=0x7f2c7400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7400acb0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c1a33d0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c74007e90 con 0x7f2c7c1056b0 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740115c0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.922+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c1a38d0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.923+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c7c10f950 con 0x7f2c7c1056b0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.924+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f2c74012420 con 0x7f2c7c1056b0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c63fff700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2c640a1560 0x7f2c640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c7affd700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2c640a1560 0x7f2c640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2c740cd8e0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c63fff700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] conn(0x7f2c640ac710 0x7f2c640aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 --> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c640af280 con 0x7f2c640ac710 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c740cdcf0 con 0x7f2c7c1056b0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c7a7fc700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] conn(0x7f2c640ac710 0x7f2c640aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.925+0000 7f2c7affd700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2c640a1560 0x7f2c640a3a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00b2e0 tx=0x7f2c6c005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.926+0000 7f2c7a7fc700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] conn(0x7f2c640ac710 0x7f2c640aebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.926+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== osd.6 v2:172.21.15.5:6818/1379902239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2c640af280 con 0x7f2c640ac710 2023-10-08T13:04:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.942+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 --> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c7c100df0 con 0x7f2c640ac710 2023-10-08T13:04:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c63fff700 1 -- 172.21.15.5:0/527014163 <== osd.6 v2:172.21.15.5:6818/1379902239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2c7c100df0 con 0x7f2c640ac710 2023-10-08T13:04:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] conn(0x7f2c640ac710 msgr2=0x7f2c640aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] conn(0x7f2c640ac710 0x7f2c640aebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2c640a1560 msgr2=0x7f2c640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2c640a1560 0x7f2c640a3a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00b2e0 tx=0x7f2c6c005fd0 comp rx=0 tx=0).stop 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 msgr2=0x7f2c7c1a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 --2- 172.21.15.5:0/527014163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c7c1056b0 0x7f2c7c1a2af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2c74007d40 tx=0x7f2c7400a340 comp rx=0 tx=0).stop 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c7b7fe700 1 -- 172.21.15.5:0/527014163 reap_dead start 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 shutdown_connections 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 >> 172.21.15.5:0/527014163 conn(0x7f2c7c075790 msgr2=0x7f2c7c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.943+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 shutdown_connections 2023-10-08T13:04:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:54.944+0000 7f2c816e6700 1 -- 172.21.15.5:0/527014163 wait complete. 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 -- 172.21.15.5:0/664885127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 msgr2=0x7efeb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 --2- 172.21.15.5:0/664885127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb0068b50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efea401a9a0 tx=0x7efea401acb0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 -- 172.21.15.5:0/664885127 shutdown_connections 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 --2- 172.21.15.5:0/664885127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efeb0103250 0x7efeb0103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 --2- 172.21.15.5:0/664885127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb01056f0 0x7efeb0068190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 --2- 172.21.15.5:0/664885127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb0068b50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 -- 172.21.15.5:0/664885127 >> 172.21.15.5:0/664885127 conn(0x7efeb0075790 msgr2=0x7efeb0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 -- 172.21.15.5:0/664885127 shutdown_connections 2023-10-08T13:04:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.509+0000 7efeb4866700 1 -- 172.21.15.5:0/664885127 wait complete. 2023-10-08T13:04:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.510+0000 7efeb4866700 1 Processor -- start 2023-10-08T13:04:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.510+0000 7efeb4866700 1 -- start start 2023-10-08T13:04:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeb4866700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeb4866700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0103250 0x7efeb01102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeb4866700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efeb01056f0 0x7efeb01994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeb4866700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0199bb0 con 0x7efeb00686d0 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeb4866700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0199d20 con 0x7efeb01056f0 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeb4866700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0199ee0 con 0x7efeb0103250 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb010fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33104/0 (socket says 172.21.15.5:33104) 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 -- 172.21.15.5:0/1524557853 learned_addr learned my addr 172.21.15.5:0/1524557853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeadd9b700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0103250 0x7efeb01102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeaed9d700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efeb01056f0 0x7efeb01994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 -- 172.21.15.5:0/1524557853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0103250 msgr2=0x7efeb01102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efeb0103250 0x7efeb01102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 -- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efeb01056f0 msgr2=0x7efeb01994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efeb01056f0 0x7efeb01994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.511+0000 7efeae59c700 1 -- 172.21.15.5:0/1524557853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea401a600 con 0x7efeb00686d0 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.512+0000 7efeae59c700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb010fdb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efea000d980 tx=0x7efea000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.512+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0004220 con 0x7efeb00686d0 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.512+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb019a1c0 con 0x7efeb00686d0 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.512+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb01a1790 con 0x7efeb00686d0 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.512+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efea0007640 con 0x7efeb00686d0 2023-10-08T13:04:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.512+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0005690 con 0x7efeb00686d0 2023-10-08T13:04:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.513+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe90000fc0 con 0x7efeb00686d0 2023-10-08T13:04:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.514+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efea0004380 con 0x7efeb00686d0 2023-10-08T13:04:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.515+0000 7efe9f7fe700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe980a1560 0x7efe980a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.515+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efea00cd620 con 0x7efeb00686d0 2023-10-08T13:04:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.515+0000 7efeadd9b700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe980a1560 0x7efe980a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.515+0000 7efe9f7fe700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] conn(0x7efe980ac710 0x7efe980aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.515+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 --> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe980af280 con 0x7efe980ac710 2023-10-08T13:04:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.515+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7efea00cda30 con 0x7efeb00686d0 2023-10-08T13:04:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.516+0000 7efeadd9b700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe980a1560 0x7efe980a3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efea401a8f0 tx=0x7efea402b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.516+0000 7efeaed9d700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] conn(0x7efe980ac710 0x7efe980aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.516+0000 7efeaed9d700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] conn(0x7efe980ac710 0x7efe980aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.517+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== osd.7 v2:172.21.15.60:6816/2435076534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efe980af280 con 0x7efe980ac710 2023-10-08T13:04:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.535+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 --> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe90002d40 con 0x7efe980ac710 2023-10-08T13:04:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efe9f7fe700 1 -- 172.21.15.5:0/1524557853 <== osd.7 v2:172.21.15.60:6816/2435076534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efe90002d40 con 0x7efe980ac710 2023-10-08T13:04:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] conn(0x7efe980ac710 msgr2=0x7efe980aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] conn(0x7efe980ac710 0x7efe980aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe980a1560 msgr2=0x7efe980a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe980a1560 0x7efe980a3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efea401a8f0 tx=0x7efea402b040 comp rx=0 tx=0).stop 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 msgr2=0x7efeb010fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 --2- 172.21.15.5:0/1524557853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb00686d0 0x7efeb010fdb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efea000d980 tx=0x7efea000dc90 comp rx=0 tx=0).stop 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeaed9d700 1 -- 172.21.15.5:0/1524557853 reap_dead start 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 shutdown_connections 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 >> 172.21.15.5:0/1524557853 conn(0x7efeb0075790 msgr2=0x7efeb00fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 shutdown_connections 2023-10-08T13:04:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.536+0000 7efeb4866700 1 -- 172.21.15.5:0/1524557853 wait complete. 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/1103535623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 msgr2=0x7f3a2810f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/1103535623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2810f6f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b0a0 tx=0x7f3a2000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/1103535623 shutdown_connections 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/1103535623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2810f6f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/1103535623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a28068190 0x7f3a28068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/1103535623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a28068ab0 0x7f3a2810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/1103535623 >> 172.21.15.5:0/1103535623 conn(0x7f3a28075790 msgr2=0x7f3a28075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/1103535623 shutdown_connections 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.547+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/1103535623 wait complete. 2023-10-08T13:04:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.548+0000 7f3a2e9bb700 1 Processor -- start 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.548+0000 7f3a2e9bb700 1 -- start start 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.548+0000 7f3a2e9bb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a28068190 0x7f3a28198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2e9bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a28068ab0 0x7f3a28199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2e9bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2e9bb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2819de00 con 0x7f3a2810d300 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2e9bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2819df70 con 0x7f3a28068ab0 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2e9bb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2819e130 con 0x7f3a28068190 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2819d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33124/0 (socket says 172.21.15.5:33124) 2023-10-08T13:04:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 -- 172.21.15.5:0/3610724182 learned_addr learned my addr 172.21.15.5:0/3610724182 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a27fff700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a28068190 0x7f3a28198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a277fe700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a28068ab0 0x7f3a28199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 -- 172.21.15.5:0/3610724182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a28068190 msgr2=0x7f3a28198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a28068190 0x7f3a28198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 -- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a28068ab0 msgr2=0x7f3a28199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a28068ab0 0x7f3a28199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 -- 172.21.15.5:0/3610724182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009d00 con 0x7f3a2810d300 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a27fff700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a28068190 0x7f3a28198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a277fe700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a28068ab0 0x7f3a28199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a2cf58700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2819d7f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b070 tx=0x7f3a200078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.549+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000e040 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.550+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2819e3b0 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.550+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a2001d470 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.550+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a200052a0 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.550+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a281a5c70 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.550+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a28112bc0 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.552+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3a2001d870 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.552+0000 7f3a257fa700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a100a1560 0x7f3a100a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3a200ceea0 con 0x7f3a2810d300 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a27fff700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a100a1560 0x7f3a100a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a257fa700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] conn(0x7f3a100ac710 0x7f3a100aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 --> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a100af280 con 0x7f3a100ac710 2023-10-08T13:04:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a200cf2b0 con 0x7f3a2810d300 2023-10-08T13:04:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a277fe700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] conn(0x7f3a100ac710 0x7f3a100aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a27fff700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a100a1560 0x7f3a100a3a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3a18011490 tx=0x7f3a18009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.553+0000 7f3a277fe700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] conn(0x7f3a100ac710 0x7f3a100aebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.554+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== osd.4 v2:172.21.15.60:6808/3771970201 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3a100af280 con 0x7f3a100ac710 2023-10-08T13:04:55.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.571+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 --> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a280ffd30 con 0x7f3a100ac710 2023-10-08T13:04:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a257fa700 1 -- 172.21.15.5:0/3610724182 <== osd.4 v2:172.21.15.60:6808/3771970201 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3a280ffd30 con 0x7f3a100ac710 2023-10-08T13:04:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] conn(0x7f3a100ac710 msgr2=0x7f3a100aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] conn(0x7f3a100ac710 0x7f3a100aebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a100a1560 msgr2=0x7f3a100a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a100a1560 0x7f3a100a3a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3a18011490 tx=0x7f3a18009260 comp rx=0 tx=0).stop 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 msgr2=0x7f3a2819d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2e9bb700 1 --2- 172.21.15.5:0/3610724182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a2810d300 0x7f3a2819d7f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b070 tx=0x7f3a200078e0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.572+0000 7f3a2cf58700 1 -- 172.21.15.5:0/3610724182 reap_dead start 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.573+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 shutdown_connections 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.573+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 >> 172.21.15.5:0/3610724182 conn(0x7f3a28075790 msgr2=0x7f3a2810e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.573+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 shutdown_connections 2023-10-08T13:04:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.573+0000 7f3a2e9bb700 1 -- 172.21.15.5:0/3610724182 wait complete. 2023-10-08T13:04:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 -- 172.21.15.5:0/2055754980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 msgr2=0x7f5ffc0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 --2- 172.21.15.5:0/2055754980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc0ffbd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009990 tx=0x7f5fec009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 -- 172.21.15.5:0/2055754980 shutdown_connections 2023-10-08T13:04:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 --2- 172.21.15.5:0/2055754980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc100110 0x7f5ffc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 --2- 172.21.15.5:0/2055754980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc1056b0 0x7f5ffc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 --2- 172.21.15.5:0/2055754980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc0ffbd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 -- 172.21.15.5:0/2055754980 >> 172.21.15.5:0/2055754980 conn(0x7f5ffc075790 msgr2=0x7f5ffc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:55.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 -- 172.21.15.5:0/2055754980 shutdown_connections 2023-10-08T13:04:55.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 -- 172.21.15.5:0/2055754980 wait complete. 2023-10-08T13:04:55.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 Processor -- start 2023-10-08T13:04:55.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.621+0000 7f6004446700 1 -- start start 2023-10-08T13:04:55.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc100110 0x7f5ffc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc1056b0 0x7f5ffc1a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc198870 con 0x7f5ffc0ff750 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1a3030 con 0x7f5ffc100110 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1a3170 con 0x7f5ffc1056b0 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33136/0 (socket says 172.21.15.5:33136) 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 -- 172.21.15.5:0/3219938341 learned_addr learned my addr 172.21.15.5:0/3219938341 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60029e3700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc1056b0 0x7f5ffc1a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60019e1700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc100110 0x7f5ffc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 -- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc1056b0 msgr2=0x7f5ffc1a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ffc1056b0 0x7f5ffc1a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 -- 172.21.15.5:0/3219938341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc100110 msgr2=0x7f5ffc197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ffc100110 0x7f5ffc197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 -- 172.21.15.5:0/3219938341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0095f0 con 0x7f5ffc0ff750 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f60021e2700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc197a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c920 tx=0x7f5ff800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004a30 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ff80054e0 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc1a33f0 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8007bd0 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.622+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc1a3940 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.623+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ffc10f9b0 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f5ff8007d30 con 0x7f5ffc0ff750 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f5ff37fe700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fe80a15e0 0x7f5fe80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f60019e1700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fe80a15e0 0x7f5fe80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5ff80cd0f0 con 0x7f5ffc0ff750 2023-10-08T13:04:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f5ff37fe700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] conn(0x7f5fe80ac790 0x7f5fe80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 --> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fe80af300 con 0x7f5fe80ac790 2023-10-08T13:04:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.625+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff80cd500 con 0x7f5ffc0ff750 2023-10-08T13:04:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.626+0000 7f60029e3700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] conn(0x7f5fe80ac790 0x7f5fe80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:55.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.626+0000 7f60019e1700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fe80a15e0 0x7f5fe80a3aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0689a0 tx=0x7f5fec005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.626+0000 7f60029e3700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] conn(0x7f5fe80ac790 0x7f5fe80aec30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.627+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== osd.2 v2:172.21.15.118:6800/1550334849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5fe80af300 con 0x7f5fe80ac790 2023-10-08T13:04:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.643+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 --> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ffc100df0 con 0x7f5fe80ac790 2023-10-08T13:04:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f5ff37fe700 1 -- 172.21.15.5:0/3219938341 <== osd.2 v2:172.21.15.118:6800/1550334849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ffc100df0 con 0x7f5fe80ac790 2023-10-08T13:04:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] conn(0x7f5fe80ac790 msgr2=0x7f5fe80aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] conn(0x7f5fe80ac790 0x7f5fe80aec30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fe80a15e0 msgr2=0x7f5fe80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5fe80a15e0 0x7f5fe80a3aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0689a0 tx=0x7f5fec005fd0 comp rx=0 tx=0).stop 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 msgr2=0x7f5ffc197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 --2- 172.21.15.5:0/3219938341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ffc0ff750 0x7f5ffc197a70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c920 tx=0x7f5ff800cc30 comp rx=0 tx=0).stop 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f60029e3700 1 -- 172.21.15.5:0/3219938341 reap_dead start 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 shutdown_connections 2023-10-08T13:04:55.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 >> 172.21.15.5:0/3219938341 conn(0x7f5ffc075790 msgr2=0x7f5ffc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 shutdown_connections 2023-10-08T13:04:55.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:55.644+0000 7f6004446700 1 -- 172.21.15.5:0/3219938341 wait complete. 2023-10-08T13:04:56.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:56 smithi005 ceph-mon[99496]: pgmap v266: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-08T13:04:56.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:56 smithi118 ceph-mon[104234]: pgmap v266: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-08T13:04:56.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:56 smithi060 ceph-mon[103190]: pgmap v266: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.747+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2205354875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf581067a0 msgr2=0x7fcf58106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.747+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2205354875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf581067a0 0x7fcf58106b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009990 tx=0x7fcf4c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2205354875 shutdown_connections 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2205354875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf58068b30 0x7fcf5810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2205354875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf581067a0 0x7fcf58106b80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2205354875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf58068190 0x7fcf580685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2205354875 >> 172.21.15.5:0/2205354875 conn(0x7fcf58075790 msgr2=0x7fcf58075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2205354875 shutdown_connections 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2205354875 wait complete. 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 Processor -- start 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.748+0000 7fcf5df8c700 1 -- start start 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58068190 0x7fcf580ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf58068b30 0x7fcf580ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf581067a0 0x7fcf581002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581a50d0 con 0x7fcf58068190 2023-10-08T13:04:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581a5240 con 0x7fcf58068b30 2023-10-08T13:04:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581a5400 con 0x7fcf581067a0 2023-10-08T13:04:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58068190 0x7fcf580ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58068190 0x7fcf580ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33150/0 (socket says 172.21.15.5:33150) 2023-10-08T13:04:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 -- 172.21.15.5:0/2888645323 learned_addr learned my addr 172.21.15.5:0/2888645323 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf57fff700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf581067a0 0x7fcf581002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 -- 172.21.15.5:0/2888645323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf581067a0 msgr2=0x7fcf581002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf581067a0 0x7fcf581002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 -- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf58068b30 msgr2=0x7fcf580ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf58068b30 0x7fcf580ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 -- 172.21.15.5:0/2888645323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0095f0 con 0x7fcf58068190 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf577fe700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58068190 0x7fcf580ff820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000c00 tx=0x7fcf4c00f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01d070 con 0x7fcf58068190 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf4c00fca0 con 0x7fcf58068190 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf581a5680 con 0x7fcf58068190 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c017750 con 0x7fcf58068190 2023-10-08T13:04:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.749+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf581a5af0 con 0x7fcf58068190 2023-10-08T13:04:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.750+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf58110ac0 con 0x7fcf58068190 2023-10-08T13:04:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.751+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fcf4c022470 con 0x7fcf58068190 2023-10-08T13:04:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.752+0000 7fcf54ff9700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf400a15e0 0x7fcf400a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.752+0000 7fcf56ffd700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf400a15e0 0x7fcf400a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.752+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcf4c0ceea0 con 0x7fcf58068190 2023-10-08T13:04:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.752+0000 7fcf54ff9700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] conn(0x7fcf400ac710 0x7fcf400aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.752+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 --> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf400af280 con 0x7fcf400ac710 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.752+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf4c0cf2b0 con 0x7fcf58068190 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.753+0000 7fcf56ffd700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf400a15e0 0x7fcf400a3aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf58100f00 tx=0x7fcf48006d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.753+0000 7fcf57fff700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] conn(0x7fcf400ac710 0x7fcf400aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.753+0000 7fcf57fff700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] conn(0x7fcf400ac710 0x7fcf400aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.754+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== osd.1 v2:172.21.15.60:6800/1932201040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcf400af280 con 0x7fcf400ac710 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.770+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 --> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf58060ef0 con 0x7fcf400ac710 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf54ff9700 1 -- 172.21.15.5:0/2888645323 <== osd.1 v2:172.21.15.60:6800/1932201040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf58060ef0 con 0x7fcf400ac710 2023-10-08T13:04:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] conn(0x7fcf400ac710 msgr2=0x7fcf400aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] conn(0x7fcf400ac710 0x7fcf400aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf400a15e0 msgr2=0x7fcf400a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf400a15e0 0x7fcf400a3aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf58100f00 tx=0x7fcf48006d20 comp rx=0 tx=0).stop 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58068190 msgr2=0x7fcf580ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf5df8c700 1 --2- 172.21.15.5:0/2888645323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf58068190 0x7fcf580ff820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000c00 tx=0x7fcf4c00f7b0 comp rx=0 tx=0).stop 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.771+0000 7fcf57fff700 1 -- 172.21.15.5:0/2888645323 reap_dead start 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.772+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 shutdown_connections 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.772+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 >> 172.21.15.5:0/2888645323 conn(0x7fcf58075790 msgr2=0x7fcf580fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.772+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 shutdown_connections 2023-10-08T13:04:56.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:56.772+0000 7fcf5df8c700 1 -- 172.21.15.5:0/2888645323 wait complete. 2023-10-08T13:04:57.221 INFO:teuthology.orchestra.run.smithi005.stdout:219043332133 2023-10-08T13:04:57.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-08T13:04:57.295 INFO:teuthology.orchestra.run.smithi005.stdout:81604378683 2023-10-08T13:04:57.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-08T13:04:58.393 INFO:teuthology.orchestra.run.smithi005.stdout:197568495658 2023-10-08T13:04:58.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-08T13:04:58.484 INFO:teuthology.orchestra.run.smithi005.stdout:141733920819 2023-10-08T13:04:58.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-08T13:04:58.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:04:58 smithi005 ceph-mon[99496]: pgmap v267: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:04:58.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:04:58 smithi118 ceph-mon[104234]: pgmap v267: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:04:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:04:58 smithi060 ceph-mon[103190]: pgmap v267: 129 pgs: 129 active+clean; 636 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:04:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.974+0000 7f68058af700 1 -- 172.21.15.5:0/2617074388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68001058d0 msgr2=0x7f6800105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.974+0000 7f68058af700 1 --2- 172.21.15.5:0/2617074388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68001058d0 0x7f6800105cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098f0 tx=0x7f67f0009c00 comp rx=0 tx=0).stop 2023-10-08T13:04:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.974+0000 7f68058af700 1 -- 172.21.15.5:0/2617074388 shutdown_connections 2023-10-08T13:04:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.974+0000 7f68058af700 1 --2- 172.21.15.5:0/2617074388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68000ffb30 0x7f680010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.974+0000 7f68058af700 1 --2- 172.21.15.5:0/2617074388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68001058d0 0x7f6800105cb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.974+0000 7f68058af700 1 --2- 172.21.15.5:0/2617074388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68000ff190 0x7f68000ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.975+0000 7f68058af700 1 -- 172.21.15.5:0/2617074388 >> 172.21.15.5:0/2617074388 conn(0x7f6800074a10 msgr2=0x7f6800074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.975+0000 7f68058af700 1 -- 172.21.15.5:0/2617074388 shutdown_connections 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.975+0000 7f68058af700 1 -- 172.21.15.5:0/2617074388 wait complete. 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.975+0000 7f68058af700 1 Processor -- start 2023-10-08T13:04:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.975+0000 7f68058af700 1 -- start start 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68000ff190 0x7f6800100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68000ffb30 0x7f68001008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68001058d0 0x7f6800100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68001a4f90 con 0x7f68000ffb30 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68001a5100 con 0x7f68000ff190 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68001a52c0 con 0x7f68001058d0 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68000ffb30 0x7f68001008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68000ffb30 0x7f68001008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33168/0 (socket says 172.21.15.5:33168) 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 -- 172.21.15.5:0/1758852611 learned_addr learned my addr 172.21.15.5:0/1758852611 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67ff7fe700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68001058d0 0x7f6800100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67feffd700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68000ff190 0x7f6800100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 -- 172.21.15.5:0/1758852611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68001058d0 msgr2=0x7f6800100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68001058d0 0x7f6800100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 -- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68000ff190 msgr2=0x7f6800100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68000ff190 0x7f6800100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 -- 172.21.15.5:0/1758852611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8009d00 con 0x7f68000ffb30 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67feffd700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68000ff190 0x7f6800100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f67fe7fc700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68000ffb30 0x7f68001008b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e9a0 tx=0x7f67f400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4009790 con 0x7f68000ffb30 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67f400cbd0 con 0x7f68000ffb30 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4018680 con 0x7f68000ffb30 2023-10-08T13:04:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.976+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f0009520 con 0x7f68000ffb30 2023-10-08T13:04:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.977+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68001a5910 con 0x7f68000ffb30 2023-10-08T13:04:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.977+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68001109c0 con 0x7f68000ffb30 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.979+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f67f400cd40 con 0x7f68000ffb30 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.979+0000 7f68048ad700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67e80a15e0 0x7f67e80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.979+0000 7f67feffd700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67e80a15e0 0x7f67e80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.979+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f67f4014070 con 0x7f68000ffb30 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.980+0000 7f68048ad700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] conn(0x7f67e80ac790 0x7f67e80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.980+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 --> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67e80af300 con 0x7f67e80ac790 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.980+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67f40cdc80 con 0x7f68000ffb30 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.980+0000 7f67feffd700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67e80a15e0 0x7f67e80a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009810 tx=0x7f67f0019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.980+0000 7f67ff7fe700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] conn(0x7f67e80ac790 0x7f67e80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:04:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.980+0000 7f67ff7fe700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] conn(0x7f67e80ac790 0x7f67e80aec30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:04:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.981+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== osd.10 v2:172.21.15.60:6824/2643673100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f67e80af300 con 0x7f67e80ac790 2023-10-08T13:04:59.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.997+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 --> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6800060ef0 con 0x7f67e80ac790 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.998+0000 7f68048ad700 1 -- 172.21.15.5:0/1758852611 <== osd.10 v2:172.21.15.60:6824/2643673100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6800060ef0 con 0x7f67e80ac790 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.998+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] conn(0x7f67e80ac790 msgr2=0x7f67e80aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.998+0000 7f68058af700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] conn(0x7f67e80ac790 0x7f67e80aec30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67e80a15e0 msgr2=0x7f67e80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67e80a15e0 0x7f67e80a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009810 tx=0x7f67f0019040 comp rx=0 tx=0).stop 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68000ffb30 msgr2=0x7f68001008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 --2- 172.21.15.5:0/1758852611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68000ffb30 0x7f68001008b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e9a0 tx=0x7f67f400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f67ff7fe700 1 -- 172.21.15.5:0/1758852611 reap_dead start 2023-10-08T13:04:59.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 shutdown_connections 2023-10-08T13:04:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 >> 172.21.15.5:0/1758852611 conn(0x7f6800074a10 msgr2=0x7f68000fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:04:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 shutdown_connections 2023-10-08T13:04:59.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:04:58.999+0000 7f68058af700 1 -- 172.21.15.5:0/1758852611 wait complete. 2023-10-08T13:04:59.745 INFO:teuthology.orchestra.run.smithi005.stdout:60129542207 2023-10-08T13:04:59.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-08T13:05:00.066 INFO:teuthology.orchestra.run.smithi005.stdout:304942678041 2023-10-08T13:05:00.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-08T13:05:00.390 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:00 smithi005 ceph-mon[99496]: pgmap v268: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 -- 172.21.15.5:0/543941831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 msgr2=0x7fd00c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 --2- 172.21.15.5:0/543941831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c100d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd000009990 tx=0x7fd000009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 -- 172.21.15.5:0/543941831 shutdown_connections 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 --2- 172.21.15.5:0/543941831 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd00c101260 0x7fd00c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 --2- 172.21.15.5:0/543941831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c1057c0 0x7fd00c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 --2- 172.21.15.5:0/543941831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c100d20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.463+0000 7fd011708700 1 -- 172.21.15.5:0/543941831 >> 172.21.15.5:0/543941831 conn(0x7fd00c0779e0 msgr2=0x7fd00c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.464+0000 7fd011708700 1 -- 172.21.15.5:0/543941831 shutdown_connections 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.464+0000 7fd011708700 1 -- 172.21.15.5:0/543941831 wait complete. 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.464+0000 7fd011708700 1 Processor -- start 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 -- start start 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c101260 0x7fd00c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd00c1057c0 0x7fd00c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c19dde0 con 0x7fd00c1008a0 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c19df50 con 0x7fd00c101260 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd011708700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c19e110 con 0x7fd00c1057c0 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd00affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd00affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33198/0 (socket says 172.21.15.5:33198) 2023-10-08T13:05:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd00affd700 1 -- 172.21.15.5:0/1479214541 learned_addr learned my addr 172.21.15.5:0/1479214541 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.465+0000 7fd00b7fe700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd00c1057c0 0x7fd00c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd00affd700 1 -- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd00c1057c0 msgr2=0x7fd00c19d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd00affd700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd00c1057c0 0x7fd00c19d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd00affd700 1 -- 172.21.15.5:0/1479214541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c101260 msgr2=0x7fd00c199470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd00affd700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c101260 0x7fd00c199470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd00affd700 1 -- 172.21.15.5:0/1479214541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000095f0 con 0x7fd00c1008a0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd00affd700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c198f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00e970 tx=0x7fcffc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc009790 con 0x7fd00c1008a0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c19e3f0 con 0x7fd00c1008a0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcffc0044e0 con 0x7fd00c1008a0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc003e30 con 0x7fd00c1008a0 2023-10-08T13:05:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.466+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1a5c50 con 0x7fd00c1008a0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.467+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd00c1109f0 con 0x7fd00c1008a0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.468+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fcffc004000 con 0x7fd00c1008a0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.469+0000 7fcff3fff700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcff40a1560 0x7fcff40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.469+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcffc014070 con 0x7fd00c1008a0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.470+0000 7fcff3fff700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] conn(0x7fcff40ac710 0x7fcff40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.470+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 --> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcff40af280 con 0x7fcff40ac710 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.470+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcffc0cda50 con 0x7fd00c1008a0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.470+0000 7fd00a7fc700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcff40a1560 0x7fcff40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.471+0000 7fd00b7fe700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] conn(0x7fcff40ac710 0x7fcff40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.471+0000 7fd00a7fc700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcff40a1560 0x7fcff40a3a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0000098e0 tx=0x7fd000005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.471+0000 7fd00b7fe700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] conn(0x7fcff40ac710 0x7fcff40aebb0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.472+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== osd.11 v2:172.21.15.118:6824/1490826203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcff40af280 con 0x7fcff40ac710 2023-10-08T13:05:00.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.493+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 --> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd00c10c400 con 0x7fcff40ac710 2023-10-08T13:05:00.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.494+0000 7fcff3fff700 1 -- 172.21.15.5:0/1479214541 <== osd.11 v2:172.21.15.118:6824/1490826203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd00c10c400 con 0x7fcff40ac710 2023-10-08T13:05:00.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.494+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] conn(0x7fcff40ac710 msgr2=0x7fcff40aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] conn(0x7fcff40ac710 0x7fcff40aebb0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcff40a1560 msgr2=0x7fcff40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcff40a1560 0x7fcff40a3a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0000098e0 tx=0x7fd000005a90 comp rx=0 tx=0).stop 2023-10-08T13:05:00.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 msgr2=0x7fd00c198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 --2- 172.21.15.5:0/1479214541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00c1008a0 0x7fd00c198f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00e970 tx=0x7fcffc00ed30 comp rx=0 tx=0).stop 2023-10-08T13:05:00.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd00b7fe700 1 -- 172.21.15.5:0/1479214541 reap_dead start 2023-10-08T13:05:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 shutdown_connections 2023-10-08T13:05:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 >> 172.21.15.5:0/1479214541 conn(0x7fd00c0779e0 msgr2=0x7fd00c10bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 shutdown_connections 2023-10-08T13:05:00.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.495+0000 7fd011708700 1 -- 172.21.15.5:0/1479214541 wait complete. 2023-10-08T13:05:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:00 smithi118 ceph-mon[104234]: pgmap v268: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T13:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 -- 172.21.15.5:0/1516672952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5280ff750 msgr2=0x7fe5280ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/1516672952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5280ff750 0x7fe5280ffbd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe5180099c0 tx=0x7fe518009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 -- 172.21.15.5:0/1516672952 shutdown_connections 2023-10-08T13:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/1516672952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe528100110 0x7fe52810c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/1516672952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe528105700 0x7fe528105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/1516672952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5280ff750 0x7fe5280ffbd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 -- 172.21.15.5:0/1516672952 >> 172.21.15.5:0/1516672952 conn(0x7fe528075790 msgr2=0x7fe528075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 -- 172.21.15.5:0/1516672952 shutdown_connections 2023-10-08T13:05:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.530+0000 7fe52fc8e700 1 -- 172.21.15.5:0/1516672952 wait complete. 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 Processor -- start 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 -- start start 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5280ff750 0x7fe52819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe528100110 0x7fe52819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe528105700 0x7fe528195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528195f90 con 0x7fe528105700 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe528196100 con 0x7fe5280ff750 2023-10-08T13:05:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.531+0000 7fe52fc8e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5281962c0 con 0x7fe528100110 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe528105700 0x7fe528195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe528105700 0x7fe528195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33218/0 (socket says 172.21.15.5:33218) 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 -- 172.21.15.5:0/2156930306 learned_addr learned my addr 172.21.15.5:0/2156930306 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52da2a700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5280ff750 0x7fe52819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52d229700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe528100110 0x7fe52819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 -- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe528100110 msgr2=0x7fe52819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe528100110 0x7fe52819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 -- 172.21.15.5:0/2156930306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5280ff750 msgr2=0x7fe52819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5280ff750 0x7fe52819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 -- 172.21.15.5:0/2156930306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5180095f0 con 0x7fe528105700 2023-10-08T13:05:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52da2a700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5280ff750 0x7fe52819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52e22b700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe528105700 0x7fe528195930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe52000ef30 tx=0x7fe52000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520018070 con 0x7fe528105700 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe52000f040 con 0x7fe528105700 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe528196540 con 0x7fe528105700 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000cd00 con 0x7fe528105700 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.532+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5281a27e0 con 0x7fe528105700 2023-10-08T13:05:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.533+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe52810f950 con 0x7fe528105700 2023-10-08T13:05:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.534+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe520003a00 con 0x7fe528105700 2023-10-08T13:05:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.535+0000 7fe51effd700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5140a15e0 0x7fe5140a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.535+0000 7fe52da2a700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5140a15e0 0x7fe5140a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.535+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe5200cd710 con 0x7fe528105700 2023-10-08T13:05:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.535+0000 7fe51effd700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] conn(0x7fe5140ac790 0x7fe5140aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.535+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 --> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5140af300 con 0x7fe5140ac790 2023-10-08T13:05:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.535+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5200cdb20 con 0x7fe528105700 2023-10-08T13:05:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.536+0000 7fe52da2a700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5140a15e0 0x7fe5140a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe524009fd0 tx=0x7fe524009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.536+0000 7fe52d229700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] conn(0x7fe5140ac790 0x7fe5140aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.536+0000 7fe52d229700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] conn(0x7fe5140ac790 0x7fe5140aec30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.537+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== osd.8 v2:172.21.15.118:6816/4053101254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe5140af300 con 0x7fe5140ac790 2023-10-08T13:05:00.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.554+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 --> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe528060ef0 con 0x7fe5140ac790 2023-10-08T13:05:00.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.554+0000 7fe51effd700 1 -- 172.21.15.5:0/2156930306 <== osd.8 v2:172.21.15.118:6816/4053101254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe528060ef0 con 0x7fe5140ac790 2023-10-08T13:05:00.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] conn(0x7fe5140ac790 msgr2=0x7fe5140aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] conn(0x7fe5140ac790 0x7fe5140aec30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5140a15e0 msgr2=0x7fe5140a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe5140a15e0 0x7fe5140a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe524009fd0 tx=0x7fe524009260 comp rx=0 tx=0).stop 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe528105700 msgr2=0x7fe528195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 --2- 172.21.15.5:0/2156930306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe528105700 0x7fe528195930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe52000ef30 tx=0x7fe52000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52e22b700 1 -- 172.21.15.5:0/2156930306 reap_dead start 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 shutdown_connections 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 >> 172.21.15.5:0/2156930306 conn(0x7fe528075790 msgr2=0x7fe5280fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 shutdown_connections 2023-10-08T13:05:00.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.555+0000 7fe52fc8e700 1 -- 172.21.15.5:0/2156930306 wait complete. 2023-10-08T13:05:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 -- 172.21.15.5:0/375247935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 msgr2=0x7fab380ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 --2- 172.21.15.5:0/375247935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab380ffbd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fab20009990 tx=0x7fab20009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 -- 172.21.15.5:0/375247935 shutdown_connections 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 --2- 172.21.15.5:0/375247935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab38100110 0x7fab3810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 --2- 172.21.15.5:0/375247935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab381056b0 0x7fab38105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 --2- 172.21.15.5:0/375247935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab380ffbd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 -- 172.21.15.5:0/375247935 >> 172.21.15.5:0/375247935 conn(0x7fab38075790 msgr2=0x7fab38075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 -- 172.21.15.5:0/375247935 shutdown_connections 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.334+0000 7fab3e82a700 1 -- 172.21.15.5:0/375247935 wait complete. 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 Processor -- start 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 -- start start 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab38198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab38100110 0x7fab38199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab381056b0 0x7fab3819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3819dde0 con 0x7fab380ff750 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3819df50 con 0x7fab381056b0 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3e82a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3819e110 con 0x7fab38100110 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab37fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab38198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab37fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab38198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33182/0 (socket says 172.21.15.5:33182) 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab37fff700 1 -- 172.21.15.5:0/60662101 learned_addr learned my addr 172.21.15.5:0/60662101 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.335+0000 7fab3cdc7700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab381056b0 0x7fab3819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab2ffff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab38100110 0x7fab38199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab37fff700 1 -- 172.21.15.5:0/60662101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab38100110 msgr2=0x7fab38199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab37fff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab38100110 0x7fab38199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab37fff700 1 -- 172.21.15.5:0/60662101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab381056b0 msgr2=0x7fab3819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab37fff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab381056b0 0x7fab3819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab37fff700 1 -- 172.21.15.5:0/60662101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200095f0 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab2ffff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab38100110 0x7fab38199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab37fff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab38198ee0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab2800d950 tx=0x7fab2800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28009940 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab28010460 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3819e3f0 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2800f620 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.336+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab381a5c50 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.337+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab3810f920 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.338+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fab280108d0 con 0x7fab380ff750 2023-10-08T13:05:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.338+0000 7fab35ffb700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fab240a15e0 0x7fab240a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab2ffff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fab240a15e0 0x7fab240a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fab280cd570 con 0x7fab380ff750 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab35ffb700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] conn(0x7fab240ac790 0x7fab240aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 --> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab240af300 con 0x7fab240ac790 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab280cd980 con 0x7fab380ff750 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab3cdc7700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] conn(0x7fab240ac790 0x7fab240aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab2ffff700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fab240a15e0 0x7fab240a3aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b5c0 tx=0x7fab20005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.339+0000 7fab3cdc7700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] conn(0x7fab240ac790 0x7fab240aec30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.340+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== osd.3 v2:172.21.15.5:6810/731890565 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fab240af300 con 0x7fab240ac790 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.358+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 --> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab38100df0 con 0x7fab240ac790 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab35ffb700 1 -- 172.21.15.5:0/60662101 <== osd.3 v2:172.21.15.5:6810/731890565 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fab38100df0 con 0x7fab240ac790 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] conn(0x7fab240ac790 msgr2=0x7fab240aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] conn(0x7fab240ac790 0x7fab240aec30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fab240a15e0 msgr2=0x7fab240a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fab240a15e0 0x7fab240a3aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b5c0 tx=0x7fab20005fb0 comp rx=0 tx=0).stop 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 msgr2=0x7fab38198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 --2- 172.21.15.5:0/60662101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab380ff750 0x7fab38198ee0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab2800d950 tx=0x7fab2800dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3cdc7700 1 -- 172.21.15.5:0/60662101 reap_dead start 2023-10-08T13:05:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 shutdown_connections 2023-10-08T13:05:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 >> 172.21.15.5:0/60662101 conn(0x7fab38075790 msgr2=0x7fab380fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.359+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 shutdown_connections 2023-10-08T13:05:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:00.360+0000 7fab3e82a700 1 -- 172.21.15.5:0/60662101 wait complete. 2023-10-08T13:05:00.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:00 smithi060 ceph-mon[103190]: pgmap v268: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T13:05:01.140 INFO:teuthology.orchestra.run.smithi005.stdout:249108103202 2023-10-08T13:05:01.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 -- 172.21.15.5:0/1911580073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 msgr2=0x7fd2e810bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 --2- 172.21.15.5:0/1911580073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e810bd50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b0a0 tx=0x7fd2e000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 -- 172.21.15.5:0/1911580073 shutdown_connections 2023-10-08T13:05:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 --2- 172.21.15.5:0/1911580073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e810bd50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 --2- 172.21.15.5:0/1911580073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2e80ff0f0 0x7fd2e80ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 --2- 172.21.15.5:0/1911580073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e80ffaa0 0x7fd2e8103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 -- 172.21.15.5:0/1911580073 >> 172.21.15.5:0/1911580073 conn(0x7fd2e8075cf0 msgr2=0x7fd2e80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 -- 172.21.15.5:0/1911580073 shutdown_connections 2023-10-08T13:05:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.372+0000 7fd2ed118700 1 -- 172.21.15.5:0/1911580073 wait complete. 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 Processor -- start 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 -- start start 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2e80ff0f0 0x7fd2e8195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e80ffaa0 0x7fd2e8195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e81963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e81a50f0 con 0x7fd2e8104180 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e81a5260 con 0x7fd2e80ff0f0 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2ed118700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e81a5420 con 0x7fd2e80ffaa0 2023-10-08T13:05:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2e759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e81963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2e6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2e80ff0f0 0x7fd2e8195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2e759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e81963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33234/0 (socket says 172.21.15.5:33234) 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2e6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2e80ff0f0 0x7fd2e8195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:56412/0 (socket says 172.21.15.5:56412) 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.373+0000 7fd2e759e700 1 -- 172.21.15.5:0/3541440180 learned_addr learned my addr 172.21.15.5:0/3541440180 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e659c700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e80ffaa0 0x7fd2e8195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e759e700 1 -- 172.21.15.5:0/3541440180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e80ffaa0 msgr2=0x7fd2e8195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e759e700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2e80ffaa0 0x7fd2e8195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e759e700 1 -- 172.21.15.5:0/3541440180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2e80ff0f0 msgr2=0x7fd2e8195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e759e700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2e80ff0f0 0x7fd2e8195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e759e700 1 -- 172.21.15.5:0/3541440180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e0009d00 con 0x7fd2e8104180 2023-10-08T13:05:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2e759e700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e81963d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b070 tx=0x7fd2e0007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000e040 con 0x7fd2e8104180 2023-10-08T13:05:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2e001d470 con 0x7fd2e8104180 2023-10-08T13:05:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e81a56a0 con 0x7fd2e8104180 2023-10-08T13:05:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00052a0 con 0x7fd2e8104180 2023-10-08T13:05:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.374+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e81a5b10 con 0x7fd2e8104180 2023-10-08T13:05:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.375+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2e810f940 con 0x7fd2e8104180 2023-10-08T13:05:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.376+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fd2e001d850 con 0x7fd2e8104180 2023-10-08T13:05:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2cffff700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2d00a1560 0x7fd2d00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd2e00ce6f0 con 0x7fd2e8104180 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2e6d9d700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2d00a1560 0x7fd2d00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2cffff700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] conn(0x7fd2d00ac710 0x7fd2d00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 --> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2d00af280 con 0x7fd2d00ac710 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e00ceb00 con 0x7fd2e8104180 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.377+0000 7fd2e659c700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] conn(0x7fd2d00ac710 0x7fd2d00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.378+0000 7fd2e6d9d700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2d00a1560 0x7fd2d00a3a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009c60 tx=0x7fd2d8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.378+0000 7fd2e659c700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] conn(0x7fd2d00ac710 0x7fd2d00aebb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.379+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== osd.0 v2:172.21.15.5:6802/2048074026 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd2d00af280 con 0x7fd2d00ac710 2023-10-08T13:05:01.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.395+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 --> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2e8060ef0 con 0x7fd2d00ac710 2023-10-08T13:05:01.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2cffff700 1 -- 172.21.15.5:0/3541440180 <== osd.0 v2:172.21.15.5:6802/2048074026 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2e8060ef0 con 0x7fd2d00ac710 2023-10-08T13:05:01.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] conn(0x7fd2d00ac710 msgr2=0x7fd2d00aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] conn(0x7fd2d00ac710 0x7fd2d00aebb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2d00a1560 msgr2=0x7fd2d00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd2d00a1560 0x7fd2d00a3a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009c60 tx=0x7fd2d8009260 comp rx=0 tx=0).stop 2023-10-08T13:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 msgr2=0x7fd2e81963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:01.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 --2- 172.21.15.5:0/3541440180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2e8104180 0x7fd2e81963d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b070 tx=0x7fd2e0007930 comp rx=0 tx=0).stop 2023-10-08T13:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2e759e700 1 -- 172.21.15.5:0/3541440180 reap_dead start 2023-10-08T13:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 shutdown_connections 2023-10-08T13:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 >> 172.21.15.5:0/3541440180 conn(0x7fd2e8075cf0 msgr2=0x7fd2e80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 shutdown_connections 2023-10-08T13:05:01.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:01.396+0000 7fd2ed118700 1 -- 172.21.15.5:0/3541440180 wait complete. 2023-10-08T13:05:01.878 INFO:teuthology.orchestra.run.smithi005.stdout:335007449109 2023-10-08T13:05:01.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-08T13:05:02.103 INFO:teuthology.orchestra.run.smithi005.stdout:38654705733 2023-10-08T13:05:02.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-08T13:05:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 -- 172.21.15.5:0/528095647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a81000f0 msgr2=0x7fb6a810c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 --2- 172.21.15.5:0/528095647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a81000f0 0x7fb6a810c5f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000b0a0 tx=0x7fb6a000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 -- 172.21.15.5:0/528095647 shutdown_connections 2023-10-08T13:05:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 --2- 172.21.15.5:0/528095647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a81000f0 0x7fb6a810c5f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 --2- 172.21.15.5:0/528095647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6a8105720 0x7fb6a8105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 --2- 172.21.15.5:0/528095647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a80ff730 0x7fb6a80ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 -- 172.21.15.5:0/528095647 >> 172.21.15.5:0/528095647 conn(0x7fb6a80767a0 msgr2=0x7fb6a8076bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 -- 172.21.15.5:0/528095647 shutdown_connections 2023-10-08T13:05:02.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.213+0000 7fb6afe14700 1 -- 172.21.15.5:0/528095647 wait complete. 2023-10-08T13:05:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 Processor -- start 2023-10-08T13:05:02.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 -- start start 2023-10-08T13:05:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a80ff730 0x7fb6a810b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6a81000f0 0x7fb6a810ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a8105720 0x7fb6a81a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81a22b0 con 0x7fb6a80ff730 2023-10-08T13:05:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81a2420 con 0x7fb6a81000f0 2023-10-08T13:05:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6afe14700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81a25e0 con 0x7fb6a8105720 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6adbb0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a80ff730 0x7fb6a810b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6adbb0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a80ff730 0x7fb6a810b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33248/0 (socket says 172.21.15.5:33248) 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6adbb0700 1 -- 172.21.15.5:0/877923267 learned_addr learned my addr 172.21.15.5:0/877923267 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.214+0000 7fb6ad3af700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6a81000f0 0x7fb6a810ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6adbb0700 1 -- 172.21.15.5:0/877923267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a8105720 msgr2=0x7fb6a81a1ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6adbb0700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6a8105720 0x7fb6a81a1ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6adbb0700 1 -- 172.21.15.5:0/877923267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6a81000f0 msgr2=0x7fb6a810ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6adbb0700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6a81000f0 0x7fb6a810ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6adbb0700 1 -- 172.21.15.5:0/877923267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009d00 con 0x7fb6a80ff730 2023-10-08T13:05:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6adbb0700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a80ff730 0x7fb6a810b4d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb69800e9a0 tx=0x7fb69800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800cbd0 con 0x7fb6a80ff730 2023-10-08T13:05:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb69800cd30 con 0x7fb6a80ff730 2023-10-08T13:05:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698018680 con 0x7fb6a80ff730 2023-10-08T13:05:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a81a28c0 con 0x7fb6a80ff730 2023-10-08T13:05:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.215+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a81aa120 con 0x7fb6a80ff730 2023-10-08T13:05:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.217+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6a8100e60 con 0x7fb6a80ff730 2023-10-08T13:05:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.218+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fb698010430 con 0x7fb6a80ff730 2023-10-08T13:05:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb69effd700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb6940a15c0 0x7fb6940a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb698014070 con 0x7fb6a80ff730 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb6ad3af700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb6940a15c0 0x7fb6940a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb69effd700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] conn(0x7fb6940ac770 0x7fb6940aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 --> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6940af2e0 con 0x7fb6940ac770 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6980cdb90 con 0x7fb6a80ff730 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb6ae3b1700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] conn(0x7fb6940ac770 0x7fb6940aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.219+0000 7fb6ad3af700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb6940a15c0 0x7fb6940a3a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6a810ca30 tx=0x7fb6a400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.220+0000 7fb6ae3b1700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] conn(0x7fb6940ac770 0x7fb6940aec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.221+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== osd.9 v2:172.21.15.5:6826/2685763933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb6940af2e0 con 0x7fb6940ac770 2023-10-08T13:05:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.239+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 --> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6a810e780 con 0x7fb6940ac770 2023-10-08T13:05:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.239+0000 7fb69effd700 1 -- 172.21.15.5:0/877923267 <== osd.9 v2:172.21.15.5:6826/2685763933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb6a810e780 con 0x7fb6940ac770 2023-10-08T13:05:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] conn(0x7fb6940ac770 msgr2=0x7fb6940aec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] conn(0x7fb6940ac770 0x7fb6940aec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb6940a15c0 msgr2=0x7fb6940a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb6940a15c0 0x7fb6940a3a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6a810ca30 tx=0x7fb6a400a300 comp rx=0 tx=0).stop 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a80ff730 msgr2=0x7fb6a810b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 --2- 172.21.15.5:0/877923267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6a80ff730 0x7fb6a810b4d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb69800e9a0 tx=0x7fb69800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6ae3b1700 1 -- 172.21.15.5:0/877923267 reap_dead start 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 shutdown_connections 2023-10-08T13:05:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 >> 172.21.15.5:0/877923267 conn(0x7fb6a80767a0 msgr2=0x7fb6a8103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 shutdown_connections 2023-10-08T13:05:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.240+0000 7fb6afe14700 1 -- 172.21.15.5:0/877923267 wait complete. 2023-10-08T13:05:02.263 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:02 smithi005 ceph-mon[99496]: pgmap v269: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:05:02.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 -- 172.21.15.5:0/471555649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d81056b0 msgr2=0x7fd8d8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 --2- 172.21.15.5:0/471555649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d81056b0 0x7fd8d8105a90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009990 tx=0x7fd8d4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 -- 172.21.15.5:0/471555649 shutdown_connections 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 --2- 172.21.15.5:0/471555649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d8100110 0x7fd8d810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 --2- 172.21.15.5:0/471555649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d81056b0 0x7fd8d8105a90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 --2- 172.21.15.5:0/471555649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d80ff750 0x7fd8d80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.389+0000 7fd8df782700 1 -- 172.21.15.5:0/471555649 >> 172.21.15.5:0/471555649 conn(0x7fd8d8075790 msgr2=0x7fd8d8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.390+0000 7fd8df782700 1 -- 172.21.15.5:0/471555649 shutdown_connections 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.390+0000 7fd8df782700 1 -- 172.21.15.5:0/471555649 wait complete. 2023-10-08T13:05:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.390+0000 7fd8df782700 1 Processor -- start 2023-10-08T13:05:02.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 -- start start 2023-10-08T13:05:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d80ff750 0x7fd8d8196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d8100110 0x7fd8d8197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d81056b0 0x7fd8d819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d819bce0 con 0x7fd8d80ff750 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d819be50 con 0x7fd8d8100110 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8df782700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d819c010 con 0x7fd8d81056b0 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8dd51e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d80ff750 0x7fd8d8196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8dd51e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d80ff750 0x7fd8d8196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33260/0 (socket says 172.21.15.5:33260) 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8dd51e700 1 -- 172.21.15.5:0/3257858308 learned_addr learned my addr 172.21.15.5:0/3257858308 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8dcd1d700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d8100110 0x7fd8d8197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.391+0000 7fd8ddd1f700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d81056b0 0x7fd8d819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dd51e700 1 -- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d81056b0 msgr2=0x7fd8d819b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dd51e700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8d81056b0 0x7fd8d819b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dd51e700 1 -- 172.21.15.5:0/3257858308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d8100110 msgr2=0x7fd8d8197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dd51e700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d8100110 0x7fd8d8197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dd51e700 1 -- 172.21.15.5:0/3257858308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40095f0 con 0x7fd8d80ff750 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dcd1d700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d8100110 0x7fd8d8197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8dd51e700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d80ff750 0x7fd8d8196de0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40098e0 tx=0x7fd8d4003b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d401d070 con 0x7fd8d80ff750 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8d4003e10 con 0x7fd8d80ff750 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400fe90 con 0x7fd8d80ff750 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d819c290 con 0x7fd8d80ff750 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.392+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d81a3b50 con 0x7fd8d80ff750 2023-10-08T13:05:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.393+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8d8110b30 con 0x7fd8d80ff750 2023-10-08T13:05:02.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.395+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fd8d40052d0 con 0x7fd8d80ff750 2023-10-08T13:05:02.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.395+0000 7fd8ce7fc700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd8c40a15e0 0x7fd8c40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.395+0000 7fd8dcd1d700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd8c40a15e0 0x7fd8c40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.395+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd8d40ce770 con 0x7fd8d80ff750 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.395+0000 7fd8ce7fc700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] conn(0x7fd8c40ac4f0 0x7fd8c40ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.395+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 --> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8c40af060 con 0x7fd8c40ac4f0 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.396+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8d40ceb80 con 0x7fd8d80ff750 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.396+0000 7fd8dcd1d700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd8c40a15e0 0x7fd8c40a3aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8198340 tx=0x7fd8c8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.396+0000 7fd8ddd1f700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] conn(0x7fd8c40ac4f0 0x7fd8c40ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.396+0000 7fd8ddd1f700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] conn(0x7fd8c40ac4f0 0x7fd8c40ae990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:02.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.397+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== osd.5 v2:172.21.15.118:6808/389070865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd8c40af060 con 0x7fd8c40ac4f0 2023-10-08T13:05:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.414+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 --> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8d819c560 con 0x7fd8c40ac4f0 2023-10-08T13:05:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.414+0000 7fd8ce7fc700 1 -- 172.21.15.5:0/3257858308 <== osd.5 v2:172.21.15.118:6808/389070865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd8d0009ab0 con 0x7fd8c40ac4f0 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] conn(0x7fd8c40ac4f0 msgr2=0x7fd8c40ae990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] conn(0x7fd8c40ac4f0 0x7fd8c40ae990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd8c40a15e0 msgr2=0x7fd8c40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd8c40a15e0 0x7fd8c40a3aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8198340 tx=0x7fd8c8008040 comp rx=0 tx=0).stop 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d80ff750 msgr2=0x7fd8d8196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 --2- 172.21.15.5:0/3257858308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d80ff750 0x7fd8d8196de0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40098e0 tx=0x7fd8d4003b40 comp rx=0 tx=0).stop 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8ddd1f700 1 -- 172.21.15.5:0/3257858308 reap_dead start 2023-10-08T13:05:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 shutdown_connections 2023-10-08T13:05:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 >> 172.21.15.5:0/3257858308 conn(0x7fd8d8075790 msgr2=0x7fd8d80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 shutdown_connections 2023-10-08T13:05:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:02.415+0000 7fd8df782700 1 -- 172.21.15.5:0/3257858308 wait complete. 2023-10-08T13:05:02.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:02 smithi118 ceph-mon[104234]: pgmap v269: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:05:02.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:02 smithi060 ceph-mon[103190]: pgmap v269: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:05:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:03.431 INFO:teuthology.orchestra.run.smithi005.stdout:163208757295 2023-10-08T13:05:03.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-08T13:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout:283467841567 2023-10-08T13:05:03.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-08T13:05:03.690 INFO:teuthology.orchestra.run.smithi005.stdout:111669149750 2023-10-08T13:05:03.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-08T13:05:03.796 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:04 smithi118 ceph-mon[104234]: pgmap v270: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-08T13:05:04.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:04 smithi005 ceph-mon[99496]: pgmap v270: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-08T13:05:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:04 smithi060 ceph-mon[103190]: pgmap v270: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-08T13:05:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 -- 172.21.15.5:0/591556576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3301008a0 msgr2=0x7fa330100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:04.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 --2- 172.21.15.5:0/591556576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3301008a0 0x7fa330100d20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa318009990 tx=0x7fa318009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 -- 172.21.15.5:0/591556576 shutdown_connections 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 --2- 172.21.15.5:0/591556576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa330101260 0x7fa33010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 --2- 172.21.15.5:0/591556576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3301057c0 0x7fa330105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 --2- 172.21.15.5:0/591556576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3301008a0 0x7fa330100d20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 -- 172.21.15.5:0/591556576 >> 172.21.15.5:0/591556576 conn(0x7fa3300779e0 msgr2=0x7fa330077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 -- 172.21.15.5:0/591556576 shutdown_connections 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.813+0000 7fa335d6c700 1 -- 172.21.15.5:0/591556576 wait complete. 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 Processor -- start 2023-10-08T13:05:04.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 -- start start 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3301008a0 0x7fa33019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 0x7fa33019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3301057c0 0x7fa330196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330197130 con 0x7fa330101260 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3301972a0 con 0x7fa3301008a0 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa335d6c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330197460 con 0x7fa3301057c0 2023-10-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 0x7fa33019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 0x7fa33019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33276/0 (socket says 172.21.15.5:33276) 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 -- 172.21.15.5:0/1345604994 learned_addr learned my addr 172.21.15.5:0/1345604994 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa32f7fe700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3301008a0 0x7fa33019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa32ffff700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3301057c0 0x7fa330196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 -- 172.21.15.5:0/1345604994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3301057c0 msgr2=0x7fa330196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3301057c0 0x7fa330196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 -- 172.21.15.5:0/1345604994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3301008a0 msgr2=0x7fa33019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3301008a0 0x7fa33019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa326ffd700 1 -- 172.21.15.5:0/1345604994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180095f0 con 0x7fa330101260 2023-10-08T13:05:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.814+0000 7fa32ffff700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3301057c0 0x7fa330196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.815+0000 7fa326ffd700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 0x7fa33019ced0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa318009fd0 tx=0x7fa31800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.815+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31801d070 con 0x7fa330101260 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.815+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3301976e0 con 0x7fa330101260 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.815+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa318005510 con 0x7fa330101260 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.815+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318004bd0 con 0x7fa330101260 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.815+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa330072bf0 con 0x7fa330101260 2023-10-08T13:05:04.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.816+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa330108da0 con 0x7fa330101260 2023-10-08T13:05:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.817+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fa318004d30 con 0x7fa330101260 2023-10-08T13:05:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.818+0000 7fa32d7fa700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa31c0a1560 0x7fa31c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.818+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa3180ce110 con 0x7fa330101260 2023-10-08T13:05:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.818+0000 7fa32f7fe700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa31c0a1560 0x7fa31c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.818+0000 7fa32f7fe700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa31c0a1560 0x7fa31c0a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa320005950 tx=0x7fa3200058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:04.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:04.822+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa3180973d0 con 0x7fa330101260 2023-10-08T13:05:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.027+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa330101f30 con 0x7fa330101260 2023-10-08T13:05:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.028+0000 7fa32d7fa700 1 -- 172.21.15.5:0/1345604994 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa31809a9f0 con 0x7fa330101260 2023-10-08T13:05:05.029 INFO:teuthology.orchestra.run.smithi005.stdout:219043332134 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa31c0a1560 msgr2=0x7fa31c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa31c0a1560 0x7fa31c0a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa320005950 tx=0x7fa3200058e0 comp rx=0 tx=0).stop 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 msgr2=0x7fa33019ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 0x7fa33019ced0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa318009fd0 tx=0x7fa31800f720 comp rx=0 tx=0).stop 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 shutdown_connections 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa31c0a1560 0x7fa31c0a3a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3301057c0 0x7fa330196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3301008a0 0x7fa33019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:05.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 --2- 172.21.15.5:0/1345604994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa330101260 0x7fa33019ced0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:05.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 >> 172.21.15.5:0/1345604994 conn(0x7fa3300779e0 msgr2=0x7fa3300fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:05.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 shutdown_connections 2023-10-08T13:05:05.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:05.030+0000 7fa335d6c700 1 -- 172.21.15.5:0/1345604994 wait complete. 2023-10-08T13:05:05.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:05 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1345604994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T13:05:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:05 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1345604994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T13:05:05.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:05 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1345604994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T13:05:05.811 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332133 got 219043332134 for osd.7 2023-10-08T13:05:05.812 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:06.538 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:06 smithi005 ceph-mon[99496]: pgmap v271: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:05:06.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:06 smithi060 ceph-mon[103190]: pgmap v271: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:05:06.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:06 smithi118 ceph-mon[104234]: pgmap v271: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 -- 172.21.15.5:0/2338235628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 msgr2=0x7f2520069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 --2- 172.21.15.5:0/2338235628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f2520069340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 -- 172.21.15.5:0/2338235628 shutdown_connections 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 --2- 172.21.15.5:0/2338235628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520069880 0x7f252010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 --2- 172.21.15.5:0/2338235628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2520106970 0x7f2520106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 --2- 172.21.15.5:0/2338235628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f2520069340 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:06.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 -- 172.21.15.5:0/2338235628 >> 172.21.15.5:0/2338235628 conn(0x7f2520076580 msgr2=0x7f2520076990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:06.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 -- 172.21.15.5:0/2338235628 shutdown_connections 2023-10-08T13:05:06.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.870+0000 7f25275be700 1 -- 172.21.15.5:0/2338235628 wait complete. 2023-10-08T13:05:06.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 Processor -- start 2023-10-08T13:05:06.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 -- start start 2023-10-08T13:05:06.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f252019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2520069880 0x7f252019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520106970 0x7f2520196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520196fe0 con 0x7f2520068ec0 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520197150 con 0x7f2520106970 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.871+0000 7f25275be700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520197310 con 0x7f2520069880 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f252019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f252019c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33286/0 (socket says 172.21.15.5:33286) 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 -- 172.21.15.5:0/3760646127 learned_addr learned my addr 172.21.15.5:0/3760646127 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f2524b59700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2520069880 0x7f252019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f2525b5b700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520106970 0x7f2520196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:06.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 -- 172.21.15.5:0/3760646127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2520069880 msgr2=0x7f252019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2520069880 0x7f252019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 -- 172.21.15.5:0/3760646127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520106970 msgr2=0x7f2520196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520106970 0x7f2520196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 -- 172.21.15.5:0/3760646127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100095f0 con 0x7f2520068ec0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f2525b5b700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520106970 0x7f2520196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f252535a700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f252019c830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c9b0 tx=0x7f251c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c007b00 con 0x7f2520068ec0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f251c007c60 con 0x7f2520068ec0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25201975f0 con 0x7f2520068ec0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c018660 con 0x7f2520068ec0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.872+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25201a3820 con 0x7f2520068ec0 2023-10-08T13:05:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.873+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25040052f0 con 0x7f2520068ec0 2023-10-08T13:05:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.874+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f251c00f450 con 0x7f2520068ec0 2023-10-08T13:05:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.875+0000 7f25167fc700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f250c0a15e0 0x7f250c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.875+0000 7f2524b59700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f250c0a15e0 0x7f250c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:06.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.875+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f251c0cd0f0 con 0x7f2520068ec0 2023-10-08T13:05:06.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.876+0000 7f2524b59700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f250c0a15e0 0x7f250c0a3aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f25100098e0 tx=0x7f2510005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:06.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:06.879+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f251c096200 con 0x7f2520068ec0 2023-10-08T13:05:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:07.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.087+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2504005870 con 0x7f2520068ec0 2023-10-08T13:05:07.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.087+0000 7f25167fc700 1 -- 172.21.15.5:0/3760646127 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f251c099820 con 0x7f2520068ec0 2023-10-08T13:05:07.088 INFO:teuthology.orchestra.run.smithi005.stdout:81604378684 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f250c0a15e0 msgr2=0x7f250c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f250c0a15e0 0x7f250c0a3aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f25100098e0 tx=0x7f2510005960 comp rx=0 tx=0).stop 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 msgr2=0x7f252019c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f252019c830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c9b0 tx=0x7f251c00ccc0 comp rx=0 tx=0).stop 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 shutdown_connections 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f250c0a15e0 0x7f250c0a3aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2520106970 0x7f2520196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:07.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2520068ec0 0x7f252019c830 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 --2- 172.21.15.5:0/3760646127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2520069880 0x7f252019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 >> 172.21.15.5:0/3760646127 conn(0x7f2520076580 msgr2=0x7f25200fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 shutdown_connections 2023-10-08T13:05:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:07.090+0000 7f25275be700 1 -- 172.21.15.5:0/3760646127 wait complete. 2023-10-08T13:05:07.124 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:07.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:07 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3760646127' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T13:05:07.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:07 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3760646127' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T13:05:07.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:07 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3760646127' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T13:05:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:08.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:08 smithi060 ceph-mon[103190]: pgmap v272: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:05:08.668 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:08 smithi005 ceph-mon[99496]: pgmap v272: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:05:08.686 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378683 got 81604378684 for osd.2 2023-10-08T13:05:08.686 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:08 smithi118 ceph-mon[104234]: pgmap v272: 129 pgs: 129 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 -- 172.21.15.5:0/390821337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 msgr2=0x7fd91c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 --2- 172.21.15.5:0/390821337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c10c580 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b0a0 tx=0x7fd91400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 -- 172.21.15.5:0/390821337 shutdown_connections 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 --2- 172.21.15.5:0/390821337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c10c580 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 --2- 172.21.15.5:0/390821337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c1056b0 0x7fd91c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 --2- 172.21.15.5:0/390821337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 0x7fd91c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 -- 172.21.15.5:0/390821337 >> 172.21.15.5:0/390821337 conn(0x7fd91c075790 msgr2=0x7fd91c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 -- 172.21.15.5:0/390821337 shutdown_connections 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 -- 172.21.15.5:0/390821337 wait complete. 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.571+0000 7fd922164700 1 Processor -- start 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 -- start start 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 0x7fd91c197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c1056b0 0x7fd91c1a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1988b0 con 0x7fd91c100110 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1a3090 con 0x7fd91c1056b0 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd922164700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1a31d0 con 0x7fd91c0ff750 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33302/0 (socket says 172.21.15.5:33302) 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 -- 172.21.15.5:0/797541523 learned_addr learned my addr 172.21.15.5:0/797541523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91bfff700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c1056b0 0x7fd91c1a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91b7fe700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 0x7fd91c197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 -- 172.21.15.5:0/797541523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 msgr2=0x7fd91c197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 0x7fd91c197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 -- 172.21.15.5:0/797541523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c1056b0 msgr2=0x7fd91c1a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c1056b0 0x7fd91c1a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 -- 172.21.15.5:0/797541523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914009d00 con 0x7fd91c100110 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91b7fe700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 0x7fd91c197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.572+0000 7fd91affd700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c198010 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c9e0 tx=0x7fd91000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.573+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910007ac0 con 0x7fd91c100110 2023-10-08T13:05:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.573+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c1a3480 con 0x7fd91c100110 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.573+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd910007c20 con 0x7fd91c100110 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.573+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910018660 con 0x7fd91c100110 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.573+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c1a3980 con 0x7fd91c100110 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stdout:304942678042 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.574+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c107cb0 con 0x7fd91c100110 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.575+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fd91000f450 con 0x7fd91c100110 2023-10-08T13:05:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.575+0000 7fd918ff9700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9040a1560 0x7fd9040a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.575+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd9100cd4b0 con 0x7fd91c100110 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.575+0000 7fd91b7fe700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9040a1560 0x7fd9040a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.576+0000 7fd91b7fe700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9040a1560 0x7fd9040a3a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd90c005e90 tx=0x7fd90c005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.579+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd9100965c0 con 0x7fd91c100110 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.798+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fd91c100df0 con 0x7fd91c100110 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.799+0000 7fd918ff9700 1 -- 172.21.15.5:0/797541523 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fd910099be0 con 0x7fd91c100110 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9040a1560 msgr2=0x7fd9040a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9040a1560 0x7fd9040a3a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd90c005e90 tx=0x7fd90c005d20 comp rx=0 tx=0).stop 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 msgr2=0x7fd91c198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c198010 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c9e0 tx=0x7fd91000cda0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 shutdown_connections 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9040a1560 0x7fd9040a3a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd91c1056b0 0x7fd91c1a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd91c0ff750 0x7fd91c197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 --2- 172.21.15.5:0/797541523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd91c100110 0x7fd91c198010 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 >> 172.21.15.5:0/797541523 conn(0x7fd91c075790 msgr2=0x7fd91c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 shutdown_connections 2023-10-08T13:05:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:08.801+0000 7fd922164700 1 -- 172.21.15.5:0/797541523 wait complete. 2023-10-08T13:05:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 -- 172.21.15.5:0/2776575537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0ff750 msgr2=0x7f18cc0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 --2- 172.21.15.5:0/2776575537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0ff750 0x7f18cc0ffbd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009990 tx=0x7f18c0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 -- 172.21.15.5:0/2776575537 shutdown_connections 2023-10-08T13:05:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 --2- 172.21.15.5:0/2776575537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18cc100110 0x7f18cc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 --2- 172.21.15.5:0/2776575537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18cc1056b0 0x7f18cc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 --2- 172.21.15.5:0/2776575537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0ff750 0x7f18cc0ffbd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 -- 172.21.15.5:0/2776575537 >> 172.21.15.5:0/2776575537 conn(0x7f18cc075790 msgr2=0x7f18cc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 -- 172.21.15.5:0/2776575537 shutdown_connections 2023-10-08T13:05:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.138+0000 7f18d38c4700 1 -- 172.21.15.5:0/2776575537 wait complete. 2023-10-08T13:05:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 Processor -- start 2023-10-08T13:05:09.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 -- start start 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18cc0ff750 0x7f18cc19c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18cc100110 0x7f18cc19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 0x7f18cc196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc197150 con 0x7f18cc1056b0 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1972c0 con 0x7f18cc0ff750 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d38c4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc197480 con 0x7f18cc100110 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d1e61700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 0x7f18cc196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d1e61700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 0x7f18cc196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33318/0 (socket says 172.21.15.5:33318) 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d1e61700 1 -- 172.21.15.5:0/4079472833 learned_addr learned my addr 172.21.15.5:0/4079472833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:09.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.139+0000 7f18d1660700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18cc0ff750 0x7f18cc19c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d0e5f700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18cc100110 0x7f18cc19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d1e61700 1 -- 172.21.15.5:0/4079472833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18cc100110 msgr2=0x7f18cc19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d1e61700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18cc100110 0x7f18cc19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d1e61700 1 -- 172.21.15.5:0/4079472833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18cc0ff750 msgr2=0x7f18cc19c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d1e61700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18cc0ff750 0x7f18cc19c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d1e61700 1 -- 172.21.15.5:0/4079472833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c00095f0 con 0x7f18cc1056b0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d1e61700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 0x7f18cc196af0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f18c400ada0 tx=0x7f18c400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400f070 con 0x7f18cc1056b0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18c4007b30 con 0x7f18cc1056b0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc197760 con 0x7f18cc1056b0 2023-10-08T13:05:09.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4005280 con 0x7f18cc1056b0 2023-10-08T13:05:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.140+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1a3950 con 0x7f18cc1056b0 2023-10-08T13:05:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.141+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc108c50 con 0x7f18cc1056b0 2023-10-08T13:05:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.142+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f18c400a090 con 0x7f18cc1056b0 2023-10-08T13:05:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.143+0000 7f18ca7fc700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18b40a1560 0x7f18b40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.143+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f18c40cce00 con 0x7f18cc1056b0 2023-10-08T13:05:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.143+0000 7f18d1660700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18b40a1560 0x7f18b40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.143+0000 7f18d1660700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18b40a1560 0x7f18b40a3a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18bc005950 tx=0x7f18bc00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:09.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.146+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f18c4099a30 con 0x7f18cc1056b0 2023-10-08T13:05:09.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.364+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f18cc197f60 con 0x7f18cc1056b0 2023-10-08T13:05:09.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.364+0000 7f18ca7fc700 1 -- 172.21.15.5:0/4079472833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18c40995c0 con 0x7f18cc1056b0 2023-10-08T13:05:09.365 INFO:teuthology.orchestra.run.smithi005.stdout:197568495661 2023-10-08T13:05:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18b40a1560 msgr2=0x7f18b40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18b40a1560 0x7f18b40a3a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18bc005950 tx=0x7f18bc00b410 comp rx=0 tx=0).stop 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 msgr2=0x7f18cc196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 0x7f18cc196af0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f18c400ada0 tx=0x7f18c400c330 comp rx=0 tx=0).stop 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 shutdown_connections 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18b40a1560 0x7f18b40a3a20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc1056b0 0x7f18cc196af0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18cc0ff750 0x7f18cc19c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 --2- 172.21.15.5:0/4079472833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18cc100110 0x7f18cc19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 >> 172.21.15.5:0/4079472833 conn(0x7f18cc075790 msgr2=0x7f18cc068610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 shutdown_connections 2023-10-08T13:05:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.366+0000 7f18d38c4700 1 -- 172.21.15.5:0/4079472833 wait complete. 2023-10-08T13:05:09.492 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:09 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/797541523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T13:05:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:09.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:09 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/797541523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T13:05:09.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:09 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/797541523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T13:05:09.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 -- 172.21.15.5:0/1095045246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca2010d250 msgr2=0x7fca2010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 --2- 172.21.15.5:0/1095045246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca2010d250 0x7fca2010f640 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca1800b0a0 tx=0x7fca1800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 -- 172.21.15.5:0/1095045246 shutdown_connections 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 --2- 172.21.15.5:0/1095045246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca2010d250 0x7fca2010f640 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 --2- 172.21.15.5:0/1095045246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca20072a20 0x7fca20072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 --2- 172.21.15.5:0/1095045246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca20073340 0x7fca2010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 -- 172.21.15.5:0/1095045246 >> 172.21.15.5:0/1095045246 conn(0x7fca200779e0 msgr2=0x7fca20077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.865+0000 7fca26ed5700 1 -- 172.21.15.5:0/1095045246 shutdown_connections 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 -- 172.21.15.5:0/1095045246 wait complete. 2023-10-08T13:05:09.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 Processor -- start 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 -- start start 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 0x7fca20198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca20073340 0x7fca201994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca2010d250 0x7fca2019d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2019de30 con 0x7fca20072a20 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2019dfa0 con 0x7fca2010d250 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca26ed5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2019e160 con 0x7fca20073340 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.866+0000 7fca24c71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 0x7fca20198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 0x7fca20198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33328/0 (socket says 172.21.15.5:33328) 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 -- 172.21.15.5:0/2981432054 learned_addr learned my addr 172.21.15.5:0/2981432054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca1ffff700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca20073340 0x7fca201994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 -- 172.21.15.5:0/2981432054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca20073340 msgr2=0x7fca201994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca20073340 0x7fca201994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca25472700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca2010d250 0x7fca2019d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 -- 172.21.15.5:0/2981432054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca2010d250 msgr2=0x7fca2019d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca2010d250 0x7fca2019d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 -- 172.21.15.5:0/2981432054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18009d00 con 0x7fca20072a20 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca24c71700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 0x7fca20198f80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c970 tx=0x7fca1400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14007aa0 con 0x7fca20072a20 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2019e440 con 0x7fca20072a20 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca14004cf0 con 0x7fca20072a20 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14005600 con 0x7fca20072a20 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.867+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca201a5ca0 con 0x7fca20072a20 2023-10-08T13:05:09.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.868+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca200740b0 con 0x7fca20072a20 2023-10-08T13:05:09.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.869+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fca14004750 con 0x7fca20072a20 2023-10-08T13:05:09.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.870+0000 7fca1dffb700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca100a1560 0x7fca100a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:09.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.870+0000 7fca1ffff700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca100a1560 0x7fca100a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:09.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.870+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fca14013070 con 0x7fca20072a20 2023-10-08T13:05:09.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.870+0000 7fca1ffff700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca100a1560 0x7fca100a3a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca2019a490 tx=0x7fca0c005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:09.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:09.874+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fca140962a0 con 0x7fca20072a20 2023-10-08T13:05:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.079+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca2019a240 con 0x7fca20072a20 2023-10-08T13:05:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.079+0000 7fca1dffb700 1 -- 172.21.15.5:0/2981432054 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca14004e60 con 0x7fca20072a20 2023-10-08T13:05:10.080 INFO:teuthology.orchestra.run.smithi005.stdout:60129542209 2023-10-08T13:05:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca100a1560 msgr2=0x7fca100a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca100a1560 0x7fca100a3a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca2019a490 tx=0x7fca0c005d50 comp rx=0 tx=0).stop 2023-10-08T13:05:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 msgr2=0x7fca20198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 0x7fca20198f80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c970 tx=0x7fca1400cd30 comp rx=0 tx=0).stop 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 shutdown_connections 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fca100a1560 0x7fca100a3a20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca2010d250 0x7fca2019d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca20072a20 0x7fca20198f80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 --2- 172.21.15.5:0/2981432054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca20073340 0x7fca201994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 >> 172.21.15.5:0/2981432054 conn(0x7fca200779e0 msgr2=0x7fca200fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 shutdown_connections 2023-10-08T13:05:10.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:10.082+0000 7fca26ed5700 1 -- 172.21.15.5:0/2981432054 wait complete. 2023-10-08T13:05:10.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:10 smithi005 ceph-mon[99496]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T13:05:10.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:10 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4079472833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T13:05:10.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:10 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2981432054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T13:05:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:10 smithi060 ceph-mon[103190]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T13:05:10.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:10 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4079472833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T13:05:10.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:10 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2981432054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T13:05:10.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:10 smithi118 ceph-mon[104234]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T13:05:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:10 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4079472833' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T13:05:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:10 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2981432054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T13:05:10.932 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678041 got 304942678042 for osd.10 2023-10-08T13:05:10.932 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:11.074 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495658 got 197568495661 for osd.6 2023-10-08T13:05:11.075 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:11.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542207 got 60129542209 for osd.1 2023-10-08T13:05:11.438 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 -- 172.21.15.5:0/4055212919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 msgr2=0x7ffb0c10bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 --2- 172.21.15.5:0/4055212919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c10bd10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400aaa0 tx=0x7ffb0400adb0 comp rx=0 tx=0).stop 2023-10-08T13:05:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 -- 172.21.15.5:0/4055212919 shutdown_connections 2023-10-08T13:05:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 --2- 172.21.15.5:0/4055212919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c10bd10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 --2- 172.21.15.5:0/4055212919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c103e70 0x7ffb0c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 --2- 172.21.15.5:0/4055212919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c0ff190 0x7ffb0c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.867+0000 7ffb11251700 1 -- 172.21.15.5:0/4055212919 >> 172.21.15.5:0/4055212919 conn(0x7ffb0c074a10 msgr2=0x7ffb0c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.868+0000 7ffb11251700 1 -- 172.21.15.5:0/4055212919 shutdown_connections 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.868+0000 7ffb11251700 1 -- 172.21.15.5:0/4055212919 wait complete. 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.868+0000 7ffb11251700 1 Processor -- start 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.868+0000 7ffb11251700 1 -- start start 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb11251700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c0ff190 0x7ffb0c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb11251700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb11251700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c103e70 0x7ffb0c196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb11251700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c197140 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb11251700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1972b0 con 0x7ffb0c103e70 2023-10-08T13:05:11.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb11251700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c197470 con 0x7ffb0c0ff190 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33344/0 (socket says 172.21.15.5:33344) 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 -- 172.21.15.5:0/2594235190 learned_addr learned my addr 172.21.15.5:0/2594235190 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0ad9d700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c0ff190 0x7ffb0c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0b59e700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c103e70 0x7ffb0c196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 -- 172.21.15.5:0/2594235190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c0ff190 msgr2=0x7ffb0c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c0ff190 0x7ffb0c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 -- 172.21.15.5:0/2594235190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c103e70 msgr2=0x7ffb0c196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c103e70 0x7ffb0c196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 -- 172.21.15.5:0/2594235190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0400a700 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb0259c700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c19ce20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400d950 tx=0x7ffaf400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.869+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400f890 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.870+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c197750 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.870+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaf4010460 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.870+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400e610 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.870+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c1a38b0 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.871+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c1005b0 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.872+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ffaf40108d0 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.872+0000 7ffb08d99700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a1560 0x7ffaf80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.872+0000 7ffb0ad9d700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a1560 0x7ffaf80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.872+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ffaf40cd3d0 con 0x7ffb0c0ffb50 2023-10-08T13:05:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.873+0000 7ffb0ad9d700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a1560 0x7ffaf80a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c077270 tx=0x7ffafc007a30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:11.877+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffaf40964e0 con 0x7ffb0c0ffb50 2023-10-08T13:05:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.092+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7ffb0c197e70 con 0x7ffb0c0ffb50 2023-10-08T13:05:12.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.092+0000 7ffb08d99700 1 -- 172.21.15.5:0/2594235190 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaf4099b00 con 0x7ffb0c0ffb50 2023-10-08T13:05:12.095 INFO:teuthology.orchestra.run.smithi005.stdout:283467841568 2023-10-08T13:05:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a1560 msgr2=0x7ffaf80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a1560 0x7ffaf80a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c077270 tx=0x7ffafc007a30 comp rx=0 tx=0).stop 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 msgr2=0x7ffb0c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c19ce20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400d950 tx=0x7ffaf400dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 shutdown_connections 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffaf80a1560 0x7ffaf80a3a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0c103e70 0x7ffb0c196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb0c0ff190 0x7ffb0c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 --2- 172.21.15.5:0/2594235190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb0c0ffb50 0x7ffb0c19ce20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 >> 172.21.15.5:0/2594235190 conn(0x7ffb0c074a10 msgr2=0x7ffb0c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 shutdown_connections 2023-10-08T13:05:12.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.095+0000 7ffb11251700 1 -- 172.21.15.5:0/2594235190 wait complete. 2023-10-08T13:05:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.292+0000 7f0954a90700 1 -- 172.21.15.5:0/4127632423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09500ffb30 msgr2=0x7f095010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.292+0000 7f0954a90700 1 --2- 172.21.15.5:0/4127632423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09500ffb30 0x7f095010d5c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f094800b0a0 tx=0x7f094800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 -- 172.21.15.5:0/4127632423 shutdown_connections 2023-10-08T13:05:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 --2- 172.21.15.5:0/4127632423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09500ffb30 0x7f095010d5c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 --2- 172.21.15.5:0/4127632423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09501058d0 0x7f0950105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 --2- 172.21.15.5:0/4127632423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09500ff190 0x7f09500ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 -- 172.21.15.5:0/4127632423 >> 172.21.15.5:0/4127632423 conn(0x7f0950074a10 msgr2=0x7f0950074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 -- 172.21.15.5:0/4127632423 shutdown_connections 2023-10-08T13:05:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 -- 172.21.15.5:0/4127632423 wait complete. 2023-10-08T13:05:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 Processor -- start 2023-10-08T13:05:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.293+0000 7f0954a90700 1 -- start start 2023-10-08T13:05:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09500ff190 0x7f0950100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09500ffb30 0x7f09501008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:12.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 0x7f0950100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501a5090 con 0x7f09501058d0 2023-10-08T13:05:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501a5200 con 0x7f09500ff190 2023-10-08T13:05:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501a53c0 con 0x7f09500ffb30 2023-10-08T13:05:12.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 0x7f0950100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 0x7f0950100df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33360/0 (socket says 172.21.15.5:33360) 2023-10-08T13:05:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 -- 172.21.15.5:0/1228193433 learned_addr learned my addr 172.21.15.5:0/1228193433 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094dd9b700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09500ffb30 0x7f09501008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:12.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094e59c700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09500ff190 0x7f0950100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 -- 172.21.15.5:0/1228193433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09500ffb30 msgr2=0x7f09501008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09500ffb30 0x7f09501008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 -- 172.21.15.5:0/1228193433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09500ff190 msgr2=0x7f0950100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09500ff190 0x7f0950100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 -- 172.21.15.5:0/1228193433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948009d00 con 0x7f09501058d0 2023-10-08T13:05:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094e59c700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09500ff190 0x7f0950100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f094ed9d700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 0x7f0950100df0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f094800b070 tx=0x7f0948007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094800e040 con 0x7f09501058d0 2023-10-08T13:05:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f094800be40 con 0x7f09501058d0 2023-10-08T13:05:12.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.294+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09501a5640 con 0x7f09501058d0 2023-10-08T13:05:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.295+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480052a0 con 0x7f09501058d0 2023-10-08T13:05:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.295+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09501a5ab0 con 0x7f09501058d0 2023-10-08T13:05:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.295+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0950108d30 con 0x7f09501058d0 2023-10-08T13:05:12.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.297+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f094801d470 con 0x7f09501058d0 2023-10-08T13:05:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.297+0000 7f09477fe700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f093c0a15e0 0x7f093c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.297+0000 7f094e59c700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f093c0a15e0 0x7f093c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.297+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f09480ced20 con 0x7f09501058d0 2023-10-08T13:05:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.298+0000 7f094e59c700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f093c0a15e0 0x7f093c0a3aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0940005d90 tx=0x7f0940005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:12.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.301+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0948097ec0 con 0x7f09501058d0 2023-10-08T13:05:12.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:12 smithi005 ceph-mon[99496]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:12.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:12 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2594235190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T13:05:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.502+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f0950067c30 con 0x7f09501058d0 2023-10-08T13:05:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.502+0000 7f09477fe700 1 -- 172.21.15.5:0/1228193433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f094809b4e0 con 0x7f09501058d0 2023-10-08T13:05:12.503 INFO:teuthology.orchestra.run.smithi005.stdout:249108103205 2023-10-08T13:05:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f093c0a15e0 msgr2=0x7f093c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f093c0a15e0 0x7f093c0a3aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0940005d90 tx=0x7f0940005d00 comp rx=0 tx=0).stop 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 msgr2=0x7f0950100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 0x7f0950100df0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f094800b070 tx=0x7f0948007930 comp rx=0 tx=0).stop 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 shutdown_connections 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f093c0a15e0 0x7f093c0a3aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09501058d0 0x7f0950100df0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09500ff190 0x7f0950100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 --2- 172.21.15.5:0/1228193433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09500ffb30 0x7f09501008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.504+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 >> 172.21.15.5:0/1228193433 conn(0x7f0950074a10 msgr2=0x7f09500fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.505+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 shutdown_connections 2023-10-08T13:05:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.505+0000 7f0954a90700 1 -- 172.21.15.5:0/1228193433 wait complete. 2023-10-08T13:05:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:12 smithi060 ceph-mon[103190]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:12.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:12 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2594235190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T13:05:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:12 smithi118 ceph-mon[104234]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:12 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2594235190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T13:05:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 -- 172.21.15.5:0/771160165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728068a50 msgr2=0x7fc728068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/771160165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728068a50 0x7fc728068ed0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0099c0 tx=0x7fc71c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 -- 172.21.15.5:0/771160165 shutdown_connections 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/771160165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728069410 0x7fc72810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/771160165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc728105670 0x7fc728105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/771160165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728068a50 0x7fc728068ed0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 -- 172.21.15.5:0/771160165 >> 172.21.15.5:0/771160165 conn(0x7fc7280766c0 msgr2=0x7fc728076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 -- 172.21.15.5:0/771160165 shutdown_connections 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.624+0000 7fc72dfbb700 1 -- 172.21.15.5:0/771160165 wait complete. 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 Processor -- start 2023-10-08T13:05:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 -- start start 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc728068a50 0x7fc728198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 0x7fc7281993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728105670 0x7fc72819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72819dd70 con 0x7fc728069410 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72819dee0 con 0x7fc728068a50 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc72dfbb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72819e0a0 con 0x7fc728105670 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc726ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 0x7fc7281993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc726ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 0x7fc7281993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33372/0 (socket says 172.21.15.5:33372) 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.625+0000 7fc726ffd700 1 -- 172.21.15.5:0/393407549 learned_addr learned my addr 172.21.15.5:0/393407549 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc7277fe700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc728068a50 0x7fc728198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc727fff700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728105670 0x7fc72819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc726ffd700 1 -- 172.21.15.5:0/393407549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728105670 msgr2=0x7fc72819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc726ffd700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728105670 0x7fc72819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc726ffd700 1 -- 172.21.15.5:0/393407549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc728068a50 msgr2=0x7fc728198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc726ffd700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc728068a50 0x7fc728198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc726ffd700 1 -- 172.21.15.5:0/393407549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0095f0 con 0x7fc728069410 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc727fff700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728105670 0x7fc72819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc726ffd700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 0x7fc7281993b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc71c005b40 tx=0x7fc71c00ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c01d070 con 0x7fc728069410 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72819e320 con 0x7fc728069410 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc71c004bd0 con 0x7fc728069410 2023-10-08T13:05:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00fc10 con 0x7fc728069410 2023-10-08T13:05:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.626+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7281a5be0 con 0x7fc728069410 2023-10-08T13:05:13.015 INFO:teuthology.orchestra.run.smithi005.stdout:141733920822 2023-10-08T13:05:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.627+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7280fecf0 con 0x7fc728069410 2023-10-08T13:05:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.628+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fc71c02b440 con 0x7fc728069410 2023-10-08T13:05:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.629+0000 7fc724ff9700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7100a1560 0x7fc7100a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:13.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.629+0000 7fc7277fe700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7100a1560 0x7fc7100a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.629+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc71c0ce050 con 0x7fc728069410 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.630+0000 7fc7277fe700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7100a1560 0x7fc7100a3a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc718005950 tx=0x7fc71800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.634+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc71c0971f0 con 0x7fc728069410 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.839+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc72804e4c0 con 0x7fc728069410 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.839+0000 7fc724ff9700 1 -- 172.21.15.5:0/393407549 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc71c09a810 con 0x7fc728069410 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.841+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7100a1560 msgr2=0x7fc7100a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.841+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7100a1560 0x7fc7100a3a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc718005950 tx=0x7fc71800b410 comp rx=0 tx=0).stop 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.841+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 msgr2=0x7fc7281993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.841+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 0x7fc7281993b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc71c005b40 tx=0x7fc71c00ba30 comp rx=0 tx=0).stop 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 shutdown_connections 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7100a1560 0x7fc7100a3a20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc728105670 0x7fc72819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc728068a50 0x7fc728198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 --2- 172.21.15.5:0/393407549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc728069410 0x7fc7281993b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 >> 172.21.15.5:0/393407549 conn(0x7fc7280766c0 msgr2=0x7fc72810bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 shutdown_connections 2023-10-08T13:05:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:12.842+0000 7fc72dfbb700 1 -- 172.21.15.5:0/393407549 wait complete. 2023-10-08T13:05:13.141 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841567 got 283467841568 for osd.9 2023-10-08T13:05:13.142 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:13.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:13 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1228193433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T13:05:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:13 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:05:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:13 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/393407549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T13:05:13.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:13 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1228193433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T13:05:13.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:13 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:05:13.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:13 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/393407549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T13:05:13.673 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920819 got 141733920822 for osd.4 2023-10-08T13:05:13.673 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:13.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:13 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1228193433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T13:05:13.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:13 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:05:13.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:13 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/393407549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T13:05:13.909 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103202 got 249108103205 for osd.8 2023-10-08T13:05:13.910 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 -- 172.21.15.5:0/1260830028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23541002a0 msgr2=0x7f2354100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1260830028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23541002a0 0x7f2354100720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2344009990 tx=0x7f2344009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 -- 172.21.15.5:0/1260830028 shutdown_connections 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1260830028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2354100c60 0x7f235410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1260830028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2354104720 0x7f2354104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1260830028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23541002a0 0x7f2354100720 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.021+0000 7f235b5a7700 1 -- 172.21.15.5:0/1260830028 >> 172.21.15.5:0/1260830028 conn(0x7f2354074a10 msgr2=0x7f2354074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 -- 172.21.15.5:0/1260830028 shutdown_connections 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 -- 172.21.15.5:0/1260830028 wait complete. 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 Processor -- start 2023-10-08T13:05:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 -- start start 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23541002a0 0x7f235419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 0x7f235419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2354104720 0x7f2354196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354197260 con 0x7f2354100c60 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.022+0000 7f235b5a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23541973d0 con 0x7f23541002a0 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f235b5a7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354197590 con 0x7f2354104720 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 0x7f235419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 0x7f235419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33386/0 (socket says 172.21.15.5:33386) 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 -- 172.21.15.5:0/1540268854 learned_addr learned my addr 172.21.15.5:0/1540268854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2359343700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23541002a0 0x7f235419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2359b44700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2354104720 0x7f2354196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 -- 172.21.15.5:0/1540268854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2354104720 msgr2=0x7f2354196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2354104720 0x7f2354196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 -- 172.21.15.5:0/1540268854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23541002a0 msgr2=0x7f235419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23541002a0 0x7f235419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 -- 172.21.15.5:0/1540268854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440095f0 con 0x7f2354100c60 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f2358b42700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 0x7f235419cf40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2344005910 tx=0x7f2344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.023+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234401d070 con 0x7f2354100c60 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.024+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2344022470 con 0x7f2354100c60 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.024+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2354197810 con 0x7f2354100c60 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.024+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344017650 con 0x7f2354100c60 2023-10-08T13:05:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.024+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23541a3980 con 0x7f2354100c60 2023-10-08T13:05:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.025+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2354107c60 con 0x7f2354100c60 2023-10-08T13:05:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.026+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f23440225e0 con 0x7f2354100c60 2023-10-08T13:05:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.026+0000 7f234a7fc700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23400a1560 0x7f23400a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.027+0000 7f2359343700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23400a1560 0x7f23400a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.027+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f23440ce4f0 con 0x7f2354100c60 2023-10-08T13:05:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.027+0000 7f2359343700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23400a1560 0x7f23400a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2350009be0 tx=0x7f2350009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:14.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.031+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f23440977b0 con 0x7f2354100c60 2023-10-08T13:05:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 -- 172.21.15.5:0/1537681730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 msgr2=0x7fcf78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/1537681730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf78068b50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009990 tx=0x7fcf6c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 -- 172.21.15.5:0/1537681730 shutdown_connections 2023-10-08T13:05:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/1537681730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf78103250 0x7fcf78103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/1537681730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf781056f0 0x7fcf78068190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/1537681730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf78068b50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 -- 172.21.15.5:0/1537681730 >> 172.21.15.5:0/1537681730 conn(0x7fcf78075790 msgr2=0x7fcf78075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 -- 172.21.15.5:0/1537681730 shutdown_connections 2023-10-08T13:05:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.054+0000 7fcf7cab3700 1 -- 172.21.15.5:0/1537681730 wait complete. 2023-10-08T13:05:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.055+0000 7fcf7cab3700 1 Processor -- start 2023-10-08T13:05:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.055+0000 7fcf7cab3700 1 -- start start 2023-10-08T13:05:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.055+0000 7fcf7cab3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf7819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7cab3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf78103250 0x7fcf7819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7cab3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf781056f0 0x7fcf781a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7cab3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf781a1fe0 con 0x7fcf780686d0 2023-10-08T13:05:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7cab3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf781a2150 con 0x7fcf78103250 2023-10-08T13:05:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7cab3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf781a2310 con 0x7fcf781056f0 2023-10-08T13:05:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf7819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf7819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33398/0 (socket says 172.21.15.5:33398) 2023-10-08T13:05:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 -- 172.21.15.5:0/3117269181 learned_addr learned my addr 172.21.15.5:0/3117269181 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf76d9d700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf781056f0 0x7fcf781a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf75d9b700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf78103250 0x7fcf7819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 -- 172.21.15.5:0/3117269181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf781056f0 msgr2=0x7fcf781a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf781056f0 0x7fcf781a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 -- 172.21.15.5:0/3117269181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf78103250 msgr2=0x7fcf7819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf78103250 0x7fcf7819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 -- 172.21.15.5:0/3117269181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0095f0 con 0x7fcf780686d0 2023-10-08T13:05:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf76d9d700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf781056f0 0x7fcf781a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:05:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.056+0000 7fcf7659c700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf7819d150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c9b0 tx=0x7fcf6800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.057+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68007b00 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.057+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf6800ce50 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.057+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf781a25f0 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.057+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68018660 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.057+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf781a9e50 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.058+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf780ffd30 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.059+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fcf6800f450 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.060+0000 7fcf677fe700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf600a1560 0x7fcf600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.060+0000 7fcf75d9b700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf600a1560 0x7fcf600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.060+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fcf680cd390 con 0x7fcf780686d0 2023-10-08T13:05:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.060+0000 7fcf75d9b700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf600a1560 0x7fcf600a3a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf78068ec0 tx=0x7fcf6c005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.063+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf680965d0 con 0x7fcf780686d0 2023-10-08T13:05:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.252+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f2354197f90 con 0x7f2354100c60 2023-10-08T13:05:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.252+0000 7f234a7fc700 1 -- 172.21.15.5:0/1540268854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f2344027090 con 0x7f2354100c60 2023-10-08T13:05:14.254 INFO:teuthology.orchestra.run.smithi005.stdout:335007449111 2023-10-08T13:05:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.254+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23400a1560 msgr2=0x7f23400a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.254+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23400a1560 0x7f23400a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2350009be0 tx=0x7f2350009260 comp rx=0 tx=0).stop 2023-10-08T13:05:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.254+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 msgr2=0x7f235419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.254+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 0x7f235419cf40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2344005910 tx=0x7f2344004730 comp rx=0 tx=0).stop 2023-10-08T13:05:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 shutdown_connections 2023-10-08T13:05:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23400a1560 0x7f23400a3a20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2354104720 0x7f2354196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23541002a0 0x7f235419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 --2- 172.21.15.5:0/1540268854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2354100c60 0x7f235419cf40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 >> 172.21.15.5:0/1540268854 conn(0x7f2354074a10 msgr2=0x7f23540fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 shutdown_connections 2023-10-08T13:05:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.255+0000 7f235b5a7700 1 -- 172.21.15.5:0/1540268854 wait complete. 2023-10-08T13:05:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.270+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcf7804e4c0 con 0x7fcf780686d0 2023-10-08T13:05:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.271+0000 7fcf677fe700 1 -- 172.21.15.5:0/3117269181 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf68007e60 con 0x7fcf780686d0 2023-10-08T13:05:14.272 INFO:teuthology.orchestra.run.smithi005.stdout:163208757297 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf600a1560 msgr2=0x7fcf600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf600a1560 0x7fcf600a3a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf78068ec0 tx=0x7fcf6c005fd0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 msgr2=0x7fcf7819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf7819d150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c9b0 tx=0x7fcf6800ccc0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 shutdown_connections 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcf600a1560 0x7fcf600a3a20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf781056f0 0x7fcf781a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf780686d0 0x7fcf7819d150 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 --2- 172.21.15.5:0/3117269181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf78103250 0x7fcf7819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 >> 172.21.15.5:0/3117269181 conn(0x7fcf78075790 msgr2=0x7fcf78102230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 shutdown_connections 2023-10-08T13:05:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.273+0000 7fcf7cab3700 1 -- 172.21.15.5:0/3117269181 wait complete. 2023-10-08T13:05:14.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:14 smithi060 ceph-mon[103190]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:05:14.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:14 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1540268854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T13:05:14.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:14 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3117269181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T13:05:14.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:14 smithi005 ceph-mon[99496]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:05:14.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:14 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1540268854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T13:05:14.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:14 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3117269181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T13:05:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:14 smithi118 ceph-mon[104234]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:05:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:14 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1540268854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T13:05:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:14 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3117269181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T13:05:14.786 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757295 got 163208757297 for osd.5 2023-10-08T13:05:14.787 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:14.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 -- 172.21.15.5:0/2250739691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 msgr2=0x7f006810d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 --2- 172.21.15.5:0/2250739691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f006810d6d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f006000b0a0 tx=0x7f006000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 -- 172.21.15.5:0/2250739691 shutdown_connections 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 --2- 172.21.15.5:0/2250739691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f006810d6d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 --2- 172.21.15.5:0/2250739691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 0x7f00680ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 --2- 172.21.15.5:0/2250739691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680ff950 0x7f0068105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.830+0000 7f006ebcc700 1 -- 172.21.15.5:0/2250739691 >> 172.21.15.5:0/2250739691 conn(0x7f0068075cc0 msgr2=0x7f00680fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 -- 172.21.15.5:0/2250739691 shutdown_connections 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 -- 172.21.15.5:0/2250739691 wait complete. 2023-10-08T13:05:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 Processor -- start 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 -- start start 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 0x7f006819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680ff950 0x7f006819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f0068196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068197190 con 0x7f0068105b70 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068197300 con 0x7f00680fefa0 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.831+0000 7f006ebcc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00681974c0 con 0x7f00680ff950 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f0068196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006c968700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 0x7f006819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f0068196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33416/0 (socket says 172.21.15.5:33416) 2023-10-08T13:05:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006c968700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 0x7f006819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:56594/0 (socket says 172.21.15.5:56594) 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 -- 172.21.15.5:0/1898362411 learned_addr learned my addr 172.21.15.5:0/1898362411 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f0067fff700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680ff950 0x7f006819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 -- 172.21.15.5:0/1898362411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680ff950 msgr2=0x7f006819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680ff950 0x7f006819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 -- 172.21.15.5:0/1898362411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 msgr2=0x7f006819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 0x7f006819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 -- 172.21.15.5:0/1898362411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060009d00 con 0x7f0068105b70 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006d169700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f0068196b30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f006000b070 tx=0x7f0060007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000e040 con 0x7f0068105b70 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f006001d470 con 0x7f0068105b70 2023-10-08T13:05:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0068197740 con 0x7f0068105b70 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600052a0 con 0x7f0068105b70 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.832+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00681a3990 con 0x7f0068105b70 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.834+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0068108e20 con 0x7f0068105b70 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.835+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f006001d870 con 0x7f0068105b70 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.835+0000 7f0065ffb700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00580a15e0 0x7f00580a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.835+0000 7f006c968700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00580a15e0 0x7f00580a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.835+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f00600ce590 con 0x7f0068105b70 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.836+0000 7f006c968700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00580a15e0 0x7f00580a3aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f005c00ac50 tx=0x7f005c00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:14.840+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0060097730 con 0x7f0068105b70 2023-10-08T13:05:14.990 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449109 got 335007449111 for osd.11 2023-10-08T13:05:14.990 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.050+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0068197fa0 con 0x7f0068105b70 2023-10-08T13:05:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.051+0000 7f0065ffb700 1 -- 172.21.15.5:0/1898362411 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f006009ad50 con 0x7f0068105b70 2023-10-08T13:05:15.052 INFO:teuthology.orchestra.run.smithi005.stdout:111669149753 2023-10-08T13:05:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00580a15e0 msgr2=0x7f00580a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00580a15e0 0x7f00580a3aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f005c00ac50 tx=0x7f005c00a380 comp rx=0 tx=0).stop 2023-10-08T13:05:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 msgr2=0x7f0068196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f0068196b30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f006000b070 tx=0x7f0060007930 comp rx=0 tx=0).stop 2023-10-08T13:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 shutdown_connections 2023-10-08T13:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f00580a15e0 0x7f00580a3aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0068105b70 0x7f0068196b30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00680fefa0 0x7f006819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 --2- 172.21.15.5:0/1898362411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f00680ff950 0x7f006819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 >> 172.21.15.5:0/1898362411 conn(0x7f0068075cc0 msgr2=0x7f00680fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 shutdown_connections 2023-10-08T13:05:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.053+0000 7f006ebcc700 1 -- 172.21.15.5:0/1898362411 wait complete. 2023-10-08T13:05:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 -- 172.21.15.5:0/3278451223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde4101260 msgr2=0x7efde410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 --2- 172.21.15.5:0/3278451223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde4101260 0x7efde410d650 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efddc00b0a0 tx=0x7efddc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 -- 172.21.15.5:0/3278451223 shutdown_connections 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 --2- 172.21.15.5:0/3278451223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde4101260 0x7efde410d650 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 --2- 172.21.15.5:0/3278451223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde41057c0 0x7efde4105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 --2- 172.21.15.5:0/3278451223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde41008a0 0x7efde4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 -- 172.21.15.5:0/3278451223 >> 172.21.15.5:0/3278451223 conn(0x7efde40779e0 msgr2=0x7efde4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 -- 172.21.15.5:0/3278451223 shutdown_connections 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.247+0000 7efde9cee700 1 -- 172.21.15.5:0/3278451223 wait complete. 2023-10-08T13:05:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 Processor -- start 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 -- start start 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde41008a0 0x7efde4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde4101260 0x7efde4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 0x7efde4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde41a50a0 con 0x7efde41057c0 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde41a5210 con 0x7efde4101260 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde9cee700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde41a53d0 con 0x7efde41008a0 2023-10-08T13:05:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 0x7efde4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 0x7efde4073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33430/0 (socket says 172.21.15.5:33430) 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde41008a0 0x7efde4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde3fff700 1 -- 172.21.15.5:0/1308926109 learned_addr learned my addr 172.21.15.5:0/1308926109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde2ffd700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde4101260 0x7efde4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde3fff700 1 -- 172.21.15.5:0/1308926109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde41008a0 msgr2=0x7efde4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde3fff700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde41008a0 0x7efde4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.248+0000 7efde3fff700 1 -- 172.21.15.5:0/1308926109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde4101260 msgr2=0x7efde4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde3fff700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde4101260 0x7efde4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde3fff700 1 -- 172.21.15.5:0/1308926109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc009d00 con 0x7efde41057c0 2023-10-08T13:05:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde3fff700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 0x7efde4073570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efddc00b070 tx=0x7efddc0078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00e040 con 0x7efde41057c0 2023-10-08T13:05:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efddc01d470 con 0x7efde41057c0 2023-10-08T13:05:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde41a5650 con 0x7efde41057c0 2023-10-08T13:05:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0052a0 con 0x7efde41057c0 2023-10-08T13:05:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.249+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde41a5b10 con 0x7efde41057c0 2023-10-08T13:05:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.250+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde4108da0 con 0x7efde41057c0 2023-10-08T13:05:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.251+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efddc01d5e0 con 0x7efde41057c0 2023-10-08T13:05:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.252+0000 7efde0ff9700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efdcc0a15e0 0x7efdcc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.252+0000 7efde37fe700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efdcc0a15e0 0x7efdcc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.252+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efddc0ce950 con 0x7efde41057c0 2023-10-08T13:05:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.253+0000 7efde37fe700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efdcc0a15e0 0x7efdcc0a3aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efde4101930 tx=0x7efdd4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.256+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efddc097af0 con 0x7efde41057c0 2023-10-08T13:05:15.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.465+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efde4073fd0 con 0x7efde41057c0 2023-10-08T13:05:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.465+0000 7efde0ff9700 1 -- 172.21.15.5:0/1308926109 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efddc09b110 con 0x7efde41057c0 2023-10-08T13:05:15.467 INFO:teuthology.orchestra.run.smithi005.stdout:38654705736 2023-10-08T13:05:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efdcc0a15e0 msgr2=0x7efdcc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efdcc0a15e0 0x7efdcc0a3aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efde4101930 tx=0x7efdd4009260 comp rx=0 tx=0).stop 2023-10-08T13:05:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 msgr2=0x7efde4073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 0x7efde4073570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efddc00b070 tx=0x7efddc0078e0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 shutdown_connections 2023-10-08T13:05:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efdcc0a15e0 0x7efdcc0a3aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde41057c0 0x7efde4073570 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efde41008a0 0x7efde4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 --2- 172.21.15.5:0/1308926109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efde4101260 0x7efde4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 >> 172.21.15.5:0/1308926109 conn(0x7efde40779e0 msgr2=0x7efde40fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 shutdown_connections 2023-10-08T13:05:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:15.468+0000 7efde9cee700 1 -- 172.21.15.5:0/1308926109 wait complete. 2023-10-08T13:05:15.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:15 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1898362411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T13:05:15.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:15 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1898362411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T13:05:15.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:15 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1898362411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T13:05:15.952 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149750 got 111669149753 for osd.3 2023-10-08T13:05:15.952 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:15.999 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705733 got 38654705736 for osd.0 2023-10-08T13:05:15.999 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:15.999 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-08T13:05:15.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T13:05:16.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:16 smithi060 ceph-mon[103190]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:16.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:16 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1308926109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T13:05:16.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:16 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:16 smithi005 ceph-mon[99496]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:16 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1308926109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T13:05:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:16 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:16.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:16 smithi118 ceph-mon[104234]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:16.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:16 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1308926109' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T13:05:16.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:16.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:16 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 -- 172.21.15.5:0/2725183635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 msgr2=0x7f3fec10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/2725183635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec10d600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b0a0 tx=0x7f3fe400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 -- 172.21.15.5:0/2725183635 shutdown_connections 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/2725183635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec10d600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/2725183635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec105670 0x7f3fec105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/2725183635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fec068e20 0x7f3fec0692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:17.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 -- 172.21.15.5:0/2725183635 >> 172.21.15.5:0/2725183635 conn(0x7f3fec0757d0 msgr2=0x7f3fec075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 -- 172.21.15.5:0/2725183635 shutdown_connections 2023-10-08T13:05:17.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.955+0000 7f3ff24c8700 1 -- 172.21.15.5:0/2725183635 wait complete. 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.956+0000 7f3ff24c8700 1 Processor -- start 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.956+0000 7f3ff24c8700 1 -- start start 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.956+0000 7f3ff24c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fec068e20 0x7f3fec196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.956+0000 7f3ff24c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff24c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec105670 0x7f3fec19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff24c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec19bc80 con 0x7f3fec0697e0 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff24c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec19bdf0 con 0x7f3fec068e20 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff24c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec19bfb0 con 0x7f3fec105670 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:17.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33442/0 (socket says 172.21.15.5:33442) 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 -- 172.21.15.5:0/3142197833 learned_addr learned my addr 172.21.15.5:0/3142197833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff0a65700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec105670 0x7f3fec19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3febfff700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fec068e20 0x7f3fec196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 -- 172.21.15.5:0/3142197833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec105670 msgr2=0x7f3fec19b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec105670 0x7f3fec19b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 -- 172.21.15.5:0/3142197833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fec068e20 msgr2=0x7f3fec196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fec068e20 0x7f3fec196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 -- 172.21.15.5:0/3142197833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009d00 con 0x7f3fec0697e0 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3feb7fe700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec1972c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000d950 tx=0x7f3fe000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0009940 con 0x7f3fec0697e0 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fe0010460 con 0x7f3fec0697e0 2023-10-08T13:05:17.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec19c290 con 0x7f3fec0697e0 2023-10-08T13:05:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000f620 con 0x7f3fec0697e0 2023-10-08T13:05:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.957+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec1a3af0 con 0x7f3fec0697e0 2023-10-08T13:05:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.958+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec108cc0 con 0x7f3fec0697e0 2023-10-08T13:05:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.960+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3fe00108d0 con 0x7f3fec0697e0 2023-10-08T13:05:17.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.960+0000 7f3fe97fa700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fd40a15e0 0x7f3fd40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.960+0000 7f3febfff700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fd40a15e0 0x7f3fd40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.960+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3fe00cd1b0 con 0x7f3fec0697e0 2023-10-08T13:05:17.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.961+0000 7f3febfff700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fd40a15e0 0x7f3fd40a3aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00dad0 tx=0x7f3fdc00d4b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:17.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:17.964+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fe00962c0 con 0x7f3fec0697e0 2023-10-08T13:05:18.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.164+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fec0686b0 con 0x7f3fd40a15e0 2023-10-08T13:05:18.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.181+0000 7f3fe97fa700 1 -- 172.21.15.5:0/3142197833 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+424911 (secure 0 0 0) 0x7f3fec0686b0 con 0x7f3fd40a15e0 2023-10-08T13:05:18.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fd40a15e0 msgr2=0x7f3fd40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fd40a15e0 0x7f3fd40a3aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00dad0 tx=0x7f3fdc00d4b0 comp rx=0 tx=0).stop 2023-10-08T13:05:18.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 msgr2=0x7f3fec1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec1972c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000d950 tx=0x7f3fe000dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 shutdown_connections 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fd40a15e0 0x7f3fd40a3aa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fec105670 0x7f3fec19b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fec068e20 0x7f3fec196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 --2- 172.21.15.5:0/3142197833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fec0697e0 0x7f3fec1972c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 >> 172.21.15.5:0/3142197833 conn(0x7f3fec0757d0 msgr2=0x7f3fec0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 shutdown_connections 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:18.185+0000 7f3ff24c8700 1 -- 172.21.15.5:0/3142197833 wait complete. 2023-10-08T13:05:18.192 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:05:18.555 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:18 smithi005 ceph-mon[99496]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:18.555 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:18.555 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:18 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:18.603 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2023-10-08T13:05:17.103300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656789,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":576,"num_read_kb":408,"num_write":419,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180982,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338272,"kb_used_data":14028,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603552,"statfs":{"total":1151940427776,"available":1151594037248,"internally_reserved":0,"allocated":14364672,"data_stored":7991377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":56,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003386"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205500+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:04:37.205500+0000","last_peered":"2023-10-08T13:04:37.205500+0000","last_clean":"2023-10-08T13:04:37.205500+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:04:37.205500+0000","last_undegraded":"2023-10-08T13:04:37.205500+0000","last_fullsized":"2023-10-08T13:04:37.205500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202223+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:04:37.202223+0000","last_peered":"2023-10-08T13:04:37.202223+0000","last_clean":"2023-10-08T13:04:37.202223+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:37.202223+0000","last_undegraded":"2023-10-08T13:04:37.202223+0000","last_fullsized":"2023-10-08T13:04:37.202223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202091+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:04:37.202091+0000","last_peered":"2023-10-08T13:04:37.202091+0000","last_clean":"2023-10-08T13:04:37.202091+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:04:37.202091+0000","last_undegraded":"2023-10-08T13:04:37.202091+0000","last_fullsized":"2023-10-08T13:04:37.202091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206210+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:04:37.206210+0000","last_peered":"2023-10-08T13:04:37.206210+0000","last_clean":"2023-10-08T13:04:37.206210+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:04:37.206210+0000","last_undegraded":"2023-10-08T13:04:37.206210+0000","last_fullsized":"2023-10-08T13:04:37.206210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201997+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:04:37.201997+0000","last_peered":"2023-10-08T13:04:37.201997+0000","last_clean":"2023-10-08T13:04:37.201997+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:04:37.201997+0000","last_undegraded":"2023-10-08T13:04:37.201997+0000","last_fullsized":"2023-10-08T13:04:37.201997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.210845+0000","last_change":"2023-10-08T13:04:38.210845+0000","last_active":"2023-10-08T13:04:38.210845+0000","last_peered":"2023-10-08T13:04:38.210845+0000","last_clean":"2023-10-08T13:04:38.210845+0000","last_became_active":"2023-10-08T13:04:38.210454+0000","last_became_peered":"2023-10-08T13:04:38.210454+0000","last_unstale":"2023-10-08T13:04:38.210845+0000","last_undegraded":"2023-10-08T13:04:38.210845+0000","last_fullsized":"2023-10-08T13:04:38.210845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:10.493230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201680+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:04:37.201680+0000","last_peered":"2023-10-08T13:04:37.201680+0000","last_clean":"2023-10-08T13:04:37.201680+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:04:37.201680+0000","last_undegraded":"2023-10-08T13:04:37.201680+0000","last_fullsized":"2023-10-08T13:04:37.201680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208142+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:04:37.208142+0000","last_peered":"2023-10-08T13:04:37.208142+0000","last_clean":"2023-10-08T13:04:37.208142+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:04:37.208142+0000","last_undegraded":"2023-10-08T13:04:37.208142+0000","last_fullsized":"2023-10-08T13:04:37.208142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208843+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:04:37.208843+0000","last_peered":"2023-10-08T13:04:37.208843+0000","last_clean":"2023-10-08T13:04:37.208843+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:04:37.208843+0000","last_undegraded":"2023-10-08T13:04:37.208843+0000","last_fullsized":"2023-10-08T13:04:37.208843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208796+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:04:37.208796+0000","last_peered":"2023-10-08T13:04:37.208796+0000","last_clean":"2023-10-08T13:04:37.208796+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:04:37.208796+0000","last_undegraded":"2023-10-08T13:04:37.208796+0000","last_fullsized":"2023-10-08T13:04:37.208796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202423+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:04:37.202423+0000","last_peered":"2023-10-08T13:04:37.202423+0000","last_clean":"2023-10-08T13:04:37.202423+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:04:37.202423+0000","last_undegraded":"2023-10-08T13:04:37.202423+0000","last_fullsized":"2023-10-08T13:04:37.202423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206202+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:04:37.206202+0000","last_peered":"2023-10-08T13:04:37.206202+0000","last_clean":"2023-10-08T13:04:37.206202+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:04:37.206202+0000","last_undegraded":"2023-10-08T13:04:37.206202+0000","last_fullsized":"2023-10-08T13:04:37.206202+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.209983+0000","last_change":"2023-10-08T13:04:38.209983+0000","last_active":"2023-10-08T13:04:38.209983+0000","last_peered":"2023-10-08T13:04:38.209983+0000","last_clean":"2023-10-08T13:04:38.209983+0000","last_became_active":"2023-10-08T13:04:38.209572+0000","last_became_peered":"2023-10-08T13:04:38.209572+0000","last_unstale":"2023-10-08T13:04:38.209983+0000","last_undegraded":"2023-10-08T13:04:38.209983+0000","last_fullsized":"2023-10-08T13:04:38.209983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:01.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201771+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:04:37.201771+0000","last_peered":"2023-10-08T13:04:37.201771+0000","last_clean":"2023-10-08T13:04:37.201771+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:37.201771+0000","last_undegraded":"2023-10-08T13:04:37.201771+0000","last_fullsized":"2023-10-08T13:04:37.201771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201914+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:04:37.201914+0000","last_peered":"2023-10-08T13:04:37.201914+0000","last_clean":"2023-10-08T13:04:37.201914+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:04:37.201914+0000","last_undegraded":"2023-10-08T13:04:37.201914+0000","last_fullsized":"2023-10-08T13:04:37.201914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205042+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:04:37.205042+0000","last_peered":"2023-10-08T13:04:37.205042+0000","last_clean":"2023-10-08T13:04:37.205042+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:04:37.205042+0000","last_undegraded":"2023-10-08T13:04:37.205042+0000","last_fullsized":"2023-10-08T13:04:37.205042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204781+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:04:37.204781+0000","last_peered":"2023-10-08T13:04:37.204781+0000","last_clean":"2023-10-08T13:04:37.204781+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:04:37.204781+0000","last_undegraded":"2023-10-08T13:04:37.204781+0000","last_fullsized":"2023-10-08T13:04:37.204781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204962+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:04:37.204962+0000","last_peered":"2023-10-08T13:04:37.204962+0000","last_clean":"2023-10-08T13:04:37.204962+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:04:37.204962+0000","last_undegraded":"2023-10-08T13:04:37.204962+0000","last_fullsized":"2023-10-08T13:04:37.204962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209142+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:04:37.209142+0000","last_peered":"2023-10-08T13:04:37.209142+0000","last_clean":"2023-10-08T13:04:37.209142+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:04:37.209142+0000","last_undegraded":"2023-10-08T13:04:37.209142+0000","last_fullsized":"2023-10-08T13:04:37.209142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209016+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:04:37.209016+0000","last_peered":"2023-10-08T13:04:37.209016+0000","last_clean":"2023-10-08T13:04:37.209016+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:04:37.209016+0000","last_undegraded":"2023-10-08T13:04:37.209016+0000","last_fullsized":"2023-10-08T13:04:37.209016+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:15.218886+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:05:15.218886+0000","last_peered":"2023-10-08T13:05:15.218886+0000","last_clean":"2023-10-08T13:05:15.218886+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:05:15.218886+0000","last_undegraded":"2023-10-08T13:05:15.218886+0000","last_fullsized":"2023-10-08T13:05:15.218886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208675+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:04:37.208675+0000","last_peered":"2023-10-08T13:04:37.208675+0000","last_clean":"2023-10-08T13:04:37.208675+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:04:37.208675+0000","last_undegraded":"2023-10-08T13:04:37.208675+0000","last_fullsized":"2023-10-08T13:04:37.208675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205403+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:04:37.205403+0000","last_peered":"2023-10-08T13:04:37.205403+0000","last_clean":"2023-10-08T13:04:37.205403+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:04:37.205403+0000","last_undegraded":"2023-10-08T13:04:37.205403+0000","last_fullsized":"2023-10-08T13:04:37.205403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208768+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:04:37.208768+0000","last_peered":"2023-10-08T13:04:37.208768+0000","last_clean":"2023-10-08T13:04:37.208768+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:04:37.208768+0000","last_undegraded":"2023-10-08T13:04:37.208768+0000","last_fullsized":"2023-10-08T13:04:37.208768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202014+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:04:37.202014+0000","last_peered":"2023-10-08T13:04:37.202014+0000","last_clean":"2023-10-08T13:04:37.202014+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:04:37.202014+0000","last_undegraded":"2023-10-08T13:04:37.202014+0000","last_fullsized":"2023-10-08T13:04:37.202014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204849+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:04:37.204849+0000","last_peered":"2023-10-08T13:04:37.204849+0000","last_clean":"2023-10-08T13:04:37.204849+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:04:37.204849+0000","last_undegraded":"2023-10-08T13:04:37.204849+0000","last_fullsized":"2023-10-08T13:04:37.204849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202517+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:04:37.202517+0000","last_peered":"2023-10-08T13:04:37.202517+0000","last_clean":"2023-10-08T13:04:37.202517+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:04:37.202517+0000","last_undegraded":"2023-10-08T13:04:37.202517+0000","last_fullsized":"2023-10-08T13:04:37.202517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208920+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:04:37.208920+0000","last_peered":"2023-10-08T13:04:37.208920+0000","last_clean":"2023-10-08T13:04:37.208920+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:04:37.208920+0000","last_undegraded":"2023-10-08T13:04:37.208920+0000","last_fullsized":"2023-10-08T13:04:37.208920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205438+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:04:37.205438+0000","last_peered":"2023-10-08T13:04:37.205438+0000","last_clean":"2023-10-08T13:04:37.205438+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:04:37.205438+0000","last_undegraded":"2023-10-08T13:04:37.205438+0000","last_fullsized":"2023-10-08T13:04:37.205438+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202151+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:04:37.202151+0000","last_peered":"2023-10-08T13:04:37.202151+0000","last_clean":"2023-10-08T13:04:37.202151+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:04:37.202151+0000","last_undegraded":"2023-10-08T13:04:37.202151+0000","last_fullsized":"2023-10-08T13:04:37.202151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206549+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:04:37.206549+0000","last_peered":"2023-10-08T13:04:37.206549+0000","last_clean":"2023-10-08T13:04:37.206549+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:04:37.206549+0000","last_undegraded":"2023-10-08T13:04:37.206549+0000","last_fullsized":"2023-10-08T13:04:37.206549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208821+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:04:37.208821+0000","last_peered":"2023-10-08T13:04:37.208821+0000","last_clean":"2023-10-08T13:04:37.208821+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:04:37.208821+0000","last_undegraded":"2023-10-08T13:04:37.208821+0000","last_fullsized":"2023-10-08T13:04:37.208821+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:14.218945+0000","last_change":"2023-10-08T13:04:09.752715+0000","last_active":"2023-10-08T13:05:14.218945+0000","last_peered":"2023-10-08T13:05:14.218945+0000","last_clean":"2023-10-08T13:05:14.218945+0000","last_became_active":"2023-10-08T13:04:09.752343+0000","last_became_peered":"2023-10-08T13:04:09.752343+0000","last_unstale":"2023-10-08T13:05:14.218945+0000","last_undegraded":"2023-10-08T13:05:14.218945+0000","last_fullsized":"2023-10-08T13:05:14.218945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:08.548171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202173+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:04:37.202173+0000","last_peered":"2023-10-08T13:04:37.202173+0000","last_clean":"2023-10-08T13:04:37.202173+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:04:37.202173+0000","last_undegraded":"2023-10-08T13:04:37.202173+0000","last_fullsized":"2023-10-08T13:04:37.202173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208800+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:04:37.208800+0000","last_peered":"2023-10-08T13:04:37.208800+0000","last_clean":"2023-10-08T13:04:37.208800+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:04:37.208800+0000","last_undegraded":"2023-10-08T13:04:37.208800+0000","last_fullsized":"2023-10-08T13:04:37.208800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209540+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:04:37.209540+0000","last_peered":"2023-10-08T13:04:37.209540+0000","last_clean":"2023-10-08T13:04:37.209540+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:04:37.209540+0000","last_undegraded":"2023-10-08T13:04:37.209540+0000","last_fullsized":"2023-10-08T13:04:37.209540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206160+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:04:37.206160+0000","last_peered":"2023-10-08T13:04:37.206160+0000","last_clean":"2023-10-08T13:04:37.206160+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:04:37.206160+0000","last_undegraded":"2023-10-08T13:04:37.206160+0000","last_fullsized":"2023-10-08T13:04:37.206160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204686+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:04:37.204686+0000","last_peered":"2023-10-08T13:04:37.204686+0000","last_clean":"2023-10-08T13:04:37.204686+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:04:37.204686+0000","last_undegraded":"2023-10-08T13:04:37.204686+0000","last_fullsized":"2023-10-08T13:04:37.204686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208990+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:04:37.208990+0000","last_peered":"2023-10-08T13:04:37.208990+0000","last_clean":"2023-10-08T13:04:37.208990+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:04:37.208990+0000","last_undegraded":"2023-10-08T13:04:37.208990+0000","last_fullsized":"2023-10-08T13:04:37.208990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208324+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:04:37.208324+0000","last_peered":"2023-10-08T13:04:37.208324+0000","last_clean":"2023-10-08T13:04:37.208324+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:04:37.208324+0000","last_undegraded":"2023-10-08T13:04:37.208324+0000","last_fullsized":"2023-10-08T13:04:37.208324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202117+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:04:37.202117+0000","last_peered":"2023-10-08T13:04:37.202117+0000","last_clean":"2023-10-08T13:04:37.202117+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:04:37.202117+0000","last_undegraded":"2023-10-08T13:04:37.202117+0000","last_fullsized":"2023-10-08T13:04:37.202117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206208+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:04:37.206208+0000","last_peered":"2023-10-08T13:04:37.206208+0000","last_clean":"2023-10-08T13:04:37.206208+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:04:37.206208+0000","last_undegraded":"2023-10-08T13:04:37.206208+0000","last_fullsized":"2023-10-08T13:04:37.206208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204291+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:04:37.204291+0000","last_peered":"2023-10-08T13:04:37.204291+0000","last_clean":"2023-10-08T13:04:37.204291+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:04:37.204291+0000","last_undegraded":"2023-10-08T13:04:37.204291+0000","last_fullsized":"2023-10-08T13:04:37.204291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.210011+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:04:37.210011+0000","last_peered":"2023-10-08T13:04:37.210011+0000","last_clean":"2023-10-08T13:04:37.210011+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:04:37.210011+0000","last_undegraded":"2023-10-08T13:04:37.210011+0000","last_fullsized":"2023-10-08T13:04:37.210011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:12.215883+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:05:12.215883+0000","last_peered":"2023-10-08T13:05:12.215883+0000","last_clean":"2023-10-08T13:05:12.215883+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:05:12.215883+0000","last_undegraded":"2023-10-08T13:05:12.215883+0000","last_fullsized":"2023-10-08T13:05:12.215883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208845+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:04:37.208845+0000","last_peered":"2023-10-08T13:04:37.208845+0000","last_clean":"2023-10-08T13:04:37.208845+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:04:37.208845+0000","last_undegraded":"2023-10-08T13:04:37.208845+0000","last_fullsized":"2023-10-08T13:04:37.208845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204003+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:04:37.204003+0000","last_peered":"2023-10-08T13:04:37.204003+0000","last_clean":"2023-10-08T13:04:37.204003+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:04:37.204003+0000","last_undegraded":"2023-10-08T13:04:37.204003+0000","last_fullsized":"2023-10-08T13:04:37.204003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202110+0000","last_change":"2023-10-08T13:04:09.754360+0000","last_active":"2023-10-08T13:04:37.202110+0000","last_peered":"2023-10-08T13:04:37.202110+0000","last_clean":"2023-10-08T13:04:37.202110+0000","last_became_active":"2023-10-08T13:04:09.754047+0000","last_became_peered":"2023-10-08T13:04:09.754047+0000","last_unstale":"2023-10-08T13:04:37.202110+0000","last_undegraded":"2023-10-08T13:04:37.202110+0000","last_fullsized":"2023-10-08T13:04:37.202110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:11.616693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202109+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:04:37.202109+0000","last_peered":"2023-10-08T13:04:37.202109+0000","last_clean":"2023-10-08T13:04:37.202109+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:04:37.202109+0000","last_undegraded":"2023-10-08T13:04:37.202109+0000","last_fullsized":"2023-10-08T13:04:37.202109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.220707+0000","last_change":"2023-10-08T13:04:38.220707+0000","last_active":"2023-10-08T13:04:38.220707+0000","last_peered":"2023-10-08T13:04:38.220707+0000","last_clean":"2023-10-08T13:04:38.220707+0000","last_became_active":"2023-10-08T13:04:38.215253+0000","last_became_peered":"2023-10-08T13:04:38.215253+0000","last_unstale":"2023-10-08T13:04:38.220707+0000","last_undegraded":"2023-10-08T13:04:38.220707+0000","last_fullsized":"2023-10-08T13:04:38.220707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:15.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206614+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:04:37.206614+0000","last_peered":"2023-10-08T13:04:37.206614+0000","last_clean":"2023-10-08T13:04:37.206614+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:04:37.206614+0000","last_undegraded":"2023-10-08T13:04:37.206614+0000","last_fullsized":"2023-10-08T13:04:37.206614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.214872+0000","last_change":"2023-10-08T13:04:38.214872+0000","last_active":"2023-10-08T13:04:38.214872+0000","last_peered":"2023-10-08T13:04:38.214872+0000","last_clean":"2023-10-08T13:04:38.214872+0000","last_became_active":"2023-10-08T13:04:38.214480+0000","last_became_peered":"2023-10-08T13:04:38.214480+0000","last_unstale":"2023-10-08T13:04:38.214872+0000","last_undegraded":"2023-10-08T13:04:38.214872+0000","last_fullsized":"2023-10-08T13:04:38.214872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:05.108568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204567+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:04:37.204567+0000","last_peered":"2023-10-08T13:04:37.204567+0000","last_clean":"2023-10-08T13:04:37.204567+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:04:37.204567+0000","last_undegraded":"2023-10-08T13:04:37.204567+0000","last_fullsized":"2023-10-08T13:04:37.204567+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":138,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:12.215946+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:05:12.215946+0000","last_peered":"2023-10-08T13:05:12.215946+0000","last_clean":"2023-10-08T13:05:12.215946+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:05:12.215946+0000","last_undegraded":"2023-10-08T13:05:12.215946+0000","last_fullsized":"2023-10-08T13:05:12.215946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58583,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":85,"num_read_kb":99,"num_write":36,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202270+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:04:37.202270+0000","last_peered":"2023-10-08T13:04:37.202270+0000","last_clean":"2023-10-08T13:04:37.202270+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:04:37.202270+0000","last_undegraded":"2023-10-08T13:04:37.202270+0000","last_fullsized":"2023-10-08T13:04:37.202270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206895+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:04:37.206895+0000","last_peered":"2023-10-08T13:04:37.206895+0000","last_clean":"2023-10-08T13:04:37.206895+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:04:37.206895+0000","last_undegraded":"2023-10-08T13:04:37.206895+0000","last_fullsized":"2023-10-08T13:04:37.206895+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208978+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:04:37.208978+0000","last_peered":"2023-10-08T13:04:37.208978+0000","last_clean":"2023-10-08T13:04:37.208978+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:04:37.208978+0000","last_undegraded":"2023-10-08T13:04:37.208978+0000","last_fullsized":"2023-10-08T13:04:37.208978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208777+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:04:37.208777+0000","last_peered":"2023-10-08T13:04:37.208777+0000","last_clean":"2023-10-08T13:04:37.208777+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:04:37.208777+0000","last_undegraded":"2023-10-08T13:04:37.208777+0000","last_fullsized":"2023-10-08T13:04:37.208777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204589+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:04:37.204589+0000","last_peered":"2023-10-08T13:04:37.204589+0000","last_clean":"2023-10-08T13:04:37.204589+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:04:37.204589+0000","last_undegraded":"2023-10-08T13:04:37.204589+0000","last_fullsized":"2023-10-08T13:04:37.204589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206416+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:04:37.206416+0000","last_peered":"2023-10-08T13:04:37.206416+0000","last_clean":"2023-10-08T13:04:37.206416+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:04:37.206416+0000","last_undegraded":"2023-10-08T13:04:37.206416+0000","last_fullsized":"2023-10-08T13:04:37.206416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201867+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:04:37.201867+0000","last_peered":"2023-10-08T13:04:37.201867+0000","last_clean":"2023-10-08T13:04:37.201867+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:04:37.201867+0000","last_undegraded":"2023-10-08T13:04:37.201867+0000","last_fullsized":"2023-10-08T13:04:37.201867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205056+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:04:37.205056+0000","last_peered":"2023-10-08T13:04:37.205056+0000","last_clean":"2023-10-08T13:04:37.205056+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:04:37.205056+0000","last_undegraded":"2023-10-08T13:04:37.205056+0000","last_fullsized":"2023-10-08T13:04:37.205056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:13.217079+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:05:13.217079+0000","last_peered":"2023-10-08T13:05:13.217079+0000","last_clean":"2023-10-08T13:05:13.217079+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:05:13.217079+0000","last_undegraded":"2023-10-08T13:05:13.217079+0000","last_fullsized":"2023-10-08T13:05:13.217079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201708+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:04:37.201708+0000","last_peered":"2023-10-08T13:04:37.201708+0000","last_clean":"2023-10-08T13:04:37.201708+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:04:37.201708+0000","last_undegraded":"2023-10-08T13:04:37.201708+0000","last_fullsized":"2023-10-08T13:04:37.201708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208333+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:04:37.208333+0000","last_peered":"2023-10-08T13:04:37.208333+0000","last_clean":"2023-10-08T13:04:37.208333+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:04:37.208333+0000","last_undegraded":"2023-10-08T13:04:37.208333+0000","last_fullsized":"2023-10-08T13:04:37.208333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201912+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:04:37.201912+0000","last_peered":"2023-10-08T13:04:37.201912+0000","last_clean":"2023-10-08T13:04:37.201912+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:04:37.201912+0000","last_undegraded":"2023-10-08T13:04:37.201912+0000","last_fullsized":"2023-10-08T13:04:37.201912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213791+0000","last_change":"2023-10-08T13:04:38.213542+0000","last_active":"2023-10-08T13:04:38.213791+0000","last_peered":"2023-10-08T13:04:38.213791+0000","last_clean":"2023-10-08T13:04:38.213791+0000","last_became_active":"2023-10-08T13:04:38.213218+0000","last_became_peered":"2023-10-08T13:04:38.213218+0000","last_unstale":"2023-10-08T13:04:38.213791+0000","last_undegraded":"2023-10-08T13:04:38.213791+0000","last_fullsized":"2023-10-08T13:04:38.213791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:51.125175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205975+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:04:37.205975+0000","last_peered":"2023-10-08T13:04:37.205975+0000","last_clean":"2023-10-08T13:04:37.205975+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:04:37.205975+0000","last_undegraded":"2023-10-08T13:04:37.205975+0000","last_fullsized":"2023-10-08T13:04:37.205975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202517+0000","last_change":"2023-10-08T13:04:09.753810+0000","last_active":"2023-10-08T13:04:37.202517+0000","last_peered":"2023-10-08T13:04:37.202517+0000","last_clean":"2023-10-08T13:04:37.202517+0000","last_became_active":"2023-10-08T13:04:09.753497+0000","last_became_peered":"2023-10-08T13:04:09.753497+0000","last_unstale":"2023-10-08T13:04:37.202517+0000","last_undegraded":"2023-10-08T13:04:37.202517+0000","last_fullsized":"2023-10-08T13:04:37.202517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:11.309476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205365+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:04:37.205365+0000","last_peered":"2023-10-08T13:04:37.205365+0000","last_clean":"2023-10-08T13:04:37.205365+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:04:37.205365+0000","last_undegraded":"2023-10-08T13:04:37.205365+0000","last_fullsized":"2023-10-08T13:04:37.205365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.215172+0000","last_change":"2023-10-08T13:04:38.215172+0000","last_active":"2023-10-08T13:04:38.215172+0000","last_peered":"2023-10-08T13:04:38.215172+0000","last_clean":"2023-10-08T13:04:38.215172+0000","last_became_active":"2023-10-08T13:04:38.214666+0000","last_became_peered":"2023-10-08T13:04:38.214666+0000","last_unstale":"2023-10-08T13:04:38.215172+0000","last_undegraded":"2023-10-08T13:04:38.215172+0000","last_fullsized":"2023-10-08T13:04:38.215172+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:45.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205182+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:04:37.205182+0000","last_peered":"2023-10-08T13:04:37.205182+0000","last_clean":"2023-10-08T13:04:37.205182+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:04:37.205182+0000","last_undegraded":"2023-10-08T13:04:37.205182+0000","last_fullsized":"2023-10-08T13:04:37.205182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208628+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:04:37.208628+0000","last_peered":"2023-10-08T13:04:37.208628+0000","last_clean":"2023-10-08T13:04:37.208628+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:04:37.208628+0000","last_undegraded":"2023-10-08T13:04:37.208628+0000","last_fullsized":"2023-10-08T13:04:37.208628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208190+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:04:37.208190+0000","last_peered":"2023-10-08T13:04:37.208190+0000","last_clean":"2023-10-08T13:04:37.208190+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:04:37.208190+0000","last_undegraded":"2023-10-08T13:04:37.208190+0000","last_fullsized":"2023-10-08T13:04:37.208190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:12.215691+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:05:12.215691+0000","last_peered":"2023-10-08T13:05:12.215691+0000","last_clean":"2023-10-08T13:05:12.215691+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:05:12.215691+0000","last_undegraded":"2023-10-08T13:05:12.215691+0000","last_fullsized":"2023-10-08T13:05:12.215691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208321+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:04:37.208321+0000","last_peered":"2023-10-08T13:04:37.208321+0000","last_clean":"2023-10-08T13:04:37.208321+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:04:37.208321+0000","last_undegraded":"2023-10-08T13:04:37.208321+0000","last_fullsized":"2023-10-08T13:04:37.208321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208547+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:04:37.208547+0000","last_peered":"2023-10-08T13:04:37.208547+0000","last_clean":"2023-10-08T13:04:37.208547+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:04:37.208547+0000","last_undegraded":"2023-10-08T13:04:37.208547+0000","last_fullsized":"2023-10-08T13:04:37.208547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213418+0000","last_change":"2023-10-08T13:04:38.213418+0000","last_active":"2023-10-08T13:04:38.213418+0000","last_peered":"2023-10-08T13:04:38.213418+0000","last_clean":"2023-10-08T13:04:38.213418+0000","last_became_active":"2023-10-08T13:04:38.213000+0000","last_became_peered":"2023-10-08T13:04:38.213000+0000","last_unstale":"2023-10-08T13:04:38.213418+0000","last_undegraded":"2023-10-08T13:04:38.213418+0000","last_fullsized":"2023-10-08T13:04:38.213418+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:20.821412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":64,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:11.213530+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:05:11.213530+0000","last_peered":"2023-10-08T13:05:11.213530+0000","last_clean":"2023-10-08T13:05:11.213530+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:05:11.213530+0000","last_undegraded":"2023-10-08T13:05:11.213530+0000","last_fullsized":"2023-10-08T13:05:11.213530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.218150+0000","last_change":"2023-10-08T13:04:38.218150+0000","last_active":"2023-10-08T13:04:38.218150+0000","last_peered":"2023-10-08T13:04:38.218150+0000","last_clean":"2023-10-08T13:04:38.218150+0000","last_became_active":"2023-10-08T13:04:38.210481+0000","last_became_peered":"2023-10-08T13:04:38.210481+0000","last_unstale":"2023-10-08T13:04:38.218150+0000","last_undegraded":"2023-10-08T13:04:38.218150+0000","last_fullsized":"2023-10-08T13:04:38.218150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:42.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208975+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:04:37.208975+0000","last_peered":"2023-10-08T13:04:37.208975+0000","last_clean":"2023-10-08T13:04:37.208975+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:04:37.208975+0000","last_undegraded":"2023-10-08T13:04:37.208975+0000","last_fullsized":"2023-10-08T13:04:37.208975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205043+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:04:37.205043+0000","last_peered":"2023-10-08T13:04:37.205043+0000","last_clean":"2023-10-08T13:04:37.205043+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:04:37.205043+0000","last_undegraded":"2023-10-08T13:04:37.205043+0000","last_fullsized":"2023-10-08T13:04:37.205043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":323,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201566+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:04:37.201566+0000","last_peered":"2023-10-08T13:04:37.201566+0000","last_clean":"2023-10-08T13:04:37.201566+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:04:37.201566+0000","last_undegraded":"2023-10-08T13:04:37.201566+0000","last_fullsized":"2023-10-08T13:04:37.201566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205300+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:04:37.205300+0000","last_peered":"2023-10-08T13:04:37.205300+0000","last_clean":"2023-10-08T13:04:37.205300+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:04:37.205300+0000","last_undegraded":"2023-10-08T13:04:37.205300+0000","last_fullsized":"2023-10-08T13:04:37.205300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208863+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:04:37.208863+0000","last_peered":"2023-10-08T13:04:37.208863+0000","last_clean":"2023-10-08T13:04:37.208863+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:04:37.208863+0000","last_undegraded":"2023-10-08T13:04:37.208863+0000","last_fullsized":"2023-10-08T13:04:37.208863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201704+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:04:37.201704+0000","last_peered":"2023-10-08T13:04:37.201704+0000","last_clean":"2023-10-08T13:04:37.201704+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:04:37.201704+0000","last_undegraded":"2023-10-08T13:04:37.201704+0000","last_fullsized":"2023-10-08T13:04:37.201704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204625+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:04:37.204625+0000","last_peered":"2023-10-08T13:04:37.204625+0000","last_clean":"2023-10-08T13:04:37.204625+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:04:37.204625+0000","last_undegraded":"2023-10-08T13:04:37.204625+0000","last_fullsized":"2023-10-08T13:04:37.204625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202452+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:04:37.202452+0000","last_peered":"2023-10-08T13:04:37.202452+0000","last_clean":"2023-10-08T13:04:37.202452+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:04:37.202452+0000","last_undegraded":"2023-10-08T13:04:37.202452+0000","last_fullsized":"2023-10-08T13:04:37.202452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208330+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:04:37.208330+0000","last_peered":"2023-10-08T13:04:37.208330+0000","last_clean":"2023-10-08T13:04:37.208330+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:04:37.208330+0000","last_undegraded":"2023-10-08T13:04:37.208330+0000","last_fullsized":"2023-10-08T13:04:37.208330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208237+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:04:37.208237+0000","last_peered":"2023-10-08T13:04:37.208237+0000","last_clean":"2023-10-08T13:04:37.208237+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:04:37.208237+0000","last_undegraded":"2023-10-08T13:04:37.208237+0000","last_fullsized":"2023-10-08T13:04:37.208237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.851514+0000","last_change":"2023-10-08T13:04:09.752541+0000","last_active":"2023-10-08T13:04:38.851514+0000","last_peered":"2023-10-08T13:04:38.851514+0000","last_clean":"2023-10-08T13:04:38.851514+0000","last_became_active":"2023-10-08T13:04:09.751993+0000","last_became_peered":"2023-10-08T13:04:09.751993+0000","last_unstale":"2023-10-08T13:04:38.851514+0000","last_undegraded":"2023-10-08T13:04:38.851514+0000","last_fullsized":"2023-10-08T13:04:38.851514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:02.681384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208950+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:04:37.208950+0000","last_peered":"2023-10-08T13:04:37.208950+0000","last_clean":"2023-10-08T13:04:37.208950+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:04:37.208950+0000","last_undegraded":"2023-10-08T13:04:37.208950+0000","last_fullsized":"2023-10-08T13:04:37.208950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208410+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:04:37.208410+0000","last_peered":"2023-10-08T13:04:37.208410+0000","last_clean":"2023-10-08T13:04:37.208410+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:04:37.208410+0000","last_undegraded":"2023-10-08T13:04:37.208410+0000","last_fullsized":"2023-10-08T13:04:37.208410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205929+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:04:37.205929+0000","last_peered":"2023-10-08T13:04:37.205929+0000","last_clean":"2023-10-08T13:04:37.205929+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:04:37.205929+0000","last_undegraded":"2023-10-08T13:04:37.205929+0000","last_fullsized":"2023-10-08T13:04:37.205929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202211+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:04:37.202211+0000","last_peered":"2023-10-08T13:04:37.202211+0000","last_clean":"2023-10-08T13:04:37.202211+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:04:37.202211+0000","last_undegraded":"2023-10-08T13:04:37.202211+0000","last_fullsized":"2023-10-08T13:04:37.202211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205279+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:37.205279+0000","last_peered":"2023-10-08T13:04:37.205279+0000","last_clean":"2023-10-08T13:04:37.205279+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:04:37.205279+0000","last_undegraded":"2023-10-08T13:04:37.205279+0000","last_fullsized":"2023-10-08T13:04:37.205279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205153+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:04:37.205153+0000","last_peered":"2023-10-08T13:04:37.205153+0000","last_clean":"2023-10-08T13:04:37.205153+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:04:37.205153+0000","last_undegraded":"2023-10-08T13:04:37.205153+0000","last_fullsized":"2023-10-08T13:04:37.205153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201902+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:04:37.201902+0000","last_peered":"2023-10-08T13:04:37.201902+0000","last_clean":"2023-10-08T13:04:37.201902+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:04:37.201902+0000","last_undegraded":"2023-10-08T13:04:37.201902+0000","last_fullsized":"2023-10-08T13:04:37.201902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205217+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:04:37.205217+0000","last_peered":"2023-10-08T13:04:37.205217+0000","last_clean":"2023-10-08T13:04:37.205217+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:04:37.205217+0000","last_undegraded":"2023-10-08T13:04:37.205217+0000","last_fullsized":"2023-10-08T13:04:37.205217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209904+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:04:37.209904+0000","last_peered":"2023-10-08T13:04:37.209904+0000","last_clean":"2023-10-08T13:04:37.209904+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:04:37.209904+0000","last_undegraded":"2023-10-08T13:04:37.209904+0000","last_fullsized":"2023-10-08T13:04:37.209904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204414+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:04:37.204414+0000","last_peered":"2023-10-08T13:04:37.204414+0000","last_clean":"2023-10-08T13:04:37.204414+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:04:37.204414+0000","last_undegraded":"2023-10-08T13:04:37.204414+0000","last_fullsized":"2023-10-08T13:04:37.204414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213883+0000","last_change":"2023-10-08T13:04:38.213883+0000","last_active":"2023-10-08T13:04:38.213883+0000","last_peered":"2023-10-08T13:04:38.213883+0000","last_clean":"2023-10-08T13:04:38.213883+0000","last_became_active":"2023-10-08T13:04:38.212887+0000","last_became_peered":"2023-10-08T13:04:38.212887+0000","last_unstale":"2023-10-08T13:04:38.213883+0000","last_undegraded":"2023-10-08T13:04:38.213883+0000","last_fullsized":"2023-10-08T13:04:38.213883+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:14.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208606+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:04:37.208606+0000","last_peered":"2023-10-08T13:04:37.208606+0000","last_clean":"2023-10-08T13:04:37.208606+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:04:37.208606+0000","last_undegraded":"2023-10-08T13:04:37.208606+0000","last_fullsized":"2023-10-08T13:04:37.208606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208693+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:04:37.208693+0000","last_peered":"2023-10-08T13:04:37.208693+0000","last_clean":"2023-10-08T13:04:37.208693+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:04:37.208693+0000","last_undegraded":"2023-10-08T13:04:37.208693+0000","last_fullsized":"2023-10-08T13:04:37.208693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205045+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:37.205045+0000","last_peered":"2023-10-08T13:04:37.205045+0000","last_clean":"2023-10-08T13:04:37.205045+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:04:37.205045+0000","last_undegraded":"2023-10-08T13:04:37.205045+0000","last_fullsized":"2023-10-08T13:04:37.205045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202094+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:04:37.202094+0000","last_peered":"2023-10-08T13:04:37.202094+0000","last_clean":"2023-10-08T13:04:37.202094+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:04:37.202094+0000","last_undegraded":"2023-10-08T13:04:37.202094+0000","last_fullsized":"2023-10-08T13:04:37.202094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202125+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:04:37.202125+0000","last_peered":"2023-10-08T13:04:37.202125+0000","last_clean":"2023-10-08T13:04:37.202125+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:04:37.202125+0000","last_undegraded":"2023-10-08T13:04:37.202125+0000","last_fullsized":"2023-10-08T13:04:37.202125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208125+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:04:37.208125+0000","last_peered":"2023-10-08T13:04:37.208125+0000","last_clean":"2023-10-08T13:04:37.208125+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:04:37.208125+0000","last_undegraded":"2023-10-08T13:04:37.208125+0000","last_fullsized":"2023-10-08T13:04:37.208125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:14.225287+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:05:14.225287+0000","last_peered":"2023-10-08T13:05:14.225287+0000","last_clean":"2023-10-08T13:05:14.225287+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:05:14.225287+0000","last_undegraded":"2023-10-08T13:05:14.225287+0000","last_fullsized":"2023-10-08T13:05:14.225287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202540+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:04:37.202540+0000","last_peered":"2023-10-08T13:04:37.202540+0000","last_clean":"2023-10-08T13:04:37.202540+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:04:37.202540+0000","last_undegraded":"2023-10-08T13:04:37.202540+0000","last_fullsized":"2023-10-08T13:04:37.202540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201758+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:04:37.201758+0000","last_peered":"2023-10-08T13:04:37.201758+0000","last_clean":"2023-10-08T13:04:37.201758+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:04:37.201758+0000","last_undegraded":"2023-10-08T13:04:37.201758+0000","last_fullsized":"2023-10-08T13:04:37.201758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206650+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:04:37.206650+0000","last_peered":"2023-10-08T13:04:37.206650+0000","last_clean":"2023-10-08T13:04:37.206650+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:04:37.206650+0000","last_undegraded":"2023-10-08T13:04:37.206650+0000","last_fullsized":"2023-10-08T13:04:37.206650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202162+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:04:37.202162+0000","last_peered":"2023-10-08T13:04:37.202162+0000","last_clean":"2023-10-08T13:04:37.202162+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:04:37.202162+0000","last_undegraded":"2023-10-08T13:04:37.202162+0000","last_fullsized":"2023-10-08T13:04:37.202162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204935+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:04:37.204935+0000","last_peered":"2023-10-08T13:04:37.204935+0000","last_clean":"2023-10-08T13:04:37.204935+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:04:37.204935+0000","last_undegraded":"2023-10-08T13:04:37.204935+0000","last_fullsized":"2023-10-08T13:04:37.204935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208437+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:04:37.208437+0000","last_peered":"2023-10-08T13:04:37.208437+0000","last_clean":"2023-10-08T13:04:37.208437+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:04:37.208437+0000","last_undegraded":"2023-10-08T13:04:37.208437+0000","last_fullsized":"2023-10-08T13:04:37.208437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202563+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:04:37.202563+0000","last_peered":"2023-10-08T13:04:37.202563+0000","last_clean":"2023-10-08T13:04:37.202563+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:04:37.202563+0000","last_undegraded":"2023-10-08T13:04:37.202563+0000","last_fullsized":"2023-10-08T13:04:37.202563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204511+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:04:37.204511+0000","last_peered":"2023-10-08T13:04:37.204511+0000","last_clean":"2023-10-08T13:04:37.204511+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:04:37.204511+0000","last_undegraded":"2023-10-08T13:04:37.204511+0000","last_fullsized":"2023-10-08T13:04:37.204511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209161+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:04:37.209161+0000","last_peered":"2023-10-08T13:04:37.209161+0000","last_clean":"2023-10-08T13:04:37.209161+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:04:37.209161+0000","last_undegraded":"2023-10-08T13:04:37.209161+0000","last_fullsized":"2023-10-08T13:04:37.209161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208457+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:04:37.208457+0000","last_peered":"2023-10-08T13:04:37.208457+0000","last_clean":"2023-10-08T13:04:37.208457+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:04:37.208457+0000","last_undegraded":"2023-10-08T13:04:37.208457+0000","last_fullsized":"2023-10-08T13:04:37.208457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202131+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:04:37.202131+0000","last_peered":"2023-10-08T13:04:37.202131+0000","last_clean":"2023-10-08T13:04:37.202131+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:04:37.202131+0000","last_undegraded":"2023-10-08T13:04:37.202131+0000","last_fullsized":"2023-10-08T13:04:37.202131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208418+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:04:37.208418+0000","last_peered":"2023-10-08T13:04:37.208418+0000","last_clean":"2023-10-08T13:04:37.208418+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:04:37.208418+0000","last_undegraded":"2023-10-08T13:04:37.208418+0000","last_fullsized":"2023-10-08T13:04:37.208418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205236+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:04:37.205236+0000","last_peered":"2023-10-08T13:04:37.205236+0000","last_clean":"2023-10-08T13:04:37.205236+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:04:37.205236+0000","last_undegraded":"2023-10-08T13:04:37.205236+0000","last_fullsized":"2023-10-08T13:04:37.205236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209183+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:04:37.209183+0000","last_peered":"2023-10-08T13:04:37.209183+0000","last_clean":"2023-10-08T13:04:37.209183+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:04:37.209183+0000","last_undegraded":"2023-10-08T13:04:37.209183+0000","last_fullsized":"2023-10-08T13:04:37.209183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209116+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:04:37.209116+0000","last_peered":"2023-10-08T13:04:37.209116+0000","last_clean":"2023-10-08T13:04:37.209116+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:04:37.209116+0000","last_undegraded":"2023-10-08T13:04:37.209116+0000","last_fullsized":"2023-10-08T13:04:37.209116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205186+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:04:37.205186+0000","last_peered":"2023-10-08T13:04:37.205186+0000","last_clean":"2023-10-08T13:04:37.205186+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:04:37.205186+0000","last_undegraded":"2023-10-08T13:04:37.205186+0000","last_fullsized":"2023-10-08T13:04:37.205186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213639+0000","last_change":"2023-10-08T13:04:38.213278+0000","last_active":"2023-10-08T13:04:38.213639+0000","last_peered":"2023-10-08T13:04:38.213639+0000","last_clean":"2023-10-08T13:04:38.213639+0000","last_became_active":"2023-10-08T13:04:38.213016+0000","last_became_peered":"2023-10-08T13:04:38.213016+0000","last_unstale":"2023-10-08T13:04:38.213639+0000","last_undegraded":"2023-10-08T13:04:38.213639+0000","last_fullsized":"2023-10-08T13:04:38.213639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:49.650606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208454+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:04:37.208454+0000","last_peered":"2023-10-08T13:04:37.208454+0000","last_clean":"2023-10-08T13:04:37.208454+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:04:37.208454+0000","last_undegraded":"2023-10-08T13:04:37.208454+0000","last_fullsized":"2023-10-08T13:04:37.208454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208753+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:04:37.208753+0000","last_peered":"2023-10-08T13:04:37.208753+0000","last_clean":"2023-10-08T13:04:37.208753+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:04:37.208753+0000","last_undegraded":"2023-10-08T13:04:37.208753+0000","last_fullsized":"2023-10-08T13:04:37.208753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205036+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:04:37.205036+0000","last_peered":"2023-10-08T13:04:37.205036+0000","last_clean":"2023-10-08T13:04:37.205036+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:04:37.205036+0000","last_undegraded":"2023-10-08T13:04:37.205036+0000","last_fullsized":"2023-10-08T13:04:37.205036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66175,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":440,"num_read_kb":289,"num_write":236,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":504810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.748}]},{"osd":8,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.69999999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.76200000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65800000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1708032,"data_stored":1150209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.432},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":1.456,"15min":1.456},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.383,"15min":1.383},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93400000000000005,"5min":1.085,"15min":1.085},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":1.337,"15min":1.337},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.871}]},{"osd":8,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.88700000000000001},"min":{"1min":0.66900000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98899999999999999,"5min":1.637,"15min":1.637},"last":0.81100000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.89100000000000001},"min":{"1min":0.68999999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1459999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.627,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.748,"15min":1.748},"last":0.745}]},{"osd":11,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.96499999999999997}]}]},{"osd":9,"up_from":66,"seq":283467841570,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":504350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.441,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52500000000000002,"5min":0.625,"15min":0.625},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.55100000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.29699999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.751,"5min":0.875,"15min":0.875},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.76400000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.62,"15min":0.627},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.48399999999999999,"15min":0.49299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52200000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70499999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79000000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82499999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81899999999999995,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.5},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79200000000000004,"15min":0.80800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.016},"last":0.61499999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.95799999999999996,"5min":1.123,"15min":1.123},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86699999999999999,"5min":1.109,"15min":1.109},"last":0.625}]},{"osd":10,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.871,"5min":1.095,"15min":1.095},"last":0.70399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":8,"up_from":58,"seq":249108103206,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":508493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.752,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.502},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.373}]},{"osd":3,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.127},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.32600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.81999999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.90700000000000003,"5min":1.127,"15min":1.127},"last":0.45800000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":1.048,"15min":1.048},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:04:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95299999999999996,"5min":1.202,"15min":1.202},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92500000000000004,"5min":1.01,"15min":1.01},"last":0.56999999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.64500000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.77500000000000002,"15min":0.75700000000000001},"min":{"1min":0.69799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0189999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63700000000000001}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.628},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332137,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1626112,"data_stored":1097245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84599999999999997,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.78600000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.66200000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.748},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0049999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":1.1180000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.998,"5min":1.23,"15min":1.23},"last":1.038},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.95299999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.016},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0349999999999999,"5min":1.266,"15min":1.266},"last":1.103}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":1.081}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495662,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":500244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.747,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.40300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.505}]},{"osd":2,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.622},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94199999999999995,"5min":1.075,"15min":1.075},"last":0.57899999999999996}]},{"osd":5,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.48699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.02,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77000000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77900000000000003,"15min":0.78000000000000003},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.626}]},{"osd":9,"last update":"Sun Oct 8 13:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81599999999999995},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.123,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65400000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:04:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.75}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":563953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.59599999999999997,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60299999999999998,"15min":0.56699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.55900000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.57799999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93500000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.746}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.628,"15min":0.58199999999999996},"min":{"1min":0.53400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69199999999999995,"15min":0.64500000000000002},"min":{"1min":0.54300000000000004,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.083,"5min":1.173,"15min":1.173},"last":0.88900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.03,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.501,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.93799999999999994}]},{"osd":9,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.61499999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.82499999999999996},"min":{"1min":0.65600000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.085,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.92400000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.097,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.875,"15min":0.87},"min":{"1min":0.67800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.98799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":501700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":1.278,"15min":1.278},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:04:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77100000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.378}]},{"osd":4,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88500000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.753,"5min":1.387,"15min":1.387},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.373,"15min":0.373},"max":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69499999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61199999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.01,"15min":1.01},"last":0.433}]},{"osd":7,"last update":"Sun Oct 8 13:04:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.996,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0209999999999999,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":0.86599999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76200000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.495}]},{"osd":9,"last update":"Sun Oct 8 13:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80600000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59899999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90800000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.095,"15min":1.095},"last":0.75900000000000001}]},{"osd":11,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80800000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":564173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69199999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83999999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.59499999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.442},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.56299999999999994},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.80100000000000005,"5min":1.375,"15min":1.375},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65300000000000002,"5min":1.72,"15min":1.72},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.496},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90800000000000003,"5min":1.135,"15min":1.135},"last":0.50600000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66800000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0469999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.623}]},{"osd":9,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0289999999999999,"5min":1.169,"15min":1.169},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.028,"5min":1.397,"15min":1.397},"last":0.68100000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.054,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.073,"5min":1.296,"15min":1.296},"last":0.70299999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69099999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":499562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.372,"15min":0.35199999999999998},"min":{"1min":0.28299999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.374,"15min":0.34599999999999997},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.33200000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70199999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.86599999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.099,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.80300000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.085,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82099999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76100000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":504318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.875},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80400000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61699999999999999,"15min":0.58499999999999996},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.621}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:04:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.502,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.51300000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.97799999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94899999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68899999999999995,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.044,"15min":1.044},"last":0.91800000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0409999999999999,"5min":1.071,"15min":1.071},"last":1.0229999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:04:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0669999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.53300000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.95799999999999996}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.081,"5min":1.137,"15min":1.137},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.0409999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0580000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1092320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77300000000000002,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.505,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":1.899,"15min":1.899},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40899999999999997,"15min":0.38500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.35399999999999998},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.495}]},{"osd":3,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.872,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75900000000000001,"5min":2.085,"15min":2.085},"last":0.55900000000000005}]},{"osd":4,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.55600000000000005},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":1.962,"15min":1.962},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.622,"15min":0.59199999999999997},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.41599999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78200000000000003,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79700000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44}]},{"osd":7,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93400000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88500000000000001,"5min":2.113,"15min":2.113},"last":0.38600000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66400000000000003,"15min":0.67300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":2.198,"15min":2.198},"last":0.37},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.51700000000000002}]},{"osd":9,"last update":"Sun Oct 8 13:04:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91200000000000003,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.55100000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91100000000000003,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.50700000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":1.99,"15min":1.99},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:05:18.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T13:05:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:18 smithi060 ceph-mon[103190]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:18.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:18 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:18.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:18 smithi118 ceph-mon[104234]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:05:18.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:18.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:18 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:19.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:19 smithi005 ceph-mon[99496]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:05:19.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:05:19.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:05:19.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:19 smithi060 ceph-mon[103190]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:05:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:05:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:05:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:19.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:19 smithi118 ceph-mon[104234]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:05:19.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:05:19.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:05:19.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:05:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 -- 172.21.15.5:0/837720144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c10d300 msgr2=0x7f726c10f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 --2- 172.21.15.5:0/837720144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c10d300 0x7f726c10f6f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f726400b0a0 tx=0x7f726400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 -- 172.21.15.5:0/837720144 shutdown_connections 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 --2- 172.21.15.5:0/837720144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c10d300 0x7f726c10f6f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 --2- 172.21.15.5:0/837720144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f726c068190 0x7f726c068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 --2- 172.21.15.5:0/837720144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f726c068ab0 0x7f726c10cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.502+0000 7f7273447700 1 -- 172.21.15.5:0/837720144 >> 172.21.15.5:0/837720144 conn(0x7f726c075790 msgr2=0x7f726c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 -- 172.21.15.5:0/837720144 shutdown_connections 2023-10-08T13:05:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 -- 172.21.15.5:0/837720144 wait complete. 2023-10-08T13:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 Processor -- start 2023-10-08T13:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 -- start start 2023-10-08T13:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f726c068190 0x7f726c198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:20.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 0x7f726c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f726c10d300 0x7f726c19d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c19de50 con 0x7f726c068ab0 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c19dfc0 con 0x7f726c068190 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.503+0000 7f7273447700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c19e180 con 0x7f726c10d300 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 0x7f726c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 0x7f726c1994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33454/0 (socket says 172.21.15.5:33454) 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 -- 172.21.15.5:0/1204275139 learned_addr learned my addr 172.21.15.5:0/1204275139 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72719e4700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f726c10d300 0x7f726c19d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72711e3700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f726c068190 0x7f726c198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 -- 172.21.15.5:0/1204275139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f726c10d300 msgr2=0x7f726c19d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f726c10d300 0x7f726c19d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 -- 172.21.15.5:0/1204275139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f726c068190 msgr2=0x7f726c198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f726c068190 0x7f726c198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 -- 172.21.15.5:0/1204275139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009d00 con 0x7f726c068ab0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72709e2700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 0x7f726c1994e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c9b0 tx=0x7f725c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c007b00 con 0x7f726c068ab0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f725c007c60 con 0x7f726c068ab0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c018660 con 0x7f726c068ab0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c19e460 con 0x7f726c068ab0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.504+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c1a5cc0 con 0x7f726c068ab0 2023-10-08T13:05:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.505+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c108520 con 0x7f726c068ab0 2023-10-08T13:05:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.506+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f725c018880 con 0x7f726c068ab0 2023-10-08T13:05:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.507+0000 7f72627fc700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72580a15e0 0x7f72580a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.507+0000 7f72711e3700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72580a15e0 0x7f72580a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.507+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f725c0cd530 con 0x7f726c068ab0 2023-10-08T13:05:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.508+0000 7f72711e3700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72580a15e0 0x7f72580a3aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7268005fd0 tx=0x7f726800a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.511+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f725c096750 con 0x7f726c068ab0 2023-10-08T13:05:20.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.705+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f726c19a260 con 0x7f72580a15e0 2023-10-08T13:05:20.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.720+0000 7f72627fc700 1 -- 172.21.15.5:0/1204275139 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+425962 (secure 0 0 0) 0x7f726c19a260 con 0x7f72580a15e0 2023-10-08T13:05:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:20.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72580a15e0 msgr2=0x7f72580a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72580a15e0 0x7f72580a3aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7268005fd0 tx=0x7f726800a560 comp rx=0 tx=0).stop 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 msgr2=0x7f726c1994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 0x7f726c1994e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c9b0 tx=0x7f725c00cd70 comp rx=0 tx=0).stop 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 shutdown_connections 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72580a15e0 0x7f72580a3aa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f726c10d300 0x7f726c19d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f726c068190 0x7f726c198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 --2- 172.21.15.5:0/1204275139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f726c068ab0 0x7f726c1994e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 >> 172.21.15.5:0/1204275139 conn(0x7f726c075790 msgr2=0x7f726c10e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 shutdown_connections 2023-10-08T13:05:20.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:20.724+0000 7f7273447700 1 -- 172.21.15.5:0/1204275139 wait complete. 2023-10-08T13:05:20.731 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:05:21.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:20 smithi005 ceph-mon[99496]: pgmap v278: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T13:05:21.047 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2023-10-08T13:05:19.103846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656789,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":606,"num_read_kb":428,"num_write":419,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180982,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338272,"kb_used_data":14028,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603552,"statfs":{"total":1151940427776,"available":1151594037248,"internally_reserved":0,"allocated":14364672,"data_stored":7991377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":72,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003331"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205500+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:04:37.205500+0000","last_peered":"2023-10-08T13:04:37.205500+0000","last_clean":"2023-10-08T13:04:37.205500+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:04:37.205500+0000","last_undegraded":"2023-10-08T13:04:37.205500+0000","last_fullsized":"2023-10-08T13:04:37.205500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202223+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:04:37.202223+0000","last_peered":"2023-10-08T13:04:37.202223+0000","last_clean":"2023-10-08T13:04:37.202223+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:37.202223+0000","last_undegraded":"2023-10-08T13:04:37.202223+0000","last_fullsized":"2023-10-08T13:04:37.202223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202091+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:04:37.202091+0000","last_peered":"2023-10-08T13:04:37.202091+0000","last_clean":"2023-10-08T13:04:37.202091+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:04:37.202091+0000","last_undegraded":"2023-10-08T13:04:37.202091+0000","last_fullsized":"2023-10-08T13:04:37.202091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206210+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:04:37.206210+0000","last_peered":"2023-10-08T13:04:37.206210+0000","last_clean":"2023-10-08T13:04:37.206210+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:04:37.206210+0000","last_undegraded":"2023-10-08T13:04:37.206210+0000","last_fullsized":"2023-10-08T13:04:37.206210+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201997+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:04:37.201997+0000","last_peered":"2023-10-08T13:04:37.201997+0000","last_clean":"2023-10-08T13:04:37.201997+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:04:37.201997+0000","last_undegraded":"2023-10-08T13:04:37.201997+0000","last_fullsized":"2023-10-08T13:04:37.201997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.210845+0000","last_change":"2023-10-08T13:04:38.210845+0000","last_active":"2023-10-08T13:04:38.210845+0000","last_peered":"2023-10-08T13:04:38.210845+0000","last_clean":"2023-10-08T13:04:38.210845+0000","last_became_active":"2023-10-08T13:04:38.210454+0000","last_became_peered":"2023-10-08T13:04:38.210454+0000","last_unstale":"2023-10-08T13:04:38.210845+0000","last_undegraded":"2023-10-08T13:04:38.210845+0000","last_fullsized":"2023-10-08T13:04:38.210845+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:10.493230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201680+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:04:37.201680+0000","last_peered":"2023-10-08T13:04:37.201680+0000","last_clean":"2023-10-08T13:04:37.201680+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:04:37.201680+0000","last_undegraded":"2023-10-08T13:04:37.201680+0000","last_fullsized":"2023-10-08T13:04:37.201680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208142+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:04:37.208142+0000","last_peered":"2023-10-08T13:04:37.208142+0000","last_clean":"2023-10-08T13:04:37.208142+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:04:37.208142+0000","last_undegraded":"2023-10-08T13:04:37.208142+0000","last_fullsized":"2023-10-08T13:04:37.208142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208843+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:04:37.208843+0000","last_peered":"2023-10-08T13:04:37.208843+0000","last_clean":"2023-10-08T13:04:37.208843+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:04:37.208843+0000","last_undegraded":"2023-10-08T13:04:37.208843+0000","last_fullsized":"2023-10-08T13:04:37.208843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208796+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:04:37.208796+0000","last_peered":"2023-10-08T13:04:37.208796+0000","last_clean":"2023-10-08T13:04:37.208796+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:04:37.208796+0000","last_undegraded":"2023-10-08T13:04:37.208796+0000","last_fullsized":"2023-10-08T13:04:37.208796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202423+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:04:37.202423+0000","last_peered":"2023-10-08T13:04:37.202423+0000","last_clean":"2023-10-08T13:04:37.202423+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:04:37.202423+0000","last_undegraded":"2023-10-08T13:04:37.202423+0000","last_fullsized":"2023-10-08T13:04:37.202423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206202+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:04:37.206202+0000","last_peered":"2023-10-08T13:04:37.206202+0000","last_clean":"2023-10-08T13:04:37.206202+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:04:37.206202+0000","last_undegraded":"2023-10-08T13:04:37.206202+0000","last_fullsized":"2023-10-08T13:04:37.206202+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.209983+0000","last_change":"2023-10-08T13:04:38.209983+0000","last_active":"2023-10-08T13:04:38.209983+0000","last_peered":"2023-10-08T13:04:38.209983+0000","last_clean":"2023-10-08T13:04:38.209983+0000","last_became_active":"2023-10-08T13:04:38.209572+0000","last_became_peered":"2023-10-08T13:04:38.209572+0000","last_unstale":"2023-10-08T13:04:38.209983+0000","last_undegraded":"2023-10-08T13:04:38.209983+0000","last_fullsized":"2023-10-08T13:04:38.209983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:01.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201771+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:04:37.201771+0000","last_peered":"2023-10-08T13:04:37.201771+0000","last_clean":"2023-10-08T13:04:37.201771+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:04:37.201771+0000","last_undegraded":"2023-10-08T13:04:37.201771+0000","last_fullsized":"2023-10-08T13:04:37.201771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201914+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:04:37.201914+0000","last_peered":"2023-10-08T13:04:37.201914+0000","last_clean":"2023-10-08T13:04:37.201914+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:04:37.201914+0000","last_undegraded":"2023-10-08T13:04:37.201914+0000","last_fullsized":"2023-10-08T13:04:37.201914+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205042+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:04:37.205042+0000","last_peered":"2023-10-08T13:04:37.205042+0000","last_clean":"2023-10-08T13:04:37.205042+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:04:37.205042+0000","last_undegraded":"2023-10-08T13:04:37.205042+0000","last_fullsized":"2023-10-08T13:04:37.205042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204781+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:04:37.204781+0000","last_peered":"2023-10-08T13:04:37.204781+0000","last_clean":"2023-10-08T13:04:37.204781+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:04:37.204781+0000","last_undegraded":"2023-10-08T13:04:37.204781+0000","last_fullsized":"2023-10-08T13:04:37.204781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204962+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:04:37.204962+0000","last_peered":"2023-10-08T13:04:37.204962+0000","last_clean":"2023-10-08T13:04:37.204962+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:04:37.204962+0000","last_undegraded":"2023-10-08T13:04:37.204962+0000","last_fullsized":"2023-10-08T13:04:37.204962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209142+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:04:37.209142+0000","last_peered":"2023-10-08T13:04:37.209142+0000","last_clean":"2023-10-08T13:04:37.209142+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:04:37.209142+0000","last_undegraded":"2023-10-08T13:04:37.209142+0000","last_fullsized":"2023-10-08T13:04:37.209142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209016+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:04:37.209016+0000","last_peered":"2023-10-08T13:04:37.209016+0000","last_clean":"2023-10-08T13:04:37.209016+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:04:37.209016+0000","last_undegraded":"2023-10-08T13:04:37.209016+0000","last_fullsized":"2023-10-08T13:04:37.209016+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:15.218886+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:05:15.218886+0000","last_peered":"2023-10-08T13:05:15.218886+0000","last_clean":"2023-10-08T13:05:15.218886+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:05:15.218886+0000","last_undegraded":"2023-10-08T13:05:15.218886+0000","last_fullsized":"2023-10-08T13:05:15.218886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208675+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:04:37.208675+0000","last_peered":"2023-10-08T13:04:37.208675+0000","last_clean":"2023-10-08T13:04:37.208675+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:04:37.208675+0000","last_undegraded":"2023-10-08T13:04:37.208675+0000","last_fullsized":"2023-10-08T13:04:37.208675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205403+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:04:37.205403+0000","last_peered":"2023-10-08T13:04:37.205403+0000","last_clean":"2023-10-08T13:04:37.205403+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:04:37.205403+0000","last_undegraded":"2023-10-08T13:04:37.205403+0000","last_fullsized":"2023-10-08T13:04:37.205403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208768+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:04:37.208768+0000","last_peered":"2023-10-08T13:04:37.208768+0000","last_clean":"2023-10-08T13:04:37.208768+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:04:37.208768+0000","last_undegraded":"2023-10-08T13:04:37.208768+0000","last_fullsized":"2023-10-08T13:04:37.208768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202014+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:04:37.202014+0000","last_peered":"2023-10-08T13:04:37.202014+0000","last_clean":"2023-10-08T13:04:37.202014+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:04:37.202014+0000","last_undegraded":"2023-10-08T13:04:37.202014+0000","last_fullsized":"2023-10-08T13:04:37.202014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204849+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:04:37.204849+0000","last_peered":"2023-10-08T13:04:37.204849+0000","last_clean":"2023-10-08T13:04:37.204849+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:04:37.204849+0000","last_undegraded":"2023-10-08T13:04:37.204849+0000","last_fullsized":"2023-10-08T13:04:37.204849+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202517+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:04:37.202517+0000","last_peered":"2023-10-08T13:04:37.202517+0000","last_clean":"2023-10-08T13:04:37.202517+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:04:37.202517+0000","last_undegraded":"2023-10-08T13:04:37.202517+0000","last_fullsized":"2023-10-08T13:04:37.202517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208920+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:04:37.208920+0000","last_peered":"2023-10-08T13:04:37.208920+0000","last_clean":"2023-10-08T13:04:37.208920+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:04:37.208920+0000","last_undegraded":"2023-10-08T13:04:37.208920+0000","last_fullsized":"2023-10-08T13:04:37.208920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205438+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:04:37.205438+0000","last_peered":"2023-10-08T13:04:37.205438+0000","last_clean":"2023-10-08T13:04:37.205438+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:04:37.205438+0000","last_undegraded":"2023-10-08T13:04:37.205438+0000","last_fullsized":"2023-10-08T13:04:37.205438+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202151+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:04:37.202151+0000","last_peered":"2023-10-08T13:04:37.202151+0000","last_clean":"2023-10-08T13:04:37.202151+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:04:37.202151+0000","last_undegraded":"2023-10-08T13:04:37.202151+0000","last_fullsized":"2023-10-08T13:04:37.202151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206549+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:04:37.206549+0000","last_peered":"2023-10-08T13:04:37.206549+0000","last_clean":"2023-10-08T13:04:37.206549+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:04:37.206549+0000","last_undegraded":"2023-10-08T13:04:37.206549+0000","last_fullsized":"2023-10-08T13:04:37.206549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208821+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:04:37.208821+0000","last_peered":"2023-10-08T13:04:37.208821+0000","last_clean":"2023-10-08T13:04:37.208821+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:04:37.208821+0000","last_undegraded":"2023-10-08T13:04:37.208821+0000","last_fullsized":"2023-10-08T13:04:37.208821+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:14.218945+0000","last_change":"2023-10-08T13:04:09.752715+0000","last_active":"2023-10-08T13:05:14.218945+0000","last_peered":"2023-10-08T13:05:14.218945+0000","last_clean":"2023-10-08T13:05:14.218945+0000","last_became_active":"2023-10-08T13:04:09.752343+0000","last_became_peered":"2023-10-08T13:04:09.752343+0000","last_unstale":"2023-10-08T13:05:14.218945+0000","last_undegraded":"2023-10-08T13:05:14.218945+0000","last_fullsized":"2023-10-08T13:05:14.218945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:08.548171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202173+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:04:37.202173+0000","last_peered":"2023-10-08T13:04:37.202173+0000","last_clean":"2023-10-08T13:04:37.202173+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:04:37.202173+0000","last_undegraded":"2023-10-08T13:04:37.202173+0000","last_fullsized":"2023-10-08T13:04:37.202173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208800+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:04:37.208800+0000","last_peered":"2023-10-08T13:04:37.208800+0000","last_clean":"2023-10-08T13:04:37.208800+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:04:37.208800+0000","last_undegraded":"2023-10-08T13:04:37.208800+0000","last_fullsized":"2023-10-08T13:04:37.208800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209540+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:04:37.209540+0000","last_peered":"2023-10-08T13:04:37.209540+0000","last_clean":"2023-10-08T13:04:37.209540+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:04:37.209540+0000","last_undegraded":"2023-10-08T13:04:37.209540+0000","last_fullsized":"2023-10-08T13:04:37.209540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206160+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:04:37.206160+0000","last_peered":"2023-10-08T13:04:37.206160+0000","last_clean":"2023-10-08T13:04:37.206160+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:04:37.206160+0000","last_undegraded":"2023-10-08T13:04:37.206160+0000","last_fullsized":"2023-10-08T13:04:37.206160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204686+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:04:37.204686+0000","last_peered":"2023-10-08T13:04:37.204686+0000","last_clean":"2023-10-08T13:04:37.204686+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:04:37.204686+0000","last_undegraded":"2023-10-08T13:04:37.204686+0000","last_fullsized":"2023-10-08T13:04:37.204686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208990+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:04:37.208990+0000","last_peered":"2023-10-08T13:04:37.208990+0000","last_clean":"2023-10-08T13:04:37.208990+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:04:37.208990+0000","last_undegraded":"2023-10-08T13:04:37.208990+0000","last_fullsized":"2023-10-08T13:04:37.208990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208324+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:04:37.208324+0000","last_peered":"2023-10-08T13:04:37.208324+0000","last_clean":"2023-10-08T13:04:37.208324+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:04:37.208324+0000","last_undegraded":"2023-10-08T13:04:37.208324+0000","last_fullsized":"2023-10-08T13:04:37.208324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202117+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:04:37.202117+0000","last_peered":"2023-10-08T13:04:37.202117+0000","last_clean":"2023-10-08T13:04:37.202117+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:04:37.202117+0000","last_undegraded":"2023-10-08T13:04:37.202117+0000","last_fullsized":"2023-10-08T13:04:37.202117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206208+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:04:37.206208+0000","last_peered":"2023-10-08T13:04:37.206208+0000","last_clean":"2023-10-08T13:04:37.206208+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:04:37.206208+0000","last_undegraded":"2023-10-08T13:04:37.206208+0000","last_fullsized":"2023-10-08T13:04:37.206208+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204291+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:04:37.204291+0000","last_peered":"2023-10-08T13:04:37.204291+0000","last_clean":"2023-10-08T13:04:37.204291+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:04:37.204291+0000","last_undegraded":"2023-10-08T13:04:37.204291+0000","last_fullsized":"2023-10-08T13:04:37.204291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.210011+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:04:37.210011+0000","last_peered":"2023-10-08T13:04:37.210011+0000","last_clean":"2023-10-08T13:04:37.210011+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:04:37.210011+0000","last_undegraded":"2023-10-08T13:04:37.210011+0000","last_fullsized":"2023-10-08T13:04:37.210011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":111,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:17.222350+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:05:17.222350+0000","last_peered":"2023-10-08T13:05:17.222350+0000","last_clean":"2023-10-08T13:05:17.222350+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:05:17.222350+0000","last_undegraded":"2023-10-08T13:05:17.222350+0000","last_fullsized":"2023-10-08T13:05:17.222350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208845+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:04:37.208845+0000","last_peered":"2023-10-08T13:04:37.208845+0000","last_clean":"2023-10-08T13:04:37.208845+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:04:37.208845+0000","last_undegraded":"2023-10-08T13:04:37.208845+0000","last_fullsized":"2023-10-08T13:04:37.208845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204003+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:04:37.204003+0000","last_peered":"2023-10-08T13:04:37.204003+0000","last_clean":"2023-10-08T13:04:37.204003+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:04:37.204003+0000","last_undegraded":"2023-10-08T13:04:37.204003+0000","last_fullsized":"2023-10-08T13:04:37.204003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202110+0000","last_change":"2023-10-08T13:04:09.754360+0000","last_active":"2023-10-08T13:04:37.202110+0000","last_peered":"2023-10-08T13:04:37.202110+0000","last_clean":"2023-10-08T13:04:37.202110+0000","last_became_active":"2023-10-08T13:04:09.754047+0000","last_became_peered":"2023-10-08T13:04:09.754047+0000","last_unstale":"2023-10-08T13:04:37.202110+0000","last_undegraded":"2023-10-08T13:04:37.202110+0000","last_fullsized":"2023-10-08T13:04:37.202110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:11.616693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202109+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:04:37.202109+0000","last_peered":"2023-10-08T13:04:37.202109+0000","last_clean":"2023-10-08T13:04:37.202109+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:04:37.202109+0000","last_undegraded":"2023-10-08T13:04:37.202109+0000","last_fullsized":"2023-10-08T13:04:37.202109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.220707+0000","last_change":"2023-10-08T13:04:38.220707+0000","last_active":"2023-10-08T13:04:38.220707+0000","last_peered":"2023-10-08T13:04:38.220707+0000","last_clean":"2023-10-08T13:04:38.220707+0000","last_became_active":"2023-10-08T13:04:38.215253+0000","last_became_peered":"2023-10-08T13:04:38.215253+0000","last_unstale":"2023-10-08T13:04:38.220707+0000","last_undegraded":"2023-10-08T13:04:38.220707+0000","last_fullsized":"2023-10-08T13:04:38.220707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:15.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206614+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:04:37.206614+0000","last_peered":"2023-10-08T13:04:37.206614+0000","last_clean":"2023-10-08T13:04:37.206614+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:04:37.206614+0000","last_undegraded":"2023-10-08T13:04:37.206614+0000","last_fullsized":"2023-10-08T13:04:37.206614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.214872+0000","last_change":"2023-10-08T13:04:38.214872+0000","last_active":"2023-10-08T13:04:38.214872+0000","last_peered":"2023-10-08T13:04:38.214872+0000","last_clean":"2023-10-08T13:04:38.214872+0000","last_became_active":"2023-10-08T13:04:38.214480+0000","last_became_peered":"2023-10-08T13:04:38.214480+0000","last_unstale":"2023-10-08T13:04:38.214872+0000","last_undegraded":"2023-10-08T13:04:38.214872+0000","last_fullsized":"2023-10-08T13:04:38.214872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:05.108568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204567+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:04:37.204567+0000","last_peered":"2023-10-08T13:04:37.204567+0000","last_clean":"2023-10-08T13:04:37.204567+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:04:37.204567+0000","last_undegraded":"2023-10-08T13:04:37.204567+0000","last_fullsized":"2023-10-08T13:04:37.204567+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":148,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:17.222405+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:05:17.222405+0000","last_peered":"2023-10-08T13:05:17.222405+0000","last_clean":"2023-10-08T13:05:17.222405+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:05:17.222405+0000","last_undegraded":"2023-10-08T13:05:17.222405+0000","last_fullsized":"2023-10-08T13:05:17.222405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58583,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":104,"num_write":36,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202270+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:04:37.202270+0000","last_peered":"2023-10-08T13:04:37.202270+0000","last_clean":"2023-10-08T13:04:37.202270+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:04:37.202270+0000","last_undegraded":"2023-10-08T13:04:37.202270+0000","last_fullsized":"2023-10-08T13:04:37.202270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206895+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:04:37.206895+0000","last_peered":"2023-10-08T13:04:37.206895+0000","last_clean":"2023-10-08T13:04:37.206895+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:04:37.206895+0000","last_undegraded":"2023-10-08T13:04:37.206895+0000","last_fullsized":"2023-10-08T13:04:37.206895+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208978+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:04:37.208978+0000","last_peered":"2023-10-08T13:04:37.208978+0000","last_clean":"2023-10-08T13:04:37.208978+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:04:37.208978+0000","last_undegraded":"2023-10-08T13:04:37.208978+0000","last_fullsized":"2023-10-08T13:04:37.208978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208777+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:04:37.208777+0000","last_peered":"2023-10-08T13:04:37.208777+0000","last_clean":"2023-10-08T13:04:37.208777+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:04:37.208777+0000","last_undegraded":"2023-10-08T13:04:37.208777+0000","last_fullsized":"2023-10-08T13:04:37.208777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204589+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:04:37.204589+0000","last_peered":"2023-10-08T13:04:37.204589+0000","last_clean":"2023-10-08T13:04:37.204589+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:04:37.204589+0000","last_undegraded":"2023-10-08T13:04:37.204589+0000","last_fullsized":"2023-10-08T13:04:37.204589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206416+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:04:37.206416+0000","last_peered":"2023-10-08T13:04:37.206416+0000","last_clean":"2023-10-08T13:04:37.206416+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:04:37.206416+0000","last_undegraded":"2023-10-08T13:04:37.206416+0000","last_fullsized":"2023-10-08T13:04:37.206416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201867+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:04:37.201867+0000","last_peered":"2023-10-08T13:04:37.201867+0000","last_clean":"2023-10-08T13:04:37.201867+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:04:37.201867+0000","last_undegraded":"2023-10-08T13:04:37.201867+0000","last_fullsized":"2023-10-08T13:04:37.201867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205056+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:04:37.205056+0000","last_peered":"2023-10-08T13:04:37.205056+0000","last_clean":"2023-10-08T13:04:37.205056+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:04:37.205056+0000","last_undegraded":"2023-10-08T13:04:37.205056+0000","last_fullsized":"2023-10-08T13:04:37.205056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:13.217079+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:05:13.217079+0000","last_peered":"2023-10-08T13:05:13.217079+0000","last_clean":"2023-10-08T13:05:13.217079+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:05:13.217079+0000","last_undegraded":"2023-10-08T13:05:13.217079+0000","last_fullsized":"2023-10-08T13:05:13.217079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201708+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:04:37.201708+0000","last_peered":"2023-10-08T13:04:37.201708+0000","last_clean":"2023-10-08T13:04:37.201708+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:04:37.201708+0000","last_undegraded":"2023-10-08T13:04:37.201708+0000","last_fullsized":"2023-10-08T13:04:37.201708+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208333+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:04:37.208333+0000","last_peered":"2023-10-08T13:04:37.208333+0000","last_clean":"2023-10-08T13:04:37.208333+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:04:37.208333+0000","last_undegraded":"2023-10-08T13:04:37.208333+0000","last_fullsized":"2023-10-08T13:04:37.208333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201912+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:04:37.201912+0000","last_peered":"2023-10-08T13:04:37.201912+0000","last_clean":"2023-10-08T13:04:37.201912+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:04:37.201912+0000","last_undegraded":"2023-10-08T13:04:37.201912+0000","last_fullsized":"2023-10-08T13:04:37.201912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213791+0000","last_change":"2023-10-08T13:04:38.213542+0000","last_active":"2023-10-08T13:04:38.213791+0000","last_peered":"2023-10-08T13:04:38.213791+0000","last_clean":"2023-10-08T13:04:38.213791+0000","last_became_active":"2023-10-08T13:04:38.213218+0000","last_became_peered":"2023-10-08T13:04:38.213218+0000","last_unstale":"2023-10-08T13:04:38.213791+0000","last_undegraded":"2023-10-08T13:04:38.213791+0000","last_fullsized":"2023-10-08T13:04:38.213791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:51.125175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205975+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:04:37.205975+0000","last_peered":"2023-10-08T13:04:37.205975+0000","last_clean":"2023-10-08T13:04:37.205975+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:04:37.205975+0000","last_undegraded":"2023-10-08T13:04:37.205975+0000","last_fullsized":"2023-10-08T13:04:37.205975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202517+0000","last_change":"2023-10-08T13:04:09.753810+0000","last_active":"2023-10-08T13:04:37.202517+0000","last_peered":"2023-10-08T13:04:37.202517+0000","last_clean":"2023-10-08T13:04:37.202517+0000","last_became_active":"2023-10-08T13:04:09.753497+0000","last_became_peered":"2023-10-08T13:04:09.753497+0000","last_unstale":"2023-10-08T13:04:37.202517+0000","last_undegraded":"2023-10-08T13:04:37.202517+0000","last_fullsized":"2023-10-08T13:04:37.202517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:11.309476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205365+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:04:37.205365+0000","last_peered":"2023-10-08T13:04:37.205365+0000","last_clean":"2023-10-08T13:04:37.205365+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:04:37.205365+0000","last_undegraded":"2023-10-08T13:04:37.205365+0000","last_fullsized":"2023-10-08T13:04:37.205365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.215172+0000","last_change":"2023-10-08T13:04:38.215172+0000","last_active":"2023-10-08T13:04:38.215172+0000","last_peered":"2023-10-08T13:04:38.215172+0000","last_clean":"2023-10-08T13:04:38.215172+0000","last_became_active":"2023-10-08T13:04:38.214666+0000","last_became_peered":"2023-10-08T13:04:38.214666+0000","last_unstale":"2023-10-08T13:04:38.215172+0000","last_undegraded":"2023-10-08T13:04:38.215172+0000","last_fullsized":"2023-10-08T13:04:38.215172+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:45.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205182+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:04:37.205182+0000","last_peered":"2023-10-08T13:04:37.205182+0000","last_clean":"2023-10-08T13:04:37.205182+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:04:37.205182+0000","last_undegraded":"2023-10-08T13:04:37.205182+0000","last_fullsized":"2023-10-08T13:04:37.205182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208628+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:04:37.208628+0000","last_peered":"2023-10-08T13:04:37.208628+0000","last_clean":"2023-10-08T13:04:37.208628+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:04:37.208628+0000","last_undegraded":"2023-10-08T13:04:37.208628+0000","last_fullsized":"2023-10-08T13:04:37.208628+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208190+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:04:37.208190+0000","last_peered":"2023-10-08T13:04:37.208190+0000","last_clean":"2023-10-08T13:04:37.208190+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:04:37.208190+0000","last_undegraded":"2023-10-08T13:04:37.208190+0000","last_fullsized":"2023-10-08T13:04:37.208190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:17.222244+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:05:17.222244+0000","last_peered":"2023-10-08T13:05:17.222244+0000","last_clean":"2023-10-08T13:05:17.222244+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:05:17.222244+0000","last_undegraded":"2023-10-08T13:05:17.222244+0000","last_fullsized":"2023-10-08T13:05:17.222244+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208321+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:04:37.208321+0000","last_peered":"2023-10-08T13:04:37.208321+0000","last_clean":"2023-10-08T13:04:37.208321+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:04:37.208321+0000","last_undegraded":"2023-10-08T13:04:37.208321+0000","last_fullsized":"2023-10-08T13:04:37.208321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208547+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:04:37.208547+0000","last_peered":"2023-10-08T13:04:37.208547+0000","last_clean":"2023-10-08T13:04:37.208547+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:04:37.208547+0000","last_undegraded":"2023-10-08T13:04:37.208547+0000","last_fullsized":"2023-10-08T13:04:37.208547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213418+0000","last_change":"2023-10-08T13:04:38.213418+0000","last_active":"2023-10-08T13:04:38.213418+0000","last_peered":"2023-10-08T13:04:38.213418+0000","last_clean":"2023-10-08T13:04:38.213418+0000","last_became_active":"2023-10-08T13:04:38.213000+0000","last_became_peered":"2023-10-08T13:04:38.213000+0000","last_unstale":"2023-10-08T13:04:38.213418+0000","last_undegraded":"2023-10-08T13:04:38.213418+0000","last_fullsized":"2023-10-08T13:04:38.213418+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:20.821412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:16.220319+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:05:16.220319+0000","last_peered":"2023-10-08T13:05:16.220319+0000","last_clean":"2023-10-08T13:05:16.220319+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:05:16.220319+0000","last_undegraded":"2023-10-08T13:05:16.220319+0000","last_fullsized":"2023-10-08T13:05:16.220319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.218150+0000","last_change":"2023-10-08T13:04:38.218150+0000","last_active":"2023-10-08T13:04:38.218150+0000","last_peered":"2023-10-08T13:04:38.218150+0000","last_clean":"2023-10-08T13:04:38.218150+0000","last_became_active":"2023-10-08T13:04:38.210481+0000","last_became_peered":"2023-10-08T13:04:38.210481+0000","last_unstale":"2023-10-08T13:04:38.218150+0000","last_undegraded":"2023-10-08T13:04:38.218150+0000","last_fullsized":"2023-10-08T13:04:38.218150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:42.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208975+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:04:37.208975+0000","last_peered":"2023-10-08T13:04:37.208975+0000","last_clean":"2023-10-08T13:04:37.208975+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:04:37.208975+0000","last_undegraded":"2023-10-08T13:04:37.208975+0000","last_fullsized":"2023-10-08T13:04:37.208975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205043+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:04:37.205043+0000","last_peered":"2023-10-08T13:04:37.205043+0000","last_clean":"2023-10-08T13:04:37.205043+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:04:37.205043+0000","last_undegraded":"2023-10-08T13:04:37.205043+0000","last_fullsized":"2023-10-08T13:04:37.205043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":323,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201566+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:04:37.201566+0000","last_peered":"2023-10-08T13:04:37.201566+0000","last_clean":"2023-10-08T13:04:37.201566+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:04:37.201566+0000","last_undegraded":"2023-10-08T13:04:37.201566+0000","last_fullsized":"2023-10-08T13:04:37.201566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205300+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:04:37.205300+0000","last_peered":"2023-10-08T13:04:37.205300+0000","last_clean":"2023-10-08T13:04:37.205300+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:04:37.205300+0000","last_undegraded":"2023-10-08T13:04:37.205300+0000","last_fullsized":"2023-10-08T13:04:37.205300+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208863+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:04:37.208863+0000","last_peered":"2023-10-08T13:04:37.208863+0000","last_clean":"2023-10-08T13:04:37.208863+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:04:37.208863+0000","last_undegraded":"2023-10-08T13:04:37.208863+0000","last_fullsized":"2023-10-08T13:04:37.208863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201704+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:04:37.201704+0000","last_peered":"2023-10-08T13:04:37.201704+0000","last_clean":"2023-10-08T13:04:37.201704+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:04:37.201704+0000","last_undegraded":"2023-10-08T13:04:37.201704+0000","last_fullsized":"2023-10-08T13:04:37.201704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204625+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:04:37.204625+0000","last_peered":"2023-10-08T13:04:37.204625+0000","last_clean":"2023-10-08T13:04:37.204625+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:04:37.204625+0000","last_undegraded":"2023-10-08T13:04:37.204625+0000","last_fullsized":"2023-10-08T13:04:37.204625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202452+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:04:37.202452+0000","last_peered":"2023-10-08T13:04:37.202452+0000","last_clean":"2023-10-08T13:04:37.202452+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:04:37.202452+0000","last_undegraded":"2023-10-08T13:04:37.202452+0000","last_fullsized":"2023-10-08T13:04:37.202452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208330+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:04:37.208330+0000","last_peered":"2023-10-08T13:04:37.208330+0000","last_clean":"2023-10-08T13:04:37.208330+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:04:37.208330+0000","last_undegraded":"2023-10-08T13:04:37.208330+0000","last_fullsized":"2023-10-08T13:04:37.208330+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208237+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:04:37.208237+0000","last_peered":"2023-10-08T13:04:37.208237+0000","last_clean":"2023-10-08T13:04:37.208237+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:04:37.208237+0000","last_undegraded":"2023-10-08T13:04:37.208237+0000","last_fullsized":"2023-10-08T13:04:37.208237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.851514+0000","last_change":"2023-10-08T13:04:09.752541+0000","last_active":"2023-10-08T13:04:38.851514+0000","last_peered":"2023-10-08T13:04:38.851514+0000","last_clean":"2023-10-08T13:04:38.851514+0000","last_became_active":"2023-10-08T13:04:09.751993+0000","last_became_peered":"2023-10-08T13:04:09.751993+0000","last_unstale":"2023-10-08T13:04:38.851514+0000","last_undegraded":"2023-10-08T13:04:38.851514+0000","last_fullsized":"2023-10-08T13:04:38.851514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:02.681384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208950+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:04:37.208950+0000","last_peered":"2023-10-08T13:04:37.208950+0000","last_clean":"2023-10-08T13:04:37.208950+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:04:37.208950+0000","last_undegraded":"2023-10-08T13:04:37.208950+0000","last_fullsized":"2023-10-08T13:04:37.208950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208410+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:04:37.208410+0000","last_peered":"2023-10-08T13:04:37.208410+0000","last_clean":"2023-10-08T13:04:37.208410+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:04:37.208410+0000","last_undegraded":"2023-10-08T13:04:37.208410+0000","last_fullsized":"2023-10-08T13:04:37.208410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205929+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:04:37.205929+0000","last_peered":"2023-10-08T13:04:37.205929+0000","last_clean":"2023-10-08T13:04:37.205929+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:04:37.205929+0000","last_undegraded":"2023-10-08T13:04:37.205929+0000","last_fullsized":"2023-10-08T13:04:37.205929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202211+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:04:37.202211+0000","last_peered":"2023-10-08T13:04:37.202211+0000","last_clean":"2023-10-08T13:04:37.202211+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:04:37.202211+0000","last_undegraded":"2023-10-08T13:04:37.202211+0000","last_fullsized":"2023-10-08T13:04:37.202211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205279+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:37.205279+0000","last_peered":"2023-10-08T13:04:37.205279+0000","last_clean":"2023-10-08T13:04:37.205279+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:04:37.205279+0000","last_undegraded":"2023-10-08T13:04:37.205279+0000","last_fullsized":"2023-10-08T13:04:37.205279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205153+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:04:37.205153+0000","last_peered":"2023-10-08T13:04:37.205153+0000","last_clean":"2023-10-08T13:04:37.205153+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:04:37.205153+0000","last_undegraded":"2023-10-08T13:04:37.205153+0000","last_fullsized":"2023-10-08T13:04:37.205153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201902+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:04:37.201902+0000","last_peered":"2023-10-08T13:04:37.201902+0000","last_clean":"2023-10-08T13:04:37.201902+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:04:37.201902+0000","last_undegraded":"2023-10-08T13:04:37.201902+0000","last_fullsized":"2023-10-08T13:04:37.201902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205217+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:04:37.205217+0000","last_peered":"2023-10-08T13:04:37.205217+0000","last_clean":"2023-10-08T13:04:37.205217+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:04:37.205217+0000","last_undegraded":"2023-10-08T13:04:37.205217+0000","last_fullsized":"2023-10-08T13:04:37.205217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209904+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:04:37.209904+0000","last_peered":"2023-10-08T13:04:37.209904+0000","last_clean":"2023-10-08T13:04:37.209904+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:04:37.209904+0000","last_undegraded":"2023-10-08T13:04:37.209904+0000","last_fullsized":"2023-10-08T13:04:37.209904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204414+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:04:37.204414+0000","last_peered":"2023-10-08T13:04:37.204414+0000","last_clean":"2023-10-08T13:04:37.204414+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:04:37.204414+0000","last_undegraded":"2023-10-08T13:04:37.204414+0000","last_fullsized":"2023-10-08T13:04:37.204414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213883+0000","last_change":"2023-10-08T13:04:38.213883+0000","last_active":"2023-10-08T13:04:38.213883+0000","last_peered":"2023-10-08T13:04:38.213883+0000","last_clean":"2023-10-08T13:04:38.213883+0000","last_became_active":"2023-10-08T13:04:38.212887+0000","last_became_peered":"2023-10-08T13:04:38.212887+0000","last_unstale":"2023-10-08T13:04:38.213883+0000","last_undegraded":"2023-10-08T13:04:38.213883+0000","last_fullsized":"2023-10-08T13:04:38.213883+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:14.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208606+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:04:37.208606+0000","last_peered":"2023-10-08T13:04:37.208606+0000","last_clean":"2023-10-08T13:04:37.208606+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:04:37.208606+0000","last_undegraded":"2023-10-08T13:04:37.208606+0000","last_fullsized":"2023-10-08T13:04:37.208606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208693+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:04:37.208693+0000","last_peered":"2023-10-08T13:04:37.208693+0000","last_clean":"2023-10-08T13:04:37.208693+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:04:37.208693+0000","last_undegraded":"2023-10-08T13:04:37.208693+0000","last_fullsized":"2023-10-08T13:04:37.208693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205045+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:04:37.205045+0000","last_peered":"2023-10-08T13:04:37.205045+0000","last_clean":"2023-10-08T13:04:37.205045+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:04:37.205045+0000","last_undegraded":"2023-10-08T13:04:37.205045+0000","last_fullsized":"2023-10-08T13:04:37.205045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202094+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:04:37.202094+0000","last_peered":"2023-10-08T13:04:37.202094+0000","last_clean":"2023-10-08T13:04:37.202094+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:04:37.202094+0000","last_undegraded":"2023-10-08T13:04:37.202094+0000","last_fullsized":"2023-10-08T13:04:37.202094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202125+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:04:37.202125+0000","last_peered":"2023-10-08T13:04:37.202125+0000","last_clean":"2023-10-08T13:04:37.202125+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:04:37.202125+0000","last_undegraded":"2023-10-08T13:04:37.202125+0000","last_fullsized":"2023-10-08T13:04:37.202125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208125+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:04:37.208125+0000","last_peered":"2023-10-08T13:04:37.208125+0000","last_clean":"2023-10-08T13:04:37.208125+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:04:37.208125+0000","last_undegraded":"2023-10-08T13:04:37.208125+0000","last_fullsized":"2023-10-08T13:04:37.208125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:05:14.225287+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:05:14.225287+0000","last_peered":"2023-10-08T13:05:14.225287+0000","last_clean":"2023-10-08T13:05:14.225287+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:05:14.225287+0000","last_undegraded":"2023-10-08T13:05:14.225287+0000","last_fullsized":"2023-10-08T13:05:14.225287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202540+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:04:37.202540+0000","last_peered":"2023-10-08T13:04:37.202540+0000","last_clean":"2023-10-08T13:04:37.202540+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:04:37.202540+0000","last_undegraded":"2023-10-08T13:04:37.202540+0000","last_fullsized":"2023-10-08T13:04:37.202540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.201758+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:04:37.201758+0000","last_peered":"2023-10-08T13:04:37.201758+0000","last_clean":"2023-10-08T13:04:37.201758+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:04:37.201758+0000","last_undegraded":"2023-10-08T13:04:37.201758+0000","last_fullsized":"2023-10-08T13:04:37.201758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.206650+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:04:37.206650+0000","last_peered":"2023-10-08T13:04:37.206650+0000","last_clean":"2023-10-08T13:04:37.206650+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:04:37.206650+0000","last_undegraded":"2023-10-08T13:04:37.206650+0000","last_fullsized":"2023-10-08T13:04:37.206650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202162+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:04:37.202162+0000","last_peered":"2023-10-08T13:04:37.202162+0000","last_clean":"2023-10-08T13:04:37.202162+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:04:37.202162+0000","last_undegraded":"2023-10-08T13:04:37.202162+0000","last_fullsized":"2023-10-08T13:04:37.202162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204935+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:04:37.204935+0000","last_peered":"2023-10-08T13:04:37.204935+0000","last_clean":"2023-10-08T13:04:37.204935+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:04:37.204935+0000","last_undegraded":"2023-10-08T13:04:37.204935+0000","last_fullsized":"2023-10-08T13:04:37.204935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208437+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:04:37.208437+0000","last_peered":"2023-10-08T13:04:37.208437+0000","last_clean":"2023-10-08T13:04:37.208437+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:04:37.208437+0000","last_undegraded":"2023-10-08T13:04:37.208437+0000","last_fullsized":"2023-10-08T13:04:37.208437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202563+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:04:37.202563+0000","last_peered":"2023-10-08T13:04:37.202563+0000","last_clean":"2023-10-08T13:04:37.202563+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:04:37.202563+0000","last_undegraded":"2023-10-08T13:04:37.202563+0000","last_fullsized":"2023-10-08T13:04:37.202563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.204511+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:04:37.204511+0000","last_peered":"2023-10-08T13:04:37.204511+0000","last_clean":"2023-10-08T13:04:37.204511+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:04:37.204511+0000","last_undegraded":"2023-10-08T13:04:37.204511+0000","last_fullsized":"2023-10-08T13:04:37.204511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209161+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:04:37.209161+0000","last_peered":"2023-10-08T13:04:37.209161+0000","last_clean":"2023-10-08T13:04:37.209161+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:04:37.209161+0000","last_undegraded":"2023-10-08T13:04:37.209161+0000","last_fullsized":"2023-10-08T13:04:37.209161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208457+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:04:37.208457+0000","last_peered":"2023-10-08T13:04:37.208457+0000","last_clean":"2023-10-08T13:04:37.208457+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:04:37.208457+0000","last_undegraded":"2023-10-08T13:04:37.208457+0000","last_fullsized":"2023-10-08T13:04:37.208457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.202131+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:04:37.202131+0000","last_peered":"2023-10-08T13:04:37.202131+0000","last_clean":"2023-10-08T13:04:37.202131+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:04:37.202131+0000","last_undegraded":"2023-10-08T13:04:37.202131+0000","last_fullsized":"2023-10-08T13:04:37.202131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208418+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:04:37.208418+0000","last_peered":"2023-10-08T13:04:37.208418+0000","last_clean":"2023-10-08T13:04:37.208418+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:04:37.208418+0000","last_undegraded":"2023-10-08T13:04:37.208418+0000","last_fullsized":"2023-10-08T13:04:37.208418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205236+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:04:37.205236+0000","last_peered":"2023-10-08T13:04:37.205236+0000","last_clean":"2023-10-08T13:04:37.205236+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:04:37.205236+0000","last_undegraded":"2023-10-08T13:04:37.205236+0000","last_fullsized":"2023-10-08T13:04:37.205236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209183+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:04:37.209183+0000","last_peered":"2023-10-08T13:04:37.209183+0000","last_clean":"2023-10-08T13:04:37.209183+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:04:37.209183+0000","last_undegraded":"2023-10-08T13:04:37.209183+0000","last_fullsized":"2023-10-08T13:04:37.209183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.209116+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:04:37.209116+0000","last_peered":"2023-10-08T13:04:37.209116+0000","last_clean":"2023-10-08T13:04:37.209116+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:04:37.209116+0000","last_undegraded":"2023-10-08T13:04:37.209116+0000","last_fullsized":"2023-10-08T13:04:37.209116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205186+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:04:37.205186+0000","last_peered":"2023-10-08T13:04:37.205186+0000","last_clean":"2023-10-08T13:04:37.205186+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:04:37.205186+0000","last_undegraded":"2023-10-08T13:04:37.205186+0000","last_fullsized":"2023-10-08T13:04:37.205186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:04:38.213639+0000","last_change":"2023-10-08T13:04:38.213278+0000","last_active":"2023-10-08T13:04:38.213639+0000","last_peered":"2023-10-08T13:04:38.213639+0000","last_clean":"2023-10-08T13:04:38.213639+0000","last_became_active":"2023-10-08T13:04:38.213016+0000","last_became_peered":"2023-10-08T13:04:38.213016+0000","last_unstale":"2023-10-08T13:04:38.213639+0000","last_undegraded":"2023-10-08T13:04:38.213639+0000","last_fullsized":"2023-10-08T13:04:38.213639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:49.650606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208454+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:04:37.208454+0000","last_peered":"2023-10-08T13:04:37.208454+0000","last_clean":"2023-10-08T13:04:37.208454+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:04:37.208454+0000","last_undegraded":"2023-10-08T13:04:37.208454+0000","last_fullsized":"2023-10-08T13:04:37.208454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.208753+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:04:37.208753+0000","last_peered":"2023-10-08T13:04:37.208753+0000","last_clean":"2023-10-08T13:04:37.208753+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:04:37.208753+0000","last_undegraded":"2023-10-08T13:04:37.208753+0000","last_fullsized":"2023-10-08T13:04:37.208753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:04:37.205036+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:04:37.205036+0000","last_peered":"2023-10-08T13:04:37.205036+0000","last_clean":"2023-10-08T13:04:37.205036+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:04:37.205036+0000","last_undegraded":"2023-10-08T13:04:37.205036+0000","last_fullsized":"2023-10-08T13:04:37.205036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66175,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":470,"num_read_kb":309,"num_write":236,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":504810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.748}]},{"osd":8,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.69999999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.76200000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65800000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1708032,"data_stored":1150209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.39300000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":1.456,"15min":1.456},"last":0.40699999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.383,"15min":1.383},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93400000000000005,"5min":1.085,"15min":1.085},"last":6.0999999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.439},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":1.337,"15min":1.337},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.58799999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.623},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.88700000000000001},"min":{"1min":0.66900000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98899999999999999,"5min":1.637,"15min":1.637},"last":0.60399999999999998}]},{"osd":9,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.89100000000000001},"min":{"1min":0.68999999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1459999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.627,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.748,"15min":1.748},"last":0.63700000000000001}]},{"osd":11,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":6.0780000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":6.1289999999999996}]}]},{"osd":9,"up_from":66,"seq":283467841570,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":504350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.441,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.52500000000000002,"5min":0.625,"15min":0.625},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.55100000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.29699999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.751,"5min":0.875,"15min":0.875},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.76400000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.82799999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.62,"15min":0.627},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.48399999999999999,"15min":0.49299999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52200000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70499999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79000000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82499999999999996,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.71299999999999997,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81899999999999995,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.5},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79200000000000004,"15min":0.80800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.016},"last":0.61499999999999999}]},{"osd":8,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.95799999999999996,"5min":1.123,"15min":1.123},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86699999999999999,"5min":1.109,"15min":1.109},"last":0.625}]},{"osd":10,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.871,"5min":1.095,"15min":1.095},"last":0.70399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":8,"up_from":58,"seq":249108103206,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":508493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69999999999999996,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.752,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.501,"15min":0.502},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.373}]},{"osd":3,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80600000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.127},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.32600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.81999999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.90700000000000003,"5min":1.127,"15min":1.127},"last":0.45800000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":1.048,"15min":1.048},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.877,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73399999999999999,"15min":0.73299999999999998},"min":{"1min":0.54700000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:04:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95299999999999996,"5min":1.202,"15min":1.202},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92500000000000004,"5min":1.01,"15min":1.01},"last":0.56999999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.64500000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.77500000000000002,"15min":0.75700000000000001},"min":{"1min":0.69799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0189999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63700000000000001}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.628},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1626112,"data_stored":1097245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42199999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84599999999999997,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.498}]},{"osd":5,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.66200000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.629},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81100000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.748},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0049999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.58399999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.998,"5min":1.23,"15min":1.23},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.73299999999999998}]},{"osd":9,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.53900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0349999999999999,"5min":1.266,"15min":1.266},"last":0.90200000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.871}]},{"osd":11,"last update":"Sun Oct 8 13:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.006},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.0289999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495663,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":500244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.747,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.438},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.40300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.379,"15min":0.379},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64200000000000002,"15min":0.622},"min":{"1min":0.49199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94199999999999995,"5min":1.075,"15min":1.075},"last":0.67200000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.48699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80300000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.02,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.79000000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77900000000000003,"15min":0.78000000000000003},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.89000000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81599999999999995},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.123,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71699999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.753}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.77400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":563953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.59599999999999997,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59599999999999997,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60299999999999998,"15min":0.56699999999999995},"min":{"1min":0.498,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.46600000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.55900000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67600000000000005,"15min":0.66000000000000003},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.57799999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93500000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.746}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.628,"15min":0.58199999999999996},"min":{"1min":0.53400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69199999999999995,"15min":0.64500000000000002},"min":{"1min":0.54300000000000004,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.083,"5min":1.173,"15min":1.173},"last":0.88900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.497,"5min":0.432,"15min":0.432},"max":{"1min":1.03,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.501,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.93799999999999994}]},{"osd":9,"last update":"Sun Oct 8 13:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.61499999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.83199999999999996,"15min":0.82499999999999996},"min":{"1min":0.65600000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.085,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.92400000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.097,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.875,"15min":0.87},"min":{"1min":0.67800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.98799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":501700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":1.278,"15min":1.278},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77100000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83199999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60699999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88500000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.753,"5min":1.387,"15min":1.387},"last":0.627}]},{"osd":5,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.373,"15min":0.373},"max":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.745},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69499999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57499999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.35299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.70799999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78900000000000003,"5min":1.01,"15min":1.01},"last":0.65000000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77900000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.65600000000000003},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76200000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81699999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.628,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80600000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.84999999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90800000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.88},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.095,"15min":1.095},"last":0.68400000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:04:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.91000000000000003}]}]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":564173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69199999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83999999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.59499999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.75700000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.442},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.56299999999999994},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.80100000000000005,"5min":1.375,"15min":1.375},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65300000000000002,"5min":1.72,"15min":1.72},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.38800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.496},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90800000000000003,"5min":1.135,"15min":1.135},"last":0.50600000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66800000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0469999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.623}]},{"osd":9,"last update":"Sun Oct 8 13:04:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0289999999999999,"5min":1.169,"15min":1.169},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.028,"5min":1.397,"15min":1.397},"last":0.68100000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.054,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.073,"5min":1.296,"15min":1.296},"last":0.70299999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69099999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":499562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.372,"15min":0.35199999999999998},"min":{"1min":0.28299999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.374,"15min":0.34599999999999997},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.33200000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70199999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.86599999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:04:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77500000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.099,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0269999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.80300000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.085,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82099999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76100000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":504318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.875},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80400000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61699999999999999,"15min":0.58499999999999996},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.621}]},{"osd":5,"last update":"Sun Oct 8 13:04:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69199999999999995,"15min":0.68200000000000005},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:04:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.502,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.51300000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.97799999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94899999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68899999999999995,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.044,"15min":1.044},"last":0.91800000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0409999999999999,"5min":1.071,"15min":1.071},"last":1.0229999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:04:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0669999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.53300000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.95799999999999996}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.081,"5min":1.137,"15min":1.137},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":1.0409999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0580000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1092320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.38,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77300000000000002,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.505,"15min":0.48199999999999998},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":1.899,"15min":1.899},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88300000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40899999999999997,"15min":0.38500000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.35399999999999998},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.495}]},{"osd":3,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.872,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75900000000000001,"5min":2.085,"15min":2.085},"last":0.55900000000000005}]},{"osd":4,"last update":"Sun Oct 8 13:04:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.55600000000000005},"min":{"1min":0.443,"5min":0.38,"15min":0.38},"max":{"1min":0.84799999999999998,"5min":1.962,"15min":1.962},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.622,"15min":0.59199999999999997},"min":{"1min":0.45400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.41599999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78200000000000003,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79700000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44}]},{"osd":7,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93400000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88500000000000001,"5min":2.113,"15min":2.113},"last":0.38600000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:04:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66400000000000003,"15min":0.67300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":2.198,"15min":2.198},"last":0.37},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.51700000000000002}]},{"osd":9,"last update":"Sun Oct 8 13:04:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91200000000000003,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.55100000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91100000000000003,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.50700000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":1.99,"15min":1.99},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:05:21.057 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-08T13:05:21.058 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T13:05:21.058 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-08T13:05:21.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-08T13:05:21.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:20 smithi060 ceph-mon[103190]: pgmap v278: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T13:05:21.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:20 smithi118 ceph-mon[104234]: pgmap v278: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T13:05:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:22.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:21 smithi060 ceph-mon[103190]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:05:22.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:21 smithi005 ceph-mon[99496]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:05:22.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:21 smithi118 ceph-mon[104234]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:05:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 -- 172.21.15.5:0/757561190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94641068e0 msgr2=0x7f9464106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 --2- 172.21.15.5:0/757561190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94641068e0 0x7f9464106cc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94540099c0 tx=0x7f9454009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 -- 172.21.15.5:0/757561190 shutdown_connections 2023-10-08T13:05:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 --2- 172.21.15.5:0/757561190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94640698a0 0x7f946410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 --2- 172.21.15.5:0/757561190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94641068e0 0x7f9464106cc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:22.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 --2- 172.21.15.5:0/757561190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9464068ee0 0x7f9464069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 -- 172.21.15.5:0/757561190 >> 172.21.15.5:0/757561190 conn(0x7f94640765b0 msgr2=0x7f94640769c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 -- 172.21.15.5:0/757561190 shutdown_connections 2023-10-08T13:05:22.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 -- 172.21.15.5:0/757561190 wait complete. 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.967+0000 7f946a4bd700 1 Processor -- start 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 -- start start 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 0x7f94640ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94640698a0 0x7f94640fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641068e0 0x7f9464100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641a4f40 con 0x7f9464068ee0 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641a50b0 con 0x7f94641068e0 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f946a4bd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641a5270 con 0x7f94640698a0 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 0x7f94640ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:22.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 0x7f94640ffaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33466/0 (socket says 172.21.15.5:33466) 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 -- 172.21.15.5:0/1017753219 learned_addr learned my addr 172.21.15.5:0/1017753219 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f94637fe700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94640698a0 0x7f94640fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9468a5a700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641068e0 0x7f9464100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 -- 172.21.15.5:0/1017753219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94640698a0 msgr2=0x7f94640fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94640698a0 0x7f94640fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 -- 172.21.15.5:0/1017753219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641068e0 msgr2=0x7f9464100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641068e0 0x7f9464100520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9463fff700 1 -- 172.21.15.5:0/1017753219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94540095f0 con 0x7f9464068ee0 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.968+0000 7f9468a5a700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641068e0 0x7f9464100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.969+0000 7f9463fff700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 0x7f94640ffaa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f945400b580 tx=0x7f9454005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:22.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.969+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945401d070 con 0x7f9464068ee0 2023-10-08T13:05:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.969+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94641a54f0 con 0x7f9464068ee0 2023-10-08T13:05:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.969+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f945400fc30 con 0x7f9464068ee0 2023-10-08T13:05:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.969+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454022df0 con 0x7f9464068ee0 2023-10-08T13:05:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.969+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94641a5910 con 0x7f9464068ee0 2023-10-08T13:05:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.970+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464108db0 con 0x7f9464068ee0 2023-10-08T13:05:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.971+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9454022500 con 0x7f9464068ee0 2023-10-08T13:05:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.971+0000 7f94617fa700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f944c0a1560 0x7f944c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.972+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f94540ce650 con 0x7f9464068ee0 2023-10-08T13:05:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.972+0000 7f94637fe700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f944c0a1560 0x7f944c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.972+0000 7f94637fe700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f944c0a1560 0x7f944c0a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94641011d0 tx=0x7f945800b5b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:22.975+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9454097840 con 0x7f9464068ee0 2023-10-08T13:05:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:22 smithi060 ceph-mon[103190]: pgmap v279: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:23.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:22 smithi005 ceph-mon[99496]: pgmap v279: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:23.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.222+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9464101f80 con 0x7f9464068ee0 2023-10-08T13:05:23.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.222+0000 7f94617fa700 1 -- 172.21.15.5:0/1017753219 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f945409ae60 con 0x7f9464068ee0 2023-10-08T13:05:23.223 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:23.224 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T13:05:23.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.224+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f944c0a1560 msgr2=0x7f944c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.224+0000 7f946a4bd700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f944c0a1560 0x7f944c0a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94641011d0 tx=0x7f945800b5b0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.224+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 msgr2=0x7f94640ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.224+0000 7f946a4bd700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 0x7f94640ffaa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f945400b580 tx=0x7f9454005e80 comp rx=0 tx=0).stop 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 shutdown_connections 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f944c0a1560 0x7f944c0a3a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641068e0 0x7f9464100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9464068ee0 0x7f94640ffaa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 --2- 172.21.15.5:0/1017753219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94640698a0 0x7f94640fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 >> 172.21.15.5:0/1017753219 conn(0x7f94640765b0 msgr2=0x7f94640fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 shutdown_connections 2023-10-08T13:05:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.225+0000 7f946a4bd700 1 -- 172.21.15.5:0/1017753219 wait complete. 2023-10-08T13:05:23.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:22 smithi118 ceph-mon[104234]: pgmap v279: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:23.699 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-08T13:05:23.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 -- 172.21.15.5:0/38474355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 msgr2=0x7f70640ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 --2- 172.21.15.5:0/38474355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f70640ff9d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f70500099c0 tx=0x7f7050009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 -- 172.21.15.5:0/38474355 shutdown_connections 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 --2- 172.21.15.5:0/38474355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70640fff10 0x7f706410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 --2- 172.21.15.5:0/38474355 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7064105610 0x7f70641059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 --2- 172.21.15.5:0/38474355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f70640ff9d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 -- 172.21.15.5:0/38474355 >> 172.21.15.5:0/38474355 conn(0x7f70640fb040 msgr2=0x7f70640fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:23.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 -- 172.21.15.5:0/38474355 shutdown_connections 2023-10-08T13:05:23.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.830+0000 7f706adac700 1 -- 172.21.15.5:0/38474355 wait complete. 2023-10-08T13:05:23.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 Processor -- start 2023-10-08T13:05:23.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 -- start start 2023-10-08T13:05:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f706419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70640fff10 0x7f706419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064105610 0x7f70641967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064196e30 con 0x7f70640ff550 2023-10-08T13:05:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064196fa0 con 0x7f7064105610 2023-10-08T13:05:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f706adac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7064197160 con 0x7f70640fff10 2023-10-08T13:05:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f706419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f706419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33478/0 (socket says 172.21.15.5:33478) 2023-10-08T13:05:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 -- 172.21.15.5:0/3544240870 learned_addr learned my addr 172.21.15.5:0/3544240870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7069349700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064105610 0x7f70641967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:23.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 -- 172.21.15.5:0/3544240870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70640fff10 msgr2=0x7f706419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70640fff10 0x7f706419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 -- 172.21.15.5:0/3544240870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064105610 msgr2=0x7f70641967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064105610 0x7f70641967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7068b48700 1 -- 172.21.15.5:0/3544240870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500095f0 con 0x7f70640ff550 2023-10-08T13:05:23.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.831+0000 7f7069349700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064105610 0x7f70641967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.832+0000 7f7068b48700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f706419c690 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f705800c9b0 tx=0x7f705800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.832+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058007b00 con 0x7f70640ff550 2023-10-08T13:05:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.832+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7058007c60 con 0x7f70640ff550 2023-10-08T13:05:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.832+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064197440 con 0x7f70640ff550 2023-10-08T13:05:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.832+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058018660 con 0x7f70640ff550 2023-10-08T13:05:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.832+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70641a3680 con 0x7f70640ff550 2023-10-08T13:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.833+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7064100c70 con 0x7f70640ff550 2023-10-08T13:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.834+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f7058018880 con 0x7f70640ff550 2023-10-08T13:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.834+0000 7f7061ffb700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f70540a15e0 0x7f70540a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.835+0000 7f7063fff700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f70540a15e0 0x7f70540a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.835+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f70580cd330 con 0x7f70640ff550 2023-10-08T13:05:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.835+0000 7f7063fff700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f70540a15e0 0x7f70540a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7050009fd0 tx=0x7f7050000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:23.839+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f70580963e0 con 0x7f70640ff550 2023-10-08T13:05:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.047+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7064067550 con 0x7f70640ff550 2023-10-08T13:05:24.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.048+0000 7f7061ffb700 1 -- 172.21.15.5:0/3544240870 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24639 (secure 0 0 0) 0x7f7058099a00 con 0x7f70640ff550 2023-10-08T13:05:24.050 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:24.050 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:38.199053+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f70540a15e0 msgr2=0x7f70540a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f70540a15e0 0x7f70540a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7050009fd0 tx=0x7f7050000bc0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 msgr2=0x7f706419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f706419c690 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f705800c9b0 tx=0x7f705800cd70 comp rx=0 tx=0).stop 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 shutdown_connections 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f70540a15e0 0x7f70540a3aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064105610 0x7f70641967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70640ff550 0x7f706419c690 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 --2- 172.21.15.5:0/3544240870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70640fff10 0x7f706419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 >> 172.21.15.5:0/3544240870 conn(0x7f70640fb040 msgr2=0x7f70641036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:24.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 shutdown_connections 2023-10-08T13:05:24.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.051+0000 7f706adac700 1 -- 172.21.15.5:0/3544240870 wait complete. 2023-10-08T13:05:24.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:05:24.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:05:24.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:23 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1017753219' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T13:05:24.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:23 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1017753219' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T13:05:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 -- 172.21.15.5:0/1401367706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 msgr2=0x7f71c410c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/1401367706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c410c3b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00b0d0 tx=0x7f71bc00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 -- 172.21.15.5:0/1401367706 shutdown_connections 2023-10-08T13:05:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/1401367706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c410c3b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/1401367706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c41055f0 0x7f71c41059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/1401367706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c40ff530 0x7f71c40ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 -- 172.21.15.5:0/1401367706 >> 172.21.15.5:0/1401367706 conn(0x7f71c40fafc0 msgr2=0x7f71c40fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 -- 172.21.15.5:0/1401367706 shutdown_connections 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.196+0000 7f71ca4b1700 1 -- 172.21.15.5:0/1401367706 wait complete. 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.197+0000 7f71ca4b1700 1 Processor -- start 2023-10-08T13:05:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.197+0000 7f71ca4b1700 1 -- start start 2023-10-08T13:05:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ff530 0x7f71c419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c41055f0 0x7f71c4195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4195ec0 con 0x7f71c40ffef0 2023-10-08T13:05:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4196030 con 0x7f71c40ff530 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41961f0 con 0x7f71c41055f0 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c419bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33494/0 (socket says 172.21.15.5:33494) 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 -- 172.21.15.5:0/3065253925 learned_addr learned my addr 172.21.15.5:0/3065253925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c3fff700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ff530 0x7f71c419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c8a4e700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c41055f0 0x7f71c4195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 -- 172.21.15.5:0/3065253925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c41055f0 msgr2=0x7f71c4195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c41055f0 0x7f71c4195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 -- 172.21.15.5:0/3065253925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ff530 msgr2=0x7f71c419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ff530 0x7f71c419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 -- 172.21.15.5:0/3065253925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009d00 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c37fe700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c419bc60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e9a0 tx=0x7f71b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4009790 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c41964d0 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71b4010430 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4018680 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.198+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c41a2710 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.199+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4107a90 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.201+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f71b40105a0 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.201+0000 7f71c17fa700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71ac0a1560 0x7f71ac0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.201+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f71b4014070 con 0x7f71c40ffef0 2023-10-08T13:05:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.201+0000 7f71c3fff700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71ac0a1560 0x7f71ac0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.202+0000 7f71c3fff700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71ac0a1560 0x7f71ac0a3a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009c60 tx=0x7f71b8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.205+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71b4096790 con 0x7f71c40ffef0 2023-10-08T13:05:24.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:23 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1017753219' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T13:05:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.406+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71c4196d10 con 0x7f71c40ffef0 2023-10-08T13:05:24.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.406+0000 7f71c17fa700 1 -- 172.21.15.5:0/3065253925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71b40260a0 con 0x7f71c40ffef0 2023-10-08T13:05:24.407 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:05:24.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71ac0a1560 msgr2=0x7f71ac0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71ac0a1560 0x7f71ac0a3a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009c60 tx=0x7f71b8009260 comp rx=0 tx=0).stop 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 msgr2=0x7f71c419bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c419bc60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e9a0 tx=0x7f71b400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 shutdown_connections 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71ac0a1560 0x7f71ac0a3a20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71c41055f0 0x7f71c4195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ff530 0x7f71c419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 --2- 172.21.15.5:0/3065253925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71c40ffef0 0x7f71c419bc60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.408+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 >> 172.21.15.5:0/3065253925 conn(0x7f71c40fafc0 msgr2=0x7f71c40fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:24.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.409+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 shutdown_connections 2023-10-08T13:05:24.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.409+0000 7f71ca4b1700 1 -- 172.21.15.5:0/3065253925 wait complete. 2023-10-08T13:05:24.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:05:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 -- 172.21.15.5:0/4085172422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c0ff570 msgr2=0x7f0f1c0ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 --2- 172.21.15.5:0/4085172422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c0ff570 0x7f0f1c0ff9f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0f180099c0 tx=0x7f0f18009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 -- 172.21.15.5:0/4085172422 shutdown_connections 2023-10-08T13:05:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 --2- 172.21.15.5:0/4085172422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1c0fff30 0x7f0f1c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 --2- 172.21.15.5:0/4085172422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c105630 0x7f0f1c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 --2- 172.21.15.5:0/4085172422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c0ff570 0x7f0f1c0ff9f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 -- 172.21.15.5:0/4085172422 >> 172.21.15.5:0/4085172422 conn(0x7f0f1c0fb020 msgr2=0x7f0f1c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 -- 172.21.15.5:0/4085172422 shutdown_connections 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.551+0000 7f0f239b0700 1 -- 172.21.15.5:0/4085172422 wait complete. 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 Processor -- start 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 -- start start 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1c0ff570 0x7f0f1c1011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0fff30 0x7f0f1c101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 0x7f0f1c101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c1a4f30 con 0x7f0f1c105630 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c1a50a0 con 0x7f0f1c0fff30 2023-10-08T13:05:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f239b0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c1a5260 con 0x7f0f1c0ff570 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 0x7f0f1c101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 0x7f0f1c101c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33510/0 (socket says 172.21.15.5:33510) 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 -- 172.21.15.5:0/1633978951 learned_addr learned my addr 172.21.15.5:0/1633978951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f2174c700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1c0ff570 0x7f0f1c1011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f20f4b700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0fff30 0x7f0f1c101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 -- 172.21.15.5:0/1633978951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1c0ff570 msgr2=0x7f0f1c1011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1c0ff570 0x7f0f1c1011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 -- 172.21.15.5:0/1633978951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0fff30 msgr2=0x7f0f1c101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0fff30 0x7f0f1c101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 -- 172.21.15.5:0/1633978951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180095f0 con 0x7f0f1c105630 2023-10-08T13:05:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.552+0000 7f0f21f4d700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 0x7f0f1c101c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0f14007ee0 tx=0x7f0f1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.553+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14017070 con 0x7f0f1c105630 2023-10-08T13:05:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.553+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f1400f040 con 0x7f0f1c105630 2023-10-08T13:05:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.553+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c1a5540 con 0x7f0f1c105630 2023-10-08T13:05:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.553+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14005580 con 0x7f0f1c105630 2023-10-08T13:05:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.553+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c1a5a70 con 0x7f0f1c105630 2023-10-08T13:05:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.554+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c100c90 con 0x7f0f1c105630 2023-10-08T13:05:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.555+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f0f1400db20 con 0x7f0f1c105630 2023-10-08T13:05:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.555+0000 7f0f127fc700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f080a15e0 0x7f0f080a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.556+0000 7f0f2174c700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f080a15e0 0x7f0f080a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.556+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0f140cd000 con 0x7f0f1c105630 2023-10-08T13:05:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.556+0000 7f0f2174c700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f080a15e0 0x7f0f080a3aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005950 tx=0x7f0f0c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:24.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.559+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0f14096110 con 0x7f0f1c105630 2023-10-08T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.761+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f1c066cc0 con 0x7f0f1c105630 2023-10-08T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.761+0000 7f0f127fc700 1 -- 172.21.15.5:0/1633978951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f14099730 con 0x7f0f1c105630 2023-10-08T13:05:24.763 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f080a15e0 msgr2=0x7f0f080a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f080a15e0 0x7f0f080a3aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005950 tx=0x7f0f0c00b410 comp rx=0 tx=0).stop 2023-10-08T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 msgr2=0x7f0f1c101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 0x7f0f1c101c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0f14007ee0 tx=0x7f0f1400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 shutdown_connections 2023-10-08T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f080a15e0 0x7f0f080a3aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f1c105630 0x7f0f1c101c80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1c0ff570 0x7f0f1c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 --2- 172.21.15.5:0/1633978951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0fff30 0x7f0f1c101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 >> 172.21.15.5:0/1633978951 conn(0x7f0f1c0fb020 msgr2=0x7f0f1c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 shutdown_connections 2023-10-08T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.764+0000 7f0f239b0700 1 -- 172.21.15.5:0/1633978951 wait complete. 2023-10-08T13:05:24.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:05:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 -- 172.21.15.5:0/3808620689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa478105750 msgr2=0x7fa478105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/3808620689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa478105750 0x7fa478105b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa468009990 tx=0x7fa468009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 -- 172.21.15.5:0/3808620689 shutdown_connections 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/3808620689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4781009f0 0x7fa47810c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/3808620689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa478105750 0x7fa478105b30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/3808620689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa478100030 0x7fa4781004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 -- 172.21.15.5:0/3808620689 >> 172.21.15.5:0/3808620689 conn(0x7fa4780748d0 msgr2=0x7fa478074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 -- 172.21.15.5:0/3808620689 shutdown_connections 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.905+0000 7fa47d2cb700 1 -- 172.21.15.5:0/3808620689 wait complete. 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 Processor -- start 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 -- start start 2023-10-08T13:05:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478100030 0x7fa4781978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 0x7fa478197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa478105750 0x7fa4781a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781986d0 con 0x7fa4781009f0 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781a2eb0 con 0x7fa478100030 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.906+0000 7fa47d2cb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781a2ff0 con 0x7fa478105750 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 0x7fa478197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 0x7fa478197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33522/0 (socket says 172.21.15.5:33522) 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 -- 172.21.15.5:0/2267788544 learned_addr learned my addr 172.21.15.5:0/2267788544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4777fe700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa478105750 0x7fa4781a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa476ffd700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478100030 0x7fa4781978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 -- 172.21.15.5:0/2267788544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa478105750 msgr2=0x7fa4781a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa478105750 0x7fa4781a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 -- 172.21.15.5:0/2267788544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478100030 msgr2=0x7fa4781978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478100030 0x7fa4781978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 -- 172.21.15.5:0/2267788544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680095f0 con 0x7fa4781009f0 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa4767fc700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 0x7fa478197e30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00d9b0 tx=0x7fa46c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c004220 con 0x7fa4781009f0 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa46c007640 con 0x7fa4781009f0 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4781a32a0 con 0x7fa4781009f0 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c005590 con 0x7fa4781009f0 2023-10-08T13:05:24.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.907+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4781a3800 con 0x7fa4781009f0 2023-10-08T13:05:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.908+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478107aa0 con 0x7fa4781009f0 2023-10-08T13:05:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.909+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fa46c004750 con 0x7fa4781009f0 2023-10-08T13:05:24.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.910+0000 7fa45ffff700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa4600a15e0 0x7fa4600a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.910+0000 7fa476ffd700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa4600a15e0 0x7fa4600a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.910+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa46c0ccfa0 con 0x7fa4781009f0 2023-10-08T13:05:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.911+0000 7fa476ffd700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa4600a15e0 0x7fa4600a3aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b5c0 tx=0x7fa468005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:24.915+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa46c0960b0 con 0x7fa4781009f0 2023-10-08T13:05:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.117+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4780ff490 con 0x7fa4781009f0 2023-10-08T13:05:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.118+0000 7fa45ffff700 1 -- 172.21.15.5:0/2267788544 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa46c016020 con 0x7fa4781009f0 2023-10-08T13:05:25.119 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:05:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa4600a15e0 msgr2=0x7fa4600a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa4600a15e0 0x7fa4600a3aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b5c0 tx=0x7fa468005960 comp rx=0 tx=0).stop 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 msgr2=0x7fa478197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 0x7fa478197e30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00d9b0 tx=0x7fa46c00dcc0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 shutdown_connections 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa4600a15e0 0x7fa4600a3aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa478105750 0x7fa4781a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478100030 0x7fa4781978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 --2- 172.21.15.5:0/2267788544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4781009f0 0x7fa478197e30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 >> 172.21.15.5:0/2267788544 conn(0x7fa4780748d0 msgr2=0x7fa4780fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 shutdown_connections 2023-10-08T13:05:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.120+0000 7fa47d2cb700 1 -- 172.21.15.5:0/2267788544 wait complete. 2023-10-08T13:05:25.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:24 smithi005 ceph-mon[99496]: pgmap v280: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T13:05:25.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:24 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3544240870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:25.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:24 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3065253925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:25.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:24 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1633978951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:25.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:05:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:24 smithi060 ceph-mon[103190]: pgmap v280: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T13:05:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:24 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3544240870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:24 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3065253925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:25.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:24 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1633978951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 -- 172.21.15.5:0/1480913462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ff530 msgr2=0x7efc080ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 --2- 172.21.15.5:0/1480913462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ff530 0x7efc080ff9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0099c0 tx=0x7efbfc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 -- 172.21.15.5:0/1480913462 shutdown_connections 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 --2- 172.21.15.5:0/1480913462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc080ffef0 0x7efc0810c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 --2- 172.21.15.5:0/1480913462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc081055f0 0x7efc081059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 --2- 172.21.15.5:0/1480913462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ff530 0x7efc080ff9b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 -- 172.21.15.5:0/1480913462 >> 172.21.15.5:0/1480913462 conn(0x7efc080fafc0 msgr2=0x7efc080fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 -- 172.21.15.5:0/1480913462 shutdown_connections 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.263+0000 7efc0f58c700 1 -- 172.21.15.5:0/1480913462 wait complete. 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 Processor -- start 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 -- start start 2023-10-08T13:05:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc080ff530 0x7efc0819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 0x7efc0819bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc081055f0 0x7efc08195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08195dd0 con 0x7efc080ffef0 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08195f40 con 0x7efc080ff530 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0f58c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08196100 con 0x7efc081055f0 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0cb27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 0x7efc0819bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0cb27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 0x7efc0819bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33532/0 (socket says 172.21.15.5:33532) 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0cb27700 1 -- 172.21.15.5:0/137095711 learned_addr learned my addr 172.21.15.5:0/137095711 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0d328700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc080ff530 0x7efc0819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.264+0000 7efc0db29700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc081055f0 0x7efc08195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0cb27700 1 -- 172.21.15.5:0/137095711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc081055f0 msgr2=0x7efc08195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0cb27700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc081055f0 0x7efc08195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0cb27700 1 -- 172.21.15.5:0/137095711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc080ff530 msgr2=0x7efc0819b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0cb27700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc080ff530 0x7efc0819b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0cb27700 1 -- 172.21.15.5:0/137095711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0095f0 con 0x7efc080ffef0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0cb27700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 0x7efc0819bb80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0098e0 tx=0x7efbfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc01d070 con 0x7efc080ffef0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbfc00fbb0 con 0x7efc080ffef0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc022d40 con 0x7efc080ffef0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc08196380 con 0x7efc080ffef0 2023-10-08T13:05:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.265+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc081a2630 con 0x7efc080ffef0 2023-10-08T13:05:25.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:24 smithi118 ceph-mon[104234]: pgmap v280: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T13:05:25.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:24 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3544240870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:25.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:24 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3065253925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:25.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:24 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1633978951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.266+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc08107a90 con 0x7efc080ffef0 2023-10-08T13:05:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.267+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efbfc00fd20 con 0x7efc080ffef0 2023-10-08T13:05:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.267+0000 7efbfa7fc700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efbf40a1560 0x7efbf40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.268+0000 7efc0d328700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efbf40a1560 0x7efbf40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.268+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7efbfc0ce6a0 con 0x7efc080ffef0 2023-10-08T13:05:25.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.268+0000 7efc0d328700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efbf40a1560 0x7efbf40a3a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc04005950 tx=0x7efc040058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.272+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efbfc097900 con 0x7efc080ffef0 2023-10-08T13:05:25.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.473+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc08067550 con 0x7efc080ffef0 2023-10-08T13:05:25.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.474+0000 7efbfa7fc700 1 -- 172.21.15.5:0/137095711 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7efbfc027020 con 0x7efc080ffef0 2023-10-08T13:05:25.475 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efbf40a1560 msgr2=0x7efbf40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efbf40a1560 0x7efbf40a3a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc04005950 tx=0x7efc040058e0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 msgr2=0x7efc0819bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 0x7efc0819bb80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0098e0 tx=0x7efbfc0057f0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 shutdown_connections 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efbf40a1560 0x7efbf40a3a20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc081055f0 0x7efc08195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc080ff530 0x7efc0819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 --2- 172.21.15.5:0/137095711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc080ffef0 0x7efc0819bb80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 >> 172.21.15.5:0/137095711 conn(0x7efc080fafc0 msgr2=0x7efc080fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 shutdown_connections 2023-10-08T13:05:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.476+0000 7efc0f58c700 1 -- 172.21.15.5:0/137095711 wait complete. 2023-10-08T13:05:25.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 -- 172.21.15.5:0/626538147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300ff550 msgr2=0x7f06300ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 --2- 172.21.15.5:0/626538147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300ff550 0x7f06300ff9d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f06240099c0 tx=0x7f0624009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 -- 172.21.15.5:0/626538147 shutdown_connections 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 --2- 172.21.15.5:0/626538147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06300fff10 0x7f063010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 --2- 172.21.15.5:0/626538147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0630105610 0x7f06301059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 --2- 172.21.15.5:0/626538147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300ff550 0x7f06300ff9d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 -- 172.21.15.5:0/626538147 >> 172.21.15.5:0/626538147 conn(0x7f06300fb040 msgr2=0x7f06300fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 -- 172.21.15.5:0/626538147 shutdown_connections 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.615+0000 7f0636606700 1 -- 172.21.15.5:0/626538147 wait complete. 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 Processor -- start 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 -- start start 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06300ff550 0x7f0630197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 0x7f0630197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0630105610 0x7f06301a2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630198600 con 0x7f06300fff10 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301a2dc0 con 0x7f06300ff550 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f0636606700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301a2f00 con 0x7f0630105610 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f062f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 0x7f0630197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f062f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 0x7f0630197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33546/0 (socket says 172.21.15.5:33546) 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f062f7fe700 1 -- 172.21.15.5:0/3502473231 learned_addr learned my addr 172.21.15.5:0/3502473231 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.616+0000 7f062ffff700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06300ff550 0x7f0630197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f0634ba3700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0630105610 0x7f06301a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062f7fe700 1 -- 172.21.15.5:0/3502473231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0630105610 msgr2=0x7f06301a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062f7fe700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0630105610 0x7f06301a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062f7fe700 1 -- 172.21.15.5:0/3502473231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06300ff550 msgr2=0x7f0630197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062f7fe700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06300ff550 0x7f0630197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062f7fe700 1 -- 172.21.15.5:0/3502473231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240095f0 con 0x7f06300fff10 2023-10-08T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062f7fe700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 0x7f0630197d40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f062400b580 tx=0x7f0624005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062401d070 con 0x7f06300fff10 2023-10-08T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06301a3120 con 0x7f06300fff10 2023-10-08T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f062400fc30 con 0x7f06300fff10 2023-10-08T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624022d40 con 0x7f06300fff10 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.617+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06301a3550 con 0x7f06300fff10 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.618+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630107ab0 con 0x7f06300fff10 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.619+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f0624022470 con 0x7f06300fff10 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.620+0000 7f062d7fa700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f06180a1560 0x7f06180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.620+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f06240ced70 con 0x7f06300fff10 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.620+0000 7f062ffff700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f06180a1560 0x7f06180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.620+0000 7f062ffff700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f06180a1560 0x7f06180a3a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0620005ea0 tx=0x7f0620005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:25.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.623+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0624097f10 con 0x7f06300fff10 2023-10-08T13:05:25.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.877+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0630067f50 con 0x7f06300fff10 2023-10-08T13:05:25.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.878+0000 7f062d7fa700 1 -- 172.21.15.5:0/3502473231 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7f062409b530 con 0x7f06300fff10 2023-10-08T13:05:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:25.879 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:05:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f06180a1560 msgr2=0x7f06180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f06180a1560 0x7f06180a3a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0620005ea0 tx=0x7f0620005e30 comp rx=0 tx=0).stop 2023-10-08T13:05:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 msgr2=0x7f0630197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 0x7f0630197d40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f062400b580 tx=0x7f0624005ef0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 shutdown_connections 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f06180a1560 0x7f06180a3a20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0630105610 0x7f06301a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06300ff550 0x7f0630197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 --2- 172.21.15.5:0/3502473231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06300fff10 0x7f0630197d40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 >> 172.21.15.5:0/3502473231 conn(0x7f06300fb040 msgr2=0x7f06300fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 shutdown_connections 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:25.880+0000 7f0636606700 1 -- 172.21.15.5:0/3502473231 wait complete. 2023-10-08T13:05:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:05:25.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 -- 172.21.15.5:0/3822229205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0105610 msgr2=0x7f0fa01059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/3822229205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0105610 0x7f0fa01059f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0f900099c0 tx=0x7f0f90009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 -- 172.21.15.5:0/3822229205 shutdown_connections 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/3822229205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa00fff10 0x7f0fa010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/3822229205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0105610 0x7f0fa01059f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/3822229205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fa00ff550 0x7f0fa00ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 -- 172.21.15.5:0/3822229205 >> 172.21.15.5:0/3822229205 conn(0x7f0fa00fb040 msgr2=0x7f0fa00fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 -- 172.21.15.5:0/3822229205 shutdown_connections 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.019+0000 7f0fa6a41700 1 -- 172.21.15.5:0/3822229205 wait complete. 2023-10-08T13:05:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 Processor -- start 2023-10-08T13:05:26.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 -- start start 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fa00ff550 0x7f0fa010e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 0x7f0fa010ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105610 0x7f0fa010f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01a4e20 con 0x7f0fa00fff10 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01a4f90 con 0x7f0fa0105610 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa6a41700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01a5150 con 0x7f0fa00ff550 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 0x7f0fa010ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 0x7f0fa010ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33560/0 (socket says 172.21.15.5:33560) 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 -- 172.21.15.5:0/1915322555 learned_addr learned my addr 172.21.15.5:0/1915322555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0fa4fde700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105610 0x7f0fa010f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9ffff700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fa00ff550 0x7f0fa010e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 -- 172.21.15.5:0/1915322555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fa00ff550 msgr2=0x7f0fa010e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fa00ff550 0x7f0fa010e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 -- 172.21.15.5:0/1915322555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105610 msgr2=0x7f0fa010f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105610 0x7f0fa010f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.020+0000 7f0f9f7fe700 1 -- 172.21.15.5:0/1915322555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900095f0 con 0x7f0fa00fff10 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0fa4fde700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105610 0x7f0fa010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0f9f7fe700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 0x7f0fa010ecf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400e9a0 tx=0x7f0f9400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94009790 con 0x7f0fa00fff10 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa01a5430 con 0x7f0fa00fff10 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f9400cbd0 con 0x7f0fa00fff10 2023-10-08T13:05:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94018680 con 0x7f0fa00fff10 2023-10-08T13:05:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.021+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01a5940 con 0x7f0fa00fff10 2023-10-08T13:05:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.022+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa01108d0 con 0x7f0fa00fff10 2023-10-08T13:05:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.023+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f0f9400cd40 con 0x7f0fa00fff10 2023-10-08T13:05:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.023+0000 7f0f9d7fa700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f880a1560 0x7f0f880a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.024+0000 7f0f9ffff700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f880a1560 0x7f0f880a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.024+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0f94014070 con 0x7f0fa00fff10 2023-10-08T13:05:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.024+0000 7f0f9ffff700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f880a1560 0x7f0f880a3a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.028+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0fa01108d0 con 0x7f0fa00fff10 2023-10-08T13:05:26.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2267788544' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:26.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:25 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/137095711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:26.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2267788544' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:26.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:25 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/137095711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.232+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fa01108d0 con 0x7f0fa00fff10 2023-10-08T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.234+0000 7f0f9d7fa700 1 -- 172.21.15.5:0/1915322555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24639 (secure 0 0 0) 0x7f0fa01108d0 con 0x7f0fa00fff10 2023-10-08T13:05:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:26.235 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:38.199053+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f880a1560 msgr2=0x7f0f880a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f880a1560 0x7f0f880a3a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90005fb0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 msgr2=0x7f0fa010ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 0x7f0fa010ecf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400e9a0 tx=0x7f0f9400ed60 comp rx=0 tx=0).stop 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 shutdown_connections 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0f880a1560 0x7f0f880a3a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105610 0x7f0fa010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fa00ff550 0x7f0fa010e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 --2- 172.21.15.5:0/1915322555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa00fff10 0x7f0fa010ecf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 >> 172.21.15.5:0/1915322555 conn(0x7f0fa00fb040 msgr2=0x7f0fa00fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 shutdown_connections 2023-10-08T13:05:26.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.236+0000 7f0fa6a41700 1 -- 172.21.15.5:0/1915322555 wait complete. 2023-10-08T13:05:26.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:05:26.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:05:26.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2267788544' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:26.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:25 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/137095711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:26.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 -- 172.21.15.5:0/2537908337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ff530 msgr2=0x7fedcc0ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 --2- 172.21.15.5:0/2537908337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ff530 0x7fedcc0ff9b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0099c0 tx=0x7fedbc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 -- 172.21.15.5:0/2537908337 shutdown_connections 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 --2- 172.21.15.5:0/2537908337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ffef0 0x7fedcc10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 --2- 172.21.15.5:0/2537908337 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedcc1055f0 0x7fedcc1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 --2- 172.21.15.5:0/2537908337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ff530 0x7fedcc0ff9b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 -- 172.21.15.5:0/2537908337 >> 172.21.15.5:0/2537908337 conn(0x7fedcc0fafc0 msgr2=0x7fedcc0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 -- 172.21.15.5:0/2537908337 shutdown_connections 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.379+0000 7fedd188a700 1 -- 172.21.15.5:0/2537908337 wait complete. 2023-10-08T13:05:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 Processor -- start 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 -- start start 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ff530 0x7fedcc1011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 0x7fedcc1016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedcc1055f0 0x7fedcc101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1a4dd0 con 0x7fedcc0ffef0 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1a4f40 con 0x7fedcc0ff530 2023-10-08T13:05:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedd188a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1a5100 con 0x7fedcc1055f0 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 0x7fedcc1016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 0x7fedcc1016e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33574/0 (socket says 172.21.15.5:33574) 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 -- 172.21.15.5:0/888048925 learned_addr learned my addr 172.21.15.5:0/888048925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedcaffd700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ff530 0x7fedcc1011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 -- 172.21.15.5:0/888048925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedcc1055f0 msgr2=0x7fedcc101c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedcb7fe700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedcc1055f0 0x7fedcc101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedcc1055f0 0x7fedcc101c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 -- 172.21.15.5:0/888048925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ff530 msgr2=0x7fedcc1011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ff530 0x7fedcc1011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedca7fc700 1 -- 172.21.15.5:0/888048925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0095f0 con 0x7fedcc0ffef0 2023-10-08T13:05:26.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.380+0000 7fedcaffd700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ff530 0x7fedcc1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.381+0000 7fedca7fc700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 0x7fedcc1016e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00b580 tx=0x7fedbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.381+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc01d070 con 0x7fedcc0ffef0 2023-10-08T13:05:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.381+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc1a5380 con 0x7fedcc0ffef0 2023-10-08T13:05:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.381+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedbc00fcb0 con 0x7fedcc0ffef0 2023-10-08T13:05:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.381+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc022e00 con 0x7fedcc0ffef0 2023-10-08T13:05:26.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.381+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1a57a0 con 0x7fedcc0ffef0 2023-10-08T13:05:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.382+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc100c50 con 0x7fedcc0ffef0 2023-10-08T13:05:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.383+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fedbc022500 con 0x7fedcc0ffef0 2023-10-08T13:05:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.383+0000 7fedd0888700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fedb40a1560 0x7fedb40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.383+0000 7fedcaffd700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fedb40a1560 0x7fedb40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.383+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fedbc0ce6b0 con 0x7fedcc0ffef0 2023-10-08T13:05:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.384+0000 7fedcaffd700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fedb40a1560 0x7fedb40a3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005fd0 tx=0x7fedc0005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.388+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fedbc097850 con 0x7fedcc0ffef0 2023-10-08T13:05:26.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.587+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedcc10f4a0 con 0x7fedcc0ffef0 2023-10-08T13:05:26.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.587+0000 7fedd0888700 1 -- 172.21.15.5:0/888048925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedbc09ae70 con 0x7fedcc0ffef0 2023-10-08T13:05:26.589 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fedb40a1560 msgr2=0x7fedb40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fedb40a1560 0x7fedb40a3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fedc0005fd0 tx=0x7fedc0005e30 comp rx=0 tx=0).stop 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 msgr2=0x7fedcc1016e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 0x7fedcc1016e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00b580 tx=0x7fedbc0057f0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 shutdown_connections 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fedb40a1560 0x7fedb40a3a20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedcc1055f0 0x7fedcc101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedcc0ff530 0x7fedcc1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.589+0000 7fedd188a700 1 --2- 172.21.15.5:0/888048925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0ffef0 0x7fedcc1016e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.590+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 >> 172.21.15.5:0/888048925 conn(0x7fedcc0fafc0 msgr2=0x7fedcc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:26.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.590+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 shutdown_connections 2023-10-08T13:05:26.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.590+0000 7fedd188a700 1 -- 172.21.15.5:0/888048925 wait complete. 2023-10-08T13:05:26.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:05:26.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.730+0000 7f0e3367a700 1 -- 172.21.15.5:0/3294417448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c10ac00 msgr2=0x7f0e2c10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.730+0000 7f0e3367a700 1 --2- 172.21.15.5:0/3294417448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c10ac00 0x7f0e2c10d0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400b0a0 tx=0x7f0e2400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 -- 172.21.15.5:0/3294417448 shutdown_connections 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 --2- 172.21.15.5:0/3294417448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c10ac00 0x7f0e2c10d0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 --2- 172.21.15.5:0/3294417448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e2c1017e0 0x7f0e2c101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 --2- 172.21.15.5:0/3294417448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c102100 0x7f0e2c10a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 -- 172.21.15.5:0/3294417448 >> 172.21.15.5:0/3294417448 conn(0x7f0e2c0fafc0 msgr2=0x7f0e2c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 -- 172.21.15.5:0/3294417448 shutdown_connections 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 -- 172.21.15.5:0/3294417448 wait complete. 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 Processor -- start 2023-10-08T13:05:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.731+0000 7f0e3367a700 1 -- start start 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c1017e0 0x7f0e2c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 0x7f0e2c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e2c10ac00 0x7f0e2c196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1970a0 con 0x7f0e2c102100 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c197210 con 0x7f0e2c10ac00 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c1973d0 con 0x7f0e2c1017e0 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 0x7f0e2c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e31416700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c1017e0 0x7f0e2c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e31416700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c1017e0 0x7f0e2c19c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:46790/0 (socket says 172.21.15.5:46790) 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e31416700 1 -- 172.21.15.5:0/4191333751 learned_addr learned my addr 172.21.15.5:0/4191333751 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 0x7f0e2c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33588/0 (socket says 172.21.15.5:33588) 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e31c17700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e2c10ac00 0x7f0e2c196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 -- 172.21.15.5:0/4191333751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c1017e0 msgr2=0x7f0e2c19c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c1017e0 0x7f0e2c19c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 -- 172.21.15.5:0/4191333751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e2c10ac00 msgr2=0x7f0e2c196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e2c10ac00 0x7f0e2c196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 -- 172.21.15.5:0/4191333751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24009d00 con 0x7f0e2c102100 2023-10-08T13:05:26.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e30c15700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 0x7f0e2c19ce50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00e9f0 tx=0x7f0e1c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00c9c0 con 0x7f0e2c102100 2023-10-08T13:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e1c010430 con 0x7f0e2c102100 2023-10-08T13:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c1976b0 con 0x7f0e2c102100 2023-10-08T13:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c018680 con 0x7f0e2c102100 2023-10-08T13:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.732+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c1a3900 con 0x7f0e2c102100 2023-10-08T13:05:26.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.733+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c105d30 con 0x7f0e2c102100 2023-10-08T13:05:26.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.735+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f0e1c010860 con 0x7f0e2c102100 2023-10-08T13:05:26.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.735+0000 7f0e227fc700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0e180a1560 0x7f0e180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:26.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.736+0000 7f0e31416700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0e180a1560 0x7f0e180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:26.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.736+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0e1c014070 con 0x7f0e2c102100 2023-10-08T13:05:26.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.736+0000 7f0e31416700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0e180a1560 0x7f0e180a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e28005950 tx=0x7f0e2800b500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:26.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.739+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e1c096590 con 0x7f0e2c102100 2023-10-08T13:05:26.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.940+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e2c197f00 con 0x7f0e2c102100 2023-10-08T13:05:26.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.941+0000 7f0e227fc700 1 -- 172.21.15.5:0/4191333751 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e1c094e60 con 0x7f0e2c102100 2023-10-08T13:05:26.942 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0e180a1560 msgr2=0x7f0e180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0e180a1560 0x7f0e180a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e28005950 tx=0x7f0e2800b500 comp rx=0 tx=0).stop 2023-10-08T13:05:26.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 msgr2=0x7f0e2c19ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 0x7f0e2c19ce50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00e9f0 tx=0x7f0e1c00ed00 comp rx=0 tx=0).stop 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 shutdown_connections 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0e180a1560 0x7f0e180a3a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e2c10ac00 0x7f0e2c196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e2c1017e0 0x7f0e2c19c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 --2- 172.21.15.5:0/4191333751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e2c102100 0x7f0e2c19ce50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 >> 172.21.15.5:0/4191333751 conn(0x7f0e2c0fafc0 msgr2=0x7f0e2c0fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 shutdown_connections 2023-10-08T13:05:26.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:26.943+0000 7f0e3367a700 1 -- 172.21.15.5:0/4191333751 wait complete. 2023-10-08T13:05:26.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 -- 172.21.15.5:0/2462371754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9010ac50 msgr2=0x7fad9010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 --2- 172.21.15.5:0/2462371754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9010ac50 0x7fad9010d0f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fad8800b0a0 tx=0x7fad8800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 -- 172.21.15.5:0/2462371754 shutdown_connections 2023-10-08T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 --2- 172.21.15.5:0/2462371754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9010ac50 0x7fad9010d0f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 --2- 172.21.15.5:0/2462371754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad90101880 0x7fad90101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 --2- 172.21.15.5:0/2462371754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901021a0 0x7fad9010a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 -- 172.21.15.5:0/2462371754 >> 172.21.15.5:0/2462371754 conn(0x7fad900fb020 msgr2=0x7fad900fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 -- 172.21.15.5:0/2462371754 shutdown_connections 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 -- 172.21.15.5:0/2462371754 wait complete. 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 Processor -- start 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.084+0000 7fad961dd700 1 -- start start 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad90101880 0x7fad9019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 0x7fad9019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9010ac50 0x7fad90196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901970d0 con 0x7fad901021a0 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad90197240 con 0x7fad9010ac50 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad90197400 con 0x7fad90101880 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 0x7fad9019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 0x7fad9019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33602/0 (socket says 172.21.15.5:33602) 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 -- 172.21.15.5:0/4271486445 learned_addr learned my addr 172.21.15.5:0/4271486445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8ffff700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9010ac50 0x7fad90196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8f7fe700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad90101880 0x7fad9019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 -- 172.21.15.5:0/4271486445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad90101880 msgr2=0x7fad9019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad90101880 0x7fad9019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 -- 172.21.15.5:0/4271486445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9010ac50 msgr2=0x7fad90196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9010ac50 0x7fad90196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 -- 172.21.15.5:0/4271486445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009d00 con 0x7fad901021a0 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8ffff700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9010ac50 0x7fad90196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8effd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 0x7fad9019ce30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fad8400d980 tx=0x7fad8400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400bb60 con 0x7fad901021a0 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad901976e0 con 0x7fad901021a0 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad84007640 con 0x7fad901021a0 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.085+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84004e90 con 0x7fad901021a0 2023-10-08T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.086+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad901a38e0 con 0x7fad901021a0 2023-10-08T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.086+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad90105db0 con 0x7fad901021a0 2023-10-08T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.088+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fad8400bcc0 con 0x7fad901021a0 2023-10-08T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.088+0000 7fad8cff9700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad780a1560 0x7fad780a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.088+0000 7fad8f7fe700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad780a1560 0x7fad780a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.088+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fad840cd420 con 0x7fad901021a0 2023-10-08T13:05:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.089+0000 7fad8f7fe700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad780a1560 0x7fad780a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad80005950 tx=0x7fad800058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.092+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad84096530 con 0x7fad901021a0 2023-10-08T13:05:27.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:26 smithi060 ceph-mon[103190]: pgmap v281: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:26 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3502473231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:26 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1915322555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:26 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/888048925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:27.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:26 smithi005 ceph-mon[99496]: pgmap v281: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:27.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:26 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3502473231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:27.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:26 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1915322555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:26 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/888048925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:27.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:26 smithi118 ceph-mon[104234]: pgmap v281: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:27.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:26 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3502473231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:27.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:26 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1915322555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:27.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:26 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/888048925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.300+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad901105f0 con 0x7fad901021a0 2023-10-08T13:05:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.300+0000 7fad8cff9700 1 -- 172.21.15.5:0/4271486445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad840160a0 con 0x7fad901021a0 2023-10-08T13:05:27.302 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:05:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad780a1560 msgr2=0x7fad780a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad780a1560 0x7fad780a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad80005950 tx=0x7fad800058e0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 msgr2=0x7fad9019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 0x7fad9019ce30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fad8400d980 tx=0x7fad8400dd40 comp rx=0 tx=0).stop 2023-10-08T13:05:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 shutdown_connections 2023-10-08T13:05:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad780a1560 0x7fad780a3a20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9010ac50 0x7fad90196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad90101880 0x7fad9019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 --2- 172.21.15.5:0/4271486445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad901021a0 0x7fad9019ce30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.302+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 >> 172.21.15.5:0/4271486445 conn(0x7fad900fb020 msgr2=0x7fad900fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.303+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 shutdown_connections 2023-10-08T13:05:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.303+0000 7fad961dd700 1 -- 172.21.15.5:0/4271486445 wait complete. 2023-10-08T13:05:27.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 -- 172.21.15.5:0/3126913120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88100ff0 msgr2=0x7f9a8810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 --2- 172.21.15.5:0/3126913120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88100ff0 0x7f9a8810d610 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000b0a0 tx=0x7f9a8000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 -- 172.21.15.5:0/3126913120 shutdown_connections 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 --2- 172.21.15.5:0/3126913120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88100ff0 0x7f9a8810d610 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 --2- 172.21.15.5:0/3126913120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a88106750 0x7f9a88106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 --2- 172.21.15.5:0/3126913120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a88100630 0x7f9a88100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 -- 172.21.15.5:0/3126913120 >> 172.21.15.5:0/3126913120 conn(0x7f9a880fc100 msgr2=0x7f9a880fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 -- 172.21.15.5:0/3126913120 shutdown_connections 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 -- 172.21.15.5:0/3126913120 wait complete. 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.444+0000 7f9a8f358700 1 Processor -- start 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 -- start start 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a88100630 0x7f9a8819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a88100ff0 0x7f9a8819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 0x7f9a88198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88199340 con 0x7f9a88106750 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a881994b0 con 0x7f9a88100ff0 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8f358700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88199670 con 0x7f9a88100630 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 0x7f9a88198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 0x7f9a88198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33618/0 (socket says 172.21.15.5:33618) 2023-10-08T13:05:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 -- 172.21.15.5:0/958234548 learned_addr learned my addr 172.21.15.5:0/958234548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d0f4700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a88100630 0x7f9a8819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8c8f3700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a88100ff0 0x7f9a8819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 -- 172.21.15.5:0/958234548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a88100630 msgr2=0x7f9a8819ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a88100630 0x7f9a8819ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 -- 172.21.15.5:0/958234548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a88100ff0 msgr2=0x7f9a8819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a88100ff0 0x7f9a8819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 -- 172.21.15.5:0/958234548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009d00 con 0x7f9a88106750 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.445+0000 7f9a8d8f5700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 0x7f9a88198b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000b070 tx=0x7f9a80007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.446+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8000e040 con 0x7f9a88106750 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.446+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a8001dd50 con 0x7f9a88106750 2023-10-08T13:05:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.446+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a881998f0 con 0x7f9a88106750 2023-10-08T13:05:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.446+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8001b450 con 0x7f9a88106750 2023-10-08T13:05:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.446+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a881a5a50 con 0x7f9a88106750 2023-10-08T13:05:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.447+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a88066cc0 con 0x7f9a88106750 2023-10-08T13:05:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.448+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9a800125e0 con 0x7f9a88106750 2023-10-08T13:05:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.448+0000 7f9a7e7fc700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9a740a1560 0x7f9a740a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.448+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9a800cf740 con 0x7f9a88106750 2023-10-08T13:05:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.448+0000 7f9a8d0f4700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9a740a1560 0x7f9a740a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.449+0000 7f9a8d0f4700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9a740a1560 0x7f9a740a3a20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9a84007b60 tx=0x7f9a840073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:27.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.452+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9a80060100 con 0x7f9a88106750 2023-10-08T13:05:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.653+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9a88101ef0 con 0x7f9a88106750 2023-10-08T13:05:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.654+0000 7f9a7e7fc700 1 -- 172.21.15.5:0/958234548 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9a88101ef0 con 0x7f9a88106750 2023-10-08T13:05:27.655 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9a740a1560 msgr2=0x7f9a740a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9a740a1560 0x7f9a740a3a20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9a84007b60 tx=0x7f9a840073d0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 msgr2=0x7f9a88198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 0x7f9a88198b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000b070 tx=0x7f9a80007b70 comp rx=0 tx=0).stop 2023-10-08T13:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 shutdown_connections 2023-10-08T13:05:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9a740a1560 0x7f9a740a3a20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a88106750 0x7f9a88198b70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a88100630 0x7f9a8819ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 --2- 172.21.15.5:0/958234548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a88100ff0 0x7f9a8819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 >> 172.21.15.5:0/958234548 conn(0x7f9a880fc100 msgr2=0x7f9a8810bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 shutdown_connections 2023-10-08T13:05:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.656+0000 7f9a8f358700 1 -- 172.21.15.5:0/958234548 wait complete. 2023-10-08T13:05:27.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 -- 172.21.15.5:0/2105704840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 msgr2=0x7fe1ac0ff420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 --2- 172.21.15.5:0/2105704840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac0ff420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009990 tx=0x7fe1a0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 -- 172.21.15.5:0/2105704840 shutdown_connections 2023-10-08T13:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 --2- 172.21.15.5:0/2105704840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0ff960 0x7fe1ac10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 --2- 172.21.15.5:0/2105704840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 0x7fe1ac105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 --2- 172.21.15.5:0/2105704840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac0ff420 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 -- 172.21.15.5:0/2105704840 >> 172.21.15.5:0/2105704840 conn(0x7fe1ac074900 msgr2=0x7fe1ac074d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 -- 172.21.15.5:0/2105704840 shutdown_connections 2023-10-08T13:05:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.794+0000 7fe1b127b700 1 -- 172.21.15.5:0/2105704840 wait complete. 2023-10-08T13:05:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 Processor -- start 2023-10-08T13:05:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 -- start start 2023-10-08T13:05:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac100180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0ff960 0x7fe1ac1006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 0x7fe1ac100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1a4f70 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1a50e0 con 0x7fe1ac105680 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1b127b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1a52a0 con 0x7fe1ac0ff960 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1aaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac100180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.795+0000 7fe1aaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac100180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33628/0 (socket says 172.21.15.5:33628) 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 -- 172.21.15.5:0/744531140 learned_addr learned my addr 172.21.15.5:0/744531140 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1ab7fe700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 0x7fe1ac100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aa7fc700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0ff960 0x7fe1ac1006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 -- 172.21.15.5:0/744531140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0ff960 msgr2=0x7fe1ac1006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0ff960 0x7fe1ac1006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 -- 172.21.15.5:0/744531140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 msgr2=0x7fe1ac100c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 0x7fe1ac100c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 -- 172.21.15.5:0/744531140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00095f0 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1ab7fe700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 0x7fe1ac100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1aaffd700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac100180 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00d950 tx=0x7fe19c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c009b40 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac1a5580 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe19c009ca0 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00f620 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.796+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac1a5ae0 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.797+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac108c10 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.798+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe19c010460 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.799+0000 7fe193fff700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1940a1560 0x7fe1940a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.799+0000 7fe1aa7fc700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1940a1560 0x7fe1940a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.799+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fe19c0cd670 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.799+0000 7fe1aa7fc700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1940a1560 0x7fe1940a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00095c0 tx=0x7fe1a0009510 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:27.802+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe19c096720 con 0x7fe1ac0fefa0 2023-10-08T13:05:27.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:27 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4191333751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:27 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4271486445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:27 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/958234548' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.051+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1ac101660 con 0x7fe1ac0fefa0 2023-10-08T13:05:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.051+0000 7fe193fff700 1 -- 172.21.15.5:0/744531140 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7fe19c016090 con 0x7fe1ac0fefa0 2023-10-08T13:05:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:28.053 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:05:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1940a1560 msgr2=0x7fe1940a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1940a1560 0x7fe1940a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00095c0 tx=0x7fe1a0009510 comp rx=0 tx=0).stop 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 msgr2=0x7fe1ac100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac100180 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00d950 tx=0x7fe19c00dd10 comp rx=0 tx=0).stop 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 shutdown_connections 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1940a1560 0x7fe1940a3a20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1ac105680 0x7fe1ac100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1ac0fefa0 0x7fe1ac100180 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 --2- 172.21.15.5:0/744531140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1ac0ff960 0x7fe1ac1006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 >> 172.21.15.5:0/744531140 conn(0x7fe1ac074900 msgr2=0x7fe1ac0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 shutdown_connections 2023-10-08T13:05:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.054+0000 7fe1b127b700 1 -- 172.21.15.5:0/744531140 wait complete. 2023-10-08T13:05:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:05:28.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:28.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:27 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4191333751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:27 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4271486445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:27 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/958234548' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 -- 172.21.15.5:0/696958116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c0ff5c0 msgr2=0x7f368c0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 --2- 172.21.15.5:0/696958116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c0ff5c0 0x7f368c0ff9a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3680009990 tx=0x7f3680009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 -- 172.21.15.5:0/696958116 shutdown_connections 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 --2- 172.21.15.5:0/696958116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c1046e0 0x7f368c10c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 --2- 172.21.15.5:0/696958116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c0ff5c0 0x7f368c0ff9a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 --2- 172.21.15.5:0/696958116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c0fff70 0x7f368c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 -- 172.21.15.5:0/696958116 >> 172.21.15.5:0/696958116 conn(0x7f368c076190 msgr2=0x7f368c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 -- 172.21.15.5:0/696958116 shutdown_connections 2023-10-08T13:05:28.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.192+0000 7f36919a0700 1 -- 172.21.15.5:0/696958116 wait complete. 2023-10-08T13:05:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 Processor -- start 2023-10-08T13:05:28.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 -- start start 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0ff5c0 0x7f368c197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c1046e0 0x7f368c197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 0x7f368c1a2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c1a2f30 con 0x7f368c198250 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c1a30a0 con 0x7f368c0ff5c0 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f36919a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c1a3260 con 0x7f368c1046e0 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f369119f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 0x7f368c1a2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f369119f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 0x7f368c1a2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33646/0 (socket says 172.21.15.5:33646) 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.193+0000 7f369119f700 1 -- 172.21.15.5:0/4268715814 learned_addr learned my addr 172.21.15.5:0/4268715814 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369099e700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0ff5c0 0x7f368c197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f368bfff700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c1046e0 0x7f368c197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369119f700 1 -- 172.21.15.5:0/4268715814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c1046e0 msgr2=0x7f368c197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369119f700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c1046e0 0x7f368c197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369119f700 1 -- 172.21.15.5:0/4268715814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0ff5c0 msgr2=0x7f368c197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369119f700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0ff5c0 0x7f368c197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369119f700 1 -- 172.21.15.5:0/4268715814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800095f0 con 0x7f368c198250 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f368bfff700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c1046e0 0x7f368c197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f369119f700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 0x7f368c1a2800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3684007ee0 tx=0x7f368400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684017070 con 0x7f368c198250 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f368400f040 con 0x7f368c198250 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684005740 con 0x7f368c198250 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c1a3540 con 0x7f368c198250 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.194+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c1a3a00 con 0x7f368c198250 2023-10-08T13:05:28.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.195+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c107950 con 0x7f368c198250 2023-10-08T13:05:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.196+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f368400dc60 con 0x7f368c198250 2023-10-08T13:05:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.197+0000 7f3689ffb700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f367c0a1560 0x7f367c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.197+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f36840ccb20 con 0x7f368c198250 2023-10-08T13:05:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.197+0000 7f369099e700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f367c0a1560 0x7f367c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.197+0000 7f369099e700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f367c0a1560 0x7f367c0a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f368000b5c0 tx=0x7f3680005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.201+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3684095bd0 con 0x7f368c198250 2023-10-08T13:05:28.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:27 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4191333751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:27 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4271486445' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:27 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/958234548' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.405+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f368c100a90 con 0x7f368c198250 2023-10-08T13:05:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.406+0000 7f3689ffb700 1 -- 172.21.15.5:0/4268715814 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24639 (secure 0 0 0) 0x7f36840991f0 con 0x7f368c198250 2023-10-08T13:05:28.407 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:28.408 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:04:38.199053+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.408+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f367c0a1560 msgr2=0x7f367c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.408+0000 7f36919a0700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f367c0a1560 0x7f367c0a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f368000b5c0 tx=0x7f3680005960 comp rx=0 tx=0).stop 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.408+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 msgr2=0x7f368c1a2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.408+0000 7f36919a0700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 0x7f368c1a2800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3684007ee0 tx=0x7f368400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.408+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 shutdown_connections 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f367c0a1560 0x7f367c0a3a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f368c198250 0x7f368c1a2800 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f368c0ff5c0 0x7f368c197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 --2- 172.21.15.5:0/4268715814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368c1046e0 0x7f368c197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 >> 172.21.15.5:0/4268715814 conn(0x7f368c076190 msgr2=0x7f368c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 shutdown_connections 2023-10-08T13:05:28.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.409+0000 7f36919a0700 1 -- 172.21.15.5:0/4268715814 wait complete. 2023-10-08T13:05:28.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:05:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 -- 172.21.15.5:0/1381301273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 msgr2=0x7f1604106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 --2- 172.21.15.5:0/1381301273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604106a20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009990 tx=0x7f15f4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 -- 172.21.15.5:0/1381301273 shutdown_connections 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 --2- 172.21.15.5:0/1381301273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604100ff0 0x7f160410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 --2- 172.21.15.5:0/1381301273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604106a20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 --2- 172.21.15.5:0/1381301273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1604100630 0x7f1604100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 -- 172.21.15.5:0/1381301273 >> 172.21.15.5:0/1381301273 conn(0x7f16040fc160 msgr2=0x7f16040fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 -- 172.21.15.5:0/1381301273 shutdown_connections 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.547+0000 7f160aa12700 1 -- 172.21.15.5:0/1381301273 wait complete. 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 Processor -- start 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 -- start start 2023-10-08T13:05:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604100630 0x7f1604072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1604100ff0 0x7f1604073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16041a4e40 con 0x7f1604106640 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16041a4fb0 con 0x7f1604100ff0 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f160aa12700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16041a5170 con 0x7f1604100630 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f1608faf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f1608faf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33660/0 (socket says 172.21.15.5:33660) 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.548+0000 7f1608faf700 1 -- 172.21.15.5:0/4156570165 learned_addr learned my addr 172.21.15.5:0/4156570165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f16037fe700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1604100ff0 0x7f1604073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1603fff700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604100630 0x7f1604072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1608faf700 1 -- 172.21.15.5:0/4156570165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604100630 msgr2=0x7f1604072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1608faf700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604100630 0x7f1604072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1608faf700 1 -- 172.21.15.5:0/4156570165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1604100ff0 msgr2=0x7f1604073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1608faf700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1604100ff0 0x7f1604073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1608faf700 1 -- 172.21.15.5:0/4156570165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40095f0 con 0x7f1604106640 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f1608faf700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604073570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15fc007ee0 tx=0x7f15fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc017070 con 0x7f1604106640 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15fc00f040 con 0x7f1604106640 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16041a5450 con 0x7f1604106640 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc005580 con 0x7f1604106640 2023-10-08T13:05:28.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.549+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16041a5910 con 0x7f1604106640 2023-10-08T13:05:28.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.550+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1604108c30 con 0x7f1604106640 2023-10-08T13:05:28.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.551+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f15fc00db20 con 0x7f1604106640 2023-10-08T13:05:28.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.552+0000 7f16017fa700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15ec0a1560 0x7f15ec0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.552+0000 7f1603fff700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15ec0a1560 0x7f15ec0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.552+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f15fc0cc9b0 con 0x7f1604106640 2023-10-08T13:05:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.552+0000 7f1603fff700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15ec0a1560 0x7f15ec0a3a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f15f400b5c0 tx=0x7f15f4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.556+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15fc095ac0 con 0x7f1604106640 2023-10-08T13:05:28.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.806+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1604101d70 con 0x7f1604106640 2023-10-08T13:05:28.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.806+0000 7f16017fa700 1 -- 172.21.15.5:0/4156570165 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7f15fc0990e0 con 0x7f1604106640 2023-10-08T13:05:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:28.808 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15ec0a1560 msgr2=0x7f15ec0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15ec0a1560 0x7f15ec0a3a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f15f400b5c0 tx=0x7f15f4005960 comp rx=0 tx=0).stop 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 msgr2=0x7f1604073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604073570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f15fc007ee0 tx=0x7f15fc00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 shutdown_connections 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15ec0a1560 0x7f15ec0a3a20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1604106640 0x7f1604073570 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1604100630 0x7f1604072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 --2- 172.21.15.5:0/4156570165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1604100ff0 0x7f1604073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 >> 172.21.15.5:0/4156570165 conn(0x7f16040fc160 msgr2=0x7f16040fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 shutdown_connections 2023-10-08T13:05:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.809+0000 7f160aa12700 1 -- 172.21.15.5:0/4156570165 wait complete. 2023-10-08T13:05:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:05:28.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T13:04:10.182813+0000', 'modified': '2023-10-08T13:04:34.149988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24667, 'mds_1': 24650, 'mds_2': 24649, 'mds_3': 24643, 'mds_4': 24611}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14793': {'gid': 14793, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6839/1016601603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6838', 'nonce': 1016601603}, {'type': 'v1', 'addr': '172.21.15.5:6839', 'nonce': 1016601603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14805': {'gid': 14805, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6841/3855657162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6840', 'nonce': 3855657162}, {'type': 'v1', 'addr': '172.21.15.5:6841', 'nonce': 3855657162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24554': {'gid': 24554, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6833/2732299433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 2732299433}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 2732299433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24587': {'gid': 24587, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/2434035326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 2434035326}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 2434035326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24601': {'gid': 24601, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6833/2301164453', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 2301164453}, {'type': 'v1', 'addr': '172.21.15.118:6833', 'nonce': 2301164453}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24611': {'gid': 24611, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.60:6837/529609492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 529609492}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 529609492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24643': {'gid': 24643, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.118:6835/1209433325', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 1209433325}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1209433325}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.118:6837/1772997298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 1772997298}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 1772997298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24650': {'gid': 24650, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.60:6839/2598964762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 2598964762}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 2598964762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.118:6839/3304365163', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 3304365163}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 3304365163}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T13:05:28.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T13:05:28.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-08T13:05:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 -- 172.21.15.5:0/1908476769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ff530 msgr2=0x7f6f6c0ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 --2- 172.21.15.5:0/1908476769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c0ff9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0099c0 tx=0x7f6f5c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 -- 172.21.15.5:0/1908476769 shutdown_connections 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 --2- 172.21.15.5:0/1908476769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 --2- 172.21.15.5:0/1908476769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c1055f0 0x7f6f6c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 --2- 172.21.15.5:0/1908476769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c0ff9b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 -- 172.21.15.5:0/1908476769 >> 172.21.15.5:0/1908476769 conn(0x7f6f6c0fafc0 msgr2=0x7f6f6c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 -- 172.21.15.5:0/1908476769 shutdown_connections 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.950+0000 7f6f7137f700 1 -- 172.21.15.5:0/1908476769 wait complete. 2023-10-08T13:05:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 Processor -- start 2023-10-08T13:05:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 -- start start 2023-10-08T13:05:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c1055f0 0x7f6f6c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c196fb0 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c197120 con 0x7f6f6c0ff530 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f7137f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c1972e0 con 0x7f6f6c1055f0 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f6a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f6a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33672/0 (socket says 172.21.15.5:33672) 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2928107906 learned_addr learned my addr 172.21.15.5:0/2928107906 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f6affd700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.951+0000 7f6f6b7fe700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c1055f0 0x7f6f6c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2928107906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c1055f0 msgr2=0x7f6f6c196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c1055f0 0x7f6f6c196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2928107906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c0ff530 msgr2=0x7f6f6c19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2928107906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0095f0 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6b7fe700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c1055f0 0x7f6f6c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6affd700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c19cd10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00b580 tx=0x7f6f5c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f63fff700 1 -- 172.21.15.5:0/2928107906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c01c070 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f63fff700 1 -- 172.21.15.5:0/2928107906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f5c00fe30 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f63fff700 1 -- 172.21.15.5:0/2928107906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c022d40 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c197560 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.952+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c1a37c0 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.954+0000 7f6f63fff700 1 -- 172.21.15.5:0/2928107906 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6f5c020070 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.955+0000 7f6f63fff700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f580a1560 0x7f6f580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.955+0000 7f6f6affd700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f580a1560 0x7f6f580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.955+0000 7f6f63fff700 1 -- 172.21.15.5:0/2928107906 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6f5c0cdf30 con 0x7f6f6c0ffef0 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.955+0000 7f6f6affd700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f580a1560 0x7f6f580a3a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009fd0 tx=0x7f6f54009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 Processor -- start 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 -- start start 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a899c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a89a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a89a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a8905410 con 0x5568a899be30 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a88f6bd0 con 0x5568a899c750 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a88f44f0 con 0x5568a89a7600 2023-10-08T13:05:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f6affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a899c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f6affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a899c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33678/0 (socket says 172.21.15.5:33678) 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f6affd700 1 -- 172.21.15.5:0/1612149454 learned_addr learned my addr 172.21.15.5:0/1612149454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.956+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a89a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f6affd700 1 -- 172.21.15.5:0/1612149454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 msgr2=0x5568a89a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a89a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f6affd700 1 -- 172.21.15.5:0/1612149454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 msgr2=0x5568a89a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a89a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f6affd700 1 -- 172.21.15.5:0/1612149454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568a871ad90 con 0x5568a899be30 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a899c210 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400e720 tx=0x7f6f54014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da13e156b6121855 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f617fa700 1 -- 172.21.15.5:0/1612149454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54026600 con 0x5568a899be30 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f617fa700 1 -- 172.21.15.5:0/1612149454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f54026c20 con 0x5568a899be30 2023-10-08T13:05:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.957+0000 7f6f617fa700 1 -- 172.21.15.5:0/1612149454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5401ec60 con 0x5568a899be30 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1612149454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 msgr2=0x5568a899c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a899c210 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400e720 tx=0x7f6f54014000 comp rx=0 tx=0).stop 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1612149454 shutdown_connections 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a89a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a899c210 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1612149454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a89a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1612149454 >> 172.21.15.5:0/1612149454 conn(0x5568a8911210 msgr2=0x5568a8998280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1612149454 shutdown_connections 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1612149454 wait complete. 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 -- start start 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.958+0000 7f6f7d568b80 1 Processor -- start 2023-10-08T13:05:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a899c750 0x5568a89a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 0x5568a89a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a88efde0 con 0x5568a89a7600 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a888c6c0 con 0x5568a899be30 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a888c360 con 0x5568a899c750 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 10 client.0 _ll_register_callbacks cb 0x5568a86e97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 0x5568a89a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 0x5568a89a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33688/0 (socket says 172.21.15.5:33688) 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 -- 172.21.15.5:0/1471453069 learned_addr learned my addr 172.21.15.5:0/1471453069 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a899c750 0x5568a89a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 -- 172.21.15.5:0/1471453069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a899c750 msgr2=0x5568a89a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a899c750 0x5568a89a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 -- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 msgr2=0x5568a89a7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 -- 172.21.15.5:0/1471453069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f54017070 con 0x5568a89a7600 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f6b7fe700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 0x5568a89a4b00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007ba0 tx=0x7f6f64007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f602fff6a5e5240 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f527fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f527fc700 1 -- 172.21.15.5:0/1471453069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400fae0 con 0x5568a89a7600 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f527fc700 1 -- 172.21.15.5:0/1471453069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6f6400fc40 con 0x5568a89a7600 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.959+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568a88b7e60 con 0x5568a89a7600 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f527fc700 1 -- 172.21.15.5:0/1471453069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f6400fe00 con 0x5568a89a7600 2023-10-08T13:05:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 10 client.15390 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5568a8703c10 con 0x5568a89a7600 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f527fc700 1 -- 172.21.15.5:0/1471453069 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568a88b7e60 con 0x5568a89a7600 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f527fc700 1 -- 172.21.15.5:0/1471453069 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6f64014460 con 0x5568a89a7600 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 10 client.15390 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 10 client.15390 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 20 client.15390 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a89b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 4 client.15390 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 --> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568a88e8dc0 con 0x5568a89b7270 2023-10-08T13:05:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.960+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a89b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.961+0000 7f6f527fc700 10 client.15390 ms_handle_connect on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.961+0000 7f6f6affd700 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a89b5cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=73cfaee7408ac475 server_cookie=d8c78de9c751327e in_seq=0 out_seq=0 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f527fc700 1 -- 172.21.15.5:0/1471453069 <== mds.4 v2:172.21.15.60:6836/529609492 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5568a88e8dc0 con 0x5568a89b7270 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f527fc700 10 client.15390 handle_command_reply: tid=0 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 client.15390 shutdown 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 msgr2=0x5568a89a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 0x5568a89a4b00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007ba0 tx=0x7f6f64007f60 comp rx=0 tx=0).stop 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 shutdown_connections 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a89b5cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a89a7600 0x5568a89a4b00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f527fc700 0 client.15390 ms_handle_reset on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/1471453069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a899c750 0x5568a89a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 >> 172.21.15.5:0/1471453069 conn(0x5568a8911210 msgr2=0x5568a8997e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 shutdown_connections 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 1 -- 172.21.15.5:0/1471453069 wait complete. 2023-10-08T13:05:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.962+0000 7f6f7d568b80 20 client.15390 trim_cache size 0 max 16384 2023-10-08T13:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.980+0000 7f6f7d568b80 1 Processor -- start 2023-10-08T13:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.980+0000 7f6f7d568b80 1 -- start start 2023-10-08T13:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.980+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a89b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.980+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a899ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.980+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8997d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a87708d0 con 0x5568a899be30 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a877cde0 con 0x5568a899c750 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a88ae590 con 0x5568a89a7600 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a89b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a89b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33692/0 (socket says 172.21.15.5:33692) 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 -- 172.21.15.5:0/3785978306 learned_addr learned my addr 172.21.15.5:0/3785978306 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a899ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 -- 172.21.15.5:0/3785978306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 msgr2=0x5568a8997d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8997d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 -- 172.21.15.5:0/3785978306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 msgr2=0x5568a899ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a899ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 -- 172.21.15.5:0/3785978306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568a8741200 con 0x5568a899be30 2023-10-08T13:05:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a899ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f6affd700 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a89b3170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400e720 tx=0x7f6f54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57268a4869e87273 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f61ffb700 1 -- 172.21.15.5:0/3785978306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5402c040 con 0x5568a899be30 2023-10-08T13:05:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f61ffb700 1 -- 172.21.15.5:0/3785978306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f5401edb0 con 0x5568a899be30 2023-10-08T13:05:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.981+0000 7f6f61ffb700 1 -- 172.21.15.5:0/3785978306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54030730 con 0x5568a899be30 2023-10-08T13:05:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 -- 172.21.15.5:0/3785978306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 msgr2=0x5568a89b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a89b3170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400e720 tx=0x7f6f54017000 comp rx=0 tx=0).stop 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 -- 172.21.15.5:0/3785978306 shutdown_connections 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8997d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899be30 0x5568a89b3170 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/3785978306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899c750 0x5568a899ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 -- 172.21.15.5:0/3785978306 >> 172.21.15.5:0/3785978306 conn(0x5568a8911210 msgr2=0x5568a899f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 -- 172.21.15.5:0/3785978306 shutdown_connections 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 -- 172.21.15.5:0/3785978306 wait complete. 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 -- start start 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.982+0000 7f6f7d568b80 1 Processor -- start 2023-10-08T13:05:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 0x5568a89a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8a0ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a89a1f10 con 0x5568a899c750 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a8a0b1a0 con 0x5568a899be30 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a8a0b2e0 con 0x5568a89a7600 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 10 client.0 _ll_register_callbacks cb 0x7f6f64007730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 0x5568a89a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 0x5568a89a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33700/0 (socket says 172.21.15.5:33700) 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2994572031 learned_addr learned my addr 172.21.15.5:0/2994572031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6b7fe700 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8a0ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2994572031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 msgr2=0x5568a8a0ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8a0ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 msgr2=0x5568a89a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 -- 172.21.15.5:0/2994572031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568a871ad90 con 0x5568a899c750 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f6a7fc700 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 0x5568a89a1600 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0978c0 tx=0x7f6f5c09ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56816142b62cc5b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f527fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f527fc700 1 -- 172.21.15.5:0/2994572031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c09a540 con 0x5568a899c750 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f527fc700 1 -- 172.21.15.5:0/2994572031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6f5c09b550 con 0x5568a899c750 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f54026c20 con 0x5568a899c750 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f527fc700 1 -- 172.21.15.5:0/2994572031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f5c09ae50 con 0x5568a899c750 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 10 client.15396 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.983+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5568a8719260 con 0x5568a899c750 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f527fc700 1 -- 172.21.15.5:0/2994572031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f5c07d020 con 0x5568a899c750 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f527fc700 1 -- 172.21.15.5:0/2994572031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6f5c0aeba0 con 0x5568a899c750 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f7d568b80 10 client.15396 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f7d568b80 10 client.15396 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f7d568b80 20 client.15396 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a8a0c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f7d568b80 4 client.15396 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 --> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5568a88e8ae0 con 0x5568a89b7270 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f6affd700 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a8a0c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f527fc700 10 client.15396 ms_handle_connect on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.984+0000 7f6f6affd700 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a8a0c620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=51b0bda58e23dcbb server_cookie=560922f10b86cb83 in_seq=0 out_seq=0 2023-10-08T13:05:28.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f527fc700 1 -- 172.21.15.5:0/2994572031 <== mds.4 v2:172.21.15.60:6836/529609492 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5568a88e8ae0 con 0x5568a89b7270 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f527fc700 10 client.15396 handle_command_reply: tid=0 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 client.15396 shutdown 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 msgr2=0x5568a89a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 0x5568a89a1600 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0978c0 tx=0x7f6f5c09ad50 comp rx=0 tx=0).stop 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 shutdown_connections 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x5568a89b7270 0x5568a8a0c620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5568a89a7600 0x5568a8a0ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5568a899be30 0x5568a89a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f527fc700 0 client.15396 ms_handle_reset on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 --2- 172.21.15.5:0/2994572031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5568a899c750 0x5568a89a1600 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 >> 172.21.15.5:0/2994572031 conn(0x5568a8911210 msgr2=0x5568a8997c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 shutdown_connections 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 1 -- 172.21.15.5:0/2994572031 wait complete. 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7d568b80 20 client.15396 trim_cache size 0 max 16384 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 4, 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24611, 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 55.840307482, 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 89, 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 92.476481664999994 2023-10-08T13:05:28.994 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f580a1560 msgr2=0x7f6f580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7137f700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f580a1560 0x7f6f580a3a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009fd0 tx=0x7f6f54009260 comp rx=0 tx=0).stop 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 msgr2=0x7f6f6c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.985+0000 7f6f7137f700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c19cd10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00b580 tx=0x7f6f5c00f690 comp rx=0 tx=0).stop 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 shutdown_connections 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f580a1560 0x7f6f580a3a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f6c1055f0 0x7f6f6c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6c0ff530 0x7f6f6c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 --2- 172.21.15.5:0/2928107906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c0ffef0 0x7f6f6c19cd10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:28.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 >> 172.21.15.5:0/2928107906 conn(0x7f6f6c0fafc0 msgr2=0x7f6f6c103860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:28.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 shutdown_connections 2023-10-08T13:05:28.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:28.986+0000 7f6f7137f700 1 -- 172.21.15.5:0/2928107906 wait complete. 2023-10-08T13:05:28.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T13:05:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 -- 172.21.15.5:0/103491380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3070105600 msgr2=0x7f30701059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 --2- 172.21.15.5:0/103491380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3070105600 0x7f30701059e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f306c0099c0 tx=0x7f306c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 -- 172.21.15.5:0/103491380 shutdown_connections 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 --2- 172.21.15.5:0/103491380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30700fff00 0x7f307010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 --2- 172.21.15.5:0/103491380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3070105600 0x7f30701059e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 --2- 172.21.15.5:0/103491380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30700ff540 0x7f30700ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 -- 172.21.15.5:0/103491380 >> 172.21.15.5:0/103491380 conn(0x7f30700fafb0 msgr2=0x7f30700fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 -- 172.21.15.5:0/103491380 shutdown_connections 2023-10-08T13:05:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.125+0000 7f30775b5700 1 -- 172.21.15.5:0/103491380 wait complete. 2023-10-08T13:05:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 Processor -- start 2023-10-08T13:05:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 -- start start 2023-10-08T13:05:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30700ff540 0x7f307019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 0x7f307019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3070105600 0x7f30701967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070196ea0 con 0x7f30700fff00 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070197010 con 0x7f30700ff540 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f30775b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30701971d0 con 0x7f3070105600 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f3074b50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 0x7f307019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f3074b50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 0x7f307019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33714/0 (socket says 172.21.15.5:33714) 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f3074b50700 1 -- 172.21.15.5:0/2041900699 learned_addr learned my addr 172.21.15.5:0/2041900699 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.126+0000 7f3075351700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30700ff540 0x7f307019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3075b52700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3070105600 0x7f30701967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3074b50700 1 -- 172.21.15.5:0/2041900699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3070105600 msgr2=0x7f30701967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3074b50700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3070105600 0x7f30701967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3074b50700 1 -- 172.21.15.5:0/2041900699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30700ff540 msgr2=0x7f307019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3074b50700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30700ff540 0x7f307019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3074b50700 1 -- 172.21.15.5:0/2041900699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0095f0 con 0x7f30700fff00 2023-10-08T13:05:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f3074b50700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 0x7f307019cbe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f306000c920 tx=0x7f306000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f30667fc700 1 -- 172.21.15.5:0/2041900699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060007b00 con 0x7f30700fff00 2023-10-08T13:05:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f30667fc700 1 -- 172.21.15.5:0/2041900699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f306000ce70 con 0x7f30700fff00 2023-10-08T13:05:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30701974b0 con 0x7f30700fff00 2023-10-08T13:05:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f30667fc700 1 -- 172.21.15.5:0/2041900699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600054e0 con 0x7f30700fff00 2023-10-08T13:05:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.127+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30701a36d0 con 0x7f30700fff00 2023-10-08T13:05:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.129+0000 7f30667fc700 1 -- 172.21.15.5:0/2041900699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3060004750 con 0x7f30700fff00 2023-10-08T13:05:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.130+0000 7f30667fc700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f305c0a15e0 0x7f305c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.130+0000 7f3075351700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f305c0a15e0 0x7f305c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.130+0000 7f30667fc700 1 -- 172.21.15.5:0/2041900699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f30600cce20 con 0x7f30700fff00 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.130+0000 7f3075351700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f305c0a15e0 0x7f305c0a3aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f306c009990 tx=0x7f306c005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 Processor -- start 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 -- start start 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc93b410 con 0x55fccc9e1a10 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc92cbd0 con 0x55fccc9d1e30 2023-10-08T13:05:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f308379eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc92a4f0 con 0x55fccc9d2750 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f3075b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f3075b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9e3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33724/0 (socket says 172.21.15.5:33724) 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.131+0000 7f3075b52700 1 -- 172.21.15.5:0/4014395623 learned_addr learned my addr 172.21.15.5:0/4014395623 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075351700 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3074b50700 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075b52700 1 -- 172.21.15.5:0/4014395623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 msgr2=0x55fccc9e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075b52700 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9e14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075b52700 1 -- 172.21.15.5:0/4014395623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 msgr2=0x55fccc9d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075b52700 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075b52700 1 -- 172.21.15.5:0/4014395623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fccc750d90 con 0x55fccc9e1a10 2023-10-08T13:05:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f3075b52700 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9e3e00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f306800e190 tx=0x7f306800e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1652a7a23facf506 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f305b7fe700 1 -- 172.21.15.5:0/4014395623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068018070 con 0x55fccc9e1a10 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f305b7fe700 1 -- 172.21.15.5:0/4014395623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3068007c30 con 0x55fccc9e1a10 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.132+0000 7f305b7fe700 1 -- 172.21.15.5:0/4014395623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068014d80 con 0x55fccc9e1a10 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 -- 172.21.15.5:0/4014395623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 msgr2=0x55fccc9e3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9e3e00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f306800e190 tx=0x7f306800e4a0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 -- 172.21.15.5:0/4014395623 shutdown_connections 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9e3e00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 --2- 172.21.15.5:0/4014395623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 -- 172.21.15.5:0/4014395623 >> 172.21.15.5:0/4014395623 conn(0x55fccc947210 msgr2=0x55fccc9ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 -- 172.21.15.5:0/4014395623 shutdown_connections 2023-10-08T13:05:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 -- 172.21.15.5:0/4014395623 wait complete. 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 -- start start 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.133+0000 7f308379eb80 1 Processor -- start 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc925de0 con 0x55fccc9e1a10 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc8c26c0 con 0x55fccc9d1e30 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc8c2360 con 0x55fccc9d2750 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f308379eb80 10 client.0 _ll_register_callbacks cb 0x55fccc71f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9ded40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33730/0 (socket says 172.21.15.5:33730) 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 -- 172.21.15.5:0/1816790246 learned_addr learned my addr 172.21.15.5:0/1816790246 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3074b50700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075351700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 -- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 msgr2=0x55fccc9de6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9de6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 -- 172.21.15.5:0/1816790246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 msgr2=0x55fccc9e13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9e13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 -- 172.21.15.5:0/1816790246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306800f040 con 0x55fccc9e1a10 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075351700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9e13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3075b52700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9ded40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3068004e70 tx=0x7f3068004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a090c0627c736ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.134+0000 7f3058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f3058ff9700 1 -- 172.21.15.5:0/1816790246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068018040 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f3058ff9700 1 -- 172.21.15.5:0/1816790246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3068003c10 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fccc91edc0 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f3058ff9700 1 -- 172.21.15.5:0/1816790246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3068003dd0 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 10 client.15408 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fccc739c10 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f3058ff9700 1 -- 172.21.15.5:0/1816790246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fccc91edc0 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f3058ff9700 1 -- 172.21.15.5:0/1816790246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3068004730 con 0x55fccc9e1a10 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 10 client.15408 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 10 client.15408 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:05:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 20 client.15408 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccc9f14b0 0x55fccc9effb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 4 client.15408 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.135+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 --> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fccc91eae0 con 0x55fccc9f14b0 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.136+0000 7f3075351700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccc9f14b0 0x55fccc9effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.136+0000 7f3058ff9700 10 client.15408 ms_handle_connect on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.136+0000 7f3075351700 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccc9f14b0 0x55fccc9effb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=31b33dd41674118f server_cookie=daac56d4664347b8 in_seq=0 out_seq=0 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f3058ff9700 1 -- 172.21.15.5:0/1816790246 <== mds.3 v2:172.21.15.118:6834/1209433325 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fccc91eae0 con 0x55fccc9f14b0 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f3058ff9700 10 client.15408 handle_command_reply: tid=0 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 client.15408 shutdown 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 msgr2=0x55fccc9ded40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9ded40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3068004e70 tx=0x7f3068004ad0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 shutdown_connections 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccc9f14b0 0x55fccc9effb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9e1a10 0x55fccc9ded40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9e13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 --2- 172.21.15.5:0/1816790246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9de6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f3058ff9700 0 client.15408 ms_handle_reset on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 >> 172.21.15.5:0/1816790246 conn(0x55fccc947210 msgr2=0x55fccc9cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 shutdown_connections 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 1 -- 172.21.15.5:0/1816790246 wait complete. 2023-10-08T13:05:29.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.137+0000 7f308379eb80 20 client.15408 trim_cache size 0 max 16384 2023-10-08T13:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 Processor -- start 2023-10-08T13:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 -- start start 2023-10-08T13:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9ed580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 0x55fccc9dcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9e1a10 0x55fccc9dd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc7a68d0 con 0x55fccc9d2750 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc921f00 con 0x55fccc9d1e30 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f308379eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccc7b2de0 con 0x55fccc9e1a10 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 0x55fccc9dcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 0x55fccc9dcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33736/0 (socket says 172.21.15.5:33736) 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 -- 172.21.15.5:0/3604364555 learned_addr learned my addr 172.21.15.5:0/3604364555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3075351700 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3075b52700 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9e1a10 0x55fccc9dd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 -- 172.21.15.5:0/3604364555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9e1a10 msgr2=0x55fccc9dd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9e1a10 0x55fccc9dd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 -- 172.21.15.5:0/3604364555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 msgr2=0x55fccc9ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.155+0000 7f3074b50700 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f3074b50700 1 -- 172.21.15.5:0/3604364555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fccc777200 con 0x55fccc9d2750 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f3074b50700 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 0x55fccc9dcf90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f30600ca410 tx=0x7f306009a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616321096090d3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f305bfff700 1 -- 172.21.15.5:0/3604364555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600a1f80 con 0x55fccc9d2750 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f305bfff700 1 -- 172.21.15.5:0/3604364555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3060097f90 con 0x55fccc9d2750 2023-10-08T13:05:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f305bfff700 1 -- 172.21.15.5:0/3604364555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060099e50 con 0x55fccc9d2750 2023-10-08T13:05:29.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:28 smithi060 ceph-mon[103190]: pgmap v282: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:29.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/744531140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4268715814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:28 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4156570165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 -- 172.21.15.5:0/3604364555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 msgr2=0x55fccc9dcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 0x55fccc9dcf90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f30600ca410 tx=0x7f306009a2f0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 -- 172.21.15.5:0/3604364555 shutdown_connections 2023-10-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9e1a10 0x55fccc9dd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9d1e30 0x55fccc9ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 --2- 172.21.15.5:0/3604364555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d2750 0x55fccc9dcf90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.156+0000 7f308379eb80 1 -- 172.21.15.5:0/3604364555 >> 172.21.15.5:0/3604364555 conn(0x55fccc947210 msgr2=0x55fccc9de680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 -- 172.21.15.5:0/3604364555 shutdown_connections 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 -- 172.21.15.5:0/3604364555 wait complete. 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 -- start start 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 Processor -- start 2023-10-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 0x55fccc9f4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9e1a10 0x55fccc9f5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccca44fd0 con 0x55fccc9d1e30 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccca45140 con 0x55fccc9e1a10 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccca45300 con 0x55fccc9d2750 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.157+0000 7f308379eb80 10 client.0 _ll_register_callbacks cb 0x7f3068007e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 0x55fccc9f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 0x55fccc9f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33740/0 (socket says 172.21.15.5:33740) 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 -- 172.21.15.5:0/1191966667 learned_addr learned my addr 172.21.15.5:0/1191966667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3074b50700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075b52700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9e1a10 0x55fccc9f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 -- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 msgr2=0x55fccc9f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 -- 172.21.15.5:0/1191966667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9e1a10 msgr2=0x55fccc9f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9e1a10 0x55fccc9f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 -- 172.21.15.5:0/1191966667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30701a36d0 con 0x55fccc9d1e30 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3075351700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 0x55fccc9f4790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f306c005210 tx=0x7f306c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3523e6eebdf01c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3058ff9700 1 -- 172.21.15.5:0/1191966667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c034a20 con 0x55fccc9d1e30 2023-10-08T13:05:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fccc8ede60 con 0x55fccc9d1e30 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3058ff9700 1 -- 172.21.15.5:0/1191966667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f306c034b80 con 0x55fccc9d1e30 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f3058ff9700 1 -- 172.21.15.5:0/1191966667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f306c034d40 con 0x55fccc9d1e30 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f308379eb80 10 client.15414 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.158+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fccc74f260 con 0x55fccc9d1e30 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f3058ff9700 1 -- 172.21.15.5:0/1191966667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fccc8ede60 con 0x55fccc9d1e30 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f3058ff9700 1 -- 172.21.15.5:0/1191966667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f306c00f460 con 0x55fccc9d1e30 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f308379eb80 10 client.15414 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f308379eb80 10 client.15414 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f308379eb80 20 client.15414 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f308379eb80 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccca4a6f0 0x55fccca46b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f308379eb80 4 client.15414 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 --> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fccc771f20 con 0x55fccca4a6f0 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f3074b50700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccca4a6f0 0x55fccca46b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f3058ff9700 10 client.15414 ms_handle_connect on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.159+0000 7f3074b50700 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccca4a6f0 0x55fccca46b30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d2d824c38d73c62 server_cookie=17bb92905838a944 in_seq=0 out_seq=0 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f3058ff9700 1 -- 172.21.15.5:0/1191966667 <== mds.3 v2:172.21.15.118:6834/1209433325 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fccc771f20 con 0x55fccca4a6f0 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f3058ff9700 10 client.15414 handle_command_reply: tid=0 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 client.15414 shutdown 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 msgr2=0x55fccc9f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 0x55fccc9f4790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f306c005210 tx=0x7f306c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 shutdown_connections 2023-10-08T13:05:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x55fccca4a6f0 0x55fccca46b30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fccc9e1a10 0x55fccc9f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fccc9d1e30 0x55fccc9f4790 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 --2- 172.21.15.5:0/1191966667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fccc9d2750 0x55fccc9f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f3058ff9700 0 client.15414 ms_handle_reset on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 >> 172.21.15.5:0/1191966667 conn(0x55fccc947210 msgr2=0x55fccc9effb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 shutdown_connections 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 1 -- 172.21.15.5:0/1191966667 wait complete. 2023-10-08T13:05:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.160+0000 7f308379eb80 20 client.15414 trim_cache size 0 max 16384 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 3, 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24643, 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:29.172 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 57.021868449999999, 2023-10-08T13:05:29.172 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:29.172 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 89, 2023-10-08T13:05:29.172 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:29.172 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 97.330826561999999 2023-10-08T13:05:29.172 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:29.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f305c0a15e0 msgr2=0x7f305c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f305c0a15e0 0x7f305c0a3aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f306c009990 tx=0x7f306c005bc0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 msgr2=0x7f307019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 0x7f307019cbe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f306000c920 tx=0x7f306000cc30 comp rx=0 tx=0).stop 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 shutdown_connections 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f305c0a15e0 0x7f305c0a3aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3070105600 0x7f30701967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30700ff540 0x7f307019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 --2- 172.21.15.5:0/2041900699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30700fff00 0x7f307019cbe0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 >> 172.21.15.5:0/2041900699 conn(0x7f30700fafb0 msgr2=0x7f30700fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 shutdown_connections 2023-10-08T13:05:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.161+0000 7f30775b5700 1 -- 172.21.15.5:0/2041900699 wait complete. 2023-10-08T13:05:29.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:28 smithi005 ceph-mon[99496]: pgmap v282: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:29.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/744531140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4268715814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:28 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4156570165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T13:05:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:28 smithi118 ceph-mon[104234]: pgmap v282: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/744531140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4268715814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:28 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4156570165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 -- 172.21.15.5:0/2631860395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ffef0 msgr2=0x7f8bf810c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 --2- 172.21.15.5:0/2631860395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ffef0 0x7f8bf810c3b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000b0d0 tx=0x7f8bf000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 -- 172.21.15.5:0/2631860395 shutdown_connections 2023-10-08T13:05:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 --2- 172.21.15.5:0/2631860395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ffef0 0x7f8bf810c3b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 --2- 172.21.15.5:0/2631860395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bf81055f0 0x7f8bf81059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 --2- 172.21.15.5:0/2631860395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf80ff530 0x7f8bf80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 -- 172.21.15.5:0/2631860395 >> 172.21.15.5:0/2631860395 conn(0x7f8bf80fafc0 msgr2=0x7f8bf80fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 -- 172.21.15.5:0/2631860395 shutdown_connections 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.303+0000 7f8bff071700 1 -- 172.21.15.5:0/2631860395 wait complete. 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 Processor -- start 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 -- start start 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 0x7f8bf8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bf80ffef0 0x7f8bf8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf81055f0 0x7f8bf81a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81986e0 con 0x7f8bf80ff530 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81a2ef0 con 0x7f8bf81055f0 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bff071700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81a3030 con 0x7f8bf80ffef0 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bfce0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 0x7f8bf8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bfce0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 0x7f8bf8197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33754/0 (socket says 172.21.15.5:33754) 2023-10-08T13:05:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.304+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3107591734 learned_addr learned my addr 172.21.15.5:0/3107591734 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bf80ffef0 0x7f8bf8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf81055f0 0x7f8bf81a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3107591734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bf80ffef0 msgr2=0x7f8bf8197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bf80ffef0 0x7f8bf8197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3107591734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf81055f0 msgr2=0x7f8bf81a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf81055f0 0x7f8bf81a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3107591734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009d00 con 0x7f8bf80ff530 2023-10-08T13:05:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf81055f0 0x7f8bf81a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 0x7f8bf8197930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00d950 tx=0x7f8bec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bf5ffb700 1 -- 172.21.15.5:0/3107591734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec009940 con 0x7f8bf80ff530 2023-10-08T13:05:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bf5ffb700 1 -- 172.21.15.5:0/3107591734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bec010460 con 0x7f8bf80ff530 2023-10-08T13:05:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf81a32c0 con 0x7f8bf80ff530 2023-10-08T13:05:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bf5ffb700 1 -- 172.21.15.5:0/3107591734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00f620 con 0x7f8bf80ff530 2023-10-08T13:05:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.305+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf81a37d0 con 0x7f8bf80ff530 2023-10-08T13:05:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.307+0000 7f8bf5ffb700 1 -- 172.21.15.5:0/3107591734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f8bec0108d0 con 0x7f8bf80ff530 2023-10-08T13:05:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.308+0000 7f8bf5ffb700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8be80a1560 0x7f8be80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.308+0000 7f8bf5ffb700 1 -- 172.21.15.5:0/3107591734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8bec0cd1b0 con 0x7f8bf80ff530 2023-10-08T13:05:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.308+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8be80a1560 0x7f8be80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.308+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8be80a1560 0x7f8be80a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80681b0 tx=0x7f8be400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 Processor -- start 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 -- start start 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757ae30 0x5581b757b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 0x5581b75889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b74e4410 con 0x5581b7586600 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b74d5bd0 con 0x5581b757b750 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b74d34f0 con 0x5581b757ae30 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8bfd60e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 0x5581b75889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8bfd60e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 0x5581b75889f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33766/0 (socket says 172.21.15.5:33766) 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8bfd60e700 1 -- 172.21.15.5:0/403823424 learned_addr learned my addr 172.21.15.5:0/403823424 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.309+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757ae30 0x5581b757b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8bfd60e700 1 -- 172.21.15.5:0/403823424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757ae30 msgr2=0x5581b757b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757ae30 0x5581b757b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8bfd60e700 1 -- 172.21.15.5:0/403823424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 msgr2=0x5581b75860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75860c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8bfd60e700 1 -- 172.21.15.5:0/403823424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581b72f9d90 con 0x5581b7586600 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 0x5581b75889f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000cda0 tx=0x7f8bf000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d24cdd9a1fc29b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8be2ffd700 1 -- 172.21.15.5:0/403823424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000e050 con 0x5581b7586600 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8be2ffd700 1 -- 172.21.15.5:0/403823424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf0007d70 con 0x5581b7586600 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.310+0000 7f8be2ffd700 1 -- 172.21.15.5:0/403823424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00078a0 con 0x5581b7586600 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/403823424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 msgr2=0x5581b75889f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 0x5581b75889f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000cda0 tx=0x7f8bf000cdd0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/403823424 shutdown_connections 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b7586600 0x5581b75889f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757ae30 0x5581b757b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/403823424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75860c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/403823424 >> 172.21.15.5:0/403823424 conn(0x5581b74f0210 msgr2=0x5581b7577280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/403823424 shutdown_connections 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/403823424 wait complete. 2023-10-08T13:05:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 -- start start 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 Processor -- start 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7585f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.311+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757b750 0x5581b7583260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b7586600 0x5581b7583890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b74cede0 con 0x5581b757ae30 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b746b6c0 con 0x5581b7586600 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b746b360 con 0x5581b757b750 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8c0b25ab80 10 client.0 _ll_register_callbacks cb 0x5581b72c87b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7585f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7585f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33768/0 (socket says 172.21.15.5:33768) 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3914748886 learned_addr learned my addr 172.21.15.5:0/3914748886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757b750 0x5581b7583260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b7586600 0x5581b7583890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757b750 msgr2=0x5581b7583260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757b750 0x5581b7583260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3914748886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b7586600 msgr2=0x5581b7583890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b7586600 0x5581b7583890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 -- 172.21.15.5:0/3914748886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf810ccb0 con 0x5581b757ae30 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b7586600 0x5581b7583890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7585f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8bec010fd0 tx=0x7f8bec09a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a8215859aa3fd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bd7fff700 1 -- 172.21.15.5:0/3914748886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec09a380 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bd7fff700 1 -- 172.21.15.5:0/3914748886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8bec0a22b0 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581b7496e60 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.312+0000 7f8bd7fff700 1 -- 172.21.15.5:0/3914748886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bec099410 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 10 client.15426 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5581b72e2c10 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8bd7fff700 1 -- 172.21.15.5:0/3914748886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bec0b8030 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8bd7fff700 1 -- 172.21.15.5:0/3914748886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8bec0cad20 con 0x5581b757ae30 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 10 client.15426 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 10 client.15426 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 20 client.15426 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b7596140 0x5581b7594ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 4 client.15426 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 --> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581b74c7dc0 con 0x5581b7596140 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.313+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b7596140 0x5581b7594ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8bd7fff700 10 client.15426 ms_handle_connect on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b7596140 0x5581b7594ba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d0bb7ede482543e server_cookie=886ed1d6a56bc2fe in_seq=0 out_seq=0 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8bd7fff700 1 -- 172.21.15.5:0/3914748886 <== mds.2 v2:172.21.15.118:6836/1772997298 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5581b74c7dc0 con 0x5581b7596140 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8bd7fff700 10 client.15426 handle_command_reply: tid=0 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8c0b25ab80 1 client.15426 shutdown 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 msgr2=0x5581b7585f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7585f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8bec010fd0 tx=0x7f8bec09a710 comp rx=0 tx=0).stop 2023-10-08T13:05:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.314+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 shutdown_connections 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b7586600 0x5581b7583890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b7596140 0x5581b7594ba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7585f70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8bd7fff700 0 client.15426 ms_handle_reset on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/3914748886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b757b750 0x5581b7583260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 >> 172.21.15.5:0/3914748886 conn(0x5581b74f0210 msgr2=0x5581b7576e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 shutdown_connections 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/3914748886 wait complete. 2023-10-08T13:05:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.315+0000 7f8c0b25ab80 20 client.15426 trim_cache size 0 max 16384 2023-10-08T13:05:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 Processor -- start 2023-10-08T13:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 -- start start 2023-10-08T13:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7592110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b75804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b734f8d0 con 0x5581b757ae30 2023-10-08T13:05:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b75957f0 con 0x5581b757b750 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b748d590 con 0x5581b7586600 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7592110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7592110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33776/0 (socket says 172.21.15.5:33776) 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 -- 172.21.15.5:0/588055820 learned_addr learned my addr 172.21.15.5:0/588055820 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 -- 172.21.15.5:0/588055820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 msgr2=0x5581b75804c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b75804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b75804c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 -- 172.21.15.5:0/588055820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 msgr2=0x5581b75952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 -- 172.21.15.5:0/588055820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581b7320200 con 0x5581b757ae30 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.333+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7592110 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009520 tx=0x7f8bec09e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e8fbcace336adf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8be37fe700 1 -- 172.21.15.5:0/588055820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec095d60 con 0x5581b757ae30 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8be37fe700 1 -- 172.21.15.5:0/588055820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bec0b8040 con 0x5581b757ae30 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8be37fe700 1 -- 172.21.15.5:0/588055820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec099410 con 0x5581b757ae30 2023-10-08T13:05:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/588055820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 msgr2=0x5581b7592110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7592110 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009520 tx=0x7f8bec09e1f0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/588055820 shutdown_connections 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b75804c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757ae30 0x5581b7592110 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/588055820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757b750 0x5581b75952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/588055820 >> 172.21.15.5:0/588055820 conn(0x5581b74f0210 msgr2=0x5581b7594ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/588055820 shutdown_connections 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/588055820 wait complete. 2023-10-08T13:05:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.334+0000 7f8c0b25ab80 1 -- start start 2023-10-08T13:05:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 Processor -- start 2023-10-08T13:05:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757ae30 0x5581b757f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 0x5581b757fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b7580300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b75edca0 con 0x5581b757b750 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b75ede10 con 0x5581b757ae30 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b75edfd0 con 0x5581b7586600 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8c0b25ab80 10 client.0 _ll_register_callbacks cb 0x7f8bec099b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 0x5581b757fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 0x5581b757fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33784/0 (socket says 172.21.15.5:33784) 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 -- 172.21.15.5:0/2159691311 learned_addr learned my addr 172.21.15.5:0/2159691311 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757ae30 0x5581b757f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bfd60e700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b7580300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 -- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 msgr2=0x5581b7580300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b7580300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 -- 172.21.15.5:0/2159691311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757ae30 msgr2=0x5581b757f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757ae30 0x5581b757f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.335+0000 7f8bf7fff700 1 -- 172.21.15.5:0/2159691311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581b72e2c10 con 0x5581b757b750 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bf7fff700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 0x5581b757fdc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8be400ba80 tx=0x7f8be40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62839eb3d480f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bd7fff700 1 -- 172.21.15.5:0/2159691311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4024040 con 0x5581b757b750 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bd7fff700 1 -- 172.21.15.5:0/2159691311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f8be4017070 con 0x5581b757b750 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bf0007d70 con 0x5581b757b750 2023-10-08T13:05:29.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bd7fff700 1 -- 172.21.15.5:0/2159691311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8be4029b00 con 0x5581b757b750 2023-10-08T13:05:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 10 client.15432 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5581b72f8260 con 0x5581b757b750 2023-10-08T13:05:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bd7fff700 1 -- 172.21.15.5:0/2159691311 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8bf0007d70 con 0x5581b757b750 2023-10-08T13:05:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8bd7fff700 1 -- 172.21.15.5:0/2159691311 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8be401f550 con 0x5581b757b750 2023-10-08T13:05:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 10 client.15432 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 20 client.15432 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b75f32f0 0x5581b75ef770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 4 client.15432 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.336+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 --> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5581b74c7ae0 con 0x5581b75f32f0 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b75f32f0 0x5581b75ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8bfce0d700 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b75f32f0 0x5581b75ef770 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bdca6e7f7325be3 server_cookie=c4db3dd41806b5b2 in_seq=0 out_seq=0 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8bd7fff700 10 client.15432 ms_handle_connect on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8bd7fff700 1 -- 172.21.15.5:0/2159691311 <== mds.2 v2:172.21.15.118:6836/1772997298 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5581b74c7ae0 con 0x5581b75f32f0 2023-10-08T13:05:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8bd7fff700 10 client.15432 handle_command_reply: tid=0 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 client.15432 shutdown 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 msgr2=0x5581b757fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 0x5581b757fdc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8be400ba80 tx=0x7f8be40047c0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 shutdown_connections 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581b7586600 0x5581b7580300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581b757ae30 0x5581b757f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x5581b75f32f0 0x5581b75ef770 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 --2- 172.21.15.5:0/2159691311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581b757b750 0x5581b757fdc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8bd7fff700 0 client.15432 ms_handle_reset on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 >> 172.21.15.5:0/2159691311 conn(0x5581b74f0210 msgr2=0x5581b75827a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.337+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 shutdown_connections 2023-10-08T13:05:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8c0b25ab80 1 -- 172.21.15.5:0/2159691311 wait complete. 2023-10-08T13:05:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8c0b25ab80 20 client.15432 trim_cache size 0 max 16384 2023-10-08T13:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24649, 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 58.206998552000002, 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 89, 2023-10-08T13:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 95.228543211000002 2023-10-08T13:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8be80a1560 msgr2=0x7f8be80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8be80a1560 0x7f8be80a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80681b0 tx=0x7f8be400b410 comp rx=0 tx=0).stop 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 msgr2=0x7f8bf8197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 0x7f8bf8197930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00d950 tx=0x7f8bec00dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 shutdown_connections 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8be80a1560 0x7f8be80a3a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf81055f0 0x7f8bf81a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf80ff530 0x7f8bf8197930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 --2- 172.21.15.5:0/3107591734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bf80ffef0 0x7f8bf8197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 >> 172.21.15.5:0/3107591734 conn(0x7f8bf80fafc0 msgr2=0x7f8bf80fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 shutdown_connections 2023-10-08T13:05:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.338+0000 7f8bff071700 1 -- 172.21.15.5:0/3107591734 wait complete. 2023-10-08T13:05:29.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T13:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.480+0000 7f4019a82700 1 -- 172.21.15.5:0/3963820167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 msgr2=0x7f4014101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.480+0000 7f4019a82700 1 --2- 172.21.15.5:0/3963820167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f4014101c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4008009990 tx=0x7f4008009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.480+0000 7f4019a82700 1 -- 172.21.15.5:0/3963820167 shutdown_connections 2023-10-08T13:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.480+0000 7f4019a82700 1 --2- 172.21.15.5:0/3963820167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 0x7f401410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 --2- 172.21.15.5:0/3963820167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f4014101c40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 --2- 172.21.15.5:0/3963820167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 0x7f401410a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 -- 172.21.15.5:0/3963820167 >> 172.21.15.5:0/3963820167 conn(0x7f40140fafc0 msgr2=0x7f40140fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 -- 172.21.15.5:0/3963820167 shutdown_connections 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 -- 172.21.15.5:0/3963820167 wait complete. 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 Processor -- start 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.481+0000 7f4019a82700 1 -- start start 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f401419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 0x7f401419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 0x7f40141968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014196f30 con 0x7f4014101860 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141970a0 con 0x7f4014102180 2023-10-08T13:05:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014197260 con 0x7f401410ac30 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f401419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f401419c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33794/0 (socket says 172.21.15.5:33794) 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 -- 172.21.15.5:0/2356963955 learned_addr learned my addr 172.21.15.5:0/2356963955 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4013fff700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 0x7f40141968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4012ffd700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 0x7f401419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 -- 172.21.15.5:0/2356963955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 msgr2=0x7f40141968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 0x7f40141968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 -- 172.21.15.5:0/2356963955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 msgr2=0x7f401419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 0x7f401419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 -- 172.21.15.5:0/2356963955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080095f0 con 0x7f4014101860 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4013fff700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 0x7f40141968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4012ffd700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 0x7f401419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f40137fe700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f401419c7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f40080098e0 tx=0x7f400800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4010ff9700 1 -- 172.21.15.5:0/2356963955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400801d070 con 0x7f4014101860 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40141974e0 con 0x7f4014101860 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4010ff9700 1 -- 172.21.15.5:0/2356963955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f400800fb90 con 0x7f4014101860 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4010ff9700 1 -- 172.21.15.5:0/2356963955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008017650 con 0x7f4014101860 2023-10-08T13:05:29.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.482+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40141a3790 con 0x7f4014101860 2023-10-08T13:05:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.485+0000 7f4010ff9700 1 -- 172.21.15.5:0/2356963955 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f400800fd00 con 0x7f4014101860 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.485+0000 7f4010ff9700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3ffc0a1560 0x7f3ffc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.485+0000 7f4012ffd700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3ffc0a1560 0x7f3ffc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.485+0000 7f4010ff9700 1 -- 172.21.15.5:0/2356963955 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f40080ce390 con 0x7f4014101860 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4012ffd700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3ffc0a1560 0x7f3ffc0a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4014197a90 tx=0x7f4004005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 Processor -- start 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 -- start start 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 0x55ee8b42c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b4370c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b395410 con 0x55ee8b42be30 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b386bd0 con 0x55ee8b437600 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b3844f0 con 0x55ee8b42c750 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f40137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 0x55ee8b42c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.486+0000 7f40137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 0x55ee8b42c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33802/0 (socket says 172.21.15.5:33802) 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 -- 172.21.15.5:0/3913516604 learned_addr learned my addr 172.21.15.5:0/3913516604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f4013fff700 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f4012ffd700 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b4370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 -- 172.21.15.5:0/3913516604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 msgr2=0x55ee8b4370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b4370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 -- 172.21.15.5:0/3913516604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 msgr2=0x55ee8b4399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 -- 172.21.15.5:0/3913516604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee8b1aad90 con 0x55ee8b42be30 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f4013fff700 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f40137fe700 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 0x55ee8b42c210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f40080a3060 tx=0x7f400809aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40447d81a0301de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f3ff9ffb700 1 -- 172.21.15.5:0/3913516604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400809b290 con 0x55ee8b42be30 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f3ff9ffb700 1 -- 172.21.15.5:0/3913516604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f400809f3e0 con 0x55ee8b42be30 2023-10-08T13:05:29.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.487+0000 7f3ff9ffb700 1 -- 172.21.15.5:0/3913516604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400809a780 con 0x55ee8b42be30 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 -- 172.21.15.5:0/3913516604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 msgr2=0x55ee8b42c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 0x55ee8b42c210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f40080a3060 tx=0x7f400809aea0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 -- 172.21.15.5:0/3913516604 shutdown_connections 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42be30 0x55ee8b42c210 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/3913516604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b4370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 -- 172.21.15.5:0/3913516604 >> 172.21.15.5:0/3913516604 conn(0x55ee8b3a1210 msgr2=0x55ee8b428280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 -- 172.21.15.5:0/3913516604 shutdown_connections 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 -- 172.21.15.5:0/3913516604 wait complete. 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.488+0000 7f4025c6bb80 1 -- start start 2023-10-08T13:05:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 Processor -- start 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b4379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b437f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b438460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b37fde0 con 0x55ee8b42c750 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b31c6c0 con 0x55ee8b437600 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b31c360 con 0x55ee8b42be30 2023-10-08T13:05:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4025c6bb80 10 client.0 _ll_register_callbacks cb 0x55ee8b1797b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b437f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b437f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33810/0 (socket says 172.21.15.5:33810) 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 -- 172.21.15.5:0/4248860476 learned_addr learned my addr 172.21.15.5:0/4248860476 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f40137fe700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b4379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4013fff700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b438460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 -- 172.21.15.5:0/4248860476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 msgr2=0x55ee8b4379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b4379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 -- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 msgr2=0x55ee8b438460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b438460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.489+0000 7f4012ffd700 1 -- 172.21.15.5:0/4248860476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40141a3790 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4012ffd700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b437f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f400400a540 tx=0x7f4004004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73de09681d3ae56 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f3ff2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4248860476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004004a30 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4248860476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4004004b90 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee8b347e60 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4248860476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4004010e70 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 10 client.15444 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee8b193c10 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4248860476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee8b347e60 con 0x55ee8b42c750 2023-10-08T13:05:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4248860476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4004023030 con 0x55ee8b42c750 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 10 client.15444 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 20 client.15444 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.490+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b446d40 0x55ee8b445830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.491+0000 7f4025c6bb80 4 client.15444 mds_command: new command op to 24650 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.491+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 --> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee8b378dc0 con 0x55ee8b446d40 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.491+0000 7f40137fe700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b446d40 0x55ee8b445830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.491+0000 7f3ff2ffd700 10 client.15444 ms_handle_connect on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.491+0000 7f40137fe700 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b446d40 0x55ee8b445830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab9b341e068b27e3 server_cookie=a1db028b5b9e9064 in_seq=0 out_seq=0 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4248860476 <== mds.1 v2:172.21.15.60:6838/2598964762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee8b378dc0 con 0x55ee8b446d40 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f3ff2ffd700 10 client.15444 handle_command_reply: tid=0 2023-10-08T13:05:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 client.15444 shutdown 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 msgr2=0x55ee8b437f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b437f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f400400a540 tx=0x7f4004004750 comp rx=0 tx=0).stop 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 shutdown_connections 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b446d40 0x55ee8b445830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b438460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f3ff2ffd700 0 client.15444 ms_handle_reset on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b4379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4248860476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b437f20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 >> 172.21.15.5:0/4248860476 conn(0x55ee8b3a1210 msgr2=0x55ee8b427e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 shutdown_connections 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.492+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4248860476 wait complete. 2023-10-08T13:05:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.493+0000 7f4025c6bb80 20 client.15444 trim_cache size 0 max 16384 2023-10-08T13:05:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.510+0000 7f4025c6bb80 1 Processor -- start 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.510+0000 7f4025c6bb80 1 -- start start 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.510+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b430f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.510+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b435060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b2008d0 con 0x55ee8b42c750 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b42d7c0 con 0x55ee8b437600 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b381070 con 0x55ee8b42be30 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b435060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b435060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33818/0 (socket says 172.21.15.5:33818) 2023-10-08T13:05:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 -- 172.21.15.5:0/1900264612 learned_addr learned my addr 172.21.15.5:0/1900264612 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f40137fe700 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b430f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 -- 172.21.15.5:0/1900264612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 msgr2=0x55ee8b430f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b430f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 -- 172.21.15.5:0/1900264612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 msgr2=0x55ee8b4355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 -- 172.21.15.5:0/1900264612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee8b1d1200 con 0x55ee8b42c750 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f4012ffd700 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b435060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4004013040 tx=0x7f400400aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe63d2489d904aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f3ffa7fc700 1 -- 172.21.15.5:0/1900264612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400401db70 con 0x55ee8b42c750 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f3ffa7fc700 1 -- 172.21.15.5:0/1900264612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4004004cf0 con 0x55ee8b42c750 2023-10-08T13:05:29.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.511+0000 7f3ffa7fc700 1 -- 172.21.15.5:0/1900264612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004005480 con 0x55ee8b42c750 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 -- 172.21.15.5:0/1900264612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 msgr2=0x55ee8b435060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b435060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4004013040 tx=0x7f400400aa10 comp rx=0 tx=0).stop 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 -- 172.21.15.5:0/1900264612 shutdown_connections 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b437600 0x55ee8b4355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42be30 0x55ee8b430f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/1900264612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b42c750 0x55ee8b435060 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 -- 172.21.15.5:0/1900264612 >> 172.21.15.5:0/1900264612 conn(0x55ee8b3a1210 msgr2=0x55ee8b427480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 -- 172.21.15.5:0/1900264612 shutdown_connections 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 -- 172.21.15.5:0/1900264612 wait complete. 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 -- start start 2023-10-08T13:05:29.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.512+0000 7f4025c6bb80 1 Processor -- start 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b42be30 0x55ee8b44f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b44bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 0x55ee8b44c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b44c8f0 con 0x55ee8b437600 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b44ca60 con 0x55ee8b42be30 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee8b49a740 con 0x55ee8b42c750 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4025c6bb80 10 client.0 _ll_register_callbacks cb 0x7f400400ecc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 0x55ee8b44c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4012ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b44bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 0x55ee8b44c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33826/0 (socket says 172.21.15.5:33826) 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 -- 172.21.15.5:0/4069200549 learned_addr learned my addr 172.21.15.5:0/4069200549 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f40137fe700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b42be30 0x55ee8b44f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 -- 172.21.15.5:0/4069200549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 msgr2=0x55ee8b44bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b44bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 -- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b42be30 msgr2=0x55ee8b44f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b42be30 0x55ee8b44f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 -- 172.21.15.5:0/4069200549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee8b193c10 con 0x55ee8b437600 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4012ffd700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b44bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f4013fff700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 0x55ee8b44c1e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f400c007af0 tx=0x7f400c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecde6d364a4ad8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.513+0000 7f3ff2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4069200549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0138d0 con 0x55ee8b437600 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4069200549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f400c013a30 con 0x55ee8b437600 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f400809f3e0 con 0x55ee8b437600 2023-10-08T13:05:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4069200549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f400c013bf0 con 0x55ee8b437600 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 10 client.15450 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee8b1a9260 con 0x55ee8b437600 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4069200549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f400809f3e0 con 0x55ee8b437600 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4069200549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f400c0163d0 con 0x55ee8b437600 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 10 client.15450 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 20 client.15450 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b49fa90 0x55ee8b49beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 4 client.15450 mds_command: new command op to 24650 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 --> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ee8b378ae0 con 0x55ee8b49fa90 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.514+0000 7f40137fe700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b49fa90 0x55ee8b49beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f3ff2ffd700 10 client.15450 ms_handle_connect on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f40137fe700 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b49fa90 0x55ee8b49beb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ead655098f81d89 server_cookie=c6e2c2cb073d8c2d in_seq=0 out_seq=0 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f3ff2ffd700 1 -- 172.21.15.5:0/4069200549 <== mds.1 v2:172.21.15.60:6838/2598964762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ee8b378ae0 con 0x55ee8b49fa90 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f3ff2ffd700 10 client.15450 handle_command_reply: tid=0 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 client.15450 shutdown 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 msgr2=0x55ee8b44c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 0x55ee8b44c1e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f400c007af0 tx=0x7f400c007e00 comp rx=0 tx=0).stop 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 shutdown_connections 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x55ee8b49fa90 0x55ee8b49beb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee8b437600 0x55ee8b44c1e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee8b42be30 0x55ee8b44f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f3ff2ffd700 0 client.15450 ms_handle_reset on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 --2- 172.21.15.5:0/4069200549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ee8b42c750 0x55ee8b44bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 >> 172.21.15.5:0/4069200549 conn(0x55ee8b3a1210 msgr2=0x55ee8b435020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 shutdown_connections 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.515+0000 7f4025c6bb80 1 -- 172.21.15.5:0/4069200549 wait complete. 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4025c6bb80 20 client.15450 trim_cache size 0 max 16384 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:29.525 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24650, 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 59.396448456000002, 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 89, 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 83.912615001999995 2023-10-08T13:05:29.526 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3ffc0a1560 msgr2=0x7f3ffc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3ffc0a1560 0x7f3ffc0a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4014197a90 tx=0x7f4004005f50 comp rx=0 tx=0).stop 2023-10-08T13:05:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 msgr2=0x7f401419c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f401419c7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f40080098e0 tx=0x7f400800f720 comp rx=0 tx=0).stop 2023-10-08T13:05:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 shutdown_connections 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3ffc0a1560 0x7f3ffc0a3a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f401410ac30 0x7f40141968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014101860 0x7f401419c7a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 --2- 172.21.15.5:0/2356963955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4014102180 0x7f401419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 >> 172.21.15.5:0/2356963955 conn(0x7f40140fafc0 msgr2=0x7f40140fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 shutdown_connections 2023-10-08T13:05:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.516+0000 7f4019a82700 1 -- 172.21.15.5:0/2356963955 wait complete. 2023-10-08T13:05:29.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T13:05:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 -- 172.21.15.5:0/2211676165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480fff30 msgr2=0x7fa84810c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 --2- 172.21.15.5:0/2211676165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480fff30 0x7fa84810c3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa8400099c0 tx=0x7fa840009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 -- 172.21.15.5:0/2211676165 shutdown_connections 2023-10-08T13:05:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 --2- 172.21.15.5:0/2211676165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480fff30 0x7fa84810c3f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 --2- 172.21.15.5:0/2211676165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848105630 0x7fa848105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 --2- 172.21.15.5:0/2211676165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8480ff570 0x7fa8480ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 -- 172.21.15.5:0/2211676165 >> 172.21.15.5:0/2211676165 conn(0x7fa8480fb020 msgr2=0x7fa8480fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 -- 172.21.15.5:0/2211676165 shutdown_connections 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 -- 172.21.15.5:0/2211676165 wait complete. 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 Processor -- start 2023-10-08T13:05:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.657+0000 7fa84d665700 1 -- start start 2023-10-08T13:05:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 0x7fa84819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8480fff30 0x7fa84819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa848105630 0x7fa848195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848195d70 con 0x7fa8480ff570 2023-10-08T13:05:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848195ee0 con 0x7fa8480fff30 2023-10-08T13:05:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481960a0 con 0x7fa848105630 2023-10-08T13:05:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 0x7fa84819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 0x7fa84819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33836/0 (socket says 172.21.15.5:33836) 2023-10-08T13:05:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 -- 172.21.15.5:0/2054418611 learned_addr learned my addr 172.21.15.5:0/2054418611 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa8477fe700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa848105630 0x7fa848195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8480fff30 0x7fa84819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 -- 172.21.15.5:0/2054418611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa848105630 msgr2=0x7fa848195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa848105630 0x7fa848195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 -- 172.21.15.5:0/2054418611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8480fff30 msgr2=0x7fa84819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8480fff30 0x7fa84819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 -- 172.21.15.5:0/2054418611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830009520 con 0x7fa8480ff570 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8480fff30 0x7fa84819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 0x7fa84819b590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa838007f10 tx=0x7fa83800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa83ffff700 1 -- 172.21.15.5:0/2054418611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800de90 con 0x7fa8480ff570 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa83ffff700 1 -- 172.21.15.5:0/2054418611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa83800f040 con 0x7fa8480ff570 2023-10-08T13:05:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa83ffff700 1 -- 172.21.15.5:0/2054418611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838015400 con 0x7fa8480ff570 2023-10-08T13:05:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.658+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8400095f0 con 0x7fa8480ff570 2023-10-08T13:05:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.659+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8481a23a0 con 0x7fa8480ff570 2023-10-08T13:05:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.661+0000 7fa83ffff700 1 -- 172.21.15.5:0/2054418611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fa838003a00 con 0x7fa8480ff570 2023-10-08T13:05:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.661+0000 7fa83ffff700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8340a15e0 0x7fa8340a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.661+0000 7fa83ffff700 1 -- 172.21.15.5:0/2054418611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa8380cce70 con 0x7fa8480ff570 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.661+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8340a15e0 0x7fa8340a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.662+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8340a15e0 0x7fa8340a3aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa848196dd0 tx=0x7fa830009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.662+0000 7fa85984eb80 1 Processor -- start 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.662+0000 7fa85984eb80 1 -- start start 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be182109f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa85984eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be1816c410 con 0x55be18203750 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa85984eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be1815dbd0 con 0x55be1820e600 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa85984eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be1815b4f0 con 0x55be18202e30 2023-10-08T13:05:29.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33846/0 (socket says 172.21.15.5:33846) 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 -- 172.21.15.5:0/258830272 learned_addr learned my addr 172.21.15.5:0/258830272 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa846ffd700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8477fe700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be182109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 -- 172.21.15.5:0/258830272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 msgr2=0x55be18203210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 -- 172.21.15.5:0/258830272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 msgr2=0x55be182109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be182109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 -- 172.21.15.5:0/258830272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be17f81d90 con 0x55be18203750 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8477fe700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be182109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa846ffd700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa8467fc700 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820e0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa830010f10 tx=0x7fa830013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c57e9acadff7eec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa83d7fa700 1 -- 172.21.15.5:0/258830272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830012dc0 con 0x55be18203750 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa83d7fa700 1 -- 172.21.15.5:0/258830272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8300099e0 con 0x55be18203750 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.663+0000 7fa83d7fa700 1 -- 172.21.15.5:0/258830272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83001e710 con 0x55be18203750 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 -- 172.21.15.5:0/258830272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 msgr2=0x55be1820e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820e0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa830010f10 tx=0x7fa830013000 comp rx=0 tx=0).stop 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 -- 172.21.15.5:0/258830272 shutdown_connections 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be182109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 --2- 172.21.15.5:0/258830272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820e0c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 -- 172.21.15.5:0/258830272 >> 172.21.15.5:0/258830272 conn(0x55be18178210 msgr2=0x55be181ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 -- 172.21.15.5:0/258830272 shutdown_connections 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.664+0000 7fa85984eb80 1 -- 172.21.15.5:0/258830272 wait complete. 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 -- start start 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 Processor -- start 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be1820df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be1820b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be18156de0 con 0x55be18203750 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be180f36c0 con 0x55be1820e600 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be180f3360 con 0x55be18202e30 2023-10-08T13:05:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa85984eb80 10 client.0 _ll_register_callbacks cb 0x55be17f507b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33852/0 (socket says 172.21.15.5:33852) 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 -- 172.21.15.5:0/2674731474 learned_addr learned my addr 172.21.15.5:0/2674731474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be1820df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8477fe700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be1820b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 -- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 msgr2=0x55be1820df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be1820df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 -- 172.21.15.5:0/2674731474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 msgr2=0x55be1820b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be1820b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8467fc700 1 -- 172.21.15.5:0/2674731474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8481a23a0 con 0x55be18203750 2023-10-08T13:05:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.665+0000 7fa8477fe700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be1820b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820b270 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa83001ff20 tx=0x7fa830012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0d7954a0ff1431 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa82e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2674731474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83002e070 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2674731474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa83001f660 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be1811ee60 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2674731474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa83001f820 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 10 client.15462 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa830010bf0 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2674731474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55be1811ee60 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2674731474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa8300053b0 con 0x55be18203750 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 10 client.15462 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 10 client.15462 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 20 client.15462 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be1821e090 0x55be1821cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 4 client.15462 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.666+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be1814fdc0 con 0x55be1821e090 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.667+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be1821e090 0x55be1821cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.667+0000 7fa82e7fc700 10 client.15462 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.667+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be1821e090 0x55be1821cbb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8014999390cd4b server_cookie=4210a09d9b005064 in_seq=0 out_seq=0 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2674731474 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be1814fdc0 con 0x55be1821e090 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa82e7fc700 10 client.15462 handle_command_reply: tid=0 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 client.15462 shutdown 2023-10-08T13:05:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 msgr2=0x55be1820b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820b270 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa83001ff20 tx=0x7fa830012ea0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 shutdown_connections 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be1821e090 0x55be1821cbb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be1820b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa82e7fc700 0 client.15462 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be1820df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2674731474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be1820b270 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 >> 172.21.15.5:0/2674731474 conn(0x55be18178210 msgr2=0x55be181fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 shutdown_connections 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 1 -- 172.21.15.5:0/2674731474 wait complete. 2023-10-08T13:05:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.668+0000 7fa85984eb80 20 client.15462 trim_cache size 0 max 16384 2023-10-08T13:05:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 Processor -- start 2023-10-08T13:05:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 -- start start 2023-10-08T13:05:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18203750 0x55be1821a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 0x55be18206580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be17fd78d0 con 0x55be1820e600 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be180fd4d0 con 0x55be18202e30 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.686+0000 7fa85984eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be17fe3de0 con 0x55be18203750 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 0x55be18206580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 0x55be18206580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33862/0 (socket says 172.21.15.5:33862) 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 -- 172.21.15.5:0/1058685098 learned_addr learned my addr 172.21.15.5:0/1058685098 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8467fc700 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18203750 0x55be1821a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa846ffd700 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 -- 172.21.15.5:0/1058685098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18203750 msgr2=0x55be1821a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18203750 0x55be1821a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 -- 172.21.15.5:0/1058685098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be18202e30 msgr2=0x55be18203210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 -- 172.21.15.5:0/1058685098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be17f6ac10 con 0x55be1820e600 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa846ffd700 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa8477fe700 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 0x55be18206580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa840015000 tx=0x7fa840005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ae4050dd4a184e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa83dffb700 1 -- 172.21.15.5:0/1058685098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84001d030 con 0x55be1820e600 2023-10-08T13:05:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa83dffb700 1 -- 172.21.15.5:0/1058685098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa84001e040 con 0x55be1820e600 2023-10-08T13:05:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.687+0000 7fa83dffb700 1 -- 172.21.15.5:0/1058685098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840003ae0 con 0x55be1820e600 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 -- 172.21.15.5:0/1058685098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 msgr2=0x55be18206580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 0x55be18206580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa840015000 tx=0x7fa840005c60 comp rx=0 tx=0).stop 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 -- 172.21.15.5:0/1058685098 shutdown_connections 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1820e600 0x55be18206580 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be18202e30 0x55be18203210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 --2- 172.21.15.5:0/1058685098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18203750 0x55be1821a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 -- 172.21.15.5:0/1058685098 >> 172.21.15.5:0/1058685098 conn(0x55be18178210 msgr2=0x55be181fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 -- 172.21.15.5:0/1058685098 shutdown_connections 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 -- 172.21.15.5:0/1058685098 wait complete. 2023-10-08T13:05:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 -- start start 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.688+0000 7fa85984eb80 1 Processor -- start 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be182078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be18207e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be18208370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be182091c0 con 0x55be18203750 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be18209330 con 0x55be1820e600 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be18273aa0 con 0x55be18202e30 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 10 client.0 _ll_register_callbacks cb 0x7fa838009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be18207e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be18207e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33866/0 (socket says 172.21.15.5:33866) 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 -- 172.21.15.5:0/2241411143 learned_addr learned my addr 172.21.15.5:0/2241411143 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be182078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 -- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 msgr2=0x55be182078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be182078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 -- 172.21.15.5:0/2241411143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 msgr2=0x55be18208370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be18208370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 -- 172.21.15.5:0/2241411143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84810ccf0 con 0x55be18203750 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa8467fc700 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be18207e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa830013fd0 tx=0x7fa83001fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663de8143ba902e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa82e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2241411143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83002e050 con 0x55be18203750 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2241411143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa830028900 con 0x55be18203750 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8300099e0 con 0x55be18203750 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2241411143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa830012a10 con 0x55be18203750 2023-10-08T13:05:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 10 client.15468 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.689+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55be17fa8200 con 0x55be18203750 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2241411143 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8300099e0 con 0x55be18203750 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2241411143 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa830049070 con 0x55be18203750 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa85984eb80 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa85984eb80 10 client.15468 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa85984eb80 20 client.15468 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be18278900 0x55be18274d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa85984eb80 4 client.15468 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be1814fae0 con 0x55be18278900 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.690+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be18278900 0x55be18274d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa846ffd700 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be18278900 0x55be18274d00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b83d0c467ef442d server_cookie=eefd93e0d7fca952 in_seq=0 out_seq=0 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa82e7fc700 10 client.15468 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa82e7fc700 1 -- 172.21.15.5:0/2241411143 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55be1814fae0 con 0x55be18278900 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa82e7fc700 10 client.15468 handle_command_reply: tid=0 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 client.15468 shutdown 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 msgr2=0x55be18207e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be18207e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa830013fd0 tx=0x7fa83001fd90 comp rx=0 tx=0).stop 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 shutdown_connections 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55be18278900 0x55be18274d00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55be1820e600 0x55be18208370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa82e7fc700 0 client.15468 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55be18202e30 0x55be182078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 --2- 172.21.15.5:0/2241411143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be18203750 0x55be18207e30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 >> 172.21.15.5:0/2241411143 conn(0x55be18178210 msgr2=0x55be18209a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 shutdown_connections 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 1 -- 172.21.15.5:0/2241411143 wait complete. 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.691+0000 7fa85984eb80 20 client.15468 trim_cache size 0 max 16384 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24667, 2023-10-08T13:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 78.578026237000003, 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 89, 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 90.845398008000004 2023-10-08T13:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8340a15e0 msgr2=0x7fa8340a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8340a15e0 0x7fa8340a3aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa848196dd0 tx=0x7fa830009260 comp rx=0 tx=0).stop 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 msgr2=0x7fa84819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 0x7fa84819b590 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa838007f10 tx=0x7fa83800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 shutdown_connections 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8340a15e0 0x7fa8340a3aa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa848105630 0x7fa848195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8480ff570 0x7fa84819b590 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 --2- 172.21.15.5:0/2054418611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8480fff30 0x7fa84819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 >> 172.21.15.5:0/2054418611 conn(0x7fa8480fb020 msgr2=0x7fa8480fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 shutdown_connections 2023-10-08T13:05:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:29.692+0000 7fa84d665700 1 -- 172.21.15.5:0/2054418611 wait complete. 2023-10-08T13:05:29.705 INFO:tasks.cephadm:Setup complete, yielding 2023-10-08T13:05:29.705 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T13:05:29.715 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:05:29.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-08T13:05:30.281 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:31.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:30 smithi060 ceph-mon[103190]: pgmap v283: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:05:31.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:30 smithi005 ceph-mon[99496]: pgmap v283: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:05:31.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:30 smithi118 ceph-mon[104234]: pgmap v283: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:05:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1970653753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b380ff6e0 msgr2=0x7f6b380ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1970653753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b380ff6e0 0x7f6b380ffb60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009990 tx=0x7f6b20009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1970653753 shutdown_connections 2023-10-08T13:05:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1970653753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b381000a0 0x7f6b3810c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1970653753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b381045b0 0x7f6b38104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1970653753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b380ff6e0 0x7f6b380ffb60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1970653753 >> 172.21.15.5:0/1970653753 conn(0x7f6b380766c0 msgr2=0x7f6b38076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1970653753 shutdown_connections 2023-10-08T13:05:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.582+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1970653753 wait complete. 2023-10-08T13:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 Processor -- start 2023-10-08T13:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 -- start start 2023-10-08T13:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b380ff6e0 0x7f6b38101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 0x7f6b381017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b381045b0 0x7f6b38101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381a5030 con 0x7f6b381000a0 2023-10-08T13:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381a51a0 con 0x7f6b380ff6e0 2023-10-08T13:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3e28f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381a5360 con 0x7f6b381045b0 2023-10-08T13:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 0x7f6b381017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 0x7f6b381017a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33878/0 (socket says 172.21.15.5:33878) 2023-10-08T13:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b377fe700 1 -- 172.21.15.5:0/1510970489 learned_addr learned my addr 172.21.15.5:0/1510970489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b37fff700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b380ff6e0 0x7f6b38101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.583+0000 7f6b3c82c700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b381045b0 0x7f6b38101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b377fe700 1 -- 172.21.15.5:0/1510970489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b381045b0 msgr2=0x7f6b38101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b377fe700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b381045b0 0x7f6b38101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b377fe700 1 -- 172.21.15.5:0/1510970489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b380ff6e0 msgr2=0x7f6b38101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b377fe700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b380ff6e0 0x7f6b38101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b377fe700 1 -- 172.21.15.5:0/1510970489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200095f0 con 0x7f6b381000a0 2023-10-08T13:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b377fe700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 0x7f6b381017a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098e0 tx=0x7f6b2000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2001d070 con 0x7f6b381000a0 2023-10-08T13:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b20022470 con 0x7f6b381000a0 2023-10-08T13:05:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b381a55e0 con 0x7f6b381000a0 2023-10-08T13:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20017650 con 0x7f6b381000a0 2023-10-08T13:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.584+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b381a5a80 con 0x7f6b381000a0 2023-10-08T13:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.585+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b38108c30 con 0x7f6b381000a0 2023-10-08T13:05:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.586+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6b200225e0 con 0x7f6b381000a0 2023-10-08T13:05:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.586+0000 7f6b357fa700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6b240a1560 0x7f6b240a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.587+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6b200ce2d0 con 0x7f6b381000a0 2023-10-08T13:05:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.587+0000 7f6b37fff700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6b240a1560 0x7f6b240a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.587+0000 7f6b37fff700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6b240a1560 0x7f6b240a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005950 tx=0x7f6b2800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.591+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b20097470 con 0x7f6b381000a0 2023-10-08T13:05:31.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.805+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b381026f0 con 0x7f6b240a1560 2023-10-08T13:05:31.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.807+0000 7f6b357fa700 1 -- 172.21.15.5:0/1510970489 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6b381026f0 con 0x7f6b240a1560 2023-10-08T13:05:31.808 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2023-10-08T13:05:31.808 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2023-10-08T13:05:31.808 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.808+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6b240a1560 msgr2=0x7f6b240a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.808+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6b240a1560 0x7f6b240a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005950 tx=0x7f6b2800a300 comp rx=0 tx=0).stop 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.808+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 msgr2=0x7f6b381017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.808+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 0x7f6b381017a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6b200098e0 tx=0x7f6b2000f670 comp rx=0 tx=0).stop 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 shutdown_connections 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6b240a1560 0x7f6b240a3a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b381045b0 0x7f6b38101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b380ff6e0 0x7f6b38101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 --2- 172.21.15.5:0/1510970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b381000a0 0x7f6b381017a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 >> 172.21.15.5:0/1510970489 conn(0x7f6b380766c0 msgr2=0x7f6b38068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 shutdown_connections 2023-10-08T13:05:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:31.809+0000 7f6b3e28f700 1 -- 172.21.15.5:0/1510970489 wait complete. 2023-10-08T13:05:32.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-08T13:05:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:33.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:32 smithi060 ceph-mon[103190]: pgmap v284: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:33.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:32 smithi060 ceph-mon[103190]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:33.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:32 smithi005 ceph-mon[99496]: pgmap v284: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:33.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:32 smithi005 ceph-mon[99496]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:33.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:32 smithi118 ceph-mon[104234]: pgmap v284: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:33.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:32 smithi118 ceph-mon[104234]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 -- 172.21.15.5:0/170658150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad701056b0 msgr2=0x7fad70105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 --2- 172.21.15.5:0/170658150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad701056b0 0x7fad70105a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad60009990 tx=0x7fad60009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 -- 172.21.15.5:0/170658150 shutdown_connections 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 --2- 172.21.15.5:0/170658150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad70100110 0x7fad7010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 --2- 172.21.15.5:0/170658150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad701056b0 0x7fad70105a90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 --2- 172.21.15.5:0/170658150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad700ff750 0x7fad700ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 -- 172.21.15.5:0/170658150 >> 172.21.15.5:0/170658150 conn(0x7fad70075790 msgr2=0x7fad70075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 -- 172.21.15.5:0/170658150 shutdown_connections 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.031+0000 7fad766af700 1 -- 172.21.15.5:0/170658150 wait complete. 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 Processor -- start 2023-10-08T13:05:34.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 -- start start 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad700ff750 0x7fad7010cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 0x7fad7010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad701056b0 0x7fad7010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701a4fd0 con 0x7fad70100110 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701a5140 con 0x7fad700ff750 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad766af700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701a5300 con 0x7fad701056b0 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad6f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 0x7fad7010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad6f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 0x7fad7010d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33892/0 (socket says 172.21.15.5:33892) 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.032+0000 7fad6f7fe700 1 -- 172.21.15.5:0/1321798554 learned_addr learned my addr 172.21.15.5:0/1321798554 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6ffff700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad700ff750 0x7fad7010cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad74c4c700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad701056b0 0x7fad7010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6f7fe700 1 -- 172.21.15.5:0/1321798554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad701056b0 msgr2=0x7fad7010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6f7fe700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad701056b0 0x7fad7010d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6f7fe700 1 -- 172.21.15.5:0/1321798554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad700ff750 msgr2=0x7fad7010cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6f7fe700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad700ff750 0x7fad7010cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6f7fe700 1 -- 172.21.15.5:0/1321798554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600095f0 con 0x7fad70100110 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6f7fe700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 0x7fad7010d490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c920 tx=0x7fad6400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64007b00 con 0x7fad70100110 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad64004cf0 con 0x7fad70100110 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad701a55e0 con 0x7fad70100110 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64005610 con 0x7fad70100110 2023-10-08T13:05:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.033+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad701a5ae0 con 0x7fad70100110 2023-10-08T13:05:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.034+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70107cb0 con 0x7fad70100110 2023-10-08T13:05:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.035+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fad64004750 con 0x7fad70100110 2023-10-08T13:05:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.036+0000 7fad6d7fa700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad580a1560 0x7fad580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.036+0000 7fad6ffff700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad580a1560 0x7fad580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.036+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fad640cd340 con 0x7fad70100110 2023-10-08T13:05:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.036+0000 7fad6ffff700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad580a1560 0x7fad580a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad60005850 tx=0x7fad6001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.039+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad640963f0 con 0x7fad70100110 2023-10-08T13:05:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.252+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7010e3e0 con 0x7fad580a1560 2023-10-08T13:05:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.273+0000 7fad6d7fa700 1 -- 172.21.15.5:0/1321798554 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fad7010e3e0 con 0x7fad580a1560 2023-10-08T13:05:34.275 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-08T13:05:34.275 INFO:teuthology.orchestra.run.smithi005.stdout:mds.a smithi005 running (91s) 16s ago 90s 17.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d c30ae2b2d289 2023-10-08T13:05:34.275 INFO:teuthology.orchestra.run.smithi005.stdout:mds.b smithi060 running (88s) 18s ago 88s 20.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 855007c1507b 2023-10-08T13:05:34.275 INFO:teuthology.orchestra.run.smithi005.stdout:mds.c smithi118 running (100s) 18s ago 100s 20.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d a98f63566bc2 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.d smithi005 running (107s) 16s ago 106s 15.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 506b09006e60 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.e smithi060 running (104s) 18s ago 104s 19.2M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 7595a058a3b2 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.f smithi118 running (102s) 18s ago 102s 19.0M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 4d420ad9e2d9 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.g smithi005 running (93s) 16s ago 93s 19.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 63e51fcfc19f 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.h smithi060 running (98s) 18s ago 97s 19.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 843e1741a8c0 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.i smithi118 running (95s) 18s ago 95s 33.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 10bc09b08f28 2023-10-08T13:05:34.276 INFO:teuthology.orchestra.run.smithi005.stdout:mds.j smithi005 running (109s) 16s ago 108s 17.5M - 18.0.0-6639-g7b3143ba 09a1f3752b5d f8cf238a5380 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mds.k smithi060 running (111s) 18s ago 111s 19.6M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 330bba50d489 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mds.l smithi118 running (114s) 18s ago 113s 18.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 65efcb97e8ad 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi005 *:9283,8765 running (8m) 16s ago 8m 516M - 18.0.0-6639-g7b3143ba 09a1f3752b5d e84a512ca002 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi060 *:8443,8765 running (6m) 18s ago 6m 452M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 1b41d49321f5 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.z smithi118 *:8443,8765 running (6m) 18s ago 6m 449M - 18.0.0-6639-g7b3143ba 09a1f3752b5d f5bf1b1f44d3 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (9m) 16s ago 9m 102M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 0736b69d4152 2023-10-08T13:05:34.277 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi060 running (7m) 18s ago 7m 65.9M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d b8460296f8a1 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi118 running (7m) 18s ago 7m 71.7M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d d48c66e43778 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (6m) 16s ago 6m 73.6M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 1bab3154605f 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi060 running (5m) 18s ago 5m 77.7M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 7054e1062090 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi118 running (5m) 18s ago 5m 76.1M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 7c9279599ba8 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (5m) 16s ago 5m 66.4M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 4b02117b2c67 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi060 running (4m) 18s ago 4m 64.4M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d f5d03407601b 2023-10-08T13:05:34.278 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi118 running (4m) 18s ago 4m 69.7M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 5705af08fca5 2023-10-08T13:05:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi005 running (3m) 16s ago 3m 61.5M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 6cab8b29ec69 2023-10-08T13:05:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi060 running (3m) 18s ago 3m 67.6M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d e00e1c43ee68 2023-10-08T13:05:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 smithi118 running (3m) 18s ago 3m 64.1M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d eaa151a21da6 2023-10-08T13:05:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 smithi005 running (2m) 16s ago 2m 60.9M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 084f5177d591 2023-10-08T13:05:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 smithi060 running (2m) 18s ago 2m 65.0M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 5fc78a7a6d09 2023-10-08T13:05:34.279 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 smithi118 running (2m) 18s ago 2m 54.9M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 9d94d36809e1 2023-10-08T13:05:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad580a1560 msgr2=0x7fad580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad580a1560 0x7fad580a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad60005850 tx=0x7fad6001a040 comp rx=0 tx=0).stop 2023-10-08T13:05:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 msgr2=0x7fad7010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 0x7fad7010d490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c920 tx=0x7fad6400cce0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 shutdown_connections 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fad580a1560 0x7fad580a3a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad701056b0 0x7fad7010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad700ff750 0x7fad7010cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 --2- 172.21.15.5:0/1321798554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70100110 0x7fad7010d490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 >> 172.21.15.5:0/1321798554 conn(0x7fad70075790 msgr2=0x7fad700fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 shutdown_connections 2023-10-08T13:05:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:34.276+0000 7fad766af700 1 -- 172.21.15.5:0/1321798554 wait complete. 2023-10-08T13:05:34.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-08T13:05:34.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:34 smithi005 ceph-mon[99496]: pgmap v285: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T13:05:35.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:34 smithi060 ceph-mon[103190]: pgmap v285: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T13:05:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:35.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:34 smithi118 ceph-mon[104234]: pgmap v285: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T13:05:36.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:35 smithi060 ceph-mon[103190]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:36.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:35 smithi005 ceph-mon[99496]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:36.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:35 smithi118 ceph-mon[104234]: from='client.15480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 -- 172.21.15.5:0/2192460115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c1057c0 msgr2=0x7f060c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 --2- 172.21.15.5:0/2192460115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c1057c0 0x7f060c105ba0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009990 tx=0x7f05fc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 -- 172.21.15.5:0/2192460115 shutdown_connections 2023-10-08T13:05:36.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 --2- 172.21.15.5:0/2192460115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c101260 0x7f060c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 --2- 172.21.15.5:0/2192460115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c1057c0 0x7f060c105ba0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 --2- 172.21.15.5:0/2192460115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1008a0 0x7f060c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 -- 172.21.15.5:0/2192460115 >> 172.21.15.5:0/2192460115 conn(0x7f060c0779e0 msgr2=0x7f060c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 -- 172.21.15.5:0/2192460115 shutdown_connections 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.592+0000 7f061392f700 1 -- 172.21.15.5:0/2192460115 wait complete. 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 Processor -- start 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 -- start start 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c1008a0 0x7f060c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 0x7f060c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1057c0 0x7f060c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c197080 con 0x7f060c101260 2023-10-08T13:05:36.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c1971f0 con 0x7f060c1057c0 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f061392f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c1973b0 con 0x7f060c1008a0 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 0x7f060c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 0x7f060c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33904/0 (socket says 172.21.15.5:33904) 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 -- 172.21.15.5:0/703340926 learned_addr learned my addr 172.21.15.5:0/703340926 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f06116cb700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c1008a0 0x7f060c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0611ecc700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1057c0 0x7f060c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 -- 172.21.15.5:0/703340926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c1008a0 msgr2=0x7f060c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c1008a0 0x7f060c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 -- 172.21.15.5:0/703340926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1057c0 msgr2=0x7f060c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1057c0 0x7f060c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0610eca700 1 -- 172.21.15.5:0/703340926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0095f0 con 0x7f060c101260 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f06116cb700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c1008a0 0x7f060c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.593+0000 7f0611ecc700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1057c0 0x7f060c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.594+0000 7f0610eca700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 0x7f060c19ce10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f060800c920 tx=0x7f060800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.594+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608007b00 con 0x7f060c101260 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.594+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0608004cf0 con 0x7f060c101260 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.594+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c197690 con 0x7f060c101260 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.594+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608005610 con 0x7f060c101260 2023-10-08T13:05:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.594+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c1a38c0 con 0x7f060c101260 2023-10-08T13:05:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.595+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c108d80 con 0x7f060c101260 2023-10-08T13:05:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.596+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f0608004750 con 0x7f060c101260 2023-10-08T13:05:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.596+0000 7f06027fc700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f05f80a1560 0x7f05f80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.597+0000 7f06116cb700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f05f80a1560 0x7f05f80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.597+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f06080cd2e0 con 0x7f060c101260 2023-10-08T13:05:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.597+0000 7f06116cb700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f05f80a1560 0x7f05f80a3a20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05fc006010 tx=0x7f05fc01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:36.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.600+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f06080963f0 con 0x7f060c101260 2023-10-08T13:05:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.809+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f060c197ed0 con 0x7f05f80a1560 2023-10-08T13:05:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.817+0000 7f06027fc700 1 -- 172.21.15.5:0/703340926 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f060c197ed0 con 0x7f05f80a1560 2023-10-08T13:05:36.819 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-08T13:05:36.819 INFO:teuthology.orchestra.run.smithi005.stdout:mds.all 12/12 21s ago 118s smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi118=c;smithi118=f;smithi118=i;smithi118=l;count:12 2023-10-08T13:05:36.819 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 3/3 21s ago 6m smithi005=x;smithi060=y;smithi118=z;count:3 2023-10-08T13:05:36.819 INFO:teuthology.orchestra.run.smithi005.stdout:mon 3/3 21s ago 7m smithi005:172.21.15.5=a;smithi060:172.21.15.60=b;smithi118:172.21.15.118=c;count:3 2023-10-08T13:05:36.819 INFO:teuthology.orchestra.run.smithi005.stdout:osd 12 21s ago - 2023-10-08T13:05:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f05f80a1560 msgr2=0x7f05f80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f05f80a1560 0x7f05f80a3a20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05fc006010 tx=0x7f05fc01a040 comp rx=0 tx=0).stop 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 msgr2=0x7f060c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 0x7f060c19ce10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f060800c920 tx=0x7f060800cce0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 shutdown_connections 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f05f80a1560 0x7f05f80a3a20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f060c1057c0 0x7f060c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f060c1008a0 0x7f060c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 --2- 172.21.15.5:0/703340926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c101260 0x7f060c19ce10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.819+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 >> 172.21.15.5:0/703340926 conn(0x7f060c0779e0 msgr2=0x7f060c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.820+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 shutdown_connections 2023-10-08T13:05:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:36.820+0000 7f061392f700 1 -- 172.21.15.5:0/703340926 wait complete. 2023-10-08T13:05:37.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:36 smithi060 ceph-mon[103190]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:37.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:36 smithi005 ceph-mon[99496]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:37.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-08T13:05:37.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:36 smithi118 ceph-mon[104234]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:05:37.770 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:38.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:37 smithi060 ceph-mon[103190]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:38.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-08T13:05:38.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-08T13:05:38.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-08T13:05:38.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-08T13:05:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:37 smithi005 ceph-mon[99496]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-08T13:05:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-08T13:05:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-08T13:05:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-08T13:05:38.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:37 smithi118 ceph-mon[104234]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:38.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2023-10-08T13:05:38.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-08T13:05:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-08T13:05:38.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-08T13:05:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 -- 172.21.15.5:0/1539507180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c1056b0 msgr2=0x7fd99c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 --2- 172.21.15.5:0/1539507180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c1056b0 0x7fd99c105a90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009990 tx=0x7fd98c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 -- 172.21.15.5:0/1539507180 shutdown_connections 2023-10-08T13:05:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 --2- 172.21.15.5:0/1539507180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd99c100110 0x7fd99c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 --2- 172.21.15.5:0/1539507180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c1056b0 0x7fd99c105a90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 --2- 172.21.15.5:0/1539507180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99c0ff750 0x7fd99c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:38.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 -- 172.21.15.5:0/1539507180 >> 172.21.15.5:0/1539507180 conn(0x7fd99c075790 msgr2=0x7fd99c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 -- 172.21.15.5:0/1539507180 shutdown_connections 2023-10-08T13:05:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.994+0000 7fd9a3746700 1 -- 172.21.15.5:0/1539507180 wait complete. 2023-10-08T13:05:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 Processor -- start 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 -- start start 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd99c0ff750 0x7fd99c101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 0x7fd99c1017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99c1056b0 0x7fd99c101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c1a5000 con 0x7fd99c100110 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c1a5170 con 0x7fd99c0ff750 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a3746700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c1a5330 con 0x7fd99c1056b0 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a0ce1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 0x7fd99c1017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a0ce1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 0x7fd99c1017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33918/0 (socket says 172.21.15.5:33918) 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.995+0000 7fd9a0ce1700 1 -- 172.21.15.5:0/497862049 learned_addr learned my addr 172.21.15.5:0/497862049 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a14e2700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd99c0ff750 0x7fd99c101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a1ce3700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99c1056b0 0x7fd99c101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a0ce1700 1 -- 172.21.15.5:0/497862049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99c1056b0 msgr2=0x7fd99c101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a0ce1700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99c1056b0 0x7fd99c101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a0ce1700 1 -- 172.21.15.5:0/497862049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd99c0ff750 msgr2=0x7fd99c101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a0ce1700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd99c0ff750 0x7fd99c101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a0ce1700 1 -- 172.21.15.5:0/497862049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c0095f0 con 0x7fd99c100110 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a0ce1700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 0x7fd99c1017c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd99800d950 tx=0x7fd99800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800f890 con 0x7fd99c100110 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd998010460 con 0x7fd99c100110 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99c1a5610 con 0x7fd99c100110 2023-10-08T13:05:39.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800e610 con 0x7fd99c100110 2023-10-08T13:05:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.996+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99c1a5b10 con 0x7fd99c100110 2023-10-08T13:05:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.997+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99c108c70 con 0x7fd99c100110 2023-10-08T13:05:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.998+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd9980108d0 con 0x7fd99c100110 2023-10-08T13:05:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.999+0000 7fd9927fc700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9880a14d0 0x7fd9880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:39.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.999+0000 7fd9a14e2700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9880a14d0 0x7fd9880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:39.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:38.999+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd9980ccf50 con 0x7fd99c100110 2023-10-08T13:05:39.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.000+0000 7fd9a14e2700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9880a14d0 0x7fd9880a3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0098e0 tx=0x7fd98c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.004+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd998096150 con 0x7fd99c100110 2023-10-08T13:05:39.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:39.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-08T13:05:39.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-08T13:05:39.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-08T13:05:39.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-08T13:05:39.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T13:05:39.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:38 smithi060 ceph-mon[103190]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T13:05:39.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-08T13:05:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-08T13:05:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-08T13:05:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-08T13:05:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T13:05:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:38 smithi005 ceph-mon[99496]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T13:05:39.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.213+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd99c102760 con 0x7fd9880a14d0 2023-10-08T13:05:39.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.214+0000 7fd9927fc700 1 -- 172.21.15.5:0/497862049 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fd99c102760 con 0x7fd9880a14d0 2023-10-08T13:05:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2023-10-08T13:05:39.215 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2023-10-08T13:05:39.216 INFO:teuthology.orchestra.run.smithi005.stdout:smithi060 172.21.15.60 2023-10-08T13:05:39.216 INFO:teuthology.orchestra.run.smithi005.stdout:smithi118 172.21.15.118 2023-10-08T13:05:39.216 INFO:teuthology.orchestra.run.smithi005.stdout:3 hosts in cluster 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9880a14d0 msgr2=0x7fd9880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9880a14d0 0x7fd9880a3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0098e0 tx=0x7fd98c005960 comp rx=0 tx=0).stop 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 msgr2=0x7fd99c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 0x7fd99c1017c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd99800d950 tx=0x7fd99800dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 shutdown_connections 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd9880a14d0 0x7fd9880a3990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd99c1056b0 0x7fd99c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd99c0ff750 0x7fd99c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 --2- 172.21.15.5:0/497862049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c100110 0x7fd99c1017c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.216+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 >> 172.21.15.5:0/497862049 conn(0x7fd99c075790 msgr2=0x7fd99c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.217+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 shutdown_connections 2023-10-08T13:05:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:39.217+0000 7fd9a3746700 1 -- 172.21.15.5:0/497862049 wait complete. 2023-10-08T13:05:39.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:39.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2023-10-08T13:05:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-08T13:05:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-08T13:05:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-08T13:05:39.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T13:05:39.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:38 smithi118 ceph-mon[104234]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T13:05:39.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-08T13:05:40.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:39 smithi060 ceph-mon[103190]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T13:05:40.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:39 smithi005 ceph-mon[99496]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T13:05:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:40.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:39 smithi118 ceph-mon[104234]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T13:05:41.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:40 smithi060 ceph-mon[103190]: pgmap v290: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-10-08T13:05:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:40 smithi060 ceph-mon[103190]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:41.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:40 smithi060 ceph-mon[103190]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-08T13:05:41.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:40 smithi005 ceph-mon[99496]: pgmap v290: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-10-08T13:05:41.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:40 smithi005 ceph-mon[99496]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:41.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:40 smithi005 ceph-mon[99496]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-08T13:05:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:40 smithi118 ceph-mon[104234]: pgmap v290: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-10-08T13:05:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:40 smithi118 ceph-mon[104234]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:40 smithi118 ceph-mon[104234]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-08T13:05:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 -- 172.21.15.5:0/18975742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 msgr2=0x7f222c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 --2- 172.21.15.5:0/18975742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c105ba0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f221c009990 tx=0x7f221c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 -- 172.21.15.5:0/18975742 shutdown_connections 2023-10-08T13:05:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 --2- 172.21.15.5:0/18975742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222c101260 0x7f222c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 --2- 172.21.15.5:0/18975742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c105ba0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 --2- 172.21.15.5:0/18975742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f222c1008a0 0x7f222c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 -- 172.21.15.5:0/18975742 >> 172.21.15.5:0/18975742 conn(0x7f222c0779e0 msgr2=0x7f222c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 -- 172.21.15.5:0/18975742 shutdown_connections 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.548+0000 7f2231a67700 1 -- 172.21.15.5:0/18975742 wait complete. 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 Processor -- start 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 -- start start 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f222c1008a0 0x7f222c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222c101260 0x7f222c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c197140 con 0x7f222c1057c0 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c1972b0 con 0x7f222c101260 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f2231a67700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c197470 con 0x7f222c1008a0 2023-10-08T13:05:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f222bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f222bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33934/0 (socket says 172.21.15.5:33934) 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f222bfff700 1 -- 172.21.15.5:0/197024338 learned_addr learned my addr 172.21.15.5:0/197024338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f222affd700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222c101260 0x7f222c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.549+0000 7f222b7fe700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f222c1008a0 0x7f222c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f222bfff700 1 -- 172.21.15.5:0/197024338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f222c1008a0 msgr2=0x7f222c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f222bfff700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f222c1008a0 0x7f222c19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f222bfff700 1 -- 172.21.15.5:0/197024338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222c101260 msgr2=0x7f222c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f222bfff700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222c101260 0x7f222c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f222bfff700 1 -- 172.21.15.5:0/197024338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0095f0 con 0x7f222c1057c0 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f222bfff700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c196ae0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f222400ab50 tx=0x7f222400ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222400f070 con 0x7f222c1057c0 2023-10-08T13:05:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2224007a80 con 0x7f222c1057c0 2023-10-08T13:05:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c197750 con 0x7f222c1057c0 2023-10-08T13:05:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224005280 con 0x7f222c1057c0 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.550+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c072bf0 con 0x7f222c1057c0 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.551+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c108d80 con 0x7f222c1057c0 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.552+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f222400c620 con 0x7f222c1057c0 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.553+0000 7f2228ff9700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f22180a14d0 0x7f22180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.553+0000 7f222b7fe700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f22180a14d0 0x7f22180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.553+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f22240cc650 con 0x7f222c1057c0 2023-10-08T13:05:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.553+0000 7f222b7fe700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f22180a14d0 0x7f22180a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f221c00b5c0 tx=0x7f221c01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.557+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f22240958e0 con 0x7f222c1057c0 2023-10-08T13:05:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.763+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f222c197940 con 0x7f22180a14d0 2023-10-08T13:05:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.765+0000 7f2228ff9700 1 -- 172.21.15.5:0/197024338 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f222c197940 con 0x7f22180a14d0 2023-10-08T13:05:41.766 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-08T13:05:41.766 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-08T13:05:41.766 INFO:teuthology.orchestra.run.smithi005.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-08T13:05:41.767 INFO:teuthology.orchestra.run.smithi005.stdout:smithi118 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500JS480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-08T13:05:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f22180a14d0 msgr2=0x7f22180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f22180a14d0 0x7f22180a3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f221c00b5c0 tx=0x7f221c01a040 comp rx=0 tx=0).stop 2023-10-08T13:05:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 msgr2=0x7f222c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c196ae0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f222400ab50 tx=0x7f222400ae60 comp rx=0 tx=0).stop 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 shutdown_connections 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f22180a14d0 0x7f22180a3990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f222c1057c0 0x7f222c196ae0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f222c1008a0 0x7f222c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 --2- 172.21.15.5:0/197024338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222c101260 0x7f222c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 >> 172.21.15.5:0/197024338 conn(0x7f222c0779e0 msgr2=0x7f222c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 shutdown_connections 2023-10-08T13:05:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:41.767+0000 7f2231a67700 1 -- 172.21.15.5:0/197024338 wait complete. 2023-10-08T13:05:42.252 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T13:05:42.262 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:05:42.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-08T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:43.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:42 smithi060 ceph-mon[103190]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 9 op/s; 77 B/s, 0 objects/s recovering 2023-10-08T13:05:43.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:42 smithi060 ceph-mon[103190]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:43.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:42 smithi005 ceph-mon[99496]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 9 op/s; 77 B/s, 0 objects/s recovering 2023-10-08T13:05:43.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:42 smithi005 ceph-mon[99496]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:42 smithi118 ceph-mon[104234]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 895 B/s wr, 9 op/s; 77 B/s, 0 objects/s recovering 2023-10-08T13:05:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:42 smithi118 ceph-mon[104234]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 -- 172.21.15.5:0/1611834784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae8101260 msgr2=0x7f7ae810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 --2- 172.21.15.5:0/1611834784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae8101260 0x7f7ae810d650 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b0a0 tx=0x7f7ae000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 -- 172.21.15.5:0/1611834784 shutdown_connections 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 --2- 172.21.15.5:0/1611834784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae8101260 0x7f7ae810d650 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 --2- 172.21.15.5:0/1611834784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae81067f0 0x7f7ae8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 --2- 172.21.15.5:0/1611834784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 0x7f7ae8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 -- 172.21.15.5:0/1611834784 >> 172.21.15.5:0/1611834784 conn(0x7f7ae8077910 msgr2=0x7f7ae8077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 -- 172.21.15.5:0/1611834784 shutdown_connections 2023-10-08T13:05:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.075+0000 7f7aee43c700 1 -- 172.21.15.5:0/1611834784 wait complete. 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.076+0000 7f7aee43c700 1 Processor -- start 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.076+0000 7f7aee43c700 1 -- start start 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.076+0000 7f7aee43c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 0x7f7ae8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.076+0000 7f7aee43c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae8101260 0x7f7ae8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.076+0000 7f7aee43c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 0x7f7ae8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aee43c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81a50b0 con 0x7f7ae81067f0 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aee43c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81a5220 con 0x7f7ae81008a0 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aee43c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81a53e0 con 0x7f7ae8101260 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 0x7f7ae8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 0x7f7ae8073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33948/0 (socket says 172.21.15.5:33948) 2023-10-08T13:05:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 -- 172.21.15.5:0/3245825286 learned_addr learned my addr 172.21.15.5:0/3245825286 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7ae7fff700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 0x7f7ae8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7ae77fe700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae8101260 0x7f7ae8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 -- 172.21.15.5:0/3245825286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae8101260 msgr2=0x7f7ae8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae8101260 0x7f7ae8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 -- 172.21.15.5:0/3245825286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 msgr2=0x7f7ae8072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 0x7f7ae8072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 -- 172.21.15.5:0/3245825286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0009d00 con 0x7f7ae81067f0 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7ae7fff700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 0x7f7ae8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aec9d9700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 0x7f7ae8073570 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b830 tx=0x7f7ae00078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000e040 con 0x7f7ae81067f0 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ae0004e60 con 0x7f7ae81067f0 2023-10-08T13:05:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae81a5660 con 0x7f7ae81067f0 2023-10-08T13:05:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0005420 con 0x7f7ae81067f0 2023-10-08T13:05:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.077+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae81a5b60 con 0x7f7ae81067f0 2023-10-08T13:05:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.078+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae8108d30 con 0x7f7ae81067f0 2023-10-08T13:05:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.079+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f7ae001bb30 con 0x7f7ae81067f0 2023-10-08T13:05:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.080+0000 7f7ae57fa700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ad00a14d0 0x7f7ad00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.080+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7ae00cea70 con 0x7f7ae81067f0 2023-10-08T13:05:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.080+0000 7f7ae7fff700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ad00a14d0 0x7f7ad00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.081+0000 7f7ae7fff700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ad00a14d0 0x7f7ad00a3990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005fd0 tx=0x7f7ad800a5e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:44.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.085+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ae0097d00 con 0x7f7ae81067f0 2023-10-08T13:05:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.331+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ae8101f20 con 0x7f7ae81067f0 2023-10-08T13:05:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.331+0000 7f7ae57fa700 1 -- 172.21.15.5:0/3245825286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2962 (secure 0 0 0) 0x7f7ae009b320 con 0x7f7ae81067f0 2023-10-08T13:05:44.332 INFO:teuthology.orchestra.run.smithi005.stdout:e27 2023-10-08T13:05:44.332 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 27 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-10-08T13:04:10.182813+0000 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2023-10-08T13:04:34.149988+0000 2023-10-08T13:05:44.333 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 300 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 0 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:05:44.334 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 5 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1,2,3,4 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=24667,1=24650,2=24649,3=24643,4=24611} 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3,4] 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 0 2023-10-08T13:05:44.335 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.i{0:24667} state up:active seq 5 addr [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.l{0:24601} state up:standby-replay seq 1 addr [v2:172.21.15.118:6832/2301164453,v1:172.21.15.118:6833/2301164453] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b{1:24650} state up:active seq 8 addr [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.e{1:24587} state up:standby-replay seq 1 addr [v2:172.21.15.60:6834/2434035326,v1:172.21.15.60:6835/2434035326] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c{2:24649} state up:active seq 11 addr [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.k{2:24554} state up:standby-replay seq 1 addr [v2:172.21.15.60:6832/2732299433,v1:172.21.15.60:6833/2732299433] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.f{3:24643} state up:active seq 12 addr [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a{3:14805} state up:standby-replay seq 1 addr [v2:172.21.15.5:6840/3855657162,v1:172.21.15.5:6841/3855657162] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.h{4:24611} state up:active seq 11 addr [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.g{4:14793} state up:standby-replay seq 1 addr [v2:172.21.15.5:6838/1016601603,v1:172.21.15.5:6839/1016601603] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:44.336 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2023-10-08T13:05:44.337 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:44.337 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.j{-1:14718} state up:standby seq 1 addr [v2:172.21.15.5:6834/164464134,v1:172.21.15.5:6835/164464134] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.337 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d{-1:14730} state up:standby seq 1 addr [v2:172.21.15.5:6836/1597717069,v1:172.21.15.5:6837/1597717069] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:05:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ad00a14d0 msgr2=0x7f7ad00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ad00a14d0 0x7f7ad00a3990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005fd0 tx=0x7f7ad800a5e0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 msgr2=0x7f7ae8073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 0x7f7ae8073570 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b830 tx=0x7f7ae00078a0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 shutdown_connections 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ad00a14d0 0x7f7ad00a3990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae81067f0 0x7f7ae8073570 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ae81008a0 0x7f7ae8072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 --2- 172.21.15.5:0/3245825286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ae8101260 0x7f7ae8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 >> 172.21.15.5:0/3245825286 conn(0x7f7ae8077910 msgr2=0x7f7ae80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 shutdown_connections 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:44.333+0000 7f7aee43c700 1 -- 172.21.15.5:0/3245825286 wait complete. 2023-10-08T13:05:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:05:44.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-08T13:05:45.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:44 smithi005 ceph-mon[99496]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 12 op/s; 77 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:45.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:44 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3245825286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T13:05:45.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:44 smithi118 ceph-mon[104234]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 12 op/s; 77 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:45.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:44 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3245825286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T13:05:45.274 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:45.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:44 smithi060 ceph-mon[103190]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 12 op/s; 77 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:45.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:44 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3245825286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T13:05:46.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:46 smithi060 ceph-mon[103190]: pgmap v293: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 11 op/s; 80 B/s, 0 keys/s, 1 objects/s recovering 2023-10-08T13:05:46.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:46 smithi060 ceph-mon[103190]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-10-08T13:05:46.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:46 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T13:05:46.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:46 smithi005 ceph-mon[99496]: pgmap v293: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 11 op/s; 80 B/s, 0 keys/s, 1 objects/s recovering 2023-10-08T13:05:46.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:46 smithi005 ceph-mon[99496]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-10-08T13:05:46.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:46 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T13:05:46.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:46 smithi118 ceph-mon[104234]: pgmap v293: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 11 op/s; 80 B/s, 0 keys/s, 1 objects/s recovering 2023-10-08T13:05:46.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:46 smithi118 ceph-mon[104234]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-10-08T13:05:46.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:46 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T13:05:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 -- 172.21.15.5:0/3721446468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c0ff750 msgr2=0x7fd20c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 --2- 172.21.15.5:0/3721446468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c0ff750 0x7fd20c0ffbd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009990 tx=0x7fd1fc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 -- 172.21.15.5:0/3721446468 shutdown_connections 2023-10-08T13:05:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 --2- 172.21.15.5:0/3721446468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd20c100110 0x7fd20c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 --2- 172.21.15.5:0/3721446468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20c1056b0 0x7fd20c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 --2- 172.21.15.5:0/3721446468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c0ff750 0x7fd20c0ffbd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 -- 172.21.15.5:0/3721446468 >> 172.21.15.5:0/3721446468 conn(0x7fd20c075790 msgr2=0x7fd20c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 -- 172.21.15.5:0/3721446468 shutdown_connections 2023-10-08T13:05:46.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.538+0000 7fd214497700 1 -- 172.21.15.5:0/3721446468 wait complete. 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 Processor -- start 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 -- start start 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20c0ff750 0x7fd20c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 0x7fd20c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd20c1056b0 0x7fd20c1a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1987e0 con 0x7fd20c100110 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1a3010 con 0x7fd20c1056b0 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd214497700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1a3150 con 0x7fd20c0ff750 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 0x7fd20c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 0x7fd20c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33960/0 (socket says 172.21.15.5:33960) 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 -- 172.21.15.5:0/2470956066 learned_addr learned my addr 172.21.15.5:0/2470956066 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd212a34700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd20c1056b0 0x7fd20c1a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 -- 172.21.15.5:0/2470956066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20c0ff750 msgr2=0x7fd20c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20c0ff750 0x7fd20c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 -- 172.21.15.5:0/2470956066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd20c1056b0 msgr2=0x7fd20c1a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd20c1056b0 0x7fd20c1a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.539+0000 7fd211a32700 1 -- 172.21.15.5:0/2470956066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0095f0 con 0x7fd20c100110 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.540+0000 7fd211a32700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 0x7fd20c197f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00f670 tx=0x7fd1fc00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.540+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc01d070 con 0x7fd20c100110 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.540+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c1a3350 con 0x7fd20c100110 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.540+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1fc005510 con 0x7fd20c100110 2023-10-08T13:05:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.540+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc004a90 con 0x7fd20c100110 2023-10-08T13:05:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.540+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c1a37f0 con 0x7fd20c100110 2023-10-08T13:05:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.541+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c107cd0 con 0x7fd20c100110 2023-10-08T13:05:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.542+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd1fc004c30 con 0x7fd20c100110 2023-10-08T13:05:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.542+0000 7fd2037fe700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1f80a14d0 0x7fd1f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:46.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.543+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd1fc0ce320 con 0x7fd20c100110 2023-10-08T13:05:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.543+0000 7fd212233700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1f80a14d0 0x7fd1f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:46.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.543+0000 7fd212233700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1f80a14d0 0x7fd1f80a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd208005e90 tx=0x7fd208005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:46.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.546+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd1fc0976d0 con 0x7fd20c100110 2023-10-08T13:05:46.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.747+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fd20c068730 con 0x7fd20c100110 2023-10-08T13:05:46.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.748+0000 7fd2037fe700 1 -- 172.21.15.5:0/2470956066 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) v1 ==== 56+0+6039 (secure 0 0 0) 0x7fd1fc09acf0 con 0x7fd20c100110 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 91 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-10-08T12:56:30.006790+0000 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2023-10-08T13:05:38.894284+0000 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 27 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2023-10-08T13:05:46.749 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client luminous 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release reef 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 12 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 9 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6802/2048074026,v1:172.21.15.5:6803/2048074026] [v2:172.21.15.5:6804/2048074026,v1:172.21.15.5:6805/2048074026] exists,up 55c71842-5a9c-458b-ae21-0a86b2d745b9 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 14 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/1932201040,v1:172.21.15.60:6801/1932201040] [v2:172.21.15.60:6802/1932201040,v1:172.21.15.60:6803/1932201040] exists,up 0fccf574-a553-42c0-b7d8-1a606c9afa40 2023-10-08T13:05:46.750 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 19 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6800/1550334849,v1:172.21.15.118:6801/1550334849] [v2:172.21.15.118:6802/1550334849,v1:172.21.15.118:6803/1550334849] exists,up 7c012ac5-5677-47b6-8f91-a6146c53d52d 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 up in weight 1 up_from 26 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6810/731890565,v1:172.21.15.5:6811/731890565] [v2:172.21.15.5:6812/731890565,v1:172.21.15.5:6813/731890565] exists,up bcc8a556-63b4-44c7-92e7-0ab83f45b580 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 up in weight 1 up_from 33 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/3771970201,v1:172.21.15.60:6809/3771970201] [v2:172.21.15.60:6810/3771970201,v1:172.21.15.60:6811/3771970201] exists,up dd5a0f8e-6be8-490d-b202-a85853020088 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 up in weight 1 up_from 38 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6808/389070865,v1:172.21.15.118:6809/389070865] [v2:172.21.15.118:6810/389070865,v1:172.21.15.118:6811/389070865] exists,up 2895b033-b0cd-4ef9-b418-d7d88abf919d 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 up in weight 1 up_from 46 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6818/1379902239,v1:172.21.15.5:6819/1379902239] [v2:172.21.15.5:6820/1379902239,v1:172.21.15.5:6821/1379902239] exists,up 70aac32e-a230-4d6f-b65d-1d390ccd9d5f 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 up in weight 1 up_from 51 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/2435076534,v1:172.21.15.60:6817/2435076534] [v2:172.21.15.60:6818/2435076534,v1:172.21.15.60:6819/2435076534] exists,up ef2634ca-f063-4030-91dd-69d8d3e5216f 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 up in weight 1 up_from 58 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6816/4053101254,v1:172.21.15.118:6817/4053101254] [v2:172.21.15.118:6818/4053101254,v1:172.21.15.118:6819/4053101254] exists,up 5296573e-315f-4f81-8519-aa97734c73da 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 up in weight 1 up_from 66 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6826/2685763933,v1:172.21.15.5:6827/2685763933] [v2:172.21.15.5:6828/2685763933,v1:172.21.15.5:6829/2685763933] exists,up 2a7f6068-38ca-4855-85bf-4f8369179767 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 up in weight 1 up_from 71 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/2643673100,v1:172.21.15.60:6825/2643673100] [v2:172.21.15.60:6826/2643673100,v1:172.21.15.60:6827/2643673100] exists,up f2ca2394-71e1-489e-b517-492641d774bc 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 up in weight 1 up_from 78 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.118:6824/1490826203,v1:172.21.15.118:6825/1490826203] [v2:172.21.15.118:6826/1490826203,v1:172.21.15.118:6827/1490826203] exists,up 15ba66fb-f768-4c8c-8364-b578f94d5543 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.6 [8,11] 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.f [8,11] 2023-10-08T13:05:46.751 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.16 [2,4] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1b [2,1] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.0 [4,8] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.11 [5,9] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.14 [4,6] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.29 [3,9] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.33 [5,9] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.3a [4,7] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.2 [9,1] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.5 [5,8] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.c [9,10] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.13 [9,8] 2023-10-08T13:05:46.752 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/1305686479 expires 2023-10-09T12:58:37.011176+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3348591021 expires 2023-10-09T12:57:28.615187+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/13143194 expires 2023-10-09T12:57:28.615187+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/13143194 expires 2023-10-09T12:57:28.615187+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1012844185 expires 2023-10-09T12:57:28.615187+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3669045265 expires 2023-10-09T12:58:37.011176+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/734152753 expires 2023-10-09T12:57:01.763270+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1953950903 expires 2023-10-09T12:57:01.763270+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/1305686479 expires 2023-10-09T12:58:37.011176+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3309153845 expires 2023-10-09T12:58:37.011176+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/735752727 expires 2023-10-09T12:57:01.763270+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/632293354 expires 2023-10-09T12:57:01.763270+0000 2023-10-08T13:05:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/4243429015 expires 2023-10-09T12:58:37.011176+0000 2023-10-08T13:05:46.754 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/632293354 expires 2023-10-09T12:57:01.763270+0000 2023-10-08T13:05:46.754 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/363889719 expires 2023-10-09T12:57:28.615187+0000 2023-10-08T13:05:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1f80a14d0 msgr2=0x7fd1f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:46.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1f80a14d0 0x7fd1f80a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd208005e90 tx=0x7fd208005d00 comp rx=0 tx=0).stop 2023-10-08T13:05:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 msgr2=0x7fd20c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 0x7fd20c197f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00f670 tx=0x7fd1fc00f6a0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 shutdown_connections 2023-10-08T13:05:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1f80a14d0 0x7fd1f80a3990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd20c1056b0 0x7fd20c1a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd20c0ff750 0x7fd20c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 --2- 172.21.15.5:0/2470956066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd20c100110 0x7fd20c197f90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 >> 172.21.15.5:0/2470956066 conn(0x7fd20c075790 msgr2=0x7fd20c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 shutdown_connections 2023-10-08T13:05:46.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:46.750+0000 7fd214497700 1 -- 172.21.15.5:0/2470956066 wait complete. 2023-10-08T13:05:47.142 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-08T13:05:47.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 -- 172.21.15.5:0/442826524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c101850 msgr2=0x7f5e9c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/442826524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c101850 0x7f5e9c101c30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009990 tx=0x7f5e8c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 -- 172.21.15.5:0/442826524 shutdown_connections 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/442826524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c10ac70 0x7f5e9c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/442826524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c101850 0x7f5e9c101c30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/442826524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c102170 0x7f5e9c10a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 -- 172.21.15.5:0/442826524 >> 172.21.15.5:0/442826524 conn(0x7f5e9c0fb030 msgr2=0x7f5e9c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:47.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 -- 172.21.15.5:0/442826524 shutdown_connections 2023-10-08T13:05:47.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.288+0000 7f5ea16c7700 1 -- 172.21.15.5:0/442826524 wait complete. 2023-10-08T13:05:47.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 Processor -- start 2023-10-08T13:05:47.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 -- start start 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c101850 0x7f5e9c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 0x7f5e9c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c10ac70 0x7f5e9c196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c196f90 con 0x7f5e9c102170 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c197100 con 0x7f5e9c101850 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5ea16c7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c1972c0 con 0x7f5e9c10ac70 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5e9a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 0x7f5e9c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5e9a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 0x7f5e9c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33970/0 (socket says 172.21.15.5:33970) 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5e9a7fc700 1 -- 172.21.15.5:0/1787384941 learned_addr learned my addr 172.21.15.5:0/1787384941 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c101850 0x7f5e9c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.289+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c10ac70 0x7f5e9c196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9a7fc700 1 -- 172.21.15.5:0/1787384941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c10ac70 msgr2=0x7f5e9c196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9a7fc700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c10ac70 0x7f5e9c196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9a7fc700 1 -- 172.21.15.5:0/1787384941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c101850 msgr2=0x7f5e9c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9a7fc700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c101850 0x7f5e9c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9a7fc700 1 -- 172.21.15.5:0/1787384941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0095f0 con 0x7f5e9c102170 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9b7fe700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c10ac70 0x7f5e9c196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:47.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c101850 0x7f5e9c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e9a7fc700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 0x7f5e9c19cce0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000d950 tx=0x7f5e9000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90009b40 con 0x7f5e9c102170 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e90009ca0 con 0x7f5e9c102170 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c1975a0 con 0x7f5e9c102170 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000f620 con 0x7f5e9c102170 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.290+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c1a3790 con 0x7f5e9c102170 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.291+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c105da0 con 0x7f5e9c102170 2023-10-08T13:05:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.292+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5e90010460 con 0x7f5e9c102170 2023-10-08T13:05:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.293+0000 7f5e83fff700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e840a1550 0x7f5e840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.293+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5e900cd500 con 0x7f5e9c102170 2023-10-08T13:05:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.293+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e840a1550 0x7f5e840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.293+0000 7f5e9affd700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e840a1550 0x7f5e840a3a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006010 tx=0x7f5e8c01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:47.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.296+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e90096700 con 0x7f5e9c102170 2023-10-08T13:05:47.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:47 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2470956066' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T13:05:47.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:47 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2470956066' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T13:05:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.501+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e9c110580 con 0x7f5e9c102170 2023-10-08T13:05:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.502+0000 7f5e83fff700 1 -- 172.21.15.5:0/1787384941 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7f5e90016090 con 0x7f5e9c102170 2023-10-08T13:05:47.504 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:47.504 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e840a1550 msgr2=0x7f5e840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e840a1550 0x7f5e840a3a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006010 tx=0x7f5e8c01a040 comp rx=0 tx=0).stop 2023-10-08T13:05:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 msgr2=0x7f5e9c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 0x7f5e9c19cce0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000d950 tx=0x7f5e9000dd10 comp rx=0 tx=0).stop 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 shutdown_connections 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5e840a1550 0x7f5e840a3a10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e9c10ac70 0x7f5e9c196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e9c101850 0x7f5e9c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 --2- 172.21.15.5:0/1787384941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e9c102170 0x7f5e9c19cce0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.504+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 >> 172.21.15.5:0/1787384941 conn(0x7f5e9c0fb030 msgr2=0x7f5e9c0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.505+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 shutdown_connections 2023-10-08T13:05:47.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.505+0000 7f5ea16c7700 1 -- 172.21.15.5:0/1787384941 wait complete. 2023-10-08T13:05:47.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:05:47.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:05:47.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:47 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2470956066' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 -- 172.21.15.5:0/997451895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc105600 msgr2=0x7f43cc1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/997451895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc105600 0x7f43cc1059e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f43c80099c0 tx=0x7f43c8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 -- 172.21.15.5:0/997451895 shutdown_connections 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/997451895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc0fff00 0x7f43cc10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/997451895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc105600 0x7f43cc1059e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/997451895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43cc0ff540 0x7f43cc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.649+0000 7f43d3bd8700 1 -- 172.21.15.5:0/997451895 >> 172.21.15.5:0/997451895 conn(0x7f43cc0fb010 msgr2=0x7f43cc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 -- 172.21.15.5:0/997451895 shutdown_connections 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 -- 172.21.15.5:0/997451895 wait complete. 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 Processor -- start 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 -- start start 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 0x7f43cc19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc0fff00 0x7f43cc19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43cc105600 0x7f43cc195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc195df0 con 0x7f43cc0ff540 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc195f60 con 0x7f43cc0fff00 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.650+0000 7f43d3bd8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc196120 con 0x7f43cc105600 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 0x7f43cc19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 0x7f43cc19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33982/0 (socket says 172.21.15.5:33982) 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 -- 172.21.15.5:0/3736441451 learned_addr learned my addr 172.21.15.5:0/3736441451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d2175700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43cc105600 0x7f43cc195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1173700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc0fff00 0x7f43cc19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 -- 172.21.15.5:0/3736441451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43cc105600 msgr2=0x7f43cc195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43cc105600 0x7f43cc195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 -- 172.21.15.5:0/3736441451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc0fff00 msgr2=0x7f43cc19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc0fff00 0x7f43cc19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 -- 172.21.15.5:0/3736441451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80095f0 con 0x7f43cc0ff540 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d1974700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 0x7f43cc19b650 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f43c800b580 tx=0x7f43c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c801d070 con 0x7f43cc0ff540 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc1963a0 con 0x7f43cc0ff540 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43c800fb30 con 0x7f43cc0ff540 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8022c60 con 0x7f43cc0ff540 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.651+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc1a2640 con 0x7f43cc0ff540 2023-10-08T13:05:47.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.652+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc107a80 con 0x7f43cc0ff540 2023-10-08T13:05:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.653+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f43c800fca0 con 0x7f43cc0ff540 2023-10-08T13:05:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.654+0000 7f43c2ffd700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43b80a14d0 0x7f43b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.654+0000 7f43d1173700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43b80a14d0 0x7f43b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.655+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f43c80ce660 con 0x7f43cc0ff540 2023-10-08T13:05:47.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.655+0000 7f43d1173700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43b80a14d0 0x7f43b80a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005fd0 tx=0x7f43bc00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:47.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.658+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43c80978f0 con 0x7f43cc0ff540 2023-10-08T13:05:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.860+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43cc196c40 con 0x7f43cc0ff540 2023-10-08T13:05:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.861+0000 7f43c2ffd700 1 -- 172.21.15.5:0/3736441451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43c809af10 con 0x7f43cc0ff540 2023-10-08T13:05:47.862 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43b80a14d0 msgr2=0x7f43b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43b80a14d0 0x7f43b80a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005fd0 tx=0x7f43bc00a560 comp rx=0 tx=0).stop 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 msgr2=0x7f43cc19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 0x7f43cc19b650 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f43c800b580 tx=0x7f43c8004730 comp rx=0 tx=0).stop 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 shutdown_connections 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43b80a14d0 0x7f43b80a3990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43cc105600 0x7f43cc195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43cc0ff540 0x7f43cc19b650 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 --2- 172.21.15.5:0/3736441451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43cc0fff00 0x7f43cc19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 >> 172.21.15.5:0/3736441451 conn(0x7f43cc0fb010 msgr2=0x7f43cc0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 shutdown_connections 2023-10-08T13:05:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:47.863+0000 7f43d3bd8700 1 -- 172.21.15.5:0/3736441451 wait complete. 2023-10-08T13:05:47.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:05:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 -- 172.21.15.5:0/2468860239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb500ffef0 msgr2=0x7fcb5010c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 --2- 172.21.15.5:0/2468860239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb500ffef0 0x7fcb5010c3b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b0d0 tx=0x7fcb4800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 -- 172.21.15.5:0/2468860239 shutdown_connections 2023-10-08T13:05:48.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 --2- 172.21.15.5:0/2468860239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb500ffef0 0x7fcb5010c3b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 --2- 172.21.15.5:0/2468860239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb501055f0 0x7fcb501059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 --2- 172.21.15.5:0/2468860239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb500ff530 0x7fcb500ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 -- 172.21.15.5:0/2468860239 >> 172.21.15.5:0/2468860239 conn(0x7fcb500fafc0 msgr2=0x7fcb500fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 -- 172.21.15.5:0/2468860239 shutdown_connections 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 -- 172.21.15.5:0/2468860239 wait complete. 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 Processor -- start 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.005+0000 7fcb5876c700 1 -- start start 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb500ff530 0x7fcb50198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb500ffef0 0x7fcb50199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 0x7fcb5019d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5019de30 con 0x7fcb501055f0 2023-10-08T13:05:48.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5019dfa0 con 0x7fcb500ffef0 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5019e160 con 0x7fcb500ff530 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 0x7fcb5019d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 0x7fcb5019d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34000/0 (socket says 172.21.15.5:34000) 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 -- 172.21.15.5:0/1644171965 learned_addr learned my addr 172.21.15.5:0/1644171965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 -- 172.21.15.5:0/1644171965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb500ff530 msgr2=0x7fcb50198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56508700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb500ff530 0x7fcb50198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb500ff530 0x7fcb50198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 -- 172.21.15.5:0/1644171965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb500ffef0 msgr2=0x7fcb50199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb55d07700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb500ffef0 0x7fcb50199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb500ffef0 0x7fcb50199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 -- 172.21.15.5:0/1644171965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb48009d00 con 0x7fcb501055f0 2023-10-08T13:05:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb56d09700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 0x7fcb5019d7f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800d010 tx=0x7fcb480094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800e040 con 0x7fcb501055f0 2023-10-08T13:05:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb48007950 con 0x7fcb501055f0 2023-10-08T13:05:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5019e3e0 con 0x7fcb501055f0 2023-10-08T13:05:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4801b6d0 con 0x7fcb501055f0 2023-10-08T13:05:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.006+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb501a5c80 con 0x7fcb501055f0 2023-10-08T13:05:48.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.007+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50100c50 con 0x7fcb501055f0 2023-10-08T13:05:48.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.009+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fcb48005090 con 0x7fcb501055f0 2023-10-08T13:05:48.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.009+0000 7fcb477fe700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb3c0a14d0 0x7fcb3c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.009+0000 7fcb56508700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb3c0a14d0 0x7fcb3c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.009+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcb480cec20 con 0x7fcb501055f0 2023-10-08T13:05:48.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.010+0000 7fcb56508700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb3c0a14d0 0x7fcb3c0a3990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb40005950 tx=0x7fcb40005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:48.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.013+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb48097eb0 con 0x7fcb501055f0 2023-10-08T13:05:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.217+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb5019a210 con 0x7fcb501055f0 2023-10-08T13:05:48.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.218+0000 7fcb477fe700 1 -- 172.21.15.5:0/1644171965 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb4809b4d0 con 0x7fcb501055f0 2023-10-08T13:05:48.219 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:48.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb3c0a14d0 msgr2=0x7fcb3c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb3c0a14d0 0x7fcb3c0a3990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb40005950 tx=0x7fcb40005c70 comp rx=0 tx=0).stop 2023-10-08T13:05:48.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 msgr2=0x7fcb5019d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 0x7fcb5019d7f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800d010 tx=0x7fcb480094f0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 shutdown_connections 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb3c0a14d0 0x7fcb3c0a3990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb501055f0 0x7fcb5019d7f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb500ff530 0x7fcb50198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 --2- 172.21.15.5:0/1644171965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb500ffef0 0x7fcb50199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 >> 172.21.15.5:0/1644171965 conn(0x7fcb500fafc0 msgr2=0x7fcb500679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:48.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 shutdown_connections 2023-10-08T13:05:48.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.220+0000 7fcb5876c700 1 -- 172.21.15.5:0/1644171965 wait complete. 2023-10-08T13:05:48.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 -- 172.21.15.5:0/4116075557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0ffc90 msgr2=0x7f2fdc100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 --2- 172.21.15.5:0/4116075557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0ffc90 0x7f2fdc100110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0099c0 tx=0x7f2fcc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 -- 172.21.15.5:0/4116075557 shutdown_connections 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 --2- 172.21.15.5:0/4116075557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fdc100650 0x7f2fdc10c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 --2- 172.21.15.5:0/4116075557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 0x7f2fdc105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 --2- 172.21.15.5:0/4116075557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0ffc90 0x7f2fdc100110 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 -- 172.21.15.5:0/4116075557 >> 172.21.15.5:0/4116075557 conn(0x7f2fdc075b10 msgr2=0x7f2fdc0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 -- 172.21.15.5:0/4116075557 shutdown_connections 2023-10-08T13:05:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.363+0000 7f2fe3845700 1 -- 172.21.15.5:0/4116075557 wait complete. 2023-10-08T13:05:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 Processor -- start 2023-10-08T13:05:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 -- start start 2023-10-08T13:05:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fdc0ffc90 0x7f2fdc19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 0x7f2fdc19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 0x7f2fdc195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc195e70 con 0x7f2fdc100650 2023-10-08T13:05:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc195fe0 con 0x7f2fdc1056a0 2023-10-08T13:05:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe3845700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1961a0 con 0x7f2fdc0ffc90 2023-10-08T13:05:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe0de0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 0x7f2fdc19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe0de0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 0x7f2fdc19bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34012/0 (socket says 172.21.15.5:34012) 2023-10-08T13:05:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe0de0700 1 -- 172.21.15.5:0/2345065082 learned_addr learned my addr 172.21.15.5:0/2345065082 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe15e1700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fdc0ffc90 0x7f2fdc19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.364+0000 7f2fe1de2700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 0x7f2fdc195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe0de0700 1 -- 172.21.15.5:0/2345065082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fdc0ffc90 msgr2=0x7f2fdc19b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe0de0700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fdc0ffc90 0x7f2fdc19b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe0de0700 1 -- 172.21.15.5:0/2345065082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 msgr2=0x7f2fdc195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe0de0700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 0x7f2fdc195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe0de0700 1 -- 172.21.15.5:0/2345065082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0095f0 con 0x7f2fdc100650 2023-10-08T13:05:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe1de2700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 0x7f2fdc195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe0de0700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 0x7f2fdc19bc10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b580 tx=0x7f2fcc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc01c070 con 0x7f2fdc100650 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fcc022420 con 0x7f2fdc100650 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc196420 con 0x7f2fdc100650 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc017650 con 0x7f2fdc100650 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.365+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc1a26c0 con 0x7f2fdc100650 2023-10-08T13:05:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.366+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc107b70 con 0x7f2fdc100650 2023-10-08T13:05:48.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.367+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f2fcc020070 con 0x7f2fdc100650 2023-10-08T13:05:48.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.368+0000 7f2fd27fc700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2fc80a14d0 0x7f2fc80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.368+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2fcc0ce390 con 0x7f2fdc100650 2023-10-08T13:05:48.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.368+0000 7f2fe15e1700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2fc80a14d0 0x7f2fc80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.368+0000 7f2fe15e1700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2fc80a14d0 0x7f2fc80a3990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc072be0 tx=0x7f2fd8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:48.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.371+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2fcc0975c0 con 0x7f2fdc100650 2023-10-08T13:05:48.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:48 smithi060 ceph-mon[103190]: pgmap v294: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 444 B/s wr, 8 op/s; 69 B/s, 0 keys/s, 1 objects/s recovering 2023-10-08T13:05:48.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:48 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1787384941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:48.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:48 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3736441451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:48 smithi005 ceph-mon[99496]: pgmap v294: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 444 B/s wr, 8 op/s; 69 B/s, 0 keys/s, 1 objects/s recovering 2023-10-08T13:05:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:48 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1787384941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:48.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:48 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3736441451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:48.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:48 smithi118 ceph-mon[104234]: pgmap v294: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 444 B/s wr, 8 op/s; 69 B/s, 0 keys/s, 1 objects/s recovering 2023-10-08T13:05:48.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:48 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1787384941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:48.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:48 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3736441451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:48.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.575+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fdc196cc0 con 0x7f2fdc100650 2023-10-08T13:05:48.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.576+0000 7f2fd27fc700 1 -- 172.21.15.5:0/2345065082 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fcc027020 con 0x7f2fdc100650 2023-10-08T13:05:48.577 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:05:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2fc80a14d0 msgr2=0x7f2fc80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2fc80a14d0 0x7f2fc80a3990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc072be0 tx=0x7f2fd8009260 comp rx=0 tx=0).stop 2023-10-08T13:05:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 msgr2=0x7f2fdc19bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 0x7f2fdc19bc10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b580 tx=0x7f2fcc00f740 comp rx=0 tx=0).stop 2023-10-08T13:05:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 shutdown_connections 2023-10-08T13:05:48.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2fc80a14d0 0x7f2fc80a3990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fdc1056a0 0x7f2fdc195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fdc0ffc90 0x7f2fdc19b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 --2- 172.21.15.5:0/2345065082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc100650 0x7f2fdc19bc10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 >> 172.21.15.5:0/2345065082 conn(0x7f2fdc075b10 msgr2=0x7f2fdc0fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 shutdown_connections 2023-10-08T13:05:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.578+0000 7f2fe3845700 1 -- 172.21.15.5:0/2345065082 wait complete. 2023-10-08T13:05:48.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:05:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 -- 172.21.15.5:0/1531434060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 msgr2=0x7f279c105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 --2- 172.21.15.5:0/1531434060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c105a10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f278c0099c0 tx=0x7f278c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 -- 172.21.15.5:0/1531434060 shutdown_connections 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 --2- 172.21.15.5:0/1531434060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f279c0fff30 0x7f279c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 --2- 172.21.15.5:0/1531434060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c105a10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 --2- 172.21.15.5:0/1531434060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0ff570 0x7f279c0ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 -- 172.21.15.5:0/1531434060 >> 172.21.15.5:0/1531434060 conn(0x7f279c0fb020 msgr2=0x7f279c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 -- 172.21.15.5:0/1531434060 shutdown_connections 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.719+0000 7f27a42b8700 1 -- 172.21.15.5:0/1531434060 wait complete. 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 Processor -- start 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 -- start start 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f279c0ff570 0x7f279c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0fff30 0x7f279c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c1a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1986c0 con 0x7f279c105630 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1a2ec0 con 0x7f279c0fff30 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a42b8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1a3000 con 0x7f279c0ff570 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a2855700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c1a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a2855700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c1a2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34028/0 (socket says 172.21.15.5:34028) 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.720+0000 7f27a2855700 1 -- 172.21.15.5:0/2131738329 learned_addr learned my addr 172.21.15.5:0/2131738329 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a1853700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0fff30 0x7f279c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2054700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f279c0ff570 0x7f279c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2855700 1 -- 172.21.15.5:0/2131738329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f279c0ff570 msgr2=0x7f279c197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2855700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f279c0ff570 0x7f279c197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2855700 1 -- 172.21.15.5:0/2131738329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0fff30 msgr2=0x7f279c197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2855700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0fff30 0x7f279c197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2855700 1 -- 172.21.15.5:0/2131738329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0095f0 con 0x7f279c105630 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a1853700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0fff30 0x7f279c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a2855700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c1a2980 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f279400ef30 tx=0x7f279400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794018070 con 0x7f279c105630 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c1a3230 con 0x7f279c105630 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f279400f040 con 0x7f279c105630 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400ce00 con 0x7f279c105630 2023-10-08T13:05:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.721+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c1a3740 con 0x7f279c105630 2023-10-08T13:05:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.722+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c107ad0 con 0x7f279c105630 2023-10-08T13:05:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.723+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f2794003a00 con 0x7f279c105630 2023-10-08T13:05:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.724+0000 7f27937fe700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27880a14d0 0x7f27880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.724+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f27940cd7c0 con 0x7f279c105630 2023-10-08T13:05:48.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.724+0000 7f27a2054700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27880a14d0 0x7f27880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:48.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.724+0000 7f27a2054700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27880a14d0 0x7f27880a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f278c009990 tx=0x7f278c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:48.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.727+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f27940969f0 con 0x7f279c105630 2023-10-08T13:05:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.936+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f279c100c90 con 0x7f279c105630 2023-10-08T13:05:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.937+0000 7f27937fe700 1 -- 172.21.15.5:0/2131738329 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f279409a010 con 0x7f279c105630 2023-10-08T13:05:48.938 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27880a14d0 msgr2=0x7f27880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27880a14d0 0x7f27880a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f278c009990 tx=0x7f278c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 msgr2=0x7f279c1a2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c1a2980 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f279400ef30 tx=0x7f279400c450 comp rx=0 tx=0).stop 2023-10-08T13:05:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 shutdown_connections 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f27880a14d0 0x7f27880a3990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f279c105630 0x7f279c1a2980 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f279c0ff570 0x7f279c197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 --2- 172.21.15.5:0/2131738329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f279c0fff30 0x7f279c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 >> 172.21.15.5:0/2131738329 conn(0x7f279c0fb020 msgr2=0x7f279c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 shutdown_connections 2023-10-08T13:05:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:48.939+0000 7f27a42b8700 1 -- 172.21.15.5:0/2131738329 wait complete. 2023-10-08T13:05:48.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:05:49.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 -- 172.21.15.5:0/3385999971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c106650 msgr2=0x7f1d8c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 --2- 172.21.15.5:0/3385999971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c106650 0x7f1d8c106a30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0099c0 tx=0x7f1d7c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 -- 172.21.15.5:0/3385999971 shutdown_connections 2023-10-08T13:05:49.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 --2- 172.21.15.5:0/3385999971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 --2- 172.21.15.5:0/3385999971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c106650 0x7f1d8c106a30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 --2- 172.21.15.5:0/3385999971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0feb90 0x7f1d8c0ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 -- 172.21.15.5:0/3385999971 >> 172.21.15.5:0/3385999971 conn(0x7f1d8c075b20 msgr2=0x7f1d8c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 -- 172.21.15.5:0/3385999971 shutdown_connections 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.077+0000 7f1d90839700 1 -- 172.21.15.5:0/3385999971 wait complete. 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 Processor -- start 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 -- start start 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0feb90 0x7f1d8c0ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c1002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c106650 0x7f1d8c1007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1a4e60 con 0x7f1d8c0ff550 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1a4fd0 con 0x7f1d8c106650 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d90839700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1a5190 con 0x7f1d8c0feb90 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d89d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c1002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.078+0000 7f1d89d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c1002b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34038/0 (socket says 172.21.15.5:34038) 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 -- 172.21.15.5:0/1515583006 learned_addr learned my addr 172.21.15.5:0/1515583006 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d8a59c700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0feb90 0x7f1d8c0ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d8ad9d700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c106650 0x7f1d8c1007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 -- 172.21.15.5:0/1515583006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0feb90 msgr2=0x7f1d8c0ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0feb90 0x7f1d8c0ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 -- 172.21.15.5:0/1515583006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c106650 msgr2=0x7f1d8c1007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c106650 0x7f1d8c1007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 -- 172.21.15.5:0/1515583006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0095f0 con 0x7f1d8c0ff550 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d8ad9d700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c106650 0x7f1d8c1007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d89d9b700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c1002b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000d950 tx=0x7f1d8000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80009940 con 0x7f1d8c0ff550 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d80010460 con 0x7f1d8c0ff550 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c1a5470 con 0x7f1d8c0ff550 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000f620 con 0x7f1d8c0ff550 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.079+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c1a5980 con 0x7f1d8c0ff550 2023-10-08T13:05:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.080+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c108c40 con 0x7f1d8c0ff550 2023-10-08T13:05:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.081+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1d800108d0 con 0x7f1d8c0ff550 2023-10-08T13:05:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.082+0000 7f1d7b7fe700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1d740a14d0 0x7f1d740a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.082+0000 7f1d8a59c700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1d740a14d0 0x7f1d740a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.082+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1d800cd050 con 0x7f1d8c0ff550 2023-10-08T13:05:49.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.082+0000 7f1d8a59c700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1d740a14d0 0x7f1d740a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009990 tx=0x7f1d7c003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:49.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.085+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d80096250 con 0x7f1d8c0ff550 2023-10-08T13:05:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.338+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d8c066cc0 con 0x7f1d8c0ff550 2023-10-08T13:05:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.338+0000 7f1d7b7fe700 1 -- 172.21.15.5:0/1515583006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7f1d80020090 con 0x7f1d8c0ff550 2023-10-08T13:05:49.340 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:49.340 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:05:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1d740a14d0 msgr2=0x7f1d740a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1d740a14d0 0x7f1d740a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009990 tx=0x7f1d7c003680 comp rx=0 tx=0).stop 2023-10-08T13:05:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 msgr2=0x7f1d8c1002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c1002b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000d950 tx=0x7f1d8000dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 shutdown_connections 2023-10-08T13:05:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1d740a14d0 0x7f1d740a3990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d8c106650 0x7f1d8c1007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0feb90 0x7f1d8c0ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 --2- 172.21.15.5:0/1515583006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c0ff550 0x7f1d8c1002b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 >> 172.21.15.5:0/1515583006 conn(0x7f1d8c075b20 msgr2=0x7f1d8c0fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 shutdown_connections 2023-10-08T13:05:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.341+0000 7f1d90839700 1 -- 172.21.15.5:0/1515583006 wait complete. 2023-10-08T13:05:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:05:49.353 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:49 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1644171965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.354 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:49 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2345065082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.354 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:49 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2131738329' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:49.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:49 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1644171965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:49 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2345065082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:49 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2131738329' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 -- 172.21.15.5:0/917724092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 msgr2=0x7fb9c8100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/917724092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8100ac0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009990 tx=0x7fb9bc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 -- 172.21.15.5:0/917724092 shutdown_connections 2023-10-08T13:05:49.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/917724092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9c8101000 0x7fb9c810d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/917724092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c8106650 0x7fb9c8106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/917724092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8100ac0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 -- 172.21.15.5:0/917724092 >> 172.21.15.5:0/917724092 conn(0x7fb9c80fc150 msgr2=0x7fb9c80fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 -- 172.21.15.5:0/917724092 shutdown_connections 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 -- 172.21.15.5:0/917724092 wait complete. 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 Processor -- start 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.481+0000 7fb9ce88d700 1 -- start start 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9ce88d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9ce88d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9c8101000 0x7fb9c8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9ce88d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c8106650 0x7fb9c8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9ce88d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81a4e70 con 0x7fb9c8100640 2023-10-08T13:05:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9ce88d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81a4fe0 con 0x7fb9c8101000 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9ce88d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81a51a0 con 0x7fb9c8106650 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34050/0 (socket says 172.21.15.5:34050) 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 -- 172.21.15.5:0/3529023898 learned_addr learned my addr 172.21.15.5:0/3529023898 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9cce2a700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c8106650 0x7fb9c8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 -- 172.21.15.5:0/3529023898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c8106650 msgr2=0x7fb9c8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c8106650 0x7fb9c8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 -- 172.21.15.5:0/3529023898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9c8101000 msgr2=0x7fb9c8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c77fe700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9c8101000 0x7fb9c8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9c8101000 0x7fb9c8073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 -- 172.21.15.5:0/3529023898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0095f0 con 0x7fb9c8100640 2023-10-08T13:05:49.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c7fff700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8072af0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800d950 tx=0x7fb9b800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.482+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8009940 con 0x7fb9c8100640 2023-10-08T13:05:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.483+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c81a5480 con 0x7fb9c8100640 2023-10-08T13:05:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.483+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9b8010460 con 0x7fb9c8100640 2023-10-08T13:05:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.483+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800f620 con 0x7fb9c8100640 2023-10-08T13:05:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.483+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c81a5990 con 0x7fb9c8100640 2023-10-08T13:05:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.484+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c8108c60 con 0x7fb9c8100640 2023-10-08T13:05:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.485+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb9b80108d0 con 0x7fb9c8100640 2023-10-08T13:05:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.485+0000 7fb9c57fa700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb9b00a14d0 0x7fb9b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.486+0000 7fb9c77fe700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb9b00a14d0 0x7fb9b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.486+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb9b80ccfb0 con 0x7fb9c8100640 2023-10-08T13:05:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.486+0000 7fb9c77fe700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb9b00a14d0 0x7fb9b00a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0095c0 tx=0x7fb9bc009510 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.489+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb9b80961b0 con 0x7fb9c8100640 2023-10-08T13:05:49.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:49 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1644171965' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:49 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2345065082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:49 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2131738329' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.694+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9c8101d80 con 0x7fb9c8100640 2023-10-08T13:05:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.696+0000 7fb9c57fa700 1 -- 172.21.15.5:0/3529023898 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7fb9b8016090 con 0x7fb9c8100640 2023-10-08T13:05:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:49.698 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb9b00a14d0 msgr2=0x7fb9b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb9b00a14d0 0x7fb9b00a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0095c0 tx=0x7fb9bc009510 comp rx=0 tx=0).stop 2023-10-08T13:05:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 msgr2=0x7fb9c8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8072af0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800d950 tx=0x7fb9b800dc60 comp rx=0 tx=0).stop 2023-10-08T13:05:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 shutdown_connections 2023-10-08T13:05:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb9b00a14d0 0x7fb9b00a3990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9c8106650 0x7fb9c8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9c8100640 0x7fb9c8072af0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 --2- 172.21.15.5:0/3529023898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9c8101000 0x7fb9c8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 >> 172.21.15.5:0/3529023898 conn(0x7fb9c80fc150 msgr2=0x7fb9c80fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 shutdown_connections 2023-10-08T13:05:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.698+0000 7fb9ce88d700 1 -- 172.21.15.5:0/3529023898 wait complete. 2023-10-08T13:05:49.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:05:49.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:05:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.841+0000 7f819715e700 1 -- 172.21.15.5:0/2361535111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ff530 msgr2=0x7f81900ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.841+0000 7f819715e700 1 --2- 172.21.15.5:0/2361535111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ff530 0x7f81900ff9b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f817c0099c0 tx=0x7f817c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 -- 172.21.15.5:0/2361535111 shutdown_connections 2023-10-08T13:05:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 --2- 172.21.15.5:0/2361535111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81900ffef0 0x7f819010c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 --2- 172.21.15.5:0/2361535111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81901055f0 0x7f81901059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 --2- 172.21.15.5:0/2361535111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ff530 0x7f81900ff9b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 -- 172.21.15.5:0/2361535111 >> 172.21.15.5:0/2361535111 conn(0x7f81900fafc0 msgr2=0x7f81900fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 -- 172.21.15.5:0/2361535111 shutdown_connections 2023-10-08T13:05:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 -- 172.21.15.5:0/2361535111 wait complete. 2023-10-08T13:05:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 Processor -- start 2023-10-08T13:05:49.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 -- start start 2023-10-08T13:05:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81900ff530 0x7f81901978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.842+0000 7f819715e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 0x7f8190197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f819715e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81901055f0 0x7f81901a2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f819715e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190198670 con 0x7f81900ffef0 2023-10-08T13:05:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f819715e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81901a2e80 con 0x7f81900ff530 2023-10-08T13:05:49.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f819715e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81901a2fc0 con 0x7f81901055f0 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 0x7f8190197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 0x7f8190197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34066/0 (socket says 172.21.15.5:34066) 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 -- 172.21.15.5:0/4103471707 learned_addr learned my addr 172.21.15.5:0/4103471707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f8194efa700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81900ff530 0x7f81901978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f81956fb700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81901055f0 0x7f81901a2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 -- 172.21.15.5:0/4103471707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81901055f0 msgr2=0x7f81901a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81901055f0 0x7f81901a2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 -- 172.21.15.5:0/4103471707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81900ff530 msgr2=0x7f81901978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81900ff530 0x7f81901978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 -- 172.21.15.5:0/4103471707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0095f0 con 0x7f81900ffef0 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818ffff700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 0x7f8190197e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f817c009990 tx=0x7f817c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:49.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c01d070 con 0x7f81900ffef0 2023-10-08T13:05:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f817c004ca0 con 0x7f81900ffef0 2023-10-08T13:05:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81901a31f0 con 0x7f81900ffef0 2023-10-08T13:05:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.843+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c00f8d0 con 0x7f81900ffef0 2023-10-08T13:05:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.844+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81901a3610 con 0x7f81900ffef0 2023-10-08T13:05:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.844+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8190107a90 con 0x7f81900ffef0 2023-10-08T13:05:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.846+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f817c005000 con 0x7f81900ffef0 2023-10-08T13:05:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.847+0000 7f818dffb700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f81800a14d0 0x7f81800a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.847+0000 7f8194efa700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f81800a14d0 0x7f81800a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.847+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f817c0ce3a0 con 0x7f81900ffef0 2023-10-08T13:05:49.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.847+0000 7f8194efa700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f81800a14d0 0x7f81800a3990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8184005950 tx=0x7f818400a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:49.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:49.851+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f817c097630 con 0x7f81900ffef0 2023-10-08T13:05:50.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.052+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8190067f60 con 0x7f81900ffef0 2023-10-08T13:05:50.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.052+0000 7f818dffb700 1 -- 172.21.15.5:0/4103471707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f817c09ac50 con 0x7f81900ffef0 2023-10-08T13:05:50.054 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:05:50.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f81800a14d0 msgr2=0x7f81800a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f81800a14d0 0x7f81800a3990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8184005950 tx=0x7f818400a300 comp rx=0 tx=0).stop 2023-10-08T13:05:50.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 msgr2=0x7f8190197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 0x7f8190197e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f817c009990 tx=0x7f817c004730 comp rx=0 tx=0).stop 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 shutdown_connections 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f81800a14d0 0x7f81800a3990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.054+0000 7f819715e700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81901055f0 0x7f81901a2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.055+0000 7f819715e700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81900ff530 0x7f81901978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.055+0000 7f819715e700 1 --2- 172.21.15.5:0/4103471707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81900ffef0 0x7f8190197e00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.055+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 >> 172.21.15.5:0/4103471707 conn(0x7f81900fafc0 msgr2=0x7f81900fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.055+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 shutdown_connections 2023-10-08T13:05:50.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.055+0000 7f819715e700 1 -- 172.21.15.5:0/4103471707 wait complete. 2023-10-08T13:05:50.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:05:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 -- 172.21.15.5:0/1990621812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c106640 msgr2=0x7efe1c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 --2- 172.21.15.5:0/1990621812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c106640 0x7efe1c106a20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efe180099c0 tx=0x7efe18009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 -- 172.21.15.5:0/1990621812 shutdown_connections 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 --2- 172.21.15.5:0/1990621812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c0ff540 0x7efe1c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 --2- 172.21.15.5:0/1990621812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c106640 0x7efe1c106a20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 --2- 172.21.15.5:0/1990621812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe1c0feb80 0x7efe1c0ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 -- 172.21.15.5:0/1990621812 >> 172.21.15.5:0/1990621812 conn(0x7efe1c075b10 msgr2=0x7efe1c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 -- 172.21.15.5:0/1990621812 shutdown_connections 2023-10-08T13:05:50.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.198+0000 7efe241c8700 1 -- 172.21.15.5:0/1990621812 wait complete. 2023-10-08T13:05:50.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 Processor -- start 2023-10-08T13:05:50.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 -- start start 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 0x7efe1c19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe1c0ff540 0x7efe1c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c106640 0x7efe1c196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c197100 con 0x7efe1c0feb80 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c197270 con 0x7efe1c0ff540 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe241c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c197430 con 0x7efe1c106640 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe21f64700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 0x7efe1c19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe21f64700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 0x7efe1c19c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34078/0 (socket says 172.21.15.5:34078) 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.199+0000 7efe21f64700 1 -- 172.21.15.5:0/395081400 learned_addr learned my addr 172.21.15.5:0/395081400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21763700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe1c0ff540 0x7efe1c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe22765700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c106640 0x7efe1c196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21f64700 1 -- 172.21.15.5:0/395081400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c106640 msgr2=0x7efe1c196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21f64700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c106640 0x7efe1c196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21f64700 1 -- 172.21.15.5:0/395081400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe1c0ff540 msgr2=0x7efe1c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21f64700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe1c0ff540 0x7efe1c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21f64700 1 -- 172.21.15.5:0/395081400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180095f0 con 0x7efe1c0feb80 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe22765700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c106640 0x7efe1c196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe21f64700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 0x7efe1c19c840 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efe1800c010 tx=0x7efe1800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1801c070 con 0x7efe1c0feb80 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe18022420 con 0x7efe1c0feb80 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c1976b0 con 0x7efe1c0feb80 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18017650 con 0x7efe1c0feb80 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.200+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c1a37c0 con 0x7efe1c0feb80 2023-10-08T13:05:50.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.201+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c108c30 con 0x7efe1c0feb80 2023-10-08T13:05:50.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.202+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7efe18020070 con 0x7efe1c0feb80 2023-10-08T13:05:50.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.203+0000 7efe12ffd700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe080a14d0 0x7efe080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.203+0000 7efe21763700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe080a14d0 0x7efe080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.203+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7efe180cdea0 con 0x7efe1c0feb80 2023-10-08T13:05:50.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.203+0000 7efe21763700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe080a14d0 0x7efe080a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efe0c005fd0 tx=0x7efe0c005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:50.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.207+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe180970d0 con 0x7efe1c0feb80 2023-10-08T13:05:50.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:50 smithi060 ceph-mon[103190]: pgmap v295: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 300 B/s wr, 10 op/s; 63 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:50.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1515583006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3529023898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:50.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:50 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4103471707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.411+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe1c197dc0 con 0x7efe1c0feb80 2023-10-08T13:05:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.412+0000 7efe12ffd700 1 -- 172.21.15.5:0/395081400 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe18022590 con 0x7efe1c0feb80 2023-10-08T13:05:50.414 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe080a14d0 msgr2=0x7efe080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe080a14d0 0x7efe080a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efe0c005fd0 tx=0x7efe0c005f60 comp rx=0 tx=0).stop 2023-10-08T13:05:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 msgr2=0x7efe1c19c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 0x7efe1c19c840 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efe1800c010 tx=0x7efe1800f740 comp rx=0 tx=0).stop 2023-10-08T13:05:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 shutdown_connections 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7efe080a14d0 0x7efe080a3990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe1c106640 0x7efe1c196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe1c0feb80 0x7efe1c19c840 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 --2- 172.21.15.5:0/395081400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe1c0ff540 0x7efe1c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 >> 172.21.15.5:0/395081400 conn(0x7efe1c075b10 msgr2=0x7efe1c0fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 shutdown_connections 2023-10-08T13:05:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.414+0000 7efe241c8700 1 -- 172.21.15.5:0/395081400 wait complete. 2023-10-08T13:05:50.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:50 smithi005 ceph-mon[99496]: pgmap v295: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 300 B/s wr, 10 op/s; 63 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:50.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1515583006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:50.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3529023898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:50.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:50 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4103471707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:50.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:05:50.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:50 smithi118 ceph-mon[104234]: pgmap v295: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 300 B/s wr, 10 op/s; 63 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:50.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1515583006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3529023898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:50.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:50 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4103471707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 -- 172.21.15.5:0/3723780906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 msgr2=0x7f440c10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 --2- 172.21.15.5:0/3723780906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c10c3c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f440400b0d0 tx=0x7f440400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 -- 172.21.15.5:0/3723780906 shutdown_connections 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 --2- 172.21.15.5:0/3723780906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c10c3c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 --2- 172.21.15.5:0/3723780906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 0x7f440c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 --2- 172.21.15.5:0/3723780906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 0x7f440c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 -- 172.21.15.5:0/3723780906 >> 172.21.15.5:0/3723780906 conn(0x7f440c0fafb0 msgr2=0x7f440c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 -- 172.21.15.5:0/3723780906 shutdown_connections 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.556+0000 7f44141b5700 1 -- 172.21.15.5:0/3723780906 wait complete. 2023-10-08T13:05:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 Processor -- start 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 -- start start 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 0x7f440c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 0x7f440c1969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c197030 con 0x7f440c0fff00 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c1971a0 con 0x7f440c0ff540 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f44141b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c197360 con 0x7f440c105600 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34094/0 (socket says 172.21.15.5:34094) 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 -- 172.21.15.5:0/1992355677 learned_addr learned my addr 172.21.15.5:0/1992355677 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4412752700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 0x7f440c1969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411f51700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 0x7f440c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 -- 172.21.15.5:0/1992355677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 msgr2=0x7f440c1969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 0x7f440c1969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 -- 172.21.15.5:0/1992355677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 msgr2=0x7f440c19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 0x7f440c19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411750700 1 -- 172.21.15.5:0/1992355677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404009d00 con 0x7f440c0fff00 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4411f51700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 0x7f440c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.557+0000 7f4412752700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 0x7f440c1969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.558+0000 7f4411750700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c19cd90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00d950 tx=0x7f43fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.558+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc009b40 con 0x7f440c0fff00 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.558+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43fc009ca0 con 0x7f440c0fff00 2023-10-08T13:05:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.558+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c197640 con 0x7f440c0fff00 2023-10-08T13:05:50.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.558+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00f620 con 0x7f440c0fff00 2023-10-08T13:05:50.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.558+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c1a3840 con 0x7f440c0fff00 2023-10-08T13:05:50.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.559+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440c100c60 con 0x7f440c0fff00 2023-10-08T13:05:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.560+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f43fc010460 con 0x7f440c0fff00 2023-10-08T13:05:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.560+0000 7f4402ffd700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43f80a14d0 0x7f43f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.561+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f43fc0cd5b0 con 0x7f440c0fff00 2023-10-08T13:05:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.561+0000 7f4411f51700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43f80a14d0 0x7f43f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.561+0000 7f4411f51700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43f80a14d0 0x7f43f80a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4408005d90 tx=0x7f4408005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:50.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.564+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43fc0967b0 con 0x7f440c0fff00 2023-10-08T13:05:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.766+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f440c10f460 con 0x7f440c0fff00 2023-10-08T13:05:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.766+0000 7f4402ffd700 1 -- 172.21.15.5:0/1992355677 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43fc0160a0 con 0x7f440c0fff00 2023-10-08T13:05:50.768 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:05:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43f80a14d0 msgr2=0x7f43f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43f80a14d0 0x7f43f80a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4408005d90 tx=0x7f4408005d00 comp rx=0 tx=0).stop 2023-10-08T13:05:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 msgr2=0x7f440c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c19cd90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00d950 tx=0x7f43fc00dd10 comp rx=0 tx=0).stop 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 shutdown_connections 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f43f80a14d0 0x7f43f80a3990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f440c105600 0x7f440c1969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f440c0ff540 0x7f440c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 --2- 172.21.15.5:0/1992355677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f440c0fff00 0x7f440c19cd90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 >> 172.21.15.5:0/1992355677 conn(0x7f440c0fafb0 msgr2=0x7f440c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 shutdown_connections 2023-10-08T13:05:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.768+0000 7f44141b5700 1 -- 172.21.15.5:0/1992355677 wait complete. 2023-10-08T13:05:50.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:05:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 -- 172.21.15.5:0/1885535581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 msgr2=0x7f278410c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 --2- 172.21.15.5:0/1885535581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f278410c3b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f277c00b0d0 tx=0x7f277c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 -- 172.21.15.5:0/1885535581 shutdown_connections 2023-10-08T13:05:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 --2- 172.21.15.5:0/1885535581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f278410c3b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 --2- 172.21.15.5:0/1885535581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27841055f0 0x7f27841059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 --2- 172.21.15.5:0/1885535581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 0x7f27840ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 -- 172.21.15.5:0/1885535581 >> 172.21.15.5:0/1885535581 conn(0x7f27840fafc0 msgr2=0x7f27840fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 -- 172.21.15.5:0/1885535581 shutdown_connections 2023-10-08T13:05:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.910+0000 7f2788ed1700 1 -- 172.21.15.5:0/1885535581 wait complete. 2023-10-08T13:05:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.911+0000 7f2788ed1700 1 Processor -- start 2023-10-08T13:05:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.911+0000 7f2788ed1700 1 -- start start 2023-10-08T13:05:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2788ed1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 0x7f27841979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2788ed1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f2784197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2788ed1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27841055f0 0x7f27841a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2788ed1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784198750 con 0x7f27840ffef0 2023-10-08T13:05:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2788ed1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841a2f80 con 0x7f27840ff530 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2788ed1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841a30c0 con 0x7f27841055f0 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f2784197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f2784197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34108/0 (socket says 172.21.15.5:34108) 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 -- 172.21.15.5:0/3148608212 learned_addr learned my addr 172.21.15.5:0/3148608212 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2782d9d700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27841055f0 0x7f27841a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f278259c700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 0x7f27841979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 -- 172.21.15.5:0/3148608212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27841055f0 msgr2=0x7f27841a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27841055f0 0x7f27841a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 -- 172.21.15.5:0/3148608212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 msgr2=0x7f27841979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 0x7f27841979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 -- 172.21.15.5:0/3148608212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009d00 con 0x7f27840ffef0 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f278259c700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 0x7f27841979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.912+0000 7f2781d9b700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f2784197f00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f277800e9d0 tx=0x7f277800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.913+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778009790 con 0x7f27840ffef0 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.913+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27841a3320 con 0x7f27840ffef0 2023-10-08T13:05:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.913+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f277800cbd0 con 0x7f27840ffef0 2023-10-08T13:05:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.913+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778018680 con 0x7f27840ffef0 2023-10-08T13:05:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.913+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27841a3830 con 0x7f27840ffef0 2023-10-08T13:05:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.914+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784107a90 con 0x7f27840ffef0 2023-10-08T13:05:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.915+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f277800cd40 con 0x7f27840ffef0 2023-10-08T13:05:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.916+0000 7f27737fe700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f276c0a14d0 0x7f276c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.916+0000 7f278259c700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f276c0a14d0 0x7f276c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.916+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2778014070 con 0x7f27840ffef0 2023-10-08T13:05:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.916+0000 7f278259c700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f276c0a14d0 0x7f276c0a3990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2774009cb0 tx=0x7f2774009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:50.919+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2778096d50 con 0x7f27840ffef0 2023-10-08T13:05:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.122+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2784067f40 con 0x7f27840ffef0 2023-10-08T13:05:51.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.122+0000 7f27737fe700 1 -- 172.21.15.5:0/3148608212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f277809a370 con 0x7f27840ffef0 2023-10-08T13:05:51.124 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f276c0a14d0 msgr2=0x7f276c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f276c0a14d0 0x7f276c0a3990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2774009cb0 tx=0x7f2774009260 comp rx=0 tx=0).stop 2023-10-08T13:05:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 msgr2=0x7f2784197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f2784197f00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f277800e9d0 tx=0x7f277800ece0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 shutdown_connections 2023-10-08T13:05:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f276c0a14d0 0x7f276c0a3990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27841055f0 0x7f27841a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27840ff530 0x7f27841979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 --2- 172.21.15.5:0/3148608212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840ffef0 0x7f2784197f00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.124+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 >> 172.21.15.5:0/3148608212 conn(0x7f27840fafc0 msgr2=0x7f27840fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.125+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 shutdown_connections 2023-10-08T13:05:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.125+0000 7f2788ed1700 1 -- 172.21.15.5:0/3148608212 wait complete. 2023-10-08T13:05:51.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:05:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 -- 172.21.15.5:0/913861109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c0ff550 msgr2=0x7f6c6c0ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 --2- 172.21.15.5:0/913861109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c0ff9d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6c600099c0 tx=0x7f6c60009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 -- 172.21.15.5:0/913861109 shutdown_connections 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 --2- 172.21.15.5:0/913861109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0fff10 0x7f6c6c10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 --2- 172.21.15.5:0/913861109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c105610 0x7f6c6c1059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 --2- 172.21.15.5:0/913861109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c0ff9d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 -- 172.21.15.5:0/913861109 >> 172.21.15.5:0/913861109 conn(0x7f6c6c0fb040 msgr2=0x7f6c6c0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 -- 172.21.15.5:0/913861109 shutdown_connections 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 -- 172.21.15.5:0/913861109 wait complete. 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 Processor -- start 2023-10-08T13:05:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.266+0000 7f6c728ef700 1 -- start start 2023-10-08T13:05:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c728ef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c728ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0fff10 0x7f6c6c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c728ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c105610 0x7f6c6c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c728ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c1990f0 con 0x7f6c6c105610 2023-10-08T13:05:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c728ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c199260 con 0x7f6c6c0fff10 2023-10-08T13:05:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c728ef700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c199420 con 0x7f6c6c0ff550 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c6bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c70e8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c105610 0x7f6c6c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c6bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c19e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:47324/0 (socket says 172.21.15.5:47324) 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c6bfff700 1 -- 172.21.15.5:0/849967245 learned_addr learned my addr 172.21.15.5:0/849967245 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c6b7fe700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0fff10 0x7f6c6c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c70e8c700 1 -- 172.21.15.5:0/849967245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0ff550 msgr2=0x7f6c6c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c70e8c700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c70e8c700 1 -- 172.21.15.5:0/849967245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0fff10 msgr2=0x7f6c6c19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c70e8c700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0fff10 0x7f6c6c19eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.267+0000 7f6c70e8c700 1 -- 172.21.15.5:0/849967245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600095f0 con 0x7f6c6c105610 2023-10-08T13:05:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.268+0000 7f6c70e8c700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c105610 0x7f6c6c198a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6c64007f10 tx=0x7f6c6400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.268+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004db0 con 0x7f6c6c105610 2023-10-08T13:05:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.268+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c199700 con 0x7f6c6c105610 2023-10-08T13:05:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.268+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c6400f040 con 0x7f6c6c105610 2023-10-08T13:05:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.268+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64005990 con 0x7f6c6c105610 2023-10-08T13:05:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.268+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c1a5950 con 0x7f6c6c105610 2023-10-08T13:05:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.269+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c100c70 con 0x7f6c6c105610 2023-10-08T13:05:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.270+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6c6400db20 con 0x7f6c6c105610 2023-10-08T13:05:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.271+0000 7f6c697fa700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c540a14d0 0x7f6c540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.271+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6c640cd230 con 0x7f6c6c105610 2023-10-08T13:05:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.271+0000 7f6c6bfff700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c540a14d0 0x7f6c540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.271+0000 7f6c6bfff700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c540a14d0 0x7f6c540a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005950 tx=0x7f6c5c00b500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.274+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c64096430 con 0x7f6c6c105610 2023-10-08T13:05:51.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:51 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/395081400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:51 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1992355677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:51 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3148608212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:51 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/395081400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:51 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1992355677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:51 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3148608212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.525+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c6c067550 con 0x7f6c6c105610 2023-10-08T13:05:51.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.526+0000 7f6c697fa700 1 -- 172.21.15.5:0/849967245 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7f6c64023020 con 0x7f6c6c105610 2023-10-08T13:05:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:51.527 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:05:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c540a14d0 msgr2=0x7f6c540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c540a14d0 0x7f6c540a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005950 tx=0x7f6c5c00b500 comp rx=0 tx=0).stop 2023-10-08T13:05:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c105610 msgr2=0x7f6c6c198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c105610 0x7f6c6c198a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6c64007f10 tx=0x7f6c6400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 shutdown_connections 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6c540a14d0 0x7f6c540a3990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c105610 0x7f6c6c198a90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6c6c0ff550 0x7f6c6c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 --2- 172.21.15.5:0/849967245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0fff10 0x7f6c6c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 >> 172.21.15.5:0/849967245 conn(0x7f6c6c0fb040 msgr2=0x7f6c6c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 shutdown_connections 2023-10-08T13:05:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.528+0000 7f6c728ef700 1 -- 172.21.15.5:0/849967245 wait complete. 2023-10-08T13:05:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:05:51.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:51.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:51 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/395081400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:51 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1992355677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:51 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3148608212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:51.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 -- 172.21.15.5:0/535768075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41021e0 msgr2=0x7f3dc410a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/535768075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41021e0 0x7f3dc410a6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009990 tx=0x7f3dac009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 -- 172.21.15.5:0/535768075 shutdown_connections 2023-10-08T13:05:51.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/535768075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc410ac90 0x7f3dc410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/535768075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc41018c0 0x7f3dc4101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/535768075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41021e0 0x7f3dc410a6c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 -- 172.21.15.5:0/535768075 >> 172.21.15.5:0/535768075 conn(0x7f3dc40fb020 msgr2=0x7f3dc40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 -- 172.21.15.5:0/535768075 shutdown_connections 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.667+0000 7f3dc9d10700 1 -- 172.21.15.5:0/535768075 wait complete. 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 Processor -- start 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 -- start start 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 0x7f3dc40ff510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc41021e0 0x7f3dc40ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc410ac90 0x7f3dc40fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc41a4ef0 con 0x7f3dc41018c0 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc41a5060 con 0x7f3dc41021e0 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc9d10700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc41a5220 con 0x7f3dc410ac90 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 0x7f3dc40ff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 0x7f3dc40ff510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34134/0 (socket says 172.21.15.5:34134) 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3051525055 learned_addr learned my addr 172.21.15.5:0/3051525055 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc2ffd700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc41021e0 0x7f3dc40ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.668+0000 7f3dc3fff700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc410ac90 0x7f3dc40fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3051525055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc410ac90 msgr2=0x7f3dc40fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc37fe700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc410ac90 0x7f3dc40fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3051525055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc41021e0 msgr2=0x7f3dc40ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc37fe700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc41021e0 0x7f3dc40ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3051525055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0095f0 con 0x7f3dc41018c0 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc37fe700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 0x7f3dc40ff510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3db400e9a0 tx=0x7f3db400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:51.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4009790 con 0x7f3dc41018c0 2023-10-08T13:05:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc41a5500 con 0x7f3dc41018c0 2023-10-08T13:05:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3db4010430 con 0x7f3dc41018c0 2023-10-08T13:05:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4018680 con 0x7f3dc41018c0 2023-10-08T13:05:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.669+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc41a5a10 con 0x7f3dc41018c0 2023-10-08T13:05:51.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.670+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc4105db0 con 0x7f3dc41018c0 2023-10-08T13:05:51.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.671+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f3db40105a0 con 0x7f3dc41018c0 2023-10-08T13:05:51.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.672+0000 7f3dc0ff9700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3db00a14d0 0x7f3db00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:51.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.672+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3db4014070 con 0x7f3dc41018c0 2023-10-08T13:05:51.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.672+0000 7f3dc2ffd700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3db00a14d0 0x7f3db00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:51.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.672+0000 7f3dc2ffd700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3db00a14d0 0x7f3db00a3990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4100c40 tx=0x7f3dac005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:51.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.675+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3db4096760 con 0x7f3dc41018c0 2023-10-08T13:05:51.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.878+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dc41009f0 con 0x7f3dc41018c0 2023-10-08T13:05:51.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.880+0000 7f3dc0ff9700 1 -- 172.21.15.5:0/3051525055 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7f3db4026090 con 0x7f3dc41018c0 2023-10-08T13:05:51.881 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:51.882 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3db00a14d0 msgr2=0x7f3db00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3db00a14d0 0x7f3db00a3990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4100c40 tx=0x7f3dac005fd0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 msgr2=0x7f3dc40ff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 0x7f3dc40ff510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3db400e9a0 tx=0x7f3db400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 shutdown_connections 2023-10-08T13:05:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3db00a14d0 0x7f3db00a3990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dc410ac90 0x7f3dc40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc41018c0 0x7f3dc40ff510 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 --2- 172.21.15.5:0/3051525055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc41021e0 0x7f3dc40ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.882+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 >> 172.21.15.5:0/3051525055 conn(0x7f3dc40fb020 msgr2=0x7f3dc40fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.883+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 shutdown_connections 2023-10-08T13:05:51.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:51.883+0000 7f3dc9d10700 1 -- 172.21.15.5:0/3051525055 wait complete. 2023-10-08T13:05:51.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T13:04:10.182813+0000', 'modified': '2023-10-08T13:04:34.149988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24667, 'mds_1': 24650, 'mds_2': 24649, 'mds_3': 24643, 'mds_4': 24611}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14793': {'gid': 14793, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6839/1016601603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6838', 'nonce': 1016601603}, {'type': 'v1', 'addr': '172.21.15.5:6839', 'nonce': 1016601603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14805': {'gid': 14805, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6841/3855657162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6840', 'nonce': 3855657162}, {'type': 'v1', 'addr': '172.21.15.5:6841', 'nonce': 3855657162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24554': {'gid': 24554, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6833/2732299433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 2732299433}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 2732299433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24587': {'gid': 24587, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/2434035326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 2434035326}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 2434035326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24601': {'gid': 24601, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.118:6833/2301164453', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6832', 'nonce': 2301164453}, {'type': 'v1', 'addr': '172.21.15.118:6833', 'nonce': 2301164453}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24611': {'gid': 24611, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.60:6837/529609492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 529609492}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 529609492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24643': {'gid': 24643, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.118:6835/1209433325', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6834', 'nonce': 1209433325}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1209433325}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.118:6837/1772997298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 1772997298}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 1772997298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24650': {'gid': 24650, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.60:6839/2598964762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 2598964762}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 2598964762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.118:6839/3304365163', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6838', 'nonce': 3304365163}, {'type': 'v1', 'addr': '172.21.15.118:6839', 'nonce': 3304365163}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T13:05:51.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T13:05:51.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-08T13:05:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 -- 172.21.15.5:0/454379499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac0ffef0 msgr2=0x7f61ac10c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 --2- 172.21.15.5:0/454379499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac0ffef0 0x7f61ac10c3b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b0d0 tx=0x7f61a400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 -- 172.21.15.5:0/454379499 shutdown_connections 2023-10-08T13:05:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 --2- 172.21.15.5:0/454379499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac0ffef0 0x7f61ac10c3b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 --2- 172.21.15.5:0/454379499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1055f0 0x7f61ac1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 --2- 172.21.15.5:0/454379499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ff530 0x7f61ac0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 -- 172.21.15.5:0/454379499 >> 172.21.15.5:0/454379499 conn(0x7f61ac0fafc0 msgr2=0x7f61ac0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 -- 172.21.15.5:0/454379499 shutdown_connections 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.024+0000 7f61b2f62700 1 -- 172.21.15.5:0/454379499 wait complete. 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 Processor -- start 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 -- start start 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0ff530 0x7f61ac19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ffef0 0x7f61ac19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 0x7f61ac196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac196ec0 con 0x7f61ac1055f0 2023-10-08T13:05:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac197030 con 0x7f61ac0ff530 2023-10-08T13:05:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b2f62700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac1971f0 con 0x7f61ac0ffef0 2023-10-08T13:05:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 0x7f61ac196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 0x7f61ac196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34152/0 (socket says 172.21.15.5:34152) 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61b14ff700 1 -- 172.21.15.5:0/2495887676 learned_addr learned my addr 172.21.15.5:0/2495887676 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.025+0000 7f61abfff700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ffef0 0x7f61ac19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b14ff700 1 -- 172.21.15.5:0/2495887676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ffef0 msgr2=0x7f61ac19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0ff530 0x7f61ac19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b14ff700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ffef0 0x7f61ac19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b14ff700 1 -- 172.21.15.5:0/2495887676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0ff530 msgr2=0x7f61ac19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b14ff700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0ff530 0x7f61ac19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b14ff700 1 -- 172.21.15.5:0/2495887676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009d00 con 0x7f61ac1055f0 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61abfff700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ffef0 0x7f61ac19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0ff530 0x7f61ac19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b14ff700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 0x7f61ac196860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f61a40094c0 tx=0x7f61a40095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61a9ffb700 1 -- 172.21.15.5:0/2495887676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400e040 con 0x7f61ac1055f0 2023-10-08T13:05:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac197470 con 0x7f61ac1055f0 2023-10-08T13:05:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61a9ffb700 1 -- 172.21.15.5:0/2495887676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61a401db40 con 0x7f61ac1055f0 2023-10-08T13:05:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61a9ffb700 1 -- 172.21.15.5:0/2495887676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a401baf0 con 0x7f61ac1055f0 2023-10-08T13:05:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.026+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac1a3770 con 0x7f61ac1055f0 2023-10-08T13:05:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.029+0000 7f61a9ffb700 1 -- 172.21.15.5:0/2495887676 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f61a401dcb0 con 0x7f61ac1055f0 2023-10-08T13:05:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61a9ffb700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f619c0a14d0 0x7f619c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f619c0a14d0 0x7f619c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61a9ffb700 1 -- 172.21.15.5:0/2495887676 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f61a40ceae0 con 0x7f61ac1055f0 2023-10-08T13:05:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 Processor -- start 2023-10-08T13:05:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 -- start start 2023-10-08T13:05:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd424e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424e750 0x55acd42590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 0x55acd425b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd41b7410 con 0x55acd4259600 2023-10-08T13:05:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd41a8bd0 con 0x55acd424de30 2023-10-08T13:05:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.030+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd41a64f0 con 0x55acd424e750 2023-10-08T13:05:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 0x55acd425b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f619c0a14d0 0x7f619c0a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005fd0 tx=0x7f61a0005e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 0x55acd425b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34160/0 (socket says 172.21.15.5:34160) 2023-10-08T13:05:52.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 -- 172.21.15.5:0/1720529053 learned_addr learned my addr 172.21.15.5:0/1720529053 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61abfff700 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424e750 0x55acd42590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd424e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 -- 172.21.15.5:0/1720529053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424e750 msgr2=0x55acd42590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424e750 0x55acd42590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 -- 172.21.15.5:0/1720529053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 msgr2=0x55acd424e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd424e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 -- 172.21.15.5:0/1720529053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd3fccd90 con 0x55acd4259600 2023-10-08T13:05:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd424e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f61b14ff700 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 0x55acd425b9f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f61a409b6d0 tx=0x7f61a400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb23608db2daf8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f6196ffd700 1 -- 172.21.15.5:0/1720529053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a409c0d0 con 0x55acd4259600 2023-10-08T13:05:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f6196ffd700 1 -- 172.21.15.5:0/1720529053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61a409b9d0 con 0x55acd4259600 2023-10-08T13:05:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.031+0000 7f6196ffd700 1 -- 172.21.15.5:0/1720529053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40bb310 con 0x55acd4259600 2023-10-08T13:05:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1720529053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 msgr2=0x55acd425b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 0x55acd425b9f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f61a409b6d0 tx=0x7f61a400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1720529053 shutdown_connections 2023-10-08T13:05:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd4259600 0x55acd425b9f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd424e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1720529053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424e750 0x55acd42590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1720529053 >> 172.21.15.5:0/1720529053 conn(0x55acd41c3210 msgr2=0x55acd424a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1720529053 shutdown_connections 2023-10-08T13:05:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1720529053 wait complete. 2023-10-08T13:05:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 -- start start 2023-10-08T13:05:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.032+0000 7f61bf14bb80 1 Processor -- start 2023-10-08T13:05:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4259050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4256320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd4259600 0x55acd4256a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd41a1de0 con 0x55acd424e750 2023-10-08T13:05:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd413e6c0 con 0x55acd424de30 2023-10-08T13:05:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd413e360 con 0x55acd4259600 2023-10-08T13:05:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61bf14bb80 10 client.0 _ll_register_callbacks cb 0x55acd3f9b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4256320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4256320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34164/0 (socket says 172.21.15.5:34164) 2023-10-08T13:05:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 -- 172.21.15.5:0/3612872979 learned_addr learned my addr 172.21.15.5:0/3612872979 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4259050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61b14ff700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd4259600 0x55acd4256a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 -- 172.21.15.5:0/3612872979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd4259600 msgr2=0x55acd4256a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd4259600 0x55acd4256a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 -- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 msgr2=0x55acd4259050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4259050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 -- 172.21.15.5:0/3612872979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac1a3770 con 0x55acd424e750 2023-10-08T13:05:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4259050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f61abfff700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4256320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f619800baa0 tx=0x7f619800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b91cd19541e30b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.033+0000 7f618bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f618bfff700 1 -- 172.21.15.5:0/3612872979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619801b440 con 0x55acd424e750 2023-10-08T13:05:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f618bfff700 1 -- 172.21.15.5:0/3612872979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6198011440 con 0x55acd424e750 2023-10-08T13:05:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acd4169e60 con 0x55acd424e750 2023-10-08T13:05:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f618bfff700 1 -- 172.21.15.5:0/3612872979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6198011600 con 0x55acd424e750 2023-10-08T13:05:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 10 client.15600 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55acd3fb5c10 con 0x55acd424e750 2023-10-08T13:05:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f618bfff700 1 -- 172.21.15.5:0/3612872979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55acd4169e60 con 0x55acd424e750 2023-10-08T13:05:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f618bfff700 1 -- 172.21.15.5:0/3612872979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f619801b940 con 0x55acd424e750 2023-10-08T13:05:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 10 client.15600 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 10 client.15600 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:05:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 20 client.15600 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4269030 0x55acd4267ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 4 client.15600 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 --> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acd419adc0 con 0x55acd4269030 2023-10-08T13:05:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.034+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4269030 0x55acd4267ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.035+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4269030 0x55acd4267ac0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=36c2cd5603631854 server_cookie=edf45902d2320a16 in_seq=0 out_seq=0 2023-10-08T13:05:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.035+0000 7f618bfff700 10 client.15600 ms_handle_connect on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f618bfff700 1 -- 172.21.15.5:0/3612872979 <== mds.4 v2:172.21.15.60:6836/529609492 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55acd419adc0 con 0x55acd4269030 2023-10-08T13:05:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f618bfff700 10 client.15600 handle_command_reply: tid=0 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 client.15600 shutdown 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 msgr2=0x55acd4256320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4256320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f619800baa0 tx=0x7f619800be60 comp rx=0 tx=0).stop 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 shutdown_connections 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4269030 0x55acd4267ac0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd4259600 0x55acd4256a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4259050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f618bfff700 0 client.15600 ms_handle_reset on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/3612872979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4256320 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 >> 172.21.15.5:0/3612872979 conn(0x55acd41c3210 msgr2=0x55acd4249e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 shutdown_connections 2023-10-08T13:05:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 1 -- 172.21.15.5:0/3612872979 wait complete. 2023-10-08T13:05:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.036+0000 7f61bf14bb80 20 client.15600 trim_cache size 0 max 16384 2023-10-08T13:05:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 Processor -- start 2023-10-08T13:05:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 -- start start 2023-10-08T13:05:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd41c3210 0x55acd42681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424de30 0x55acd4258b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd42535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd40228d0 con 0x55acd424e750 2023-10-08T13:05:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd419ded0 con 0x55acd41c3210 2023-10-08T13:05:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd402ede0 con 0x55acd424de30 2023-10-08T13:05:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd42535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd42535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34174/0 (socket says 172.21.15.5:34174) 2023-10-08T13:05:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 -- 172.21.15.5:0/2748265066 learned_addr learned my addr 172.21.15.5:0/2748265066 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd41c3210 0x55acd42681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61abfff700 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424de30 0x55acd4258b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 -- 172.21.15.5:0/2748265066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424de30 msgr2=0x55acd4258b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424de30 0x55acd4258b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 -- 172.21.15.5:0/2748265066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd41c3210 msgr2=0x55acd42681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd41c3210 0x55acd42681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 -- 172.21.15.5:0/2748265066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd3ff3200 con 0x55acd424e750 2023-10-08T13:05:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd41c3210 0x55acd42681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61b14ff700 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd42535c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f61a4098440 tx=0x7f61a400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2911d7680066c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61977fe700 1 -- 172.21.15.5:0/2748265066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40a3cd0 con 0x55acd424e750 2023-10-08T13:05:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61977fe700 1 -- 172.21.15.5:0/2748265066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61a409fb20 con 0x55acd424e750 2023-10-08T13:05:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61977fe700 1 -- 172.21.15.5:0/2748265066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a401bc50 con 0x55acd424e750 2023-10-08T13:05:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 -- 172.21.15.5:0/2748265066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 msgr2=0x55acd42535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.055+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd42535c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f61a4098440 tx=0x7f61a400b9f0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- 172.21.15.5:0/2748265066 shutdown_connections 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd42535c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd41c3210 0x55acd42681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/2748265066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd424de30 0x55acd4258b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- 172.21.15.5:0/2748265066 >> 172.21.15.5:0/2748265066 conn(0x55acd4246250 msgr2=0x55acd4267ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- 172.21.15.5:0/2748265066 shutdown_connections 2023-10-08T13:05:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- 172.21.15.5:0/2748265066 wait complete. 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- start start 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 Processor -- start 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd41c3210 0x55acd4253e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4252670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4252bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd42530f0 con 0x55acd424e750 2023-10-08T13:05:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd4253260 con 0x55acd424de30 2023-10-08T13:05:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd4253420 con 0x55acd41c3210 2023-10-08T13:05:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.056+0000 7f61bf14bb80 10 client.0 _ll_register_callbacks cb 0x7f6198004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4252bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4252bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34180/0 (socket says 172.21.15.5:34180) 2023-10-08T13:05:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 -- 172.21.15.5:0/1768793027 learned_addr learned my addr 172.21.15.5:0/1768793027 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd41c3210 0x55acd4253e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61abfff700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4252670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 -- 172.21.15.5:0/1768793027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd41c3210 msgr2=0x55acd4253e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd41c3210 0x55acd4253e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 -- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 msgr2=0x55acd4252670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4252670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 -- 172.21.15.5:0/1768793027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acd3fccd90 con 0x55acd424e750 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61abfff700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4252670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61b14ff700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4252bb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009cd0 tx=0x7f61a409b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d03c99e5349e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f618bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f618bfff700 1 -- 172.21.15.5:0/1768793027 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a401be50 con 0x55acd424e750 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f618bfff700 1 -- 172.21.15.5:0/1768793027 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f61a40b9e40 con 0x55acd424e750 2023-10-08T13:05:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61a409b9d0 con 0x55acd424e750 2023-10-08T13:05:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f618bfff700 1 -- 172.21.15.5:0/1768793027 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61a40a3cd0 con 0x55acd424e750 2023-10-08T13:05:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61bf14bb80 10 client.15606 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55acd3fcb260 con 0x55acd424e750 2023-10-08T13:05:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.057+0000 7f618bfff700 1 -- 172.21.15.5:0/1768793027 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61a409b9d0 con 0x55acd424e750 2023-10-08T13:05:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f618bfff700 1 -- 172.21.15.5:0/1768793027 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f61a409bc30 con 0x55acd424e750 2023-10-08T13:05:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61bf14bb80 10 client.15606 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61bf14bb80 10 client.15606 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:05:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61bf14bb80 20 client.15606 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4259600 0x55acd42bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61bf14bb80 4 client.15606 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 --> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55acd419aae0 con 0x55acd4259600 2023-10-08T13:05:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4259600 0x55acd42bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f61b0cfe700 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4259600 0x55acd42bd990 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4b140d9b76c3d50f server_cookie=d2105cd3183e360 in_seq=0 out_seq=0 2023-10-08T13:05:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.058+0000 7f618bfff700 10 client.15606 ms_handle_connect on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f618bfff700 1 -- 172.21.15.5:0/1768793027 <== mds.4 v2:172.21.15.60:6836/529609492 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55acd419aae0 con 0x55acd4259600 2023-10-08T13:05:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f618bfff700 10 client.15606 handle_command_reply: tid=0 2023-10-08T13:05:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 client.15606 shutdown 2023-10-08T13:05:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 msgr2=0x55acd4252bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4252bb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009cd0 tx=0x7f61a409b7a0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 shutdown_connections 2023-10-08T13:05:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55acd4259600 0x55acd42bd990 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acd424e750 0x55acd4252bb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f618bfff700 0 client.15606 ms_handle_reset on v2:172.21.15.60:6836/529609492 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55acd41c3210 0x55acd4253e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 --2- 172.21.15.5:0/1768793027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55acd424de30 0x55acd4252670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 >> 172.21.15.5:0/1768793027 conn(0x55acd4246250 msgr2=0x55acd4264890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 shutdown_connections 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 1 -- 172.21.15.5:0/1768793027 wait complete. 2023-10-08T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.059+0000 7f61bf14bb80 20 client.15606 trim_cache size 0 max 16384 2023-10-08T13:05:52.085 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:52.085 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:52.085 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 4, 2023-10-08T13:05:52.086 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24611, 2023-10-08T13:05:52.086 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:52.086 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:52.086 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:52.086 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 78.914182534999995, 2023-10-08T13:05:52.087 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:52.087 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 91, 2023-10-08T13:05:52.087 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:52.087 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 115.550356444 2023-10-08T13:05:52.087 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f619c0a14d0 msgr2=0x7f619c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f619c0a14d0 0x7f619c0a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005fd0 tx=0x7f61a0005e40 comp rx=0 tx=0).stop 2023-10-08T13:05:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 msgr2=0x7f61ac196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 0x7f61ac196860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f61a40094c0 tx=0x7f61a40095a0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 shutdown_connections 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f619c0a14d0 0x7f619c0a3990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61ac1055f0 0x7f61ac196860 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0ff530 0x7f61ac19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 --2- 172.21.15.5:0/2495887676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61ac0ffef0 0x7f61ac19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 >> 172.21.15.5:0/2495887676 conn(0x7f61ac0fafc0 msgr2=0x7f61ac0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 shutdown_connections 2023-10-08T13:05:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.060+0000 7f61b2f62700 1 -- 172.21.15.5:0/2495887676 wait complete. 2023-10-08T13:05:52.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T13:05:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 -- 172.21.15.5:0/690901144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51041055f0 msgr2=0x7f51041059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 --2- 172.21.15.5:0/690901144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51041055f0 0x7f51041059d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099c0 tx=0x7f50f4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 -- 172.21.15.5:0/690901144 shutdown_connections 2023-10-08T13:05:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 --2- 172.21.15.5:0/690901144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51040ffef0 0x7f510410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 --2- 172.21.15.5:0/690901144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51041055f0 0x7f51041059d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 --2- 172.21.15.5:0/690901144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51040ff530 0x7f51040ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 -- 172.21.15.5:0/690901144 >> 172.21.15.5:0/690901144 conn(0x7f51040fafc0 msgr2=0x7f51040fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.217+0000 7f510928a700 1 -- 172.21.15.5:0/690901144 shutdown_connections 2023-10-08T13:05:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.218+0000 7f510928a700 1 -- 172.21.15.5:0/690901144 wait complete. 2023-10-08T13:05:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.218+0000 7f510928a700 1 Processor -- start 2023-10-08T13:05:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.218+0000 7f510928a700 1 -- start start 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.218+0000 7f510928a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51040ff530 0x7f5104197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 0x7f5104197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51041055f0 0x7f51041a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51041986c0 con 0x7f51040ffef0 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51041a2ef0 con 0x7f51040ff530 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51041a3030 con 0x7f51041055f0 2023-10-08T13:05:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 0x7f5104197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 0x7f5104197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34192/0 (socket says 172.21.15.5:34192) 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 -- 172.21.15.5:0/2015547711 learned_addr learned my addr 172.21.15.5:0/2015547711 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f5102ffd700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51040ff530 0x7f5104197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51037fe700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51041055f0 0x7f51041a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 -- 172.21.15.5:0/2015547711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51041055f0 msgr2=0x7f51041a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51041055f0 0x7f51041a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 -- 172.21.15.5:0/2015547711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51040ff530 msgr2=0x7f5104197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51040ff530 0x7f5104197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 -- 172.21.15.5:0/2015547711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40095f0 con 0x7f51040ffef0 2023-10-08T13:05:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f51027fc700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 0x7f5104197e70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d980 tx=0x7f50f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f50ebfff700 1 -- 172.21.15.5:0/2015547711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80098d0 con 0x7f51040ffef0 2023-10-08T13:05:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51041a3290 con 0x7f51040ffef0 2023-10-08T13:05:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f50ebfff700 1 -- 172.21.15.5:0/2015547711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50f8010460 con 0x7f51040ffef0 2023-10-08T13:05:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f50ebfff700 1 -- 172.21.15.5:0/2015547711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f800f620 con 0x7f51040ffef0 2023-10-08T13:05:52.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.219+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51041a37a0 con 0x7f51040ffef0 2023-10-08T13:05:52.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.222+0000 7f50ebfff700 1 -- 172.21.15.5:0/2015547711 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f50f8010860 con 0x7f51040ffef0 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.223+0000 7f50ebfff700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50ec0a14d0 0x7f50ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.223+0000 7f5102ffd700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50ec0a14d0 0x7f50ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.223+0000 7f50ebfff700 1 -- 172.21.15.5:0/2015547711 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f50f80ccf30 con 0x7f51040ffef0 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.223+0000 7f5102ffd700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50ec0a14d0 0x7f50ec0a3990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009990 tx=0x7f50f4003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.223+0000 7f5115473b80 1 Processor -- start 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.223+0000 7f5115473b80 1 -- start start 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5115473b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea0f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5115473b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea1a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5115473b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea1c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5115473b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe978410 con 0x559cbea0ee30 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5115473b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe969bd0 con 0x559cbea0f750 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5115473b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe9674f0 con 0x559cbea1a600 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea0f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea0f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34198/0 (socket says 172.21.15.5:34198) 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 -- 172.21.15.5:0/2815935855 learned_addr learned my addr 172.21.15.5:0/2815935855 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f51037fe700 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea1c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f51027fc700 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea1a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 -- 172.21.15.5:0/2815935855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 msgr2=0x559cbea1c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea1c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 -- 172.21.15.5:0/2815935855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 msgr2=0x559cbea1a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea1a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 -- 172.21.15.5:0/2815935855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cbe78dd90 con 0x559cbea0ee30 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f5102ffd700 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea0f210 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099c0 tx=0x7f50f4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a048bf298edc3019 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.224+0000 7f50e97fa700 1 -- 172.21.15.5:0/2815935855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400bdf0 con 0x559cbea0ee30 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f50e97fa700 1 -- 172.21.15.5:0/2815935855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50f401e040 con 0x559cbea0ee30 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f50e97fa700 1 -- 172.21.15.5:0/2815935855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400f710 con 0x559cbea0ee30 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 -- 172.21.15.5:0/2815935855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 msgr2=0x559cbea0f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea0f210 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099c0 tx=0x7f50f4020000 comp rx=0 tx=0).stop 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 -- 172.21.15.5:0/2815935855 shutdown_connections 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea1c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea0f210 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 --2- 172.21.15.5:0/2815935855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea1a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 -- 172.21.15.5:0/2815935855 >> 172.21.15.5:0/2815935855 conn(0x559cbe984210 msgr2=0x559cbea0b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 -- 172.21.15.5:0/2815935855 shutdown_connections 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.225+0000 7f5115473b80 1 -- 172.21.15.5:0/2815935855 wait complete. 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 -- start start 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 Processor -- start 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea19f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe962de0 con 0x559cbea0ee30 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe8ff6c0 con 0x559cbea0f750 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe8ff360 con 0x559cbea1a600 2023-10-08T13:05:52.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5115473b80 10 client.0 _ll_register_callbacks cb 0x559cbe75c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea19f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea19f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34204/0 (socket says 172.21.15.5:34204) 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 -- 172.21.15.5:0/4145840679 learned_addr learned my addr 172.21.15.5:0/4145840679 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f51027fc700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f51037fe700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 -- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 msgr2=0x559cbea178f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea178f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 -- 172.21.15.5:0/4145840679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 msgr2=0x559cbea172c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea172c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.226+0000 7f5102ffd700 1 -- 172.21.15.5:0/4145840679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510410ccb0 con 0x559cbea0ee30 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea19f80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009d10 tx=0x7f50f40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cb99b748866d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f50e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4145840679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400f660 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4145840679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f50f400f7c0 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cbe92ae60 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4145840679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50f400f980 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 10 client.15618 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559cbe776c10 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4145840679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559cbe92ae60 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4145840679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f50f4038430 con 0x559cbea0ee30 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 10 client.15618 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 10 client.15618 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 20 client.15618 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea29c30 0x559cbea289e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 4 client.15618 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.227+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 --> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559cbe95bdc0 con 0x559cbea29c30 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.228+0000 7f51027fc700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea29c30 0x559cbea289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.228+0000 7f50e6ff5700 10 client.15618 ms_handle_connect on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.228+0000 7f51027fc700 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea29c30 0x559cbea289e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1abb43cb8dd31865 server_cookie=85a9233f2fefc1db in_seq=0 out_seq=0 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4145840679 <== mds.3 v2:172.21.15.118:6834/1209433325 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559cbe95bdc0 con 0x559cbea29c30 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f50e6ff5700 10 client.15618 handle_command_reply: tid=0 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 client.15618 shutdown 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 msgr2=0x559cbea19f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea19f80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009d10 tx=0x7f50f40047b0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 shutdown_connections 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea29c30 0x559cbea289e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f50e6ff5700 0 client.15618 ms_handle_reset on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea19f80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 --2- 172.21.15.5:0/4145840679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea172c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 >> 172.21.15.5:0/4145840679 conn(0x559cbe984210 msgr2=0x559cbea0ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 shutdown_connections 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 1 -- 172.21.15.5:0/4145840679 wait complete. 2023-10-08T13:05:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.229+0000 7f5115473b80 20 client.15618 trim_cache size 0 max 16384 2023-10-08T13:05:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.246+0000 7f5115473b80 1 Processor -- start 2023-10-08T13:05:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 -- start start 2023-10-08T13:05:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea26150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea289e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea12600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe7e38d0 con 0x559cbea0ee30 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe9094d0 con 0x559cbea0f750 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5115473b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe7efde0 con 0x559cbea1a600 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea26150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea26150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34212/0 (socket says 172.21.15.5:34212) 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 -- 172.21.15.5:0/4156208018 learned_addr learned my addr 172.21.15.5:0/4156208018 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 -- 172.21.15.5:0/4156208018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 msgr2=0x559cbea12600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea12600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 -- 172.21.15.5:0/4156208018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 msgr2=0x559cbea289e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea289e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 -- 172.21.15.5:0/4156208018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cbe7b4200 con 0x559cbea0ee30 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea26150 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099c0 tx=0x7f50f4005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e81495a79e9eb32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f50e9ffb700 1 -- 172.21.15.5:0/4156208018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400ba70 con 0x559cbea0ee30 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f50e9ffb700 1 -- 172.21.15.5:0/4156208018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50f4004820 con 0x559cbea0ee30 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.247+0000 7f50e9ffb700 1 -- 172.21.15.5:0/4156208018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400fcf0 con 0x559cbea0ee30 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 -- 172.21.15.5:0/4156208018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 msgr2=0x559cbea26150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea26150 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099c0 tx=0x7f50f4005ce0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 -- 172.21.15.5:0/4156208018 shutdown_connections 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea12600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0ee30 0x559cbea26150 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 --2- 172.21.15.5:0/4156208018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0f750 0x559cbea289e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 -- 172.21.15.5:0/4156208018 >> 172.21.15.5:0/4156208018 conn(0x559cbe984210 msgr2=0x559cbea16820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 -- 172.21.15.5:0/4156208018 shutdown_connections 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 -- 172.21.15.5:0/4156208018 wait complete. 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 -- start start 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.248+0000 7f5115473b80 1 Processor -- start 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0ee30 0x559cbea13d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 0x559cbea14280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea81660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbea149f0 con 0x559cbea0f750 2023-10-08T13:05:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbea81ba0 con 0x559cbea0ee30 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbea81d60 con 0x559cbea1a600 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 10 client.0 _ll_register_callbacks cb 0x7f50fc007bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 0x559cbea14280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 0x559cbea14280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34220/0 (socket says 172.21.15.5:34220) 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 -- 172.21.15.5:0/4012914059 learned_addr learned my addr 172.21.15.5:0/4012914059 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0ee30 0x559cbea13d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51037fe700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea81660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 -- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 msgr2=0x559cbea81660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea81660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 -- 172.21.15.5:0/4012914059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0ee30 msgr2=0x559cbea13d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0ee30 0x559cbea13d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 -- 172.21.15.5:0/4012914059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cbe776c10 con 0x559cbea0f750 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f51027fc700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 0x559cbea14280 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f50f8010c10 tx=0x7f50f8099ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ab14a5f9084642 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f50e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4012914059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f809df40 con 0x559cbea0f750 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4012914059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f50f809d040 con 0x559cbea0f750 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.249+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cbe95bae0 con 0x559cbea0f750 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4012914059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50f80a2180 con 0x559cbea0f750 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 10 client.15624 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559cbe78c260 con 0x559cbea0f750 2023-10-08T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4012914059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559cbe95bae0 con 0x559cbea0f750 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4012914059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f50f80adc60 con 0x559cbea0f750 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 10 client.15624 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 10 client.15624 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 20 client.15624 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea87040 0x559cbea83500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 4 client.15624 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 --> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559cbe7aef20 con 0x559cbea87040 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.250+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea87040 0x559cbea83500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f50e6ff5700 10 client.15624 ms_handle_connect on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5102ffd700 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea87040 0x559cbea83500 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=42c1823d519627b4 server_cookie=7997b81bc9135110 in_seq=0 out_seq=0 2023-10-08T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f50e6ff5700 1 -- 172.21.15.5:0/4012914059 <== mds.3 v2:172.21.15.118:6834/1209433325 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x559cbe7aef20 con 0x559cbea87040 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f50e6ff5700 10 client.15624 handle_command_reply: tid=0 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 client.15624 shutdown 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 msgr2=0x559cbea14280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 0x559cbea14280 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f50f8010c10 tx=0x7f50f8099ce0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 shutdown_connections 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x559cbea87040 0x559cbea83500 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559cbea1a600 0x559cbea81660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559cbea0ee30 0x559cbea13d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 --2- 172.21.15.5:0/4012914059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cbea0f750 0x559cbea14280 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 >> 172.21.15.5:0/4012914059 conn(0x559cbe984210 msgr2=0x559cbea289e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f50e6ff5700 0 client.15624 ms_handle_reset on v2:172.21.15.118:6834/1209433325 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 shutdown_connections 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 1 -- 172.21.15.5:0/4012914059 wait complete. 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.251+0000 7f5115473b80 20 client.15624 trim_cache size 0 max 16384 2023-10-08T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:52.268 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:52.268 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 3, 2023-10-08T13:05:52.268 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24643, 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 80.113239235999998, 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 91, 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 120.42220811599999 2023-10-08T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50ec0a14d0 msgr2=0x7f50ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50ec0a14d0 0x7f50ec0a3990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009990 tx=0x7f50f4003680 comp rx=0 tx=0).stop 2023-10-08T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 msgr2=0x7f5104197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 0x7f5104197e70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d980 tx=0x7f50f800dc90 comp rx=0 tx=0).stop 2023-10-08T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 shutdown_connections 2023-10-08T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50ec0a14d0 0x7f50ec0a3990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51041055f0 0x7f51041a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51040ff530 0x7f5104197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 --2- 172.21.15.5:0/2015547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51040ffef0 0x7f5104197e70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 >> 172.21.15.5:0/2015547711 conn(0x7f51040fafc0 msgr2=0x7f51040fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 shutdown_connections 2023-10-08T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.252+0000 7f510928a700 1 -- 172.21.15.5:0/2015547711 wait complete. 2023-10-08T13:05:52.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.398+0000 7f6557a25700 1 -- 172.21.15.5:0/1947483532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 msgr2=0x7f655010a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.398+0000 7f6557a25700 1 --2- 172.21.15.5:0/1947483532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655010a610 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6540009990 tx=0x7f6540009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- 172.21.15.5:0/1947483532 shutdown_connections 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 --2- 172.21.15.5:0/1947483532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 0x7f655010d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 --2- 172.21.15.5:0/1947483532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550101810 0x7f6550101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 --2- 172.21.15.5:0/1947483532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655010a610 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- 172.21.15.5:0/1947483532 >> 172.21.15.5:0/1947483532 conn(0x7f65500fb030 msgr2=0x7f65500fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- 172.21.15.5:0/1947483532 shutdown_connections 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- 172.21.15.5:0/1947483532 wait complete. 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 Processor -- start 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- start start 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550101810 0x7f655019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 0x7f65501969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550197060 con 0x7f6550102130 2023-10-08T13:05:52.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501971d0 con 0x7f655010ac30 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.399+0000 7f6557a25700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550197390 con 0x7f6550101810 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34234/0 (socket says 172.21.15.5:34234) 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 -- 172.21.15.5:0/2909244984 learned_addr learned my addr 172.21.15.5:0/2909244984 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f65557c1700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550101810 0x7f655019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6555fc2700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 0x7f65501969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 -- 172.21.15.5:0/2909244984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550101810 msgr2=0x7f655019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550101810 0x7f655019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 -- 172.21.15.5:0/2909244984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 msgr2=0x7f65501969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 0x7f65501969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 -- 172.21.15.5:0/2909244984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65400095f0 con 0x7f6550102130 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6555fc2700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 0x7f65501969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655019cdb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6540000c00 tx=0x7f654000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f65467fc700 1 -- 172.21.15.5:0/2909244984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654001d070 con 0x7f6550102130 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6550197610 con 0x7f6550102130 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f65467fc700 1 -- 172.21.15.5:0/2909244984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65400054f0 con 0x7f6550102130 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f65467fc700 1 -- 172.21.15.5:0/2909244984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540004b30 con 0x7f6550102130 2023-10-08T13:05:52.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.400+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65501a3860 con 0x7f6550102130 2023-10-08T13:05:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.403+0000 7f65467fc700 1 -- 172.21.15.5:0/2909244984 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6540004c90 con 0x7f6550102130 2023-10-08T13:05:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.403+0000 7f65467fc700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f653c0a14d0 0x7f653c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.403+0000 7f65467fc700 1 -- 172.21.15.5:0/2909244984 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f65400cde50 con 0x7f6550102130 2023-10-08T13:05:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.403+0000 7f65557c1700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f653c0a14d0 0x7f653c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.404+0000 7f65557c1700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f653c0a14d0 0x7f653c0a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f654c007be0 tx=0x7f654c0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.404+0000 7f6563c0eb80 1 Processor -- start 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.404+0000 7f6563c0eb80 1 -- start start 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe7e30 0x55fed1fe8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1ff7a10 0x55fed1ff9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1f51410 con 0x55fed1fe8750 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1f42bd0 con 0x55fed1fe7e30 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1f404f0 con 0x55fed1ff7a10 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34242/0 (socket says 172.21.15.5:34242) 2023-10-08T13:05:52.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 -- 172.21.15.5:0/2441195172 learned_addr learned my addr 172.21.15.5:0/2441195172 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6555fc2700 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1ff7a10 0x55fed1ff9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f65557c1700 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe7e30 0x55fed1fe8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 -- 172.21.15.5:0/2441195172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1ff7a10 msgr2=0x55fed1ff9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1ff7a10 0x55fed1ff9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 -- 172.21.15.5:0/2441195172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe7e30 msgr2=0x55fed1fe8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe7e30 0x55fed1fe8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 -- 172.21.15.5:0/2441195172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fed1d66d90 con 0x55fed1fe8750 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff74d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f654009ad30 tx=0x7f6540009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777295f429dd38f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f653b7fe700 1 -- 172.21.15.5:0/2441195172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654009b4a0 con 0x55fed1fe8750 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f653b7fe700 1 -- 172.21.15.5:0/2441195172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f654009ada0 con 0x55fed1fe8750 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.405+0000 7f653b7fe700 1 -- 172.21.15.5:0/2441195172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654009a290 con 0x55fed1fe8750 2023-10-08T13:05:52.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2441195172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 msgr2=0x55fed1ff74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff74d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f654009ad30 tx=0x7f6540009310 comp rx=0 tx=0).stop 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2441195172 shutdown_connections 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1ff7a10 0x55fed1ff9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe7e30 0x55fed1fe8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2441195172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff74d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2441195172 >> 172.21.15.5:0/2441195172 conn(0x55fed1f5d210 msgr2=0x55fed1fe4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2441195172 shutdown_connections 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2441195172 wait complete. 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.406+0000 7f6563c0eb80 1 -- start start 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 Processor -- start 2023-10-08T13:05:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed1ff7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1f3bde0 con 0x55fed1fe8750 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1ed86c0 con 0x55fed1ff7a10 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1ed8360 con 0x55fed1fe7e30 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6563c0eb80 10 client.0 _ll_register_callbacks cb 0x55fed1d357b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34248/0 (socket says 172.21.15.5:34248) 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 -- 172.21.15.5:0/2032351959 learned_addr learned my addr 172.21.15.5:0/2032351959 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f65557c1700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed1ff7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6555fc2700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 -- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 msgr2=0x55fed1ff7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed1ff7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 -- 172.21.15.5:0/2032351959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 msgr2=0x55fed1ff8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.407+0000 7f6554fc0700 1 -- 172.21.15.5:0/2032351959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65501a3860 con 0x55fed1fe8750 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6554fc0700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff8330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f65400cb860 tx=0x7f65400a10c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872af54a8df25d3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6538ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6538ff9700 1 -- 172.21.15.5:0/2032351959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654009eef0 con 0x55fed1fe8750 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6538ff9700 1 -- 172.21.15.5:0/2032351959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f65400a2c10 con 0x55fed1fe8750 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fed1f03e60 con 0x55fed1fe8750 2023-10-08T13:05:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6538ff9700 1 -- 172.21.15.5:0/2032351959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65400a2dd0 con 0x55fed1fe8750 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 10 client.15636 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fed1d4fc10 con 0x55fed1fe8750 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6538ff9700 1 -- 172.21.15.5:0/2032351959 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fed1f03e60 con 0x55fed1fe8750 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6538ff9700 1 -- 172.21.15.5:0/2032351959 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6540096b90 con 0x55fed1fe8750 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 10 client.15636 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 10 client.15636 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 20 client.15636 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed2006cc0 0x55fed2005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 4 client.15636 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.408+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 --> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fed1f34dc0 con 0x55fed2006cc0 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.409+0000 7f65557c1700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed2006cc0 0x55fed2005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.409+0000 7f65557c1700 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed2006cc0 0x55fed2005a90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e8797da35e922d1 server_cookie=96432296ca1daa53 in_seq=0 out_seq=0 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.409+0000 7f6538ff9700 10 client.15636 ms_handle_connect on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6538ff9700 1 -- 172.21.15.5:0/2032351959 <== mds.2 v2:172.21.15.118:6836/1772997298 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fed1f34dc0 con 0x55fed2006cc0 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6538ff9700 10 client.15636 handle_command_reply: tid=0 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 client.15636 shutdown 2023-10-08T13:05:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 msgr2=0x55fed1ff8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff8330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f65400cb860 tx=0x7f65400a10c0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 shutdown_connections 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed1ff7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed2006cc0 0x55fed2005a90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/2032351959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff8330 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6538ff9700 0 client.15636 ms_handle_reset on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 >> 172.21.15.5:0/2032351959 conn(0x55fed1f5d210 msgr2=0x55fed1fe3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 shutdown_connections 2023-10-08T13:05:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 1 -- 172.21.15.5:0/2032351959 wait complete. 2023-10-08T13:05:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.410+0000 7f6563c0eb80 20 client.15636 trim_cache size 0 max 16384 2023-10-08T13:05:52.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:52 smithi005 ceph-mon[99496]: pgmap v296: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s; 53 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:52.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:52 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/849967245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:52.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:52 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3051525055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 Processor -- start 2023-10-08T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 -- start start 2023-10-08T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed200f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1dbc8d0 con 0x55fed1fe8750 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1ff6e20 con 0x55fed1ff7a10 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.428+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed1ff7150 con 0x55fed1fe7e30 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34256/0 (socket says 172.21.15.5:34256) 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 -- 172.21.15.5:0/462626925 learned_addr learned my addr 172.21.15.5:0/462626925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6555fc2700 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f65557c1700 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed200f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 -- 172.21.15.5:0/462626925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 msgr2=0x55fed200f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed200f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 -- 172.21.15.5:0/462626925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 msgr2=0x55fed1ff23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 -- 172.21.15.5:0/462626925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fed1d8d200 con 0x55fed1fe8750 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f6554fc0700 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff1e60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6540023000 tx=0x7f6540099350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc7db9c6126f0f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f653bfff700 1 -- 172.21.15.5:0/462626925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654009b4a0 con 0x55fed1fe8750 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f653bfff700 1 -- 172.21.15.5:0/462626925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f654009eef0 con 0x55fed1fe8750 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.429+0000 7f653bfff700 1 -- 172.21.15.5:0/462626925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540096da0 con 0x55fed1fe8750 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 -- 172.21.15.5:0/462626925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 msgr2=0x55fed1ff1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff1e60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6540023000 tx=0x7f6540099350 comp rx=0 tx=0).stop 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 -- 172.21.15.5:0/462626925 shutdown_connections 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1ff7a10 0x55fed1ff23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed200f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/462626925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1fe8750 0x55fed1ff1e60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 -- 172.21.15.5:0/462626925 >> 172.21.15.5:0/462626925 conn(0x55fed1f5d210 msgr2=0x55fed1ff1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 -- 172.21.15.5:0/462626925 shutdown_connections 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 -- 172.21.15.5:0/462626925 wait complete. 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 -- start start 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.430+0000 7f6563c0eb80 1 Processor -- start 2023-10-08T13:05:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed2009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe8750 0x55fed200a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 0x55fed200a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed205a6b0 con 0x55fed1ff7a10 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed205a7f0 con 0x55fed1fe8750 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fed205a980 con 0x55fed1fe7e30 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 10 client.0 _ll_register_callbacks cb 0x55fed1d357b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 0x55fed200a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 0x55fed200a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34264/0 (socket says 172.21.15.5:34264) 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 -- 172.21.15.5:0/92392535 learned_addr learned my addr 172.21.15.5:0/92392535 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6554fc0700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe8750 0x55fed200a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f65557c1700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed2009e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 -- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 msgr2=0x55fed2009e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed2009e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 -- 172.21.15.5:0/92392535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe8750 msgr2=0x55fed200a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe8750 0x55fed200a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 -- 172.21.15.5:0/92392535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fed1d4fc10 con 0x55fed1ff7a10 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6555fc2700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 0x55fed200a910 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6548007b50 tx=0x7f6548007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2256c934589e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6538ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6538ff9700 1 -- 172.21.15.5:0/92392535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480169c0 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f654009ada0 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.431+0000 7f6538ff9700 1 -- 172.21.15.5:0/92392535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6548016b20 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6538ff9700 1 -- 172.21.15.5:0/92392535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6548016ce0 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 10 client.15642 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fed1d65260 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6538ff9700 1 -- 172.21.15.5:0/92392535 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f654009ada0 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6538ff9700 1 -- 172.21.15.5:0/92392535 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6548014050 con 0x55fed1ff7a10 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 10 client.15642 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 10 client.15642 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 20 client.15642 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed205fda0 0x55fed205c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 4 client.15642 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 --> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fed1f34ae0 con 0x55fed205fda0 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.432+0000 7f65557c1700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed205fda0 0x55fed205c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6538ff9700 10 client.15642 ms_handle_connect on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f65557c1700 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed205fda0 0x55fed205c1e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2bd7fa2a31a960 server_cookie=58239bccb3065144 in_seq=0 out_seq=0 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6538ff9700 1 -- 172.21.15.5:0/92392535 <== mds.2 v2:172.21.15.118:6836/1772997298 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55fed1f34ae0 con 0x55fed205fda0 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6538ff9700 10 client.15642 handle_command_reply: tid=0 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 client.15642 shutdown 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 msgr2=0x55fed200a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 0x55fed200a910 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6548007b50 tx=0x7f6548007e60 comp rx=0 tx=0).stop 2023-10-08T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 shutdown_connections 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55fed205fda0 0x55fed205c1e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fed1ff7a10 0x55fed200a910 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fed1fe7e30 0x55fed2009e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 --2- 172.21.15.5:0/92392535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fed1fe8750 0x55fed200a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6538ff9700 0 client.15642 ms_handle_reset on v2:172.21.15.118:6836/1772997298 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 >> 172.21.15.5:0/92392535 conn(0x55fed1f5d210 msgr2=0x55fed1ff60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 shutdown_connections 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 1 -- 172.21.15.5:0/92392535 wait complete. 2023-10-08T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.433+0000 7f6563c0eb80 20 client.15642 trim_cache size 0 max 16384 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24649, 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:52.445 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 81.302823205999999, 2023-10-08T13:05:52.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:52.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 91, 2023-10-08T13:05:52.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:52.445 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 118.324370367 2023-10-08T13:05:52.445 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f653c0a14d0 msgr2=0x7f653c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f653c0a14d0 0x7f653c0a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f654c007be0 tx=0x7f654c0073d0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 msgr2=0x7f655019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655019cdb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6540000c00 tx=0x7f654000f690 comp rx=0 tx=0).stop 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 shutdown_connections 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f653c0a14d0 0x7f653c0a3990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f655010ac30 0x7f65501969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6550101810 0x7f655019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 --2- 172.21.15.5:0/2909244984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6550102130 0x7f655019cdb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 >> 172.21.15.5:0/2909244984 conn(0x7f65500fb030 msgr2=0x7f65500fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 shutdown_connections 2023-10-08T13:05:52.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.434+0000 7f6557a25700 1 -- 172.21.15.5:0/2909244984 wait complete. 2023-10-08T13:05:52.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T13:05:52.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:52 smithi118 ceph-mon[104234]: pgmap v296: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s; 53 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:52.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:52 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/849967245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:52.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:52 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3051525055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.574+0000 7f78c5d7b700 1 -- 172.21.15.5:0/1636575149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 msgr2=0x7f78c00ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.574+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/1636575149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c00ff9b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f78b40099c0 tx=0x7f78b4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 -- 172.21.15.5:0/1636575149 shutdown_connections 2023-10-08T13:05:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/1636575149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 0x7f78c010c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/1636575149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c01055f0 0x7f78c01059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/1636575149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c00ff9b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 -- 172.21.15.5:0/1636575149 >> 172.21.15.5:0/1636575149 conn(0x7f78c00fafc0 msgr2=0x7f78c00fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 -- 172.21.15.5:0/1636575149 shutdown_connections 2023-10-08T13:05:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.575+0000 7f78c5d7b700 1 -- 172.21.15.5:0/1636575149 wait complete. 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 Processor -- start 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 -- start start 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c0197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 0x7f78c0197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c01055f0 0x7f78c01a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0198570 con 0x7f78c00ff530 2023-10-08T13:05:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c01a2d30 con 0x7f78c01055f0 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78c5d7b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c01a2e70 con 0x7f78c00ffef0 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c0197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c0197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34274/0 (socket says 172.21.15.5:34274) 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78bf7fe700 1 -- 172.21.15.5:0/955353129 learned_addr learned my addr 172.21.15.5:0/955353129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78bffff700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c01055f0 0x7f78c01a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.576+0000 7f78beffd700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 0x7f78c0197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bf7fe700 1 -- 172.21.15.5:0/955353129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 msgr2=0x7f78c0197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 0x7f78c0197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bf7fe700 1 -- 172.21.15.5:0/955353129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c01055f0 msgr2=0x7f78c01a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c01055f0 0x7f78c01a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bf7fe700 1 -- 172.21.15.5:0/955353129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b40095f0 con 0x7f78c00ff530 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78beffd700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 0x7f78c0197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c0197770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c9b0 tx=0x7f78b000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bcff9700 1 -- 172.21.15.5:0/955353129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0007b00 con 0x7f78c00ff530 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c01a3150 con 0x7f78c00ff530 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bcff9700 1 -- 172.21.15.5:0/955353129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b0007c60 con 0x7f78c00ff530 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78bcff9700 1 -- 172.21.15.5:0/955353129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0018660 con 0x7f78c00ff530 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.577+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c01a3660 con 0x7f78c00ff530 2023-10-08T13:05:52.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.579+0000 7f78bcff9700 1 -- 172.21.15.5:0/955353129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f78b0004830 con 0x7f78c00ff530 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.580+0000 7f78bcff9700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78a80a14d0 0x7f78a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.580+0000 7f78bcff9700 1 -- 172.21.15.5:0/955353129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f78b00cd1d0 con 0x7f78c00ff530 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.580+0000 7f78beffd700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78a80a14d0 0x7f78a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.580+0000 7f78beffd700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78a80a14d0 0x7f78a80a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78c00681f0 tx=0x7f78b4005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.580+0000 7f78d1f64b80 1 Processor -- start 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 -- start start 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe71e30 0x5647bbe72210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe72750 0x5647bbe7d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbddb410 con 0x5647bbe7d600 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbdccbd0 con 0x5647bbe71e30 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbdca4f0 con 0x5647bbe72750 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34286/0 (socket says 172.21.15.5:34286) 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 -- 172.21.15.5:0/2419839463 learned_addr learned my addr 172.21.15.5:0/2419839463 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78beffd700 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe72750 0x5647bbe7d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe71e30 0x5647bbe72210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 -- 172.21.15.5:0/2419839463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe72750 msgr2=0x5647bbe7d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe72750 0x5647bbe7d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 -- 172.21.15.5:0/2419839463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe71e30 msgr2=0x5647bbe72210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe71e30 0x5647bbe72210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 -- 172.21.15.5:0/2419839463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647bbbf0d90 con 0x5647bbe7d600 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe71e30 0x5647bbe72210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.581+0000 7f78bffff700 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7f9f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098f0 tx=0x7f78b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877a00fa17c68cc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78a5ffb700 1 -- 172.21.15.5:0/2419839463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8019070 con 0x5647bbe7d600 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78a5ffb700 1 -- 172.21.15.5:0/2419839463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b800f040 con 0x5647bbe7d600 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78a5ffb700 1 -- 172.21.15.5:0/2419839463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007a90 con 0x5647bbe7d600 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 -- 172.21.15.5:0/2419839463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 msgr2=0x5647bbe7f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7f9f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098f0 tx=0x7f78b8009c00 comp rx=0 tx=0).stop 2023-10-08T13:05:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 -- 172.21.15.5:0/2419839463 shutdown_connections 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7f9f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe71e30 0x5647bbe72210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/2419839463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe72750 0x5647bbe7d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 -- 172.21.15.5:0/2419839463 >> 172.21.15.5:0/2419839463 conn(0x5647bbde7210 msgr2=0x5647bbe6e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 -- 172.21.15.5:0/2419839463 shutdown_connections 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.582+0000 7f78d1f64b80 1 -- 172.21.15.5:0/2419839463 wait complete. 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 -- start start 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 Processor -- start 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 0x5647bbe7cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe7a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe7d600 0x5647bbe7a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbdc5de0 con 0x5647bbe71e30 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbd626c0 con 0x5647bbe72750 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbd62360 con 0x5647bbe7d600 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78d1f64b80 10 client.0 _ll_register_callbacks cb 0x5647bbbbf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 0x5647bbe7cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78bf7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 0x5647bbe7cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34288/0 (socket says 172.21.15.5:34288) 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78bf7fe700 1 -- 172.21.15.5:0/788248999 learned_addr learned my addr 172.21.15.5:0/788248999 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.583+0000 7f78bffff700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe7d600 0x5647bbe7a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78beffd700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe7a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78bf7fe700 1 -- 172.21.15.5:0/788248999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe7d600 msgr2=0x5647bbe7a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe7d600 0x5647bbe7a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78bf7fe700 1 -- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 msgr2=0x5647bbe7a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe7a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78bf7fe700 1 -- 172.21.15.5:0/788248999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b8003c50 con 0x5647bbe71e30 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78beffd700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe7a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 0x5647bbe7cfc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f78b0096b00 tx=0x7f78b0099b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224a2a515d1854e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f789effd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f789effd700 1 -- 172.21.15.5:0/788248999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b009e1e0 con 0x5647bbe71e30 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f789effd700 1 -- 172.21.15.5:0/788248999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f78b00a2420 con 0x5647bbe71e30 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647bbd8de60 con 0x5647bbe71e30 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f789effd700 1 -- 172.21.15.5:0/788248999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78b009a2f0 con 0x5647bbe71e30 2023-10-08T13:05:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 10 client.15654 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5647bbbd9c10 con 0x5647bbe71e30 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f789effd700 1 -- 172.21.15.5:0/788248999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5647bbd8de60 con 0x5647bbe71e30 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f789effd700 1 -- 172.21.15.5:0/788248999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f78b00a1f90 con 0x5647bbe71e30 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 10 client.15654 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 20 client.15654 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.584+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbe8d0e0 0x5647bbe8bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.585+0000 7f78d1f64b80 4 client.15654 mds_command: new command op to 24650 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.585+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 --> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647bbdbedc0 con 0x5647bbe8d0e0 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.585+0000 7f78beffd700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbe8d0e0 0x5647bbe8bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.585+0000 7f789effd700 10 client.15654 ms_handle_connect on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:52.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.585+0000 7f78beffd700 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbe8d0e0 0x5647bbe8bc70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91f0e71df5e989ea server_cookie=4a12592f4cf22729 in_seq=0 out_seq=0 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f789effd700 1 -- 172.21.15.5:0/788248999 <== mds.1 v2:172.21.15.60:6838/2598964762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5647bbdbedc0 con 0x5647bbe8d0e0 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f789effd700 10 client.15654 handle_command_reply: tid=0 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 client.15654 shutdown 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 msgr2=0x5647bbe7cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 0x5647bbe7cfc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f78b0096b00 tx=0x7f78b0099b20 comp rx=0 tx=0).stop 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 shutdown_connections 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbe8d0e0 0x5647bbe8bc70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe7d600 0x5647bbe7a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe71e30 0x5647bbe7cfc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f789effd700 0 client.15654 ms_handle_reset on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/788248999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe7a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 >> 172.21.15.5:0/788248999 conn(0x5647bbde7210 msgr2=0x5647bbe6de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 shutdown_connections 2023-10-08T13:05:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 1 -- 172.21.15.5:0/788248999 wait complete. 2023-10-08T13:05:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.586+0000 7f78d1f64b80 20 client.15654 trim_cache size 0 max 16384 2023-10-08T13:05:52.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.604+0000 7f78d1f64b80 1 Processor -- start 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.604+0000 7f78d1f64b80 1 -- start start 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe89170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbc468d0 con 0x5647bbe7d600 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbdc1ed0 con 0x5647bbe72750 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbd6c4d0 con 0x5647bbe71e30 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34300/0 (socket says 172.21.15.5:34300) 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 -- 172.21.15.5:0/3573764245 learned_addr learned my addr 172.21.15.5:0/3573764245 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78beffd700 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe89170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 -- 172.21.15.5:0/3573764245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 msgr2=0x5647bbe74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 -- 172.21.15.5:0/3573764245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 msgr2=0x5647bbe89170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe89170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 -- 172.21.15.5:0/3573764245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647bbc17200 con 0x5647bbe7d600 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78bffff700 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7a800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098f0 tx=0x7f78b80094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c396888892bfa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78a67fc700 1 -- 172.21.15.5:0/3573764245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8019040 con 0x5647bbe7d600 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78a67fc700 1 -- 172.21.15.5:0/3573764245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b8007de0 con 0x5647bbe7d600 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.605+0000 7f78a67fc700 1 -- 172.21.15.5:0/3573764245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8004e20 con 0x5647bbe7d600 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 -- 172.21.15.5:0/3573764245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 msgr2=0x5647bbe7a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7a800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098f0 tx=0x7f78b80094e0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 -- 172.21.15.5:0/3573764245 shutdown_connections 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe7a800 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/3573764245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe89170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 -- 172.21.15.5:0/3573764245 >> 172.21.15.5:0/3573764245 conn(0x5647bbde7210 msgr2=0x5647bbe78b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 -- 172.21.15.5:0/3573764245 shutdown_connections 2023-10-08T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 -- 172.21.15.5:0/3573764245 wait complete. 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 -- start start 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.606+0000 7f78d1f64b80 1 Processor -- start 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe959c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe93e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe94360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbe94a20 con 0x5647bbe7d600 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbe94b90 con 0x5647bbe72750 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647bbee4b10 con 0x5647bbe71e30 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78d1f64b80 10 client.0 _ll_register_callbacks cb 0x5647bbbbf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe94360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe94360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34306/0 (socket says 172.21.15.5:34306) 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 -- 172.21.15.5:0/1508885394 learned_addr learned my addr 172.21.15.5:0/1508885394 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78beffd700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe93e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 -- 172.21.15.5:0/1508885394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 msgr2=0x5647bbe959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 -- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 msgr2=0x5647bbe93e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe93e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 -- 172.21.15.5:0/1508885394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647bbbf0d90 con 0x5647bbe7d600 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f78bffff700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe94360 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098c0 tx=0x7f78b8004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe624b39d523e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f789effd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.607+0000 7f789effd700 1 -- 172.21.15.5:0/1508885394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8019040 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78b800f040 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f789effd700 1 -- 172.21.15.5:0/1508885394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f78b8007970 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f789effd700 1 -- 172.21.15.5:0/1508885394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78b8007b30 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 10 client.15660 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5647bbbef260 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f789effd700 1 -- 172.21.15.5:0/1508885394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b800f040 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f789effd700 1 -- 172.21.15.5:0/1508885394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f78b8025070 con 0x5647bbe7d600 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 10 client.15660 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 20 client.15660 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbee9960 0x5647bbee5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 4 client.15660 mds_command: new command op to 24650 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 --> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5647bbdbeae0 con 0x5647bbee9960 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.608+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbee9960 0x5647bbee5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f789effd700 10 client.15660 ms_handle_connect on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78bf7fe700 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbee9960 0x5647bbee5e40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a64f1b558ddd5eff server_cookie=377993ae3fb7b825 in_seq=0 out_seq=0 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f789effd700 1 -- 172.21.15.5:0/1508885394 <== mds.1 v2:172.21.15.60:6838/2598964762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5647bbdbeae0 con 0x5647bbee9960 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f789effd700 10 client.15660 handle_command_reply: tid=0 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 client.15660 shutdown 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 msgr2=0x5647bbe94360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe94360 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098c0 tx=0x7f78b8004c50 comp rx=0 tx=0).stop 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 shutdown_connections 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x5647bbee9960 0x5647bbee5e40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5647bbe7d600 0x5647bbe94360 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5647bbe71e30 0x5647bbe959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f789effd700 0 client.15660 ms_handle_reset on v2:172.21.15.60:6838/2598964762 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 --2- 172.21.15.5:0/1508885394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5647bbe72750 0x5647bbe93e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 >> 172.21.15.5:0/1508885394 conn(0x5647bbde7210 msgr2=0x5647bbe787c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 shutdown_connections 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 1 -- 172.21.15.5:0/1508885394 wait complete. 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.609+0000 7f78d1f64b80 20 client.15660 trim_cache size 0 max 16384 2023-10-08T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24650, 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 82.490367039999995, 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 91, 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 107.006534604 2023-10-08T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78a80a14d0 msgr2=0x7f78a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78a80a14d0 0x7f78a80a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78c00681f0 tx=0x7f78b4005fd0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 msgr2=0x7f78c0197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c0197770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c9b0 tx=0x7f78b000ccc0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 shutdown_connections 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78a80a14d0 0x7f78a80a3990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78c01055f0 0x7f78c01a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c00ff530 0x7f78c0197770 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 --2- 172.21.15.5:0/955353129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78c00ffef0 0x7f78c0197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 >> 172.21.15.5:0/955353129 conn(0x7f78c00fafc0 msgr2=0x7f78c00fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 shutdown_connections 2023-10-08T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.610+0000 7f78c5d7b700 1 -- 172.21.15.5:0/955353129 wait complete. 2023-10-08T13:05:52.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T13:05:52.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:52 smithi060 ceph-mon[103190]: pgmap v296: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s; 53 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:52.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:52 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/849967245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:05:52.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:52 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3051525055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 -- 172.21.15.5:0/2430322692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae80fff00 msgr2=0x7fbae810c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 --2- 172.21.15.5:0/2430322692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae80fff00 0x7fbae810c3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b0d0 tx=0x7fbae000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 -- 172.21.15.5:0/2430322692 shutdown_connections 2023-10-08T13:05:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 --2- 172.21.15.5:0/2430322692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae80fff00 0x7fbae810c3c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 --2- 172.21.15.5:0/2430322692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae8105600 0x7fbae81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 --2- 172.21.15.5:0/2430322692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbae80ff540 0x7fbae80ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 -- 172.21.15.5:0/2430322692 >> 172.21.15.5:0/2430322692 conn(0x7fbae80fb010 msgr2=0x7fbae80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 -- 172.21.15.5:0/2430322692 shutdown_connections 2023-10-08T13:05:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.749+0000 7fbaee239700 1 -- 172.21.15.5:0/2430322692 wait complete. 2023-10-08T13:05:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 Processor -- start 2023-10-08T13:05:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 -- start start 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbae80ff540 0x7fbae81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae80fff00 0x7fbae8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 0x7fbae81a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae81987c0 con 0x7fbae8105600 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae81a2fa0 con 0x7fbae80ff540 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.750+0000 7fbaee239700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae81a30e0 con 0x7fbae80fff00 2023-10-08T13:05:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 0x7fbae81a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 0x7fbae81a2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34320/0 (socket says 172.21.15.5:34320) 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 -- 172.21.15.5:0/414310951 learned_addr learned my addr 172.21.15.5:0/414310951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae80fff00 0x7fbae8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae77fe700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbae80ff540 0x7fbae81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 -- 172.21.15.5:0/414310951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae80fff00 msgr2=0x7fbae8197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae80fff00 0x7fbae8197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 -- 172.21.15.5:0/414310951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbae80ff540 msgr2=0x7fbae81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbae80ff540 0x7fbae81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 -- 172.21.15.5:0/414310951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0009d00 con 0x7fbae8105600 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae7fff700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 0x7fbae81a2a60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbae00094f0 tx=0x7fbae0009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae4ff9700 1 -- 172.21.15.5:0/414310951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000e040 con 0x7fbae8105600 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae81a3330 con 0x7fbae8105600 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae4ff9700 1 -- 172.21.15.5:0/414310951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbae001d940 con 0x7fbae8105600 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbae4ff9700 1 -- 172.21.15.5:0/414310951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae001b9d0 con 0x7fbae8105600 2023-10-08T13:05:52.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.751+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae81a37b0 con 0x7fbae8105600 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.753+0000 7fbae4ff9700 1 -- 172.21.15.5:0/414310951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fbae001dab0 con 0x7fbae8105600 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.754+0000 7fbae4ff9700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbad40a14d0 0x7fbad40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.754+0000 7fbae4ff9700 1 -- 172.21.15.5:0/414310951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbae00ce990 con 0x7fbae8105600 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.754+0000 7fbae77fe700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbad40a14d0 0x7fbad40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 Processor -- start 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae77fe700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbad40a14d0 0x7fbad40a3990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005950 tx=0x7fbad800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 -- start start 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f625210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f6300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f6329f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f58e410 con 0x55570f625750 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f57fbd0 con 0x55570f624e30 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbafa422b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f57d4f0 con 0x55570f630600 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f6300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f6300c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34326/0 (socket says 172.21.15.5:34326) 2023-10-08T13:05:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 -- 172.21.15.5:0/2127653821 learned_addr learned my addr 172.21.15.5:0/2127653821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae77fe700 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f625210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae7fff700 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f6329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 -- 172.21.15.5:0/2127653821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 msgr2=0x55570f6329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f6329f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 -- 172.21.15.5:0/2127653821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 msgr2=0x55570f625210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f625210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.755+0000 7fbae6ffd700 1 -- 172.21.15.5:0/2127653821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570f3a3d90 con 0x55570f625750 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f6300c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007c60 tx=0x7fbad0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7d7da3e794a1b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbaddffb700 1 -- 172.21.15.5:0/2127653821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0010ca0 con 0x55570f625750 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbaddffb700 1 -- 172.21.15.5:0/2127653821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad0004510 con 0x55570f625750 2023-10-08T13:05:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbaddffb700 1 -- 172.21.15.5:0/2127653821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad001a470 con 0x55570f625750 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 -- 172.21.15.5:0/2127653821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 msgr2=0x55570f6300c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f6300c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007c60 tx=0x7fbad0007f70 comp rx=0 tx=0).stop 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 -- 172.21.15.5:0/2127653821 shutdown_connections 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f6329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f625210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 --2- 172.21.15.5:0/2127653821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f6300c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.756+0000 7fbafa422b80 1 -- 172.21.15.5:0/2127653821 >> 172.21.15.5:0/2127653821 conn(0x55570f59a210 msgr2=0x55570f621280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 -- 172.21.15.5:0/2127653821 shutdown_connections 2023-10-08T13:05:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 -- 172.21.15.5:0/2127653821 wait complete. 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 -- start start 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 Processor -- start 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f630060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f578de0 con 0x55570f624e30 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f5156c0 con 0x55570f625750 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f515360 con 0x55570f630600 2023-10-08T13:05:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbafa422b80 10 client.0 _ll_register_callbacks cb 0x55570f3727b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.757+0000 7fbae77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f630060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f630060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34330/0 (socket says 172.21.15.5:34330) 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 -- 172.21.15.5:0/3536822458 learned_addr learned my addr 172.21.15.5:0/3536822458 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 -- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 msgr2=0x55570f62db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 -- 172.21.15.5:0/3536822458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 msgr2=0x55570f62d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 -- 172.21.15.5:0/3536822458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad00078c0 con 0x55570f624e30 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbae77fe700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f630060 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbad80116f0 tx=0x7fbad80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c6f6b873c40eb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3536822458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8004a30 con 0x55570f624e30 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3536822458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbad8017070 con 0x55570f624e30 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55570f540e60 con 0x55570f624e30 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3536822458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad8004b90 con 0x55570f624e30 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbafa422b80 10 client.15672 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.758+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55570f38cc10 con 0x55570f624e30 2023-10-08T13:05:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3536822458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55570f540e60 con 0x55570f624e30 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3536822458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbad801f550 con 0x55570f624e30 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbafa422b80 10 client.15672 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbafa422b80 10 client.15672 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbafa422b80 20 client.15672 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f640280 0x55570f63ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbafa422b80 4 client.15672 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55570f571dc0 con 0x55570f640280 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f640280 0x55570f63ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f640280 0x55570f63ecd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28a27cbfe4cefc7b server_cookie=4605c1e0afe13ad1 in_seq=0 out_seq=0 2023-10-08T13:05:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.759+0000 7fbac6ffd700 10 client.15672 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3536822458 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55570f571dc0 con 0x55570f640280 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbac6ffd700 10 client.15672 handle_command_reply: tid=0 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 client.15672 shutdown 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 msgr2=0x55570f630060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f630060 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbad80116f0 tx=0x7fbad80047c0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 shutdown_connections 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f630060 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f640280 0x55570f63ecd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3536822458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbac6ffd700 0 client.15672 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 >> 172.21.15.5:0/3536822458 conn(0x55570f59a210 msgr2=0x55570f620e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 shutdown_connections 2023-10-08T13:05:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.760+0000 7fbafa422b80 1 -- 172.21.15.5:0/3536822458 wait complete. 2023-10-08T13:05:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.761+0000 7fbafa422b80 20 client.15672 trim_cache size 0 max 16384 2023-10-08T13:05:52.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 Processor -- start 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 -- start start 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f627d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f62ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f3f98d0 con 0x55570f625750 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f626080 con 0x55570f624e30 2023-10-08T13:05:52.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbafa422b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f628e70 con 0x55570f630600 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f62ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f62ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34340/0 (socket says 172.21.15.5:34340) 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 -- 172.21.15.5:0/4083006553 learned_addr learned my addr 172.21.15.5:0/4083006553 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae7fff700 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae77fe700 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f627d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 -- 172.21.15.5:0/4083006553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 msgr2=0x55570f62d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 -- 172.21.15.5:0/4083006553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 msgr2=0x55570f627d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f627d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 -- 172.21.15.5:0/4083006553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570f3ca200 con 0x55570f625750 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae77fe700 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f627d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f62ccf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007c60 tx=0x7fbad00039a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e998923098f4037 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbade7fc700 1 -- 172.21.15.5:0/4083006553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0003e00 con 0x55570f625750 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbade7fc700 1 -- 172.21.15.5:0/4083006553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad0010aa0 con 0x55570f625750 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.779+0000 7fbade7fc700 1 -- 172.21.15.5:0/4083006553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0028c60 con 0x55570f625750 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 -- 172.21.15.5:0/4083006553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 msgr2=0x55570f62ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f62ccf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007c60 tx=0x7fbad00039a0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 -- 172.21.15.5:0/4083006553 shutdown_connections 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f624e30 0x55570f627d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 --2- 172.21.15.5:0/4083006553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f625750 0x55570f62ccf0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 -- 172.21.15.5:0/4083006553 >> 172.21.15.5:0/4083006553 conn(0x55570f59a210 msgr2=0x55570f628760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 -- 172.21.15.5:0/4083006553 shutdown_connections 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 -- 172.21.15.5:0/4083006553 wait complete. 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 -- start start 2023-10-08T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.780+0000 7fbafa422b80 1 Processor -- start 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f629ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f649040 con 0x55570f624e30 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f6491b0 con 0x55570f625750 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570f693cf0 con 0x55570f630600 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 10 client.0 _ll_register_callbacks cb 0x7fbad8010ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f629ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f629ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34344/0 (socket says 172.21.15.5:34344) 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 -- 172.21.15.5:0/3682418548 learned_addr learned my addr 172.21.15.5:0/3682418548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae7fff700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 -- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 msgr2=0x55570f62a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 -- 172.21.15.5:0/3682418548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 msgr2=0x55570f62a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 -- 172.21.15.5:0/3682418548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55570f3a3d90 con 0x55570f624e30 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbae77fe700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f629ca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbad80116c0 tx=0x7fbad8005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c4c42fa348b5be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3682418548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8034450 con 0x55570f624e30 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3682418548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbad8017040 con 0x55570f624e30 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.781+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbad0004510 con 0x55570f624e30 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3682418548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad80345b0 con 0x55570f624e30 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 10 client.15678 fetch_fsmap learned FSMap version 27 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55570f3a2260 con 0x55570f624e30 2023-10-08T13:05:52.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3682418548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad0004510 con 0x55570f624e30 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3682418548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbad8027690 con 0x55570f624e30 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 10 client.15678 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 10 client.15678 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 20 client.15678 populate_metadata read hostname 'smithi005' 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f699080 0x55570f695460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 4 client.15678 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55570f571ae0 con 0x55570f699080 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.782+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f699080 0x55570f695460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbac6ffd700 10 client.15678 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:52.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbae6ffd700 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f699080 0x55570f695460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=543b74cbc5f583f8 server_cookie=182e201c97c43831 in_seq=0 out_seq=0 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbac6ffd700 1 -- 172.21.15.5:0/3682418548 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x55570f571ae0 con 0x55570f699080 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbac6ffd700 10 client.15678 handle_command_reply: tid=0 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 client.15678 shutdown 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 msgr2=0x55570f629ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f629ca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbad80116c0 tx=0x7fbad8005980 comp rx=0 tx=0).stop 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 shutdown_connections 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55570f630600 0x55570f62a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55570f624e30 0x55570f629ca0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55570f699080 0x55570f695460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 --2- 172.21.15.5:0/3682418548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55570f625750 0x55570f62a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbac6ffd700 0 client.15678 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 >> 172.21.15.5:0/3682418548 conn(0x55570f59a210 msgr2=0x55570f63ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 shutdown_connections 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 1 -- 172.21.15.5:0/3682418548 wait complete. 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.783+0000 7fbafa422b80 20 client.15678 trim_cache size 0 max 16384 2023-10-08T13:05:52.794 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f92d23c2-65d9-11ee-8db5-212e2dc638e7", 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24667, 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 101.670008685, 2023-10-08T13:05:52.795 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 27, 2023-10-08T13:05:52.796 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 91, 2023-10-08T13:05:52.796 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:05:52.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 113.937380778 2023-10-08T13:05:52.796 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:05:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbad40a14d0 msgr2=0x7fbad40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbad40a14d0 0x7fbad40a3990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005950 tx=0x7fbad800b410 comp rx=0 tx=0).stop 2023-10-08T13:05:52.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 msgr2=0x7fbae81a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 0x7fbae81a2a60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbae00094f0 tx=0x7fbae0009520 comp rx=0 tx=0).stop 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 shutdown_connections 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbad40a14d0 0x7fbad40a3990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbae8105600 0x7fbae81a2a60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbae80ff540 0x7fbae81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 --2- 172.21.15.5:0/414310951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae80fff00 0x7fbae8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 >> 172.21.15.5:0/414310951 conn(0x7fbae80fb010 msgr2=0x7fbae80fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 shutdown_connections 2023-10-08T13:05:52.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:52.784+0000 7fbaee239700 1 -- 172.21.15.5:0/414310951 wait complete. 2023-10-08T13:05:52.799 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T13:05:52.812 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T13:05:52.813 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-08T13:05:52.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:52.813 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-08T13:05:52.831 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-08T13:05:52.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:52.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:05:52.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:52.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-08T13:05:53.004 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2023-10-08T13:05:53.004 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T13:05:53.004 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-10-08T13:05:53.004 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-10-08T13:05:53.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T13:05:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:05:54.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:54 smithi005 ceph-mon[99496]: pgmap v297: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 10 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:54.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:54 smithi118 ceph-mon[104234]: pgmap v297: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 10 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:54.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:54 smithi060 ceph-mon[103190]: pgmap v297: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 10 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2023-10-08T13:05:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4123071104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c1056c0 msgr2=0x7f7b6c105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4123071104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c1056c0 0x7f7b6c105aa0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009990 tx=0x7f7b68009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4123071104 shutdown_connections 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4123071104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b6c100810 0x7f7b6c10c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4123071104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c1056c0 0x7f7b6c105aa0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4123071104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4123071104 >> 172.21.15.5:0/4123071104 conn(0x7f7b6c075cf0 msgr2=0x7f7b6c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4123071104 shutdown_connections 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.851+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4123071104 wait complete. 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 Processor -- start 2023-10-08T13:05:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 -- start start 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b6c100810 0x7f7b6c195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b6c1056c0 0x7f7b6c196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1a4f30 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1a50a0 con 0x7f7b6c1056c0 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.852+0000 7f7b73a3c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1a5260 con 0x7f7b6c100810 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34356/0 (socket says 172.21.15.5:34356) 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 -- 172.21.15.5:0/4039988395 learned_addr learned my addr 172.21.15.5:0/4039988395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b71fd9700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b6c1056c0 0x7f7b6c196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b70fd7700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b6c100810 0x7f7b6c195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 -- 172.21.15.5:0/4039988395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b6c100810 msgr2=0x7f7b6c195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b6c100810 0x7f7b6c195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 -- 172.21.15.5:0/4039988395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b6c1056c0 msgr2=0x7f7b6c196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b6c1056c0 0x7f7b6c196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 -- 172.21.15.5:0/4039988395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680095f0 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b717d8700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1957e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009fd0 tx=0x7f7b6800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6801d070 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c1a54e0 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b68005510 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68004a90 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.853+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c1a59d0 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.854+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c107cc0 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.856+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f7b68004c30 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.856+0000 7f7b5e7fc700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7b580a14d0 0x7f7b580a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.856+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7b680ce340 con 0x7f7b6c0ffe50 2023-10-08T13:05:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.856+0000 7f7b70fd7700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7b580a14d0 0x7f7b580a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.857+0000 7f7b70fd7700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7b580a14d0 0x7f7b580a3990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b60005950 tx=0x7f7b600058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:54.860+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7b680976f0 con 0x7f7b6c0ffe50 2023-10-08T13:05:55.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.108+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b6c100e60 con 0x7f7b6c0ffe50 2023-10-08T13:05:55.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.108+0000 7f7b5e7fc700 1 -- 172.21.15.5:0/4039988395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7b68026070 con 0x7f7b6c0ffe50 2023-10-08T13:05:55.109 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-08T13:05:55.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7b580a14d0 msgr2=0x7f7b580a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7b580a14d0 0x7f7b580a3990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7b60005950 tx=0x7f7b600058e0 comp rx=0 tx=0).stop 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 msgr2=0x7f7b6c1957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1957e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009fd0 tx=0x7f7b6800f670 comp rx=0 tx=0).stop 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 shutdown_connections 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7b580a14d0 0x7f7b580a3990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b6c1056c0 0x7f7b6c196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b6c0ffe50 0x7f7b6c1957e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.110+0000 7f7b73a3c700 1 --2- 172.21.15.5:0/4039988395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b6c100810 0x7f7b6c195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.111+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 >> 172.21.15.5:0/4039988395 conn(0x7f7b6c075cf0 msgr2=0x7f7b6c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.111+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 shutdown_connections 2023-10-08T13:05:55.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:55.111+0000 7f7b73a3c700 1 -- 172.21.15.5:0/4039988395 wait complete. 2023-10-08T13:05:55.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:55 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4039988395' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:05:55.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:55 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4039988395' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:05:55.536 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T13:05:55.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T13:05:55.536 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-10-08T13:05:55.536 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T13:05:55.536 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-10-08T13:05:55.536 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T13:05:55.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T13:05:55.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T13:05:55.537 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-10-08T13:05:55.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.537 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-10-08T13:05:55.556 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T13:05:55.557 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41636sec preferred_lft 41636sec 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:05:55.558 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:05:55.558 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T13:05:55.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:05:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:55 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4039988395' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:05:55.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.680 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T13:05:55.707 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-10-08T13:05:55.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.709 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-10-08T13:05:55.768 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-10-08T13:05:55.769 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T13:05:55.769 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T13:05:55.769 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T13:05:55.769 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T13:05:55.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.769 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:05:55.769 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:05:55.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T13:05:55.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T13:05:55.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T13:05:55.770 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:05:55.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.879 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-08T13:05:55.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.897 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-10-08T13:05:55.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:55.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:05:55.954 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:05:55.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--tmp-cephfs 2023-10-08T13:05:55.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-10-08T13:05:55.955 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:05:56.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-10-08T13:05:56.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.051 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:05:56.051 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:05:56.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-10-08T13:05:56.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T13:05:56.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-10-08T13:05:56.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-10-08T13:05:56.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-10-08T13:05:56.052 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:05:56.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.241 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-10-08T13:05:56.241 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-10-08T13:05:56.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-10-08T13:05:56.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T13:05:56.241 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-10-08T13:05:56.365 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:56 smithi005 ceph-mon[99496]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 1 B/s, 0 objects/s recovering 2023-10-08T13:05:56.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:05:56.367 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /tmp/cephfs 2023-10-08T13:05:56.395 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/tmp/cephfs' 2023-10-08T13:05:56.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:05:56.396 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /tmp/cephfs 2023-10-08T13:05:56.453 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-08T13:05:56.453 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-08T13:05:56.453 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/_nogroup/sv_1/f1ebe893-7572-4cde-a2d6-a4b7940d5d5a 2023-10-08T13:05:56.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/_nogroup/sv_1/f1ebe893-7572-4cde-a2d6-a4b7940d5d5a /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2023-10-08T13:05:56.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:56 smithi118 ceph-mon[104234]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 1 B/s, 0 objects/s recovering 2023-10-08T13:05:56.539 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-10-08T13:05:56.540 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-10-08T13:05:56.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:56 smithi060 ceph-mon[103190]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 1 B/s, 0 objects/s recovering 2023-10-08T13:05:56.725 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-10-08T13:05:56.725 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.60:3300,172.21.15.118:3300" 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@f92d23c2-65d9-11ee-8db5-212e2dc638e7.cephfs=/volumes/_nogroup/sv_1/f1ebe893-7572-4cde-a2d6-a4b7940d5d5a 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.5:3300/172.21.15.60:3300/172.21.15.118:3300" will pass to kernel 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:3300,172.21.15.60:3300,172.21.15.118:3300:/volumes/_nogroup/sv_1/f1ebe893-7572-4cde-a2d6-a4b7940d5d5a 2023-10-08T13:05:56.726 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mds_namespace=cephfs,fsid=f92d23c2-65d9-11ee-8db5-212e2dc638e7" will pass to kernel 2023-10-08T13:05:56.734 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T13:05:56.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /tmp/cephfs 2023-10-08T13:05:56.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.788 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T13:05:56.822 INFO:teuthology.orchestra.run.smithi005.stdout:client15687 2023-10-08T13:05:56.823 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:05:56.823 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:05:56.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.881 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T13:05:56.954 INFO:teuthology.orchestra.run.smithi005.stdout:client15687 2023-10-08T13:05:56.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:56.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T13:05:57.028 INFO:teuthology.orchestra.run.smithi005.stdout:client15687 2023-10-08T13:05:57.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:05:57.029 DEBUG:teuthology.orchestra.run.smithi005:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7.client15687/status') 2023-10-08T13:05:57.111 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.15687 (3)192.168.0.1:0/762542868 2023-10-08T13:05:57.111 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-10-08T13:05:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-10-08T13:05:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-10-08T13:05:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.6457e-05 s, 2.6 MB/s 2023-10-08T13:05:57.113 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-08T13:05:57.123 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-08T13:05:57.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.297+0000 7f29c64b2700 1 -- 172.21.15.5:0/729054162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 msgr2=0x7f29c010c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.297+0000 7f29c64b2700 1 --2- 172.21.15.5:0/729054162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c010c3e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b0d0 tx=0x7f29b800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.297+0000 7f29c64b2700 1 -- 172.21.15.5:0/729054162 shutdown_connections 2023-10-08T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 --2- 172.21.15.5:0/729054162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c010c3e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 --2- 172.21.15.5:0/729054162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29c0105620 0x7f29c0105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 --2- 172.21.15.5:0/729054162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 0x7f29c00ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 -- 172.21.15.5:0/729054162 >> 172.21.15.5:0/729054162 conn(0x7f29c00fb010 msgr2=0x7f29c00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:57.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 -- 172.21.15.5:0/729054162 shutdown_connections 2023-10-08T13:05:57.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 -- 172.21.15.5:0/729054162 wait complete. 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.298+0000 7f29c64b2700 1 Processor -- start 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 -- start start 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 0x7f29c019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29c0105620 0x7f29c0196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0196fb0 con 0x7f29c00fff20 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0197120 con 0x7f29c0105620 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c64b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c01972e0 con 0x7f29c00ff560 2023-10-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34378/0 (socket says 172.21.15.5:34378) 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 -- 172.21.15.5:0/424371423 learned_addr learned my addr 172.21.15.5:0/424371423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29c4a4f700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29c0105620 0x7f29c0196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29bffff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 0x7f29c019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 -- 172.21.15.5:0/424371423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 msgr2=0x7f29c019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 0x7f29c019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 -- 172.21.15.5:0/424371423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29c0105620 msgr2=0x7f29c0196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29c0105620 0x7f29c0196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 -- 172.21.15.5:0/424371423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8009d00 con 0x7f29c00fff20 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29bffff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 0x7f29c019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.299+0000 7f29b7fff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c019cd60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f29a800d950 tx=0x7f29a800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.300+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a8009b40 con 0x7f29c00fff20 2023-10-08T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.300+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c01975c0 con 0x7f29c00fff20 2023-10-08T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.300+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29a8009ca0 con 0x7f29c00fff20 2023-10-08T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.300+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800f620 con 0x7f29c00fff20 2023-10-08T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.300+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c01a3810 con 0x7f29c00fff20 2023-10-08T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.300+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0100c80 con 0x7f29c00fff20 2023-10-08T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.302+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f29a8010460 con 0x7f29c00fff20 2023-10-08T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.302+0000 7f29bdffb700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f29ac0a14d0 0x7f29ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.302+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f29a80cd5b0 con 0x7f29c00fff20 2023-10-08T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.302+0000 7f29bffff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f29ac0a14d0 0x7f29ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.303+0000 7f29bffff700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f29ac0a14d0 0x7f29ac0a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29b0005fd0 tx=0x7f29b0005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:57.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.306+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f29a80967b0 con 0x7f29c00fff20 2023-10-08T13:05:57.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.511+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c010f480 con 0x7f29c00fff20 2023-10-08T13:05:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.512+0000 7f29bdffb700 1 -- 172.21.15.5:0/424371423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7f29a8016090 con 0x7f29c00fff20 2023-10-08T13:05:57.513 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:57.513 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f29ac0a14d0 msgr2=0x7f29ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f29ac0a14d0 0x7f29ac0a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29b0005fd0 tx=0x7f29b0005ee0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 msgr2=0x7f29c019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c019cd60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f29a800d950 tx=0x7f29a800dd10 comp rx=0 tx=0).stop 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 shutdown_connections 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f29ac0a14d0 0x7f29ac0a3990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29c0105620 0x7f29c0196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29c00ff560 0x7f29c019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 --2- 172.21.15.5:0/424371423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00fff20 0x7f29c019cd60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 >> 172.21.15.5:0/424371423 conn(0x7f29c00fb010 msgr2=0x7f29c01036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 shutdown_connections 2023-10-08T13:05:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.514+0000 7f29c64b2700 1 -- 172.21.15.5:0/424371423 wait complete. 2023-10-08T13:05:57.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:05:57.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:05:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 -- 172.21.15.5:0/1675234891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 msgr2=0x7fbe8c0ff030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 --2- 172.21.15.5:0/1675234891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ff030 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009990 tx=0x7fbe7c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 -- 172.21.15.5:0/1675234891 shutdown_connections 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 --2- 172.21.15.5:0/1675234891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 0x7fbe8c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 --2- 172.21.15.5:0/1675234891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe8c1066d0 0x7fbe8c106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 --2- 172.21.15.5:0/1675234891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ff030 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.658+0000 7fbe946b6700 1 -- 172.21.15.5:0/1675234891 >> 172.21.15.5:0/1675234891 conn(0x7fbe8c075ae0 msgr2=0x7fbe8c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 -- 172.21.15.5:0/1675234891 shutdown_connections 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 -- 172.21.15.5:0/1675234891 wait complete. 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 Processor -- start 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 -- start start 2023-10-08T13:05:57.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 0x7fbe8c1002d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe8c1066d0 0x7fbe8c100810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1a4e80 con 0x7fbe8c0febb0 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1a4ff0 con 0x7fbe8c0ff570 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe946b6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1a51b0 con 0x7fbe8c1066d0 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe92452700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe92452700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ffd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34388/0 (socket says 172.21.15.5:34388) 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.659+0000 7fbe92452700 1 -- 172.21.15.5:0/2266037052 learned_addr learned my addr 172.21.15.5:0/2266037052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92c53700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe8c1066d0 0x7fbe8c100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe91c51700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 0x7fbe8c1002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92452700 1 -- 172.21.15.5:0/2266037052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe8c1066d0 msgr2=0x7fbe8c100810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92452700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe8c1066d0 0x7fbe8c100810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92452700 1 -- 172.21.15.5:0/2266037052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 msgr2=0x7fbe8c1002d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92452700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 0x7fbe8c1002d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92452700 1 -- 172.21.15.5:0/2266037052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0095f0 con 0x7fbe8c0febb0 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe91c51700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 0x7fbe8c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe92452700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ffd90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800d980 tx=0x7fbe8800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800bb60 con 0x7fbe8c0febb0 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c1a5490 con 0x7fbe8c0febb0 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe88007640 con 0x7fbe8c0febb0 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88004e30 con 0x7fbe8c0febb0 2023-10-08T13:05:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.660+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c1a59a0 con 0x7fbe8c0febb0 2023-10-08T13:05:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.661+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c108ce0 con 0x7fbe8c0febb0 2023-10-08T13:05:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.662+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fbe8800bcc0 con 0x7fbe8c0febb0 2023-10-08T13:05:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.663+0000 7fbe837fe700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbe780a14d0 0x7fbe780a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.663+0000 7fbe91c51700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbe780a14d0 0x7fbe780a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.663+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbe880cd520 con 0x7fbe8c0febb0 2023-10-08T13:05:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.663+0000 7fbe91c51700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbe780a14d0 0x7fbe780a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00b5c0 tx=0x7fbe7c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.666+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbe880966c0 con 0x7fbe8c0febb0 2023-10-08T13:05:57.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.870+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe8c101270 con 0x7fbe8c0febb0 2023-10-08T13:05:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.871+0000 7fbe837fe700 1 -- 172.21.15.5:0/2266037052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe880160a0 con 0x7fbe8c0febb0 2023-10-08T13:05:57.871 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbe780a14d0 msgr2=0x7fbe780a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbe780a14d0 0x7fbe780a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00b5c0 tx=0x7fbe7c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 msgr2=0x7fbe8c0ffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ffd90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800d980 tx=0x7fbe8800dd40 comp rx=0 tx=0).stop 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 shutdown_connections 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbe780a14d0 0x7fbe780a3990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe8c1066d0 0x7fbe8c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe8c0febb0 0x7fbe8c0ffd90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 --2- 172.21.15.5:0/2266037052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8c0ff570 0x7fbe8c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 >> 172.21.15.5:0/2266037052 conn(0x7fbe8c075ae0 msgr2=0x7fbe8c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 shutdown_connections 2023-10-08T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:57.873+0000 7fbe946b6700 1 -- 172.21.15.5:0/2266037052 wait complete. 2023-10-08T13:05:57.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:05:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 -- 172.21.15.5:0/552129322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a301018a0 msgr2=0x7f6a30101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 --2- 172.21.15.5:0/552129322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a301018a0 0x7f6a30101c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009990 tx=0x7f6a20009ca0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 -- 172.21.15.5:0/552129322 shutdown_connections 2023-10-08T13:05:58.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 --2- 172.21.15.5:0/552129322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a3010ac70 0x7f6a3010d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 --2- 172.21.15.5:0/552129322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a301018a0 0x7f6a30101c80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 --2- 172.21.15.5:0/552129322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a301021c0 0x7f6a3010a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 -- 172.21.15.5:0/552129322 >> 172.21.15.5:0/552129322 conn(0x7f6a300fafc0 msgr2=0x7f6a300fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 -- 172.21.15.5:0/552129322 shutdown_connections 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.015+0000 7f6a378fb700 1 -- 172.21.15.5:0/552129322 wait complete. 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 Processor -- start 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 -- start start 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a301018a0 0x7f6a300ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a301021c0 0x7f6a300ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 0x7f6a300fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a301a4f10 con 0x7f6a3010ac70 2023-10-08T13:05:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a301a5080 con 0x7f6a301021c0 2023-10-08T13:05:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a378fb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a301a5240 con 0x7f6a301018a0 2023-10-08T13:05:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a35e98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 0x7f6a300fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a35e98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 0x7f6a300fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34406/0 (socket says 172.21.15.5:34406) 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a35e98700 1 -- 172.21.15.5:0/1427348072 learned_addr learned my addr 172.21.15.5:0/1427348072 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a34e96700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a301021c0 0x7f6a300ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.016+0000 7f6a35697700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a301018a0 0x7f6a300ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a35e98700 1 -- 172.21.15.5:0/1427348072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a301018a0 msgr2=0x7f6a300ff4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a35e98700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a301018a0 0x7f6a300ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a35e98700 1 -- 172.21.15.5:0/1427348072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a301021c0 msgr2=0x7f6a300ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a35e98700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a301021c0 0x7f6a300ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a35e98700 1 -- 172.21.15.5:0/1427348072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200095f0 con 0x7f6a3010ac70 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a34e96700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a301021c0 0x7f6a300ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a35e98700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 0x7f6a300fff90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6a28007ee0 tx=0x7f6a2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:58.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28017070 con 0x7f6a3010ac70 2023-10-08T13:05:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a2800f040 con 0x7f6a3010ac70 2023-10-08T13:05:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a301a5520 con 0x7f6a3010ac70 2023-10-08T13:05:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28005740 con 0x7f6a3010ac70 2023-10-08T13:05:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.017+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a301a59e0 con 0x7f6a3010ac70 2023-10-08T13:05:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.018+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a30105df0 con 0x7f6a3010ac70 2023-10-08T13:05:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.019+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6a2800dc60 con 0x7f6a3010ac70 2023-10-08T13:05:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.020+0000 7f6a267fc700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6a1c0a14d0 0x7f6a1c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.020+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6a280cc960 con 0x7f6a3010ac70 2023-10-08T13:05:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.020+0000 7f6a35697700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6a1c0a14d0 0x7f6a1c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.020+0000 7f6a35697700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6a1c0a14d0 0x7f6a1c0a3990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a20003730 tx=0x7f6a200036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:58.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.024+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a28095b60 con 0x7f6a3010ac70 2023-10-08T13:05:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.231+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a301009d0 con 0x7f6a3010ac70 2023-10-08T13:05:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.231+0000 7f6a267fc700 1 -- 172.21.15.5:0/1427348072 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a28099180 con 0x7f6a3010ac70 2023-10-08T13:05:58.232 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6a1c0a14d0 msgr2=0x7f6a1c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6a1c0a14d0 0x7f6a1c0a3990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a20003730 tx=0x7f6a200036c0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 msgr2=0x7f6a300fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 0x7f6a300fff90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6a28007ee0 tx=0x7f6a2800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 shutdown_connections 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6a1c0a14d0 0x7f6a1c0a3990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a3010ac70 0x7f6a300fff90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a301018a0 0x7f6a300ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 --2- 172.21.15.5:0/1427348072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a301021c0 0x7f6a300ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 >> 172.21.15.5:0/1427348072 conn(0x7f6a300fafc0 msgr2=0x7f6a300fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 shutdown_connections 2023-10-08T13:05:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.234+0000 7f6a378fb700 1 -- 172.21.15.5:0/1427348072 wait complete. 2023-10-08T13:05:58.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:05:58.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 -- 172.21.15.5:0/3158861712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b841055f0 msgr2=0x7f0b841059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/3158861712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b841055f0 0x7f0b841059d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0b740099c0 tx=0x7f0b74009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 -- 172.21.15.5:0/3158861712 shutdown_connections 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/3158861712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b840ffef0 0x7f0b8410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/3158861712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b841055f0 0x7f0b841059d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/3158861712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 0x7f0b840ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 -- 172.21.15.5:0/3158861712 >> 172.21.15.5:0/3158861712 conn(0x7f0b840fafc0 msgr2=0x7f0b840fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 -- 172.21.15.5:0/3158861712 shutdown_connections 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.377+0000 7f0b89f7c700 1 -- 172.21.15.5:0/3158861712 wait complete. 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 Processor -- start 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 -- start start 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 0x7f0b841999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 0x7f0b84199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b841055f0 0x7f0b841a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8419a7f0 con 0x7f0b840ffef0 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841a4f60 con 0x7f0b841055f0 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b89f7c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841a50d0 con 0x7f0b840ff530 2023-10-08T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 0x7f0b84199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 0x7f0b84199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34418/0 (socket says 172.21.15.5:34418) 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 -- 172.21.15.5:0/1284303437 learned_addr learned my addr 172.21.15.5:0/1284303437 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b837fe700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 0x7f0b841999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b83fff700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b841055f0 0x7f0b841a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 -- 172.21.15.5:0/1284303437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 msgr2=0x7f0b841999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 0x7f0b841999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 -- 172.21.15.5:0/1284303437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b841055f0 msgr2=0x7f0b841a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b841055f0 0x7f0b841a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b82ffd700 1 -- 172.21.15.5:0/1284303437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740095f0 con 0x7f0b840ffef0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.378+0000 7f0b837fe700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 0x7f0b841999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.379+0000 7f0b82ffd700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 0x7f0b84199ee0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00c9b0 tx=0x7f0b6c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.379+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c007b00 con 0x7f0b840ffef0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.379+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b6c007c60 con 0x7f0b840ffef0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.379+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b841a53b0 con 0x7f0b840ffef0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.379+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c018660 con 0x7f0b840ffef0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.379+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b841a58c0 con 0x7f0b840ffef0 2023-10-08T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.380+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b84104880 con 0x7f0b840ffef0 2023-10-08T13:05:58.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.381+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f0b6c018880 con 0x7f0b840ffef0 2023-10-08T13:05:58.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.381+0000 7f0b80ff9700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0b700a14d0 0x7f0b700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.382+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0b6c0cd560 con 0x7f0b840ffef0 2023-10-08T13:05:58.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.382+0000 7f0b837fe700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0b700a14d0 0x7f0b700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.382+0000 7f0b837fe700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0b700a14d0 0x7f0b700a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b74005b40 tx=0x7f0b74005ab0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:58.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.385+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0b6c096790 con 0x7f0b840ffef0 2023-10-08T13:05:58.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:58 smithi118 ceph-mon[104234]: pgmap v299: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:58.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:58 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/424371423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:58.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:58 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2266037052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.590+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b8410be30 con 0x7f0b840ffef0 2023-10-08T13:05:58.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.590+0000 7f0b80ff9700 1 -- 172.21.15.5:0/1284303437 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b6c099db0 con 0x7f0b840ffef0 2023-10-08T13:05:58.591 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.592+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0b700a14d0 msgr2=0x7f0b700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.592+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0b700a14d0 0x7f0b700a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b74005b40 tx=0x7f0b74005ab0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.592+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 msgr2=0x7f0b84199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.592+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 0x7f0b84199ee0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00c9b0 tx=0x7f0b6c00cd70 comp rx=0 tx=0).stop 2023-10-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 shutdown_connections 2023-10-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0b700a14d0 0x7f0b700a3990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b841055f0 0x7f0b841a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b840ff530 0x7f0b841999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 --2- 172.21.15.5:0/1284303437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b840ffef0 0x7f0b84199ee0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 >> 172.21.15.5:0/1284303437 conn(0x7f0b840fafc0 msgr2=0x7f0b840fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 shutdown_connections 2023-10-08T13:05:58.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.593+0000 7f0b89f7c700 1 -- 172.21.15.5:0/1284303437 wait complete. 2023-10-08T13:05:58.604 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:58 smithi005 ceph-mon[99496]: pgmap v299: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:58.604 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:58 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/424371423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:58.604 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:58 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2266037052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:58.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:05:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:58 smithi060 ceph-mon[103190]: pgmap v299: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:05:58.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:58 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/424371423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:05:58.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:58 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2266037052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 -- 172.21.15.5:0/928302061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 msgr2=0x7f97c00ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 --2- 172.21.15.5:0/928302061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c00ff9c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0099c0 tx=0x7f97ac009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 -- 172.21.15.5:0/928302061 shutdown_connections 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 --2- 172.21.15.5:0/928302061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c00fff00 0x7f97c010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 --2- 172.21.15.5:0/928302061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c0105600 0x7f97c01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 --2- 172.21.15.5:0/928302061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c00ff9c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 -- 172.21.15.5:0/928302061 >> 172.21.15.5:0/928302061 conn(0x7f97c00fb010 msgr2=0x7f97c00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 -- 172.21.15.5:0/928302061 shutdown_connections 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.735+0000 7f97c71f2700 1 -- 172.21.15.5:0/928302061 wait complete. 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 Processor -- start 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 -- start start 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c019b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c00fff00 0x7f97c019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c0105600 0x7f97c01956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0195d00 con 0x7f97c00ff540 2023-10-08T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0195e70 con 0x7f97c00fff00 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c71f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0196030 con 0x7f97c0105600 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c019b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c019b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34430/0 (socket says 172.21.15.5:34430) 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 -- 172.21.15.5:0/1207183366 learned_addr learned my addr 172.21.15.5:0/1207183366 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c578f700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c0105600 0x7f97c01956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97bffff700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c00fff00 0x7f97c019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 -- 172.21.15.5:0/1207183366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c0105600 msgr2=0x7f97c01956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c0105600 0x7f97c01956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 -- 172.21.15.5:0/1207183366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c00fff00 msgr2=0x7f97c019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c00fff00 0x7f97c019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.736+0000 7f97c4f8e700 1 -- 172.21.15.5:0/1207183366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0095f0 con 0x7f97c00ff540 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.737+0000 7f97c4f8e700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c019b570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97b400c9b0 tx=0x7f97b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.737+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4007b00 con 0x7f97c00ff540 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.737+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97b400ce50 con 0x7f97c00ff540 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.737+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c0196310 con 0x7f97c00ff540 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.737+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4018660 con 0x7f97c00ff540 2023-10-08T13:05:58.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.737+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c01a2560 con 0x7f97c00ff540 2023-10-08T13:05:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.738+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c0107aa0 con 0x7f97c00ff540 2023-10-08T13:05:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.739+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f97b400f450 con 0x7f97c00ff540 2023-10-08T13:05:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.740+0000 7f97bdffb700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97b00a1550 0x7f97b00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.740+0000 7f97bffff700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97b00a1550 0x7f97b00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.740+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f97b40cd090 con 0x7f97c00ff540 2023-10-08T13:05:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.740+0000 7f97bffff700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97b00a1550 0x7f97b00a3a10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009990 tx=0x7f97ac003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.744+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f97b4096290 con 0x7f97c00ff540 2023-10-08T13:05:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.947+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97c0196b60 con 0x7f97c00ff540 2023-10-08T13:05:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.948+0000 7f97bdffb700 1 -- 172.21.15.5:0/1207183366 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97b4007e60 con 0x7f97c00ff540 2023-10-08T13:05:58.948 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97b00a1550 msgr2=0x7f97b00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97b00a1550 0x7f97b00a3a10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009990 tx=0x7f97ac003680 comp rx=0 tx=0).stop 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 msgr2=0x7f97c019b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c019b570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97b400c9b0 tx=0x7f97b400ccc0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 shutdown_connections 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97b00a1550 0x7f97b00a3a10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c0105600 0x7f97c01956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c00ff540 0x7f97c019b570 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 --2- 172.21.15.5:0/1207183366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97c00fff00 0x7f97c019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 >> 172.21.15.5:0/1207183366 conn(0x7f97c00fb010 msgr2=0x7f97c00fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 shutdown_connections 2023-10-08T13:05:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:58.950+0000 7f97c71f2700 1 -- 172.21.15.5:0/1207183366 wait complete. 2023-10-08T13:05:58.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:05:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 -- 172.21.15.5:0/3092852692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50101000 msgr2=0x7fdb5010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 --2- 172.21.15.5:0/3092852692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50101000 0x7fdb5010d510 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800b0a0 tx=0x7fdb4800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 -- 172.21.15.5:0/3092852692 shutdown_connections 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 --2- 172.21.15.5:0/3092852692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50101000 0x7fdb5010d510 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 --2- 172.21.15.5:0/3092852692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50106650 0x7fdb50106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 --2- 172.21.15.5:0/3092852692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb50100640 0x7fdb50100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 -- 172.21.15.5:0/3092852692 >> 172.21.15.5:0/3092852692 conn(0x7fdb500fc150 msgr2=0x7fdb500fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 -- 172.21.15.5:0/3092852692 shutdown_connections 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.088+0000 7fdb56b10700 1 -- 172.21.15.5:0/3092852692 wait complete. 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 Processor -- start 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 -- start start 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 0x7fdb5019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50101000 0x7fdb5019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb50106650 0x7fdb501967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50196e90 con 0x7fdb50100640 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50197000 con 0x7fdb50101000 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb56b10700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb501971c0 con 0x7fdb50106650 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb548ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 0x7fdb5019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb548ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 0x7fdb5019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34444/0 (socket says 172.21.15.5:34444) 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb548ac700 1 -- 172.21.15.5:0/1612224876 learned_addr learned my addr 172.21.15.5:0/1612224876 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb4ffff700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50101000 0x7fdb5019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.089+0000 7fdb550ad700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb50106650 0x7fdb501967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb548ac700 1 -- 172.21.15.5:0/1612224876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb50106650 msgr2=0x7fdb501967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb548ac700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb50106650 0x7fdb501967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb548ac700 1 -- 172.21.15.5:0/1612224876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50101000 msgr2=0x7fdb5019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb548ac700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50101000 0x7fdb5019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb548ac700 1 -- 172.21.15.5:0/1612224876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009d00 con 0x7fdb50100640 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb548ac700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 0x7fdb5019c690 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400d950 tx=0x7fdb4400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44009b40 con 0x7fdb50100640 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb44009ca0 con 0x7fdb50100640 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400f620 con 0x7fdb50100640 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb501974a0 con 0x7fdb50100640 2023-10-08T13:05:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.090+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb501a36c0 con 0x7fdb50100640 2023-10-08T13:05:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.091+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb50108bd0 con 0x7fdb50100640 2023-10-08T13:05:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.092+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fdb44010460 con 0x7fdb50100640 2023-10-08T13:05:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.093+0000 7fdb4dffb700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdb400a14d0 0x7fdb400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.093+0000 7fdb4ffff700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdb400a14d0 0x7fdb400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.093+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fdb440cd430 con 0x7fdb50100640 2023-10-08T13:05:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.093+0000 7fdb4ffff700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdb400a14d0 0x7fdb400a3990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005ea0 tx=0x7fdb3c005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.097+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdb440966d0 con 0x7fdb50100640 2023-10-08T13:05:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.309+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb50197d60 con 0x7fdb50100640 2023-10-08T13:05:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.310+0000 7fdb4dffb700 1 -- 172.21.15.5:0/1612224876 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7fdb44099cf0 con 0x7fdb50100640 2023-10-08T13:05:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:05:59.311 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.312+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdb400a14d0 msgr2=0x7fdb400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.312+0000 7fdb56b10700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdb400a14d0 0x7fdb400a3990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005ea0 tx=0x7fdb3c005e30 comp rx=0 tx=0).stop 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.312+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 msgr2=0x7fdb5019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 0x7fdb5019c690 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400d950 tx=0x7fdb4400dd10 comp rx=0 tx=0).stop 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 shutdown_connections 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdb400a14d0 0x7fdb400a3990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb50106650 0x7fdb501967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb50100640 0x7fdb5019c690 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 --2- 172.21.15.5:0/1612224876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50101000 0x7fdb5019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 >> 172.21.15.5:0/1612224876 conn(0x7fdb500fc150 msgr2=0x7fdb500fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 shutdown_connections 2023-10-08T13:05:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.313+0000 7fdb56b10700 1 -- 172.21.15.5:0/1612224876 wait complete. 2023-10-08T13:05:59.324 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:59 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1427348072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.324 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:59 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1284303437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.324 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:05:59 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1207183366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.326 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:05:59.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:05:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.455+0000 7fedc0adf700 1 -- 172.21.15.5:0/586653124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc0ffef0 msgr2=0x7fedbc10c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.455+0000 7fedc0adf700 1 --2- 172.21.15.5:0/586653124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc0ffef0 0x7fedbc10c3b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fedb400b0d0 tx=0x7fedb400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 -- 172.21.15.5:0/586653124 shutdown_connections 2023-10-08T13:05:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 --2- 172.21.15.5:0/586653124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc0ffef0 0x7fedbc10c3b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 --2- 172.21.15.5:0/586653124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc1055f0 0x7fedbc1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 --2- 172.21.15.5:0/586653124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ff530 0x7fedbc0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 -- 172.21.15.5:0/586653124 >> 172.21.15.5:0/586653124 conn(0x7fedbc0fafc0 msgr2=0x7fedbc0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 -- 172.21.15.5:0/586653124 shutdown_connections 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 -- 172.21.15.5:0/586653124 wait complete. 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 Processor -- start 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.456+0000 7fedc0adf700 1 -- start start 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0ff530 0x7fedbc19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ffef0 0x7fedbc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 0x7fedbc196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc197210 con 0x7fedbc1055f0 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc197380 con 0x7fedbc0ff530 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedbc197540 con 0x7fedbc0ffef0 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 0x7fedbc196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 0x7fedbc196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34462/0 (socket says 172.21.15.5:34462) 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 -- 172.21.15.5:0/950611454 learned_addr learned my addr 172.21.15.5:0/950611454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedba59c700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0ff530 0x7fedbc19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 -- 172.21.15.5:0/950611454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ffef0 msgr2=0x7fedbc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedb9d9b700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ffef0 0x7fedbc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ffef0 0x7fedbc19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 -- 172.21.15.5:0/950611454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0ff530 msgr2=0x7fedbc19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0ff530 0x7fedbc19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 -- 172.21.15.5:0/950611454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4009d00 con 0x7fedbc1055f0 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedb9d9b700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ffef0 0x7fedbc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedbad9d700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 0x7fedbc196a40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fedb40077f0 tx=0x7fedb40078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400e040 con 0x7fedbc1055f0 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedb4003c10 con 0x7fedbc1055f0 2023-10-08T13:05:59.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedbc1977c0 con 0x7fedbc1055f0 2023-10-08T13:05:59.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb401b710 con 0x7fedbc1055f0 2023-10-08T13:05:59.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.457+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedbc1a38d0 con 0x7fedbc1055f0 2023-10-08T13:05:59.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.458+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedbc100c50 con 0x7fedbc1055f0 2023-10-08T13:05:59.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.460+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fedb4024410 con 0x7fedbc1055f0 2023-10-08T13:05:59.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.460+0000 7fedab7fe700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7feda40a1550 0x7feda40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.460+0000 7fedba59c700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7feda40a1550 0x7feda40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.460+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fedb40ce410 con 0x7fedbc1055f0 2023-10-08T13:05:59.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.461+0000 7fedba59c700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7feda40a1550 0x7feda40a3a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedac005fd0 tx=0x7fedac00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:59.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.465+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fedb4097740 con 0x7fedbc1055f0 2023-10-08T13:05:59.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:59 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1427348072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:59 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1284303437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:05:59 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1207183366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:59 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1427348072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:59 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1284303437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:05:59 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1207183366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:05:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.667+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedbc067550 con 0x7fedbc1055f0 2023-10-08T13:05:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.667+0000 7fedab7fe700 1 -- 172.21.15.5:0/950611454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedbc067550 con 0x7fedbc1055f0 2023-10-08T13:05:59.667 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:05:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7feda40a1550 msgr2=0x7feda40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7feda40a1550 0x7feda40a3a10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedac005fd0 tx=0x7fedac00a560 comp rx=0 tx=0).stop 2023-10-08T13:05:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 msgr2=0x7fedbc196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 0x7fedbc196a40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fedb40077f0 tx=0x7fedb40078d0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 shutdown_connections 2023-10-08T13:05:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7feda40a1550 0x7feda40a3a10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedbc1055f0 0x7fedbc196a40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedbc0ff530 0x7fedbc19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 --2- 172.21.15.5:0/950611454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fedbc0ffef0 0x7fedbc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 >> 172.21.15.5:0/950611454 conn(0x7fedbc0fafc0 msgr2=0x7fedbc0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 shutdown_connections 2023-10-08T13:05:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.669+0000 7fedc0adf700 1 -- 172.21.15.5:0/950611454 wait complete. 2023-10-08T13:05:59.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 -- 172.21.15.5:0/4135802861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 msgr2=0x7fac840ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 --2- 172.21.15.5:0/4135802861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac840ff9b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0099c0 tx=0x7fac6c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 -- 172.21.15.5:0/4135802861 shutdown_connections 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 --2- 172.21.15.5:0/4135802861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac840ffef0 0x7fac8410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 --2- 172.21.15.5:0/4135802861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac841055f0 0x7fac841059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 --2- 172.21.15.5:0/4135802861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac840ff9b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 -- 172.21.15.5:0/4135802861 >> 172.21.15.5:0/4135802861 conn(0x7fac840fafc0 msgr2=0x7fac840fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 -- 172.21.15.5:0/4135802861 shutdown_connections 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.811+0000 7fac89cd7700 1 -- 172.21.15.5:0/4135802861 wait complete. 2023-10-08T13:05:59.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 Processor -- start 2023-10-08T13:05:59.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 -- start start 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac84197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac840ffef0 0x7fac84197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac841055f0 0x7fac841a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84198520 con 0x7fac840ff530 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac841a2d30 con 0x7fac841055f0 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac89cd7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac841a2e70 con 0x7fac840ffef0 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac84197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac84197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34472/0 (socket says 172.21.15.5:34472) 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac837fe700 1 -- 172.21.15.5:0/2215790739 learned_addr learned my addr 172.21.15.5:0/2215790739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.812+0000 7fac83fff700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac841055f0 0x7fac841a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac82ffd700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac840ffef0 0x7fac84197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac837fe700 1 -- 172.21.15.5:0/2215790739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac840ffef0 msgr2=0x7fac84197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac837fe700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac840ffef0 0x7fac84197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac837fe700 1 -- 172.21.15.5:0/2215790739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac841055f0 msgr2=0x7fac841a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac837fe700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac841055f0 0x7fac841a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac837fe700 1 -- 172.21.15.5:0/2215790739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0095f0 con 0x7fac840ff530 2023-10-08T13:05:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac83fff700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac841055f0 0x7fac841a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac837fe700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac84197770 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fac7400c9b0 tx=0x7fac7400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74007b00 con 0x7fac840ff530 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac74007c60 con 0x7fac840ff530 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac841a3100 con 0x7fac840ff530 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74018660 con 0x7fac840ff530 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.813+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac841a3610 con 0x7fac840ff530 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.814+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac84107a90 con 0x7fac840ff530 2023-10-08T13:05:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.815+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fac74018880 con 0x7fac840ff530 2023-10-08T13:05:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.816+0000 7fac80ff9700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fac700a14d0 0x7fac700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:05:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.816+0000 7fac82ffd700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fac700a14d0 0x7fac700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:05:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.816+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fac740cd560 con 0x7fac840ff530 2023-10-08T13:05:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.816+0000 7fac82ffd700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fac700a14d0 0x7fac700a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fac6c006010 tx=0x7fac6c009f10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:05:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:05:59.819+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fac74096790 con 0x7fac840ff530 2023-10-08T13:06:00.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.020+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac84068000 con 0x7fac840ff530 2023-10-08T13:06:00.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.021+0000 7fac80ff9700 1 -- 172.21.15.5:0/2215790739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac74099db0 con 0x7fac840ff530 2023-10-08T13:06:00.021 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:06:00.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fac700a14d0 msgr2=0x7fac700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fac700a14d0 0x7fac700a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fac6c006010 tx=0x7fac6c009f10 comp rx=0 tx=0).stop 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 msgr2=0x7fac84197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac84197770 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fac7400c9b0 tx=0x7fac7400cd70 comp rx=0 tx=0).stop 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 shutdown_connections 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fac700a14d0 0x7fac700a3990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac841055f0 0x7fac841a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac840ff530 0x7fac84197770 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 --2- 172.21.15.5:0/2215790739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac840ffef0 0x7fac84197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 >> 172.21.15.5:0/2215790739 conn(0x7fac840fafc0 msgr2=0x7fac840fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:00.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 shutdown_connections 2023-10-08T13:06:00.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.023+0000 7fac89cd7700 1 -- 172.21.15.5:0/2215790739 wait complete. 2023-10-08T13:06:00.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:06:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 -- 172.21.15.5:0/1010346252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44640ff530 msgr2=0x7f44640ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 --2- 172.21.15.5:0/1010346252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44640ff530 0x7f44640ff9b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44500099c0 tx=0x7f4450009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 -- 172.21.15.5:0/1010346252 shutdown_connections 2023-10-08T13:06:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 --2- 172.21.15.5:0/1010346252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44640ffef0 0x7f446410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 --2- 172.21.15.5:0/1010346252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44641055f0 0x7f44641059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 --2- 172.21.15.5:0/1010346252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44640ff530 0x7f44640ff9b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 -- 172.21.15.5:0/1010346252 >> 172.21.15.5:0/1010346252 conn(0x7f44640fafc0 msgr2=0x7f44640fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 -- 172.21.15.5:0/1010346252 shutdown_connections 2023-10-08T13:06:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.166+0000 7f446af7f700 1 -- 172.21.15.5:0/1010346252 wait complete. 2023-10-08T13:06:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 Processor -- start 2023-10-08T13:06:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 -- start start 2023-10-08T13:06:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44640ff530 0x7f4464197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44640ffef0 0x7f4464197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 0x7f44641a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464198620 con 0x7f44641055f0 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44641a2e50 con 0x7f44640ffef0 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446af7f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44641a2f90 con 0x7f44640ff530 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 0x7f44641a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 0x7f44641a2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34490/0 (socket says 172.21.15.5:34490) 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 -- 172.21.15.5:0/2093822573 learned_addr learned my addr 172.21.15.5:0/2093822573 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f4468d1b700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44640ff530 0x7f4464197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f4463fff700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44640ffef0 0x7f4464197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 -- 172.21.15.5:0/2093822573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44640ff530 msgr2=0x7f4464197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44640ff530 0x7f4464197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 -- 172.21.15.5:0/2093822573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44640ffef0 msgr2=0x7f4464197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44640ffef0 0x7f4464197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.167+0000 7f446951c700 1 -- 172.21.15.5:0/2093822573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500095f0 con 0x7f44641055f0 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.168+0000 7f446951c700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 0x7f44641a2910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f445c007f10 tx=0x7f445c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.168+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c017070 con 0x7f44641055f0 2023-10-08T13:06:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.168+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f445c00f040 con 0x7f44641055f0 2023-10-08T13:06:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.168+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44641a31f0 con 0x7f44641055f0 2023-10-08T13:06:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.168+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c005610 con 0x7f44641055f0 2023-10-08T13:06:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.168+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44641a3680 con 0x7f44641055f0 2023-10-08T13:06:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.169+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4464107a90 con 0x7f44641055f0 2023-10-08T13:06:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.170+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f445c004ad0 con 0x7f44641055f0 2023-10-08T13:06:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.171+0000 7f4461ffb700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44540a14d0 0x7f44540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.171+0000 7f4468d1b700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44540a14d0 0x7f44540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.171+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f445c0cc910 con 0x7f44641055f0 2023-10-08T13:06:00.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.171+0000 7f4468d1b700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44540a14d0 0x7f44540a3990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4458005950 tx=0x7f445800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:00.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.175+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f445c095b10 con 0x7f44641055f0 2023-10-08T13:06:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.377+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4464067fe0 con 0x7f44641055f0 2023-10-08T13:06:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.377+0000 7f4461ffb700 1 -- 172.21.15.5:0/2093822573 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f445c099130 con 0x7f44641055f0 2023-10-08T13:06:00.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44540a14d0 msgr2=0x7f44540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44540a14d0 0x7f44540a3990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4458005950 tx=0x7f445800b410 comp rx=0 tx=0).stop 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 msgr2=0x7f44641a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 0x7f44641a2910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f445c007f10 tx=0x7f445c00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 shutdown_connections 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f44540a14d0 0x7f44540a3990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44641055f0 0x7f44641a2910 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44640ff530 0x7f4464197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 --2- 172.21.15.5:0/2093822573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44640ffef0 0x7f4464197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 >> 172.21.15.5:0/2093822573 conn(0x7f44640fafc0 msgr2=0x7f44640fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.379+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 shutdown_connections 2023-10-08T13:06:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.380+0000 7f446af7f700 1 -- 172.21.15.5:0/2093822573 wait complete. 2023-10-08T13:06:00.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:00 smithi005 ceph-mon[99496]: pgmap v300: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T13:06:00.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:00 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1612224876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:00.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:00 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/950611454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:06:00.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:00 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2215790739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:06:00.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:06:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:00 smithi118 ceph-mon[104234]: pgmap v300: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T13:06:00.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:00 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1612224876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:00 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/950611454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:06:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:00 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2215790739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 -- 172.21.15.5:0/430862029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0104710 msgr2=0x7f6ec010c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 --2- 172.21.15.5:0/430862029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0104710 0x7f6ec010c290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800b0a0 tx=0x7f6eb800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 -- 172.21.15.5:0/430862029 shutdown_connections 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 --2- 172.21.15.5:0/430862029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0104710 0x7f6ec010c290 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 --2- 172.21.15.5:0/430862029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec00ff5f0 0x7f6ec00ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 --2- 172.21.15.5:0/430862029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec00fffa0 0x7f6ec0103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 -- 172.21.15.5:0/430862029 >> 172.21.15.5:0/430862029 conn(0x7f6ec00fae70 msgr2=0x7f6ec00fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:00.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 -- 172.21.15.5:0/430862029 shutdown_connections 2023-10-08T13:06:00.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.521+0000 7f6ec639e700 1 -- 172.21.15.5:0/430862029 wait complete. 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 Processor -- start 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 -- start start 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec00ff5f0 0x7f6ec00fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec0104710 0x7f6ec00fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 0x7f6ec01a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01a51d0 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01a5340 con 0x7f6ec00ff5f0 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec639e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01a5500 con 0x7f6ec0104710 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 0x7f6ec01a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 0x7f6ec01a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34504/0 (socket says 172.21.15.5:34504) 2023-10-08T13:06:00.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 -- 172.21.15.5:0/3086772854 learned_addr learned my addr 172.21.15.5:0/3086772854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec4b9b700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec0104710 0x7f6ec00fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec539c700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec00ff5f0 0x7f6ec00fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 -- 172.21.15.5:0/3086772854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec0104710 msgr2=0x7f6ec00fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec0104710 0x7f6ec00fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 -- 172.21.15.5:0/3086772854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec00ff5f0 msgr2=0x7f6ec00fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec00ff5f0 0x7f6ec00fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 -- 172.21.15.5:0/3086772854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8009d00 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec4b9b700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec0104710 0x7f6ec00fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.522+0000 7f6ec5b9d700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 0x7f6ec01a4c00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800b070 tx=0x7f6eb80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.523+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800e040 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.523+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6eb8007930 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.523+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec01a5780 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.523+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8005280 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.523+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec01a5c00 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.524+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec0108940 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.525+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6eb80053e0 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.526+0000 7f6eb67fc700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6eac0a1620 0x7f6eac0a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.526+0000 7f6ec539c700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6eac0a1620 0x7f6eac0a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.526+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6eb80ce520 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.526+0000 7f6ec539c700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6eac0a1620 0x7f6eac0a3ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc005fd0 tx=0x7f6ebc005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:00.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.529+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6eb8097830 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:00 smithi060 ceph-mon[103190]: pgmap v300: 129 pgs: 129 active+clean; 642 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-08T13:06:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:00 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1612224876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:00 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/950611454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:06:00.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:00 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2215790739' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:06:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.732+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ec00fcd30 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.732+0000 7f6eb67fc700 1 -- 172.21.15.5:0/3086772854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6eb809ae50 con 0x7f6ec00fc2d0 2023-10-08T13:06:00.733 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:06:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6eac0a1620 msgr2=0x7f6eac0a3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6eac0a1620 0x7f6eac0a3ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc005fd0 tx=0x7f6ebc005f60 comp rx=0 tx=0).stop 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 msgr2=0x7f6ec01a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 0x7f6ec01a4c00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800b070 tx=0x7f6eb80093b0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 shutdown_connections 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6eac0a1620 0x7f6eac0a3ae0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec00fc2d0 0x7f6ec01a4c00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec00ff5f0 0x7f6ec00fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 --2- 172.21.15.5:0/3086772854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec0104710 0x7f6ec00fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 >> 172.21.15.5:0/3086772854 conn(0x7f6ec00fae70 msgr2=0x7f6ec0103850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 shutdown_connections 2023-10-08T13:06:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.734+0000 7f6ec639e700 1 -- 172.21.15.5:0/3086772854 wait complete. 2023-10-08T13:06:00.748 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-08T13:06:00.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:06:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 -- 172.21.15.5:0/1519643018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 msgr2=0x7fa81810a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1519643018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81810a660 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa814009990 tx=0x7fa814009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 -- 172.21.15.5:0/1519643018 shutdown_connections 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1519643018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81810ac30 0x7fa81810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1519643018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa818101860 0x7fa818101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1519643018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81810a660 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 -- 172.21.15.5:0/1519643018 >> 172.21.15.5:0/1519643018 conn(0x7fa8180fb040 msgr2=0x7fa8180fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 -- 172.21.15.5:0/1519643018 shutdown_connections 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 -- 172.21.15.5:0/1519643018 wait complete. 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.873+0000 7fa81fb54700 1 Processor -- start 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 -- start start 2023-10-08T13:06:00.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa818101860 0x7fa81819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81810ac30 0x7fa818196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa818196f60 con 0x7fa818102180 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181970d0 con 0x7fa81810ac30 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81fb54700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa818197290 con 0x7fa818101860 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34516/0 (socket says 172.21.15.5:34516) 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 -- 172.21.15.5:0/1987848600 learned_addr learned my addr 172.21.15.5:0/1987848600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d8f0700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa818101860 0x7fa81819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81e0f1700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81810ac30 0x7fa818196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 -- 172.21.15.5:0/1987848600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa818101860 msgr2=0x7fa81819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa818101860 0x7fa81819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 -- 172.21.15.5:0/1987848600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81810ac30 msgr2=0x7fa818196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81810ac30 0x7fa818196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 -- 172.21.15.5:0/1987848600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140095f0 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.874+0000 7fa81d0ef700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81819cd10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa8140095c0 tx=0x7fa81400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.875+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81401d070 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.875+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa818197510 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.875+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa814005050 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.875+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814004a70 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.875+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8181a37c0 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.875+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa818105d50 con 0x7fa818102180 2023-10-08T13:06:00.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.877+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fa8140051c0 con 0x7fa818102180 2023-10-08T13:06:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.877+0000 7fa80affd700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8040a14d0 0x7fa8040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.877+0000 7fa81d8f0700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8040a14d0 0x7fa8040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.877+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa8140ce310 con 0x7fa818102180 2023-10-08T13:06:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.878+0000 7fa81d8f0700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8040a14d0 0x7fa8040a3990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005950 tx=0x7fa80c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:00.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:00.881+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8140975a0 con 0x7fa818102180 2023-10-08T13:06:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.128+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa818197dc0 con 0x7fa818102180 2023-10-08T13:06:01.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.128+0000 7fa80affd700 1 -- 172.21.15.5:0/1987848600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7fa81409abc0 con 0x7fa818102180 2023-10-08T13:06:01.129 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:01.130 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.130+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8040a14d0 msgr2=0x7fa8040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.130+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8040a14d0 0x7fa8040a3990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005950 tx=0x7fa80c00b410 comp rx=0 tx=0).stop 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.130+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 msgr2=0x7fa81819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.130+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81819cd10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa8140095c0 tx=0x7fa81400f690 comp rx=0 tx=0).stop 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.130+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 shutdown_connections 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa8040a14d0 0x7fa8040a3990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81810ac30 0x7fa818196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa818101860 0x7fa81819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 --2- 172.21.15.5:0/1987848600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa818102180 0x7fa81819cd10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 >> 172.21.15.5:0/1987848600 conn(0x7fa8180fb040 msgr2=0x7fa8180fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:01.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 shutdown_connections 2023-10-08T13:06:01.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.131+0000 7fa81fb54700 1 -- 172.21.15.5:0/1987848600 wait complete. 2023-10-08T13:06:01.133 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:06:01.144 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-08T13:06:01.144 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-08T13:06:01.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:06:01.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 -- 172.21.15.5:0/1975667490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff560 msgr2=0x7f2d700ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 --2- 172.21.15.5:0/1975667490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff560 0x7f2d700ff9e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2d640099c0 tx=0x7f2d64009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 -- 172.21.15.5:0/1975667490 shutdown_connections 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 --2- 172.21.15.5:0/1975667490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700fff20 0x7f2d7010c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 --2- 172.21.15.5:0/1975667490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d70105620 0x7f2d70105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 --2- 172.21.15.5:0/1975667490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff560 0x7f2d700ff9e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 -- 172.21.15.5:0/1975667490 >> 172.21.15.5:0/1975667490 conn(0x7f2d700fb010 msgr2=0x7f2d700fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 -- 172.21.15.5:0/1975667490 shutdown_connections 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 -- 172.21.15.5:0/1975667490 wait complete. 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.271+0000 7f2d7584b700 1 Processor -- start 2023-10-08T13:06:01.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 -- start start 2023-10-08T13:06:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700ff560 0x7f2d701978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff20 0x7f2d70197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 0x7f2d701a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70198660 con 0x7f2d70105620 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701a2e90 con 0x7f2d700ff560 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d7584b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701a2fd0 con 0x7f2d700fff20 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 0x7f2d701a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 0x7f2d701a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34532/0 (socket says 172.21.15.5:34532) 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d6f7fe700 1 -- 172.21.15.5:0/91193614 learned_addr learned my addr 172.21.15.5:0/91193614 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d6e7fc700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff20 0x7f2d70197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.272+0000 7f2d6effd700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700ff560 0x7f2d701978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6f7fe700 1 -- 172.21.15.5:0/91193614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff20 msgr2=0x7f2d70197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6f7fe700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff20 0x7f2d70197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6f7fe700 1 -- 172.21.15.5:0/91193614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700ff560 msgr2=0x7f2d701978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6f7fe700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700ff560 0x7f2d701978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6f7fe700 1 -- 172.21.15.5:0/91193614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640095f0 con 0x7f2d70105620 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6effd700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700ff560 0x7f2d701978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d6f7fe700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 0x7f2d701a2950 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800ef60 tx=0x7f2d6800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68018070 con 0x7f2d70105620 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d6800f040 con 0x7f2d70105620 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d701a31d0 con 0x7f2d70105620 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68003e30 con 0x7f2d70105620 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.273+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a36b0 con 0x7f2d70105620 2023-10-08T13:06:01.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.274+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d70107ac0 con 0x7f2d70105620 2023-10-08T13:06:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.275+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f2d68004ad0 con 0x7f2d70105620 2023-10-08T13:06:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.276+0000 7f2d74849700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d580a14d0 0x7f2d580a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.276+0000 7f2d6effd700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d580a14d0 0x7f2d580a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.276+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2d680cd780 con 0x7f2d70105620 2023-10-08T13:06:01.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.276+0000 7f2d6effd700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d580a14d0 0x7f2d580a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2d60005950 tx=0x7f2d600058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:01.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.279+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2d680969b0 con 0x7f2d70105620 2023-10-08T13:06:01.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:01 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2093822573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:06:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:01 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3086772854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:06:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:01 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1987848600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:01.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.481+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d700692c0 con 0x7f2d580a14d0 2023-10-08T13:06:01.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.497+0000 7f2d74849700 1 -- 172.21.15.5:0/91193614 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426753 (secure 0 0 0) 0x7f2d700692c0 con 0x7f2d580a14d0 2023-10-08T13:06:01.504 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d580a14d0 msgr2=0x7f2d580a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d580a14d0 0x7f2d580a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2d60005950 tx=0x7f2d600058e0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 msgr2=0x7f2d701a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 0x7f2d701a2950 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800ef60 tx=0x7f2d6800ef90 comp rx=0 tx=0).stop 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 shutdown_connections 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d580a14d0 0x7f2d580a3990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d70105620 0x7f2d701a2950 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700ff560 0x7f2d701978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 --2- 172.21.15.5:0/91193614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff20 0x7f2d70197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 >> 172.21.15.5:0/91193614 conn(0x7f2d700fb010 msgr2=0x7f2d700fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 shutdown_connections 2023-10-08T13:06:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.501+0000 7f2d7584b700 1 -- 172.21.15.5:0/91193614 wait complete. 2023-10-08T13:06:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:06:01.514 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-10-08T13:06:01.115198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658005,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1022,"num_read_kb":631,"num_write":435,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181626,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361,"ondisk_log_size":361,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338668,"kb_used_data":14416,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603156,"statfs":{"total":1151940427776,"available":1151593631744,"internally_reserved":0,"allocated":14761984,"data_stored":8238697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":636,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":52,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900610+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:05:37.900610+0000","last_peered":"2023-10-08T13:05:37.900610+0000","last_clean":"2023-10-08T13:05:37.900610+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:05:37.900610+0000","last_undegraded":"2023-10-08T13:05:37.900610+0000","last_fullsized":"2023-10-08T13:05:37.900610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476427+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:05:38.476427+0000","last_peered":"2023-10-08T13:05:38.476427+0000","last_clean":"2023-10-08T13:05:38.476427+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:05:38.476427+0000","last_undegraded":"2023-10-08T13:05:38.476427+0000","last_fullsized":"2023-10-08T13:05:38.476427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476391+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:05:38.476391+0000","last_peered":"2023-10-08T13:05:38.476391+0000","last_clean":"2023-10-08T13:05:38.476391+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:05:38.476391+0000","last_undegraded":"2023-10-08T13:05:38.476391+0000","last_fullsized":"2023-10-08T13:05:38.476391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907637+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:05:37.907637+0000","last_peered":"2023-10-08T13:05:37.907637+0000","last_clean":"2023-10-08T13:05:37.907637+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:05:37.907637+0000","last_undegraded":"2023-10-08T13:05:37.907637+0000","last_fullsized":"2023-10-08T13:05:37.907637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900586+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:05:37.900586+0000","last_peered":"2023-10-08T13:05:37.900586+0000","last_clean":"2023-10-08T13:05:37.900586+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:05:37.900586+0000","last_undegraded":"2023-10-08T13:05:37.900586+0000","last_fullsized":"2023-10-08T13:05:37.900586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253010+0000","last_change":"2023-10-08T13:04:38.210845+0000","last_active":"2023-10-08T13:05:38.253010+0000","last_peered":"2023-10-08T13:05:38.253010+0000","last_clean":"2023-10-08T13:05:38.253010+0000","last_became_active":"2023-10-08T13:04:38.210454+0000","last_became_peered":"2023-10-08T13:04:38.210454+0000","last_unstale":"2023-10-08T13:05:38.253010+0000","last_undegraded":"2023-10-08T13:05:38.253010+0000","last_fullsized":"2023-10-08T13:05:38.253010+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:10.493230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897780+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:05:37.897780+0000","last_peered":"2023-10-08T13:05:37.897780+0000","last_clean":"2023-10-08T13:05:37.897780+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:05:37.897780+0000","last_undegraded":"2023-10-08T13:05:37.897780+0000","last_fullsized":"2023-10-08T13:05:37.897780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898702+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:05:37.898702+0000","last_peered":"2023-10-08T13:05:37.898702+0000","last_clean":"2023-10-08T13:05:37.898702+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:05:37.898702+0000","last_undegraded":"2023-10-08T13:05:37.898702+0000","last_fullsized":"2023-10-08T13:05:37.898702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903390+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:05:37.903390+0000","last_peered":"2023-10-08T13:05:37.903390+0000","last_clean":"2023-10-08T13:05:37.903390+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:05:37.903390+0000","last_undegraded":"2023-10-08T13:05:37.903390+0000","last_fullsized":"2023-10-08T13:05:37.903390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253803+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:05:38.253803+0000","last_peered":"2023-10-08T13:05:38.253803+0000","last_clean":"2023-10-08T13:05:38.253803+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:05:38.253803+0000","last_undegraded":"2023-10-08T13:05:38.253803+0000","last_fullsized":"2023-10-08T13:05:38.253803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898482+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:05:37.898482+0000","last_peered":"2023-10-08T13:05:37.898482+0000","last_clean":"2023-10-08T13:05:37.898482+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:05:37.898482+0000","last_undegraded":"2023-10-08T13:05:37.898482+0000","last_fullsized":"2023-10-08T13:05:37.898482+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908109+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:05:37.908109+0000","last_peered":"2023-10-08T13:05:37.908109+0000","last_clean":"2023-10-08T13:05:37.908109+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:05:37.908109+0000","last_undegraded":"2023-10-08T13:05:37.908109+0000","last_fullsized":"2023-10-08T13:05:37.908109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252566+0000","last_change":"2023-10-08T13:04:38.209983+0000","last_active":"2023-10-08T13:05:38.252566+0000","last_peered":"2023-10-08T13:05:38.252566+0000","last_clean":"2023-10-08T13:05:38.252566+0000","last_became_active":"2023-10-08T13:04:38.209572+0000","last_became_peered":"2023-10-08T13:04:38.209572+0000","last_unstale":"2023-10-08T13:05:38.252566+0000","last_undegraded":"2023-10-08T13:05:38.252566+0000","last_fullsized":"2023-10-08T13:05:38.252566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:01.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476539+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:05:38.476539+0000","last_peered":"2023-10-08T13:05:38.476539+0000","last_clean":"2023-10-08T13:05:38.476539+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:05:38.476539+0000","last_undegraded":"2023-10-08T13:05:38.476539+0000","last_fullsized":"2023-10-08T13:05:38.476539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476214+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:05:38.476214+0000","last_peered":"2023-10-08T13:05:38.476214+0000","last_clean":"2023-10-08T13:05:38.476214+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:05:38.476214+0000","last_undegraded":"2023-10-08T13:05:38.476214+0000","last_fullsized":"2023-10-08T13:05:38.476214+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900738+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:05:37.900738+0000","last_peered":"2023-10-08T13:05:37.900738+0000","last_clean":"2023-10-08T13:05:37.900738+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:05:37.900738+0000","last_undegraded":"2023-10-08T13:05:37.900738+0000","last_fullsized":"2023-10-08T13:05:37.900738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900396+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:05:37.900396+0000","last_peered":"2023-10-08T13:05:37.900396+0000","last_clean":"2023-10-08T13:05:37.900396+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:05:37.900396+0000","last_undegraded":"2023-10-08T13:05:37.900396+0000","last_fullsized":"2023-10-08T13:05:37.900396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897250+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:05:37.897250+0000","last_peered":"2023-10-08T13:05:37.897250+0000","last_clean":"2023-10-08T13:05:37.897250+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:05:37.897250+0000","last_undegraded":"2023-10-08T13:05:37.897250+0000","last_fullsized":"2023-10-08T13:05:37.897250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898635+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:05:37.898635+0000","last_peered":"2023-10-08T13:05:37.898635+0000","last_clean":"2023-10-08T13:05:37.898635+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:05:37.898635+0000","last_undegraded":"2023-10-08T13:05:37.898635+0000","last_fullsized":"2023-10-08T13:05:37.898635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898186+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:05:37.898186+0000","last_peered":"2023-10-08T13:05:37.898186+0000","last_clean":"2023-10-08T13:05:37.898186+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:05:37.898186+0000","last_undegraded":"2023-10-08T13:05:37.898186+0000","last_fullsized":"2023-10-08T13:05:37.898186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'14","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:55.273216+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:05:55.273216+0000","last_peered":"2023-10-08T13:05:55.273216+0000","last_clean":"2023-10-08T13:05:55.273216+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:05:55.273216+0000","last_undegraded":"2023-10-08T13:05:55.273216+0000","last_fullsized":"2023-10-08T13:05:55.273216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899378+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:05:37.899378+0000","last_peered":"2023-10-08T13:05:37.899378+0000","last_clean":"2023-10-08T13:05:37.899378+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:05:37.899378+0000","last_undegraded":"2023-10-08T13:05:37.899378+0000","last_fullsized":"2023-10-08T13:05:37.899378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907193+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:05:37.907193+0000","last_peered":"2023-10-08T13:05:37.907193+0000","last_clean":"2023-10-08T13:05:37.907193+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:05:37.907193+0000","last_undegraded":"2023-10-08T13:05:37.907193+0000","last_fullsized":"2023-10-08T13:05:37.907193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899457+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:05:37.899457+0000","last_peered":"2023-10-08T13:05:37.899457+0000","last_clean":"2023-10-08T13:05:37.899457+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:05:37.899457+0000","last_undegraded":"2023-10-08T13:05:37.899457+0000","last_fullsized":"2023-10-08T13:05:37.899457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476398+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:05:38.476398+0000","last_peered":"2023-10-08T13:05:38.476398+0000","last_clean":"2023-10-08T13:05:38.476398+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:05:38.476398+0000","last_undegraded":"2023-10-08T13:05:38.476398+0000","last_fullsized":"2023-10-08T13:05:38.476398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907687+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:05:37.907687+0000","last_peered":"2023-10-08T13:05:37.907687+0000","last_clean":"2023-10-08T13:05:37.907687+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:05:37.907687+0000","last_undegraded":"2023-10-08T13:05:37.907687+0000","last_fullsized":"2023-10-08T13:05:37.907687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900891+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:05:37.900891+0000","last_peered":"2023-10-08T13:05:37.900891+0000","last_clean":"2023-10-08T13:05:37.900891+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:05:37.900891+0000","last_undegraded":"2023-10-08T13:05:37.900891+0000","last_fullsized":"2023-10-08T13:05:37.900891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.902964+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:05:37.902964+0000","last_peered":"2023-10-08T13:05:37.902964+0000","last_clean":"2023-10-08T13:05:37.902964+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:05:37.902964+0000","last_undegraded":"2023-10-08T13:05:37.902964+0000","last_fullsized":"2023-10-08T13:05:37.902964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908056+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:05:37.908056+0000","last_peered":"2023-10-08T13:05:37.908056+0000","last_clean":"2023-10-08T13:05:37.908056+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:05:37.908056+0000","last_undegraded":"2023-10-08T13:05:37.908056+0000","last_fullsized":"2023-10-08T13:05:37.908056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899629+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:05:37.899629+0000","last_peered":"2023-10-08T13:05:37.899629+0000","last_clean":"2023-10-08T13:05:37.899629+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:05:37.899629+0000","last_undegraded":"2023-10-08T13:05:37.899629+0000","last_fullsized":"2023-10-08T13:05:37.899629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906227+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:05:37.906227+0000","last_peered":"2023-10-08T13:05:37.906227+0000","last_clean":"2023-10-08T13:05:37.906227+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:05:37.906227+0000","last_undegraded":"2023-10-08T13:05:37.906227+0000","last_fullsized":"2023-10-08T13:05:37.906227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898495+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:05:37.898495+0000","last_peered":"2023-10-08T13:05:37.898495+0000","last_clean":"2023-10-08T13:05:37.898495+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:05:37.898495+0000","last_undegraded":"2023-10-08T13:05:37.898495+0000","last_fullsized":"2023-10-08T13:05:37.898495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:58.934882+0000","last_change":"2023-10-08T13:05:38.910616+0000","last_active":"2023-10-08T13:05:58.934882+0000","last_peered":"2023-10-08T13:05:58.934882+0000","last_clean":"2023-10-08T13:05:58.934882+0000","last_became_active":"2023-10-08T13:05:38.904333+0000","last_became_peered":"2023-10-08T13:05:38.904333+0000","last_unstale":"2023-10-08T13:05:58.934882+0000","last_undegraded":"2023-10-08T13:05:58.934882+0000","last_fullsized":"2023-10-08T13:05:58.934882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.582828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900271+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:05:37.900271+0000","last_peered":"2023-10-08T13:05:37.900271+0000","last_clean":"2023-10-08T13:05:37.900271+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:05:37.900271+0000","last_undegraded":"2023-10-08T13:05:37.900271+0000","last_fullsized":"2023-10-08T13:05:37.900271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899181+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:05:37.899181+0000","last_peered":"2023-10-08T13:05:37.899181+0000","last_clean":"2023-10-08T13:05:37.899181+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:05:37.899181+0000","last_undegraded":"2023-10-08T13:05:37.899181+0000","last_fullsized":"2023-10-08T13:05:37.899181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253006+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:05:38.253006+0000","last_peered":"2023-10-08T13:05:38.253006+0000","last_clean":"2023-10-08T13:05:38.253006+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:05:38.253006+0000","last_undegraded":"2023-10-08T13:05:38.253006+0000","last_fullsized":"2023-10-08T13:05:38.253006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908802+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:05:37.908802+0000","last_peered":"2023-10-08T13:05:37.908802+0000","last_clean":"2023-10-08T13:05:37.908802+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:05:37.908802+0000","last_undegraded":"2023-10-08T13:05:37.908802+0000","last_fullsized":"2023-10-08T13:05:37.908802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900285+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:05:37.900285+0000","last_peered":"2023-10-08T13:05:37.900285+0000","last_clean":"2023-10-08T13:05:37.900285+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:05:37.900285+0000","last_undegraded":"2023-10-08T13:05:37.900285+0000","last_fullsized":"2023-10-08T13:05:37.900285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252345+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:05:38.252345+0000","last_peered":"2023-10-08T13:05:38.252345+0000","last_clean":"2023-10-08T13:05:38.252345+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:05:38.252345+0000","last_undegraded":"2023-10-08T13:05:38.252345+0000","last_fullsized":"2023-10-08T13:05:38.252345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898798+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:05:37.898798+0000","last_peered":"2023-10-08T13:05:37.898798+0000","last_clean":"2023-10-08T13:05:37.898798+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:05:37.898798+0000","last_undegraded":"2023-10-08T13:05:37.898798+0000","last_fullsized":"2023-10-08T13:05:37.898798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476427+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:05:38.476427+0000","last_peered":"2023-10-08T13:05:38.476427+0000","last_clean":"2023-10-08T13:05:38.476427+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:05:38.476427+0000","last_undegraded":"2023-10-08T13:05:38.476427+0000","last_fullsized":"2023-10-08T13:05:38.476427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907441+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:05:37.907441+0000","last_peered":"2023-10-08T13:05:37.907441+0000","last_clean":"2023-10-08T13:05:37.907441+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:05:37.907441+0000","last_undegraded":"2023-10-08T13:05:37.907441+0000","last_fullsized":"2023-10-08T13:05:37.907441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896350+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:05:37.896350+0000","last_peered":"2023-10-08T13:05:37.896350+0000","last_clean":"2023-10-08T13:05:37.896350+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:05:37.896350+0000","last_undegraded":"2023-10-08T13:05:37.896350+0000","last_fullsized":"2023-10-08T13:05:37.896350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898929+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:05:37.898929+0000","last_peered":"2023-10-08T13:05:37.898929+0000","last_clean":"2023-10-08T13:05:37.898929+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:05:37.898929+0000","last_undegraded":"2023-10-08T13:05:37.898929+0000","last_fullsized":"2023-10-08T13:05:37.898929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.931304+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:05:56.931304+0000","last_peered":"2023-10-08T13:05:56.931304+0000","last_clean":"2023-10-08T13:05:56.931304+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:05:56.931304+0000","last_undegraded":"2023-10-08T13:05:56.931304+0000","last_fullsized":"2023-10-08T13:05:56.931304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":167,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903624+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:05:37.903624+0000","last_peered":"2023-10-08T13:05:37.903624+0000","last_clean":"2023-10-08T13:05:37.903624+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:05:37.903624+0000","last_undegraded":"2023-10-08T13:05:37.903624+0000","last_fullsized":"2023-10-08T13:05:37.903624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896284+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:05:37.896284+0000","last_peered":"2023-10-08T13:05:37.896284+0000","last_clean":"2023-10-08T13:05:37.896284+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:05:37.896284+0000","last_undegraded":"2023-10-08T13:05:37.896284+0000","last_fullsized":"2023-10-08T13:05:37.896284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.915250+0000","last_change":"2023-10-08T13:05:38.915250+0000","last_active":"2023-10-08T13:05:38.915250+0000","last_peered":"2023-10-08T13:05:38.915250+0000","last_clean":"2023-10-08T13:05:38.915250+0000","last_became_active":"2023-10-08T13:05:38.906992+0000","last_became_peered":"2023-10-08T13:05:38.906992+0000","last_unstale":"2023-10-08T13:05:38.915250+0000","last_undegraded":"2023-10-08T13:05:38.915250+0000","last_fullsized":"2023-10-08T13:05:38.915250+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:54:53.798551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476385+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:05:38.476385+0000","last_peered":"2023-10-08T13:05:38.476385+0000","last_clean":"2023-10-08T13:05:38.476385+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:05:38.476385+0000","last_undegraded":"2023-10-08T13:05:38.476385+0000","last_fullsized":"2023-10-08T13:05:38.476385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908045+0000","last_change":"2023-10-08T13:04:38.220707+0000","last_active":"2023-10-08T13:05:37.908045+0000","last_peered":"2023-10-08T13:05:37.908045+0000","last_clean":"2023-10-08T13:05:37.908045+0000","last_became_active":"2023-10-08T13:04:38.215253+0000","last_became_peered":"2023-10-08T13:04:38.215253+0000","last_unstale":"2023-10-08T13:05:37.908045+0000","last_undegraded":"2023-10-08T13:05:37.908045+0000","last_fullsized":"2023-10-08T13:05:37.908045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:15.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906126+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:05:37.906126+0000","last_peered":"2023-10-08T13:05:37.906126+0000","last_clean":"2023-10-08T13:05:37.906126+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:05:37.906126+0000","last_undegraded":"2023-10-08T13:05:37.906126+0000","last_fullsized":"2023-10-08T13:05:37.906126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903154+0000","last_change":"2023-10-08T13:04:38.214872+0000","last_active":"2023-10-08T13:05:37.903154+0000","last_peered":"2023-10-08T13:05:37.903154+0000","last_clean":"2023-10-08T13:05:37.903154+0000","last_became_active":"2023-10-08T13:04:38.214480+0000","last_became_peered":"2023-10-08T13:04:38.214480+0000","last_unstale":"2023-10-08T13:05:37.903154+0000","last_undegraded":"2023-10-08T13:05:37.903154+0000","last_fullsized":"2023-10-08T13:05:37.903154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:05.108568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896367+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:05:37.896367+0000","last_peered":"2023-10-08T13:05:37.896367+0000","last_clean":"2023-10-08T13:05:37.896367+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:05:37.896367+0000","last_undegraded":"2023-10-08T13:05:37.896367+0000","last_fullsized":"2023-10-08T13:05:37.896367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":234,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.932082+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:05:56.932082+0000","last_peered":"2023-10-08T13:05:56.932082+0000","last_clean":"2023-10-08T13:05:56.932082+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:05:56.932082+0000","last_undegraded":"2023-10-08T13:05:56.932082+0000","last_fullsized":"2023-10-08T13:05:56.932082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":145,"num_write":40,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901149+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:05:37.901149+0000","last_peered":"2023-10-08T13:05:37.901149+0000","last_clean":"2023-10-08T13:05:37.901149+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:05:37.901149+0000","last_undegraded":"2023-10-08T13:05:37.901149+0000","last_fullsized":"2023-10-08T13:05:37.901149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906509+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:05:37.906509+0000","last_peered":"2023-10-08T13:05:37.906509+0000","last_clean":"2023-10-08T13:05:37.906509+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:05:37.906509+0000","last_undegraded":"2023-10-08T13:05:37.906509+0000","last_fullsized":"2023-10-08T13:05:37.906509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899085+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:05:37.899085+0000","last_peered":"2023-10-08T13:05:37.899085+0000","last_clean":"2023-10-08T13:05:37.899085+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:05:37.899085+0000","last_undegraded":"2023-10-08T13:05:37.899085+0000","last_fullsized":"2023-10-08T13:05:37.899085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252481+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:05:38.252481+0000","last_peered":"2023-10-08T13:05:38.252481+0000","last_clean":"2023-10-08T13:05:38.252481+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:05:38.252481+0000","last_undegraded":"2023-10-08T13:05:38.252481+0000","last_fullsized":"2023-10-08T13:05:38.252481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899743+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:05:37.899743+0000","last_peered":"2023-10-08T13:05:37.899743+0000","last_clean":"2023-10-08T13:05:37.899743+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:05:37.899743+0000","last_undegraded":"2023-10-08T13:05:37.899743+0000","last_fullsized":"2023-10-08T13:05:37.899743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907936+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:05:37.907936+0000","last_peered":"2023-10-08T13:05:37.907936+0000","last_clean":"2023-10-08T13:05:37.907936+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:05:37.907936+0000","last_undegraded":"2023-10-08T13:05:37.907936+0000","last_fullsized":"2023-10-08T13:05:37.907936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908912+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:05:37.908912+0000","last_peered":"2023-10-08T13:05:37.908912+0000","last_clean":"2023-10-08T13:05:37.908912+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:05:37.908912+0000","last_undegraded":"2023-10-08T13:05:37.908912+0000","last_fullsized":"2023-10-08T13:05:37.908912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896715+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:05:37.896715+0000","last_peered":"2023-10-08T13:05:37.896715+0000","last_clean":"2023-10-08T13:05:37.896715+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:05:37.896715+0000","last_undegraded":"2023-10-08T13:05:37.896715+0000","last_fullsized":"2023-10-08T13:05:37.896715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'7","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:58.278385+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:05:58.278385+0000","last_peered":"2023-10-08T13:05:58.278385+0000","last_clean":"2023-10-08T13:05:58.278385+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:05:58.278385+0000","last_undegraded":"2023-10-08T13:05:58.278385+0000","last_fullsized":"2023-10-08T13:05:58.278385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897800+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:05:37.897800+0000","last_peered":"2023-10-08T13:05:37.897800+0000","last_clean":"2023-10-08T13:05:37.897800+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:05:37.897800+0000","last_undegraded":"2023-10-08T13:05:37.897800+0000","last_fullsized":"2023-10-08T13:05:37.897800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252637+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:05:38.252637+0000","last_peered":"2023-10-08T13:05:38.252637+0000","last_clean":"2023-10-08T13:05:38.252637+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:05:38.252637+0000","last_undegraded":"2023-10-08T13:05:38.252637+0000","last_fullsized":"2023-10-08T13:05:38.252637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899678+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:05:37.899678+0000","last_peered":"2023-10-08T13:05:37.899678+0000","last_clean":"2023-10-08T13:05:37.899678+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:05:37.899678+0000","last_undegraded":"2023-10-08T13:05:37.899678+0000","last_fullsized":"2023-10-08T13:05:37.899678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896291+0000","last_change":"2023-10-08T13:04:38.213542+0000","last_active":"2023-10-08T13:05:37.896291+0000","last_peered":"2023-10-08T13:05:37.896291+0000","last_clean":"2023-10-08T13:05:37.896291+0000","last_became_active":"2023-10-08T13:04:38.213218+0000","last_became_peered":"2023-10-08T13:04:38.213218+0000","last_unstale":"2023-10-08T13:05:37.896291+0000","last_undegraded":"2023-10-08T13:05:37.896291+0000","last_fullsized":"2023-10-08T13:05:37.896291+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:51.125175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906002+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:05:37.906002+0000","last_peered":"2023-10-08T13:05:37.906002+0000","last_clean":"2023-10-08T13:05:37.906002+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:05:37.906002+0000","last_undegraded":"2023-10-08T13:05:37.906002+0000","last_fullsized":"2023-10-08T13:05:37.906002+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.912207+0000","last_change":"2023-10-08T13:05:38.912207+0000","last_active":"2023-10-08T13:05:38.912207+0000","last_peered":"2023-10-08T13:05:38.912207+0000","last_clean":"2023-10-08T13:05:38.912207+0000","last_became_active":"2023-10-08T13:05:38.907286+0000","last_became_peered":"2023-10-08T13:05:38.907286+0000","last_unstale":"2023-10-08T13:05:38.912207+0000","last_undegraded":"2023-10-08T13:05:38.912207+0000","last_fullsized":"2023-10-08T13:05:38.912207+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:18.606537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900044+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:05:37.900044+0000","last_peered":"2023-10-08T13:05:37.900044+0000","last_clean":"2023-10-08T13:05:37.900044+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:05:37.900044+0000","last_undegraded":"2023-10-08T13:05:37.900044+0000","last_fullsized":"2023-10-08T13:05:37.900044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900177+0000","last_change":"2023-10-08T13:04:38.215172+0000","last_active":"2023-10-08T13:05:37.900177+0000","last_peered":"2023-10-08T13:05:37.900177+0000","last_clean":"2023-10-08T13:05:37.900177+0000","last_became_active":"2023-10-08T13:04:38.214666+0000","last_became_peered":"2023-10-08T13:04:38.214666+0000","last_unstale":"2023-10-08T13:05:37.900177+0000","last_undegraded":"2023-10-08T13:05:37.900177+0000","last_fullsized":"2023-10-08T13:05:37.900177+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:45.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896579+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:05:37.896579+0000","last_peered":"2023-10-08T13:05:37.896579+0000","last_clean":"2023-10-08T13:05:37.896579+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:05:37.896579+0000","last_undegraded":"2023-10-08T13:05:37.896579+0000","last_fullsized":"2023-10-08T13:05:37.896579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253485+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:05:38.253485+0000","last_peered":"2023-10-08T13:05:38.253485+0000","last_clean":"2023-10-08T13:05:38.253485+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:05:38.253485+0000","last_undegraded":"2023-10-08T13:05:38.253485+0000","last_fullsized":"2023-10-08T13:05:38.253485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252686+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:05:38.252686+0000","last_peered":"2023-10-08T13:05:38.252686+0000","last_clean":"2023-10-08T13:05:38.252686+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:05:38.252686+0000","last_undegraded":"2023-10-08T13:05:38.252686+0000","last_fullsized":"2023-10-08T13:05:38.252686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'7","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:57.276797+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:05:57.276797+0000","last_peered":"2023-10-08T13:05:57.276797+0000","last_clean":"2023-10-08T13:05:57.276797+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:05:57.276797+0000","last_undegraded":"2023-10-08T13:05:57.276797+0000","last_fullsized":"2023-10-08T13:05:57.276797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":87,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253216+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:05:38.253216+0000","last_peered":"2023-10-08T13:05:38.253216+0000","last_clean":"2023-10-08T13:05:38.253216+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:05:38.253216+0000","last_undegraded":"2023-10-08T13:05:38.253216+0000","last_fullsized":"2023-10-08T13:05:38.253216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252605+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:05:38.252605+0000","last_peered":"2023-10-08T13:05:38.252605+0000","last_clean":"2023-10-08T13:05:38.252605+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:05:38.252605+0000","last_undegraded":"2023-10-08T13:05:38.252605+0000","last_fullsized":"2023-10-08T13:05:38.252605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907529+0000","last_change":"2023-10-08T13:04:38.213418+0000","last_active":"2023-10-08T13:05:37.907529+0000","last_peered":"2023-10-08T13:05:37.907529+0000","last_clean":"2023-10-08T13:05:37.907529+0000","last_became_active":"2023-10-08T13:04:38.213000+0000","last_became_peered":"2023-10-08T13:04:38.213000+0000","last_unstale":"2023-10-08T13:05:37.907529+0000","last_undegraded":"2023-10-08T13:05:37.907529+0000","last_fullsized":"2023-10-08T13:05:37.907529+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:20.821412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.275275+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:05:56.275275+0000","last_peered":"2023-10-08T13:05:56.275275+0000","last_clean":"2023-10-08T13:05:56.275275+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:05:56.275275+0000","last_undegraded":"2023-10-08T13:05:56.275275+0000","last_fullsized":"2023-10-08T13:05:56.275275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898219+0000","last_change":"2023-10-08T13:04:38.218150+0000","last_active":"2023-10-08T13:05:37.898219+0000","last_peered":"2023-10-08T13:05:37.898219+0000","last_clean":"2023-10-08T13:05:37.898219+0000","last_became_active":"2023-10-08T13:04:38.210481+0000","last_became_peered":"2023-10-08T13:04:38.210481+0000","last_unstale":"2023-10-08T13:05:37.898219+0000","last_undegraded":"2023-10-08T13:05:37.898219+0000","last_fullsized":"2023-10-08T13:05:37.898219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:42.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899075+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:05:37.899075+0000","last_peered":"2023-10-08T13:05:37.899075+0000","last_clean":"2023-10-08T13:05:37.899075+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:05:37.899075+0000","last_undegraded":"2023-10-08T13:05:37.899075+0000","last_fullsized":"2023-10-08T13:05:37.899075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907817+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:05:37.907817+0000","last_peered":"2023-10-08T13:05:37.907817+0000","last_clean":"2023-10-08T13:05:37.907817+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:05:37.907817+0000","last_undegraded":"2023-10-08T13:05:37.907817+0000","last_fullsized":"2023-10-08T13:05:37.907817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":325,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897664+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:05:37.897664+0000","last_peered":"2023-10-08T13:05:37.897664+0000","last_clean":"2023-10-08T13:05:37.897664+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:05:37.897664+0000","last_undegraded":"2023-10-08T13:05:37.897664+0000","last_fullsized":"2023-10-08T13:05:37.897664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906676+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:05:37.906676+0000","last_peered":"2023-10-08T13:05:37.906676+0000","last_clean":"2023-10-08T13:05:37.906676+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:05:37.906676+0000","last_undegraded":"2023-10-08T13:05:37.906676+0000","last_fullsized":"2023-10-08T13:05:37.906676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252246+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:05:38.252246+0000","last_peered":"2023-10-08T13:05:38.252246+0000","last_clean":"2023-10-08T13:05:38.252246+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:05:38.252246+0000","last_undegraded":"2023-10-08T13:05:38.252246+0000","last_fullsized":"2023-10-08T13:05:38.252246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897795+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:05:37.897795+0000","last_peered":"2023-10-08T13:05:37.897795+0000","last_clean":"2023-10-08T13:05:37.897795+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:05:37.897795+0000","last_undegraded":"2023-10-08T13:05:37.897795+0000","last_fullsized":"2023-10-08T13:05:37.897795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899769+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:05:37.899769+0000","last_peered":"2023-10-08T13:05:37.899769+0000","last_clean":"2023-10-08T13:05:37.899769+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:05:37.899769+0000","last_undegraded":"2023-10-08T13:05:37.899769+0000","last_fullsized":"2023-10-08T13:05:37.899769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901058+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:05:37.901058+0000","last_peered":"2023-10-08T13:05:37.901058+0000","last_clean":"2023-10-08T13:05:37.901058+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:05:37.901058+0000","last_undegraded":"2023-10-08T13:05:37.901058+0000","last_fullsized":"2023-10-08T13:05:37.901058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252656+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:05:38.252656+0000","last_peered":"2023-10-08T13:05:38.252656+0000","last_clean":"2023-10-08T13:05:38.252656+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:05:38.252656+0000","last_undegraded":"2023-10-08T13:05:38.252656+0000","last_fullsized":"2023-10-08T13:05:38.252656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898746+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:05:37.898746+0000","last_peered":"2023-10-08T13:05:37.898746+0000","last_clean":"2023-10-08T13:05:37.898746+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:05:37.898746+0000","last_undegraded":"2023-10-08T13:05:37.898746+0000","last_fullsized":"2023-10-08T13:05:37.898746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.911816+0000","last_change":"2023-10-08T13:05:38.911816+0000","last_active":"2023-10-08T13:05:38.911816+0000","last_peered":"2023-10-08T13:05:38.911816+0000","last_clean":"2023-10-08T13:05:38.911816+0000","last_became_active":"2023-10-08T13:05:38.904337+0000","last_became_peered":"2023-10-08T13:05:38.904337+0000","last_unstale":"2023-10-08T13:05:38.911816+0000","last_undegraded":"2023-10-08T13:05:38.911816+0000","last_fullsized":"2023-10-08T13:05:38.911816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:26.645712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899892+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:05:37.899892+0000","last_peered":"2023-10-08T13:05:37.899892+0000","last_clean":"2023-10-08T13:05:37.899892+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:05:37.899892+0000","last_undegraded":"2023-10-08T13:05:37.899892+0000","last_fullsized":"2023-10-08T13:05:37.899892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897964+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:05:37.897964+0000","last_peered":"2023-10-08T13:05:37.897964+0000","last_clean":"2023-10-08T13:05:37.897964+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:05:37.897964+0000","last_undegraded":"2023-10-08T13:05:37.897964+0000","last_fullsized":"2023-10-08T13:05:37.897964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908096+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:05:37.908096+0000","last_peered":"2023-10-08T13:05:37.908096+0000","last_clean":"2023-10-08T13:05:37.908096+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:05:37.908096+0000","last_undegraded":"2023-10-08T13:05:37.908096+0000","last_fullsized":"2023-10-08T13:05:37.908096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476501+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:05:38.476501+0000","last_peered":"2023-10-08T13:05:38.476501+0000","last_clean":"2023-10-08T13:05:38.476501+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:05:38.476501+0000","last_undegraded":"2023-10-08T13:05:38.476501+0000","last_fullsized":"2023-10-08T13:05:38.476501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907477+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:05:37.907477+0000","last_peered":"2023-10-08T13:05:37.907477+0000","last_clean":"2023-10-08T13:05:37.907477+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:05:37.907477+0000","last_undegraded":"2023-10-08T13:05:37.907477+0000","last_fullsized":"2023-10-08T13:05:37.907477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900849+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:05:37.900849+0000","last_peered":"2023-10-08T13:05:37.900849+0000","last_clean":"2023-10-08T13:05:37.900849+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:05:37.900849+0000","last_undegraded":"2023-10-08T13:05:37.900849+0000","last_fullsized":"2023-10-08T13:05:37.900849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899579+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:05:37.899579+0000","last_peered":"2023-10-08T13:05:37.899579+0000","last_clean":"2023-10-08T13:05:37.899579+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:05:37.899579+0000","last_undegraded":"2023-10-08T13:05:37.899579+0000","last_fullsized":"2023-10-08T13:05:37.899579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896881+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:05:37.896881+0000","last_peered":"2023-10-08T13:05:37.896881+0000","last_clean":"2023-10-08T13:05:37.896881+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:05:37.896881+0000","last_undegraded":"2023-10-08T13:05:37.896881+0000","last_fullsized":"2023-10-08T13:05:37.896881+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898821+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:05:37.898821+0000","last_peered":"2023-10-08T13:05:37.898821+0000","last_clean":"2023-10-08T13:05:37.898821+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:05:37.898821+0000","last_undegraded":"2023-10-08T13:05:37.898821+0000","last_fullsized":"2023-10-08T13:05:37.898821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899446+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:05:37.899446+0000","last_peered":"2023-10-08T13:05:37.899446+0000","last_clean":"2023-10-08T13:05:37.899446+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:05:37.899446+0000","last_undegraded":"2023-10-08T13:05:37.899446+0000","last_fullsized":"2023-10-08T13:05:37.899446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907324+0000","last_change":"2023-10-08T13:04:38.213883+0000","last_active":"2023-10-08T13:05:37.907324+0000","last_peered":"2023-10-08T13:05:37.907324+0000","last_clean":"2023-10-08T13:05:37.907324+0000","last_became_active":"2023-10-08T13:04:38.212887+0000","last_became_peered":"2023-10-08T13:04:38.212887+0000","last_unstale":"2023-10-08T13:05:37.907324+0000","last_undegraded":"2023-10-08T13:05:37.907324+0000","last_fullsized":"2023-10-08T13:05:37.907324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:14.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.902351+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:05:38.902351+0000","last_peered":"2023-10-08T13:05:38.902351+0000","last_clean":"2023-10-08T13:05:38.902351+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:05:38.902351+0000","last_undegraded":"2023-10-08T13:05:38.902351+0000","last_fullsized":"2023-10-08T13:05:38.902351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899561+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:05:37.899561+0000","last_peered":"2023-10-08T13:05:37.899561+0000","last_clean":"2023-10-08T13:05:37.899561+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:05:37.899561+0000","last_undegraded":"2023-10-08T13:05:37.899561+0000","last_fullsized":"2023-10-08T13:05:37.899561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907877+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:05:37.907877+0000","last_peered":"2023-10-08T13:05:37.907877+0000","last_clean":"2023-10-08T13:05:37.907877+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:05:37.907877+0000","last_undegraded":"2023-10-08T13:05:37.907877+0000","last_fullsized":"2023-10-08T13:05:37.907877+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900486+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:05:37.900486+0000","last_peered":"2023-10-08T13:05:37.900486+0000","last_clean":"2023-10-08T13:05:37.900486+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:05:37.900486+0000","last_undegraded":"2023-10-08T13:05:37.900486+0000","last_fullsized":"2023-10-08T13:05:37.900486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897912+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:05:37.897912+0000","last_peered":"2023-10-08T13:05:37.897912+0000","last_clean":"2023-10-08T13:05:37.897912+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:05:37.897912+0000","last_undegraded":"2023-10-08T13:05:37.897912+0000","last_fullsized":"2023-10-08T13:05:37.897912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901970+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:05:37.901970+0000","last_peered":"2023-10-08T13:05:37.901970+0000","last_clean":"2023-10-08T13:05:37.901970+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:05:37.901970+0000","last_undegraded":"2023-10-08T13:05:37.901970+0000","last_fullsized":"2023-10-08T13:05:37.901970+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'8","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:59.296360+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:05:59.296360+0000","last_peered":"2023-10-08T13:05:59.296360+0000","last_clean":"2023-10-08T13:05:59.296360+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:05:59.296360+0000","last_undegraded":"2023-10-08T13:05:59.296360+0000","last_fullsized":"2023-10-08T13:05:59.296360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2019,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898498+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:05:37.898498+0000","last_peered":"2023-10-08T13:05:37.898498+0000","last_clean":"2023-10-08T13:05:37.898498+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:05:37.898498+0000","last_undegraded":"2023-10-08T13:05:37.898498+0000","last_fullsized":"2023-10-08T13:05:37.898498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476182+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:05:38.476182+0000","last_peered":"2023-10-08T13:05:38.476182+0000","last_clean":"2023-10-08T13:05:38.476182+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:05:38.476182+0000","last_undegraded":"2023-10-08T13:05:38.476182+0000","last_fullsized":"2023-10-08T13:05:38.476182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906326+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:05:37.906326+0000","last_peered":"2023-10-08T13:05:37.906326+0000","last_clean":"2023-10-08T13:05:37.906326+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:05:37.906326+0000","last_undegraded":"2023-10-08T13:05:37.906326+0000","last_fullsized":"2023-10-08T13:05:37.906326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898116+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:05:37.898116+0000","last_peered":"2023-10-08T13:05:37.898116+0000","last_clean":"2023-10-08T13:05:37.898116+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:05:37.898116+0000","last_undegraded":"2023-10-08T13:05:37.898116+0000","last_fullsized":"2023-10-08T13:05:37.898116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.904627+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:05:37.904627+0000","last_peered":"2023-10-08T13:05:37.904627+0000","last_clean":"2023-10-08T13:05:37.904627+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:05:37.904627+0000","last_undegraded":"2023-10-08T13:05:37.904627+0000","last_fullsized":"2023-10-08T13:05:37.904627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252671+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:05:38.252671+0000","last_peered":"2023-10-08T13:05:38.252671+0000","last_clean":"2023-10-08T13:05:38.252671+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:05:38.252671+0000","last_undegraded":"2023-10-08T13:05:38.252671+0000","last_fullsized":"2023-10-08T13:05:38.252671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898426+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:05:37.898426+0000","last_peered":"2023-10-08T13:05:37.898426+0000","last_clean":"2023-10-08T13:05:37.898426+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:05:37.898426+0000","last_undegraded":"2023-10-08T13:05:37.898426+0000","last_fullsized":"2023-10-08T13:05:37.898426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899508+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:05:37.899508+0000","last_peered":"2023-10-08T13:05:37.899508+0000","last_clean":"2023-10-08T13:05:37.899508+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:05:37.899508+0000","last_undegraded":"2023-10-08T13:05:37.899508+0000","last_fullsized":"2023-10-08T13:05:37.899508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898361+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:05:37.898361+0000","last_peered":"2023-10-08T13:05:37.898361+0000","last_clean":"2023-10-08T13:05:37.898361+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:05:37.898361+0000","last_undegraded":"2023-10-08T13:05:37.898361+0000","last_fullsized":"2023-10-08T13:05:37.898361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898299+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:05:37.898299+0000","last_peered":"2023-10-08T13:05:37.898299+0000","last_clean":"2023-10-08T13:05:37.898299+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:05:37.898299+0000","last_undegraded":"2023-10-08T13:05:37.898299+0000","last_fullsized":"2023-10-08T13:05:37.898299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476442+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:05:38.476442+0000","last_peered":"2023-10-08T13:05:38.476442+0000","last_clean":"2023-10-08T13:05:38.476442+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:05:38.476442+0000","last_undegraded":"2023-10-08T13:05:38.476442+0000","last_fullsized":"2023-10-08T13:05:38.476442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252558+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:05:38.252558+0000","last_peered":"2023-10-08T13:05:38.252558+0000","last_clean":"2023-10-08T13:05:38.252558+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:05:38.252558+0000","last_undegraded":"2023-10-08T13:05:38.252558+0000","last_fullsized":"2023-10-08T13:05:38.252558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900173+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:05:37.900173+0000","last_peered":"2023-10-08T13:05:37.900173+0000","last_clean":"2023-10-08T13:05:37.900173+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:05:37.900173+0000","last_undegraded":"2023-10-08T13:05:37.900173+0000","last_fullsized":"2023-10-08T13:05:37.900173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898897+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:05:37.898897+0000","last_peered":"2023-10-08T13:05:37.898897+0000","last_clean":"2023-10-08T13:05:37.898897+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:05:37.898897+0000","last_undegraded":"2023-10-08T13:05:37.898897+0000","last_fullsized":"2023-10-08T13:05:37.898897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900027+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:05:37.900027+0000","last_peered":"2023-10-08T13:05:37.900027+0000","last_clean":"2023-10-08T13:05:37.900027+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:05:37.900027+0000","last_undegraded":"2023-10-08T13:05:37.900027+0000","last_fullsized":"2023-10-08T13:05:37.900027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907520+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:05:37.907520+0000","last_peered":"2023-10-08T13:05:37.907520+0000","last_clean":"2023-10-08T13:05:37.907520+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:05:37.907520+0000","last_undegraded":"2023-10-08T13:05:37.907520+0000","last_fullsized":"2023-10-08T13:05:37.907520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896505+0000","last_change":"2023-10-08T13:04:38.213278+0000","last_active":"2023-10-08T13:05:37.896505+0000","last_peered":"2023-10-08T13:05:37.896505+0000","last_clean":"2023-10-08T13:05:37.896505+0000","last_became_active":"2023-10-08T13:04:38.213016+0000","last_became_peered":"2023-10-08T13:04:38.213016+0000","last_unstale":"2023-10-08T13:05:37.896505+0000","last_undegraded":"2023-10-08T13:05:37.896505+0000","last_fullsized":"2023-10-08T13:05:37.896505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:49.650606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.902188+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:05:37.902188+0000","last_peered":"2023-10-08T13:05:37.902188+0000","last_clean":"2023-10-08T13:05:37.902188+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:05:37.902188+0000","last_undegraded":"2023-10-08T13:05:37.902188+0000","last_fullsized":"2023-10-08T13:05:37.902188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252491+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:05:38.252491+0000","last_peered":"2023-10-08T13:05:38.252491+0000","last_clean":"2023-10-08T13:05:38.252491+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:05:38.252491+0000","last_undegraded":"2023-10-08T13:05:38.252491+0000","last_fullsized":"2023-10-08T13:05:38.252491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900063+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:05:37.900063+0000","last_peered":"2023-10-08T13:05:37.900063+0000","last_clean":"2023-10-08T13:05:37.900063+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:05:37.900063+0000","last_undegraded":"2023-10-08T13:05:37.900063+0000","last_fullsized":"2023-10-08T13:05:37.900063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67391,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":886,"num_read_kb":512,"num_write":252,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":644,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":210813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":525237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53100000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.45600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":1.165,"15min":1.165},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.40400000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88600000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.57299999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.747,"15min":0.73399999999999999},"min":{"1min":0.68700000000000006,"5min":0.439,"15min":0.439},"max":{"1min":0.97599999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.997,"5min":1.419,"15min":1.419},"last":0.83299999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.77000000000000002,"15min":0.754},"min":{"1min":0.626,"5min":0.44,"15min":0.44},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.76900000000000002},"min":{"1min":0.65700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.048,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82199999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.66500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78700000000000003,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.78700000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678053,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1170771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.503},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":1.456,"15min":1.456},"last":0.38600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.383,"15min":1.383},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93400000000000005,"5min":1.085,"15min":1.085},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":1.337,"15min":1.337},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78200000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.88700000000000001},"min":{"1min":0.66900000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98899999999999999,"5min":1.637,"15min":1.637},"last":0.57799999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.89100000000000001},"min":{"1min":0.68999999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1459999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.627,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.748,"15min":1.748},"last":0.59999999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.0780000000000003,"5min":6.0780000000000003,"15min":6.0780000000000003},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":0.96499999999999997,"15min":0.91500000000000004},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":6.1289999999999996,"5min":6.1289999999999996,"15min":6.1289999999999996},"last":0.90900000000000003}]}]},{"osd":9,"up_from":66,"seq":283467841578,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":524296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56000000000000005,"5min":0.625,"15min":0.625},"last":0.378},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.44400000000000001,"15min":0.46400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57499999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.875,"15min":0.875},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.64500000000000002},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.502}]},{"osd":3,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52900000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.56399999999999995,"15min":0.60399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63500000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.84299999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80600000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90500000000000003,"5min":1.123,"15min":1.123},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.85599999999999998,"5min":1.109,"15min":1.109},"last":0.624}]},{"osd":10,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.871,"5min":1.095,"15min":1.095},"last":0.73599999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65600000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103215,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":528417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90400000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.626,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0489999999999999,"5min":1.127,"15min":1.127},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.878}]},{"osd":5,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83299999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.0369999999999999,"5min":1.127,"15min":1.127},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":1.048,"15min":1.048},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92900000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68999999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83799999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.755,"15min":0.746},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77900000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.64500000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.745},{"interface":"front","average":{"1min":0.88,"5min":0.77500000000000002,"15min":0.75700000000000001},"min":{"1min":0.69799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0189999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.90200000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.624},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85299999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1658880,"data_stored":1117473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.502},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.623},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84599999999999997,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.66200000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.748},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0049999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.747}]},{"osd":8,"last update":"Sun Oct 8 13:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.67000000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.23,"15min":1.23},"last":1.101},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.72899999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.82199999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.74199999999999999,"15min":0.73299999999999998},"min":{"1min":0.54500000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.103,"5min":1.266,"15min":1.266},"last":0.97299999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.90000000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.222},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.329}]}]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":520331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"min":{"1min":0.32600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.32100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76700000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80500000000000005,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.54000000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61499999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.167,"15min":1.167},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88800000000000001,"5min":1.075,"15min":1.075},"last":0.61099999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82699999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.502,"5min":0.377,"15min":0.377},"max":{"1min":0.88200000000000001,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.02,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77000000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.89000000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.627}]},{"osd":9,"last update":"Sun Oct 8 13:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.496,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78200000000000003,"15min":0.80800000000000005},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":585137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.59599999999999997,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80600000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.59399999999999997,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.59799999999999998,"15min":0.53300000000000003},"min":{"1min":0.501,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.93300000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.62,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63300000000000001,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.83199999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71499999999999997,"15min":0.66900000000000004},"min":{"1min":0.54900000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.98399999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.628,"15min":0.58199999999999996},"min":{"1min":0.53400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69199999999999995,"15min":0.64500000000000002},"min":{"1min":0.54300000000000004,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.083,"5min":1.173,"15min":1.173},"last":0.95599999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.61199999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.1499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.91600000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.81599999999999995,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0669999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.097,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.871},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.875,"15min":0.87},"min":{"1min":0.67800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.748}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0369999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":522105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":1.278,"15min":1.278},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.39900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70999999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.56499999999999995},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59099999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.316}]},{"osd":4,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88500000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.753,"5min":1.387,"15min":1.387},"last":0.53400000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.745,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71599999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69799999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":1.01,"15min":1.01},"last":0.34899999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68999999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.47499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55500000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.628},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77000000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.40200000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90800000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.095,"15min":1.095},"last":0.72699999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.57299999999999995}]}]},{"osd":2,"up_from":19,"seq":81604378696,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":588751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70899999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.434,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.70999999999999996,"5min":1.353,"15min":1.353},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.59499999999999997,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.89700000000000002,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.504,"5min":0.246,"15min":0.246},"max":{"1min":0.93300000000000005,"5min":1.248,"15min":1.248},"last":0.82999999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.89500000000000002,"5min":1.375,"15min":1.375},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.39800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85699999999999998,"5min":1.72,"15min":1.72},"last":0.62},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.54100000000000004,"15min":0.49099999999999999},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91400000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.624,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.91300000000000003,"5min":1.135,"15min":1.135},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.93300000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:05:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0009999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.63,"15min":0.59399999999999997},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.95899999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71499999999999997},"min":{"1min":0.63200000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96399999999999997,"5min":1.169,"15min":1.169},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98999999999999999,"5min":1.397,"15min":1.397},"last":0.878}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.054,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.073,"5min":1.296,"15min":1.296},"last":1.016}]},{"osd":11,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.999}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":519508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.42699999999999999,"15min":0.371},"min":{"1min":0.313,"5min":0.222,"15min":0.222},"max":{"1min":3.96,"5min":3.96,"15min":3.96},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.35299999999999998},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.46600000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.622},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59499999999999997,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.81899999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.84199999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.754}]},{"osd":6,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80000000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.76400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93700000000000006,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.74099999999999999},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89000000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72999999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.085,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64600000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.86199999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":524405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.747}]},{"osd":3,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61699999999999999,"15min":0.58499999999999996},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.437}]},{"osd":5,"last update":"Sun Oct 8 13:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70999999999999996,"15min":0.68799999999999994},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.871}]},{"osd":6,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.67300000000000004},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94899999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68899999999999995,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.044,"15min":1.044},"last":0.72799999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92100000000000004,"5min":1.075,"15min":1.075},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.68899999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0229999999999999,"5min":1.071,"15min":1.071},"last":0.83499999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83099999999999996,"15min":0.83199999999999996},"min":{"1min":0.69599999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98999999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.623}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.081,"5min":1.137,"15min":1.137},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70199999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.90200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1112266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.32400000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.5},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.7869999999999999,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.62,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.39100000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82199999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.36199999999999999},"min":{"1min":0.317,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68300000000000005,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.52200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.437},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69599999999999995,"5min":2.085,"15min":2.085},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.56299999999999994},"min":{"1min":0.47199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":1.962,"15min":1.962},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83999999999999997,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61299999999999999,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90900000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93400000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88500000000000001,"5min":2.113,"15min":2.113},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97499999999999998,"5min":2.198,"15min":2.198},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66500000000000004,"15min":0.67900000000000005},"min":{"1min":0.44900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89800000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.67000000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.56799999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92900000000000005,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0569999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.72399999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":1.99,"15min":1.99},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:06:01.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:06:01.526 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:01 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2093822573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:06:01.527 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:01 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3086772854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:06:01.527 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:01 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1987848600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:01.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:01 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2093822573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:06:01.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:01 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3086772854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:06:01.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:01 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1987848600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:01.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 -- 172.21.15.5:0/3763687362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7640fff10 msgr2=0x7fd76410c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 --2- 172.21.15.5:0/3763687362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7640fff10 0x7fd76410c3d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00b0d0 tx=0x7fd75c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 -- 172.21.15.5:0/3763687362 shutdown_connections 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 --2- 172.21.15.5:0/3763687362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7640fff10 0x7fd76410c3d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 --2- 172.21.15.5:0/3763687362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764105610 0x7fd7641059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 --2- 172.21.15.5:0/3763687362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640ff550 0x7fd7640ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 -- 172.21.15.5:0/3763687362 >> 172.21.15.5:0/3763687362 conn(0x7fd7640fb040 msgr2=0x7fd7640fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 -- 172.21.15.5:0/3763687362 shutdown_connections 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 -- 172.21.15.5:0/3763687362 wait complete. 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 Processor -- start 2023-10-08T13:06:01.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.681+0000 7fd76a071700 1 -- start start 2023-10-08T13:06:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd76a071700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640ff550 0x7fd76419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd76a071700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7640fff10 0x7fd76419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd76a071700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 0x7fd764196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd76a071700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764196fc0 con 0x7fd764105610 2023-10-08T13:06:01.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd76a071700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764197130 con 0x7fd7640fff10 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd76a071700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641972f0 con 0x7fd7640ff550 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 0x7fd764196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 0x7fd764196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34546/0 (socket says 172.21.15.5:34546) 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 -- 172.21.15.5:0/1156567461 learned_addr learned my addr 172.21.15.5:0/1156567461 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd7637fe700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640ff550 0x7fd76419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd762ffd700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7640fff10 0x7fd76419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 -- 172.21.15.5:0/1156567461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640ff550 msgr2=0x7fd76419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640ff550 0x7fd76419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 -- 172.21.15.5:0/1156567461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7640fff10 msgr2=0x7fd76419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7640fff10 0x7fd76419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 -- 172.21.15.5:0/1156567461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009d00 con 0x7fd764105610 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd762ffd700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7640fff10 0x7fd76419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd763fff700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 0x7fd764196960 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00bd50 tx=0x7fd75c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.682+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00e040 con 0x7fd764105610 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.683+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd75c01d930 con 0x7fd764105610 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.683+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764197570 con 0x7fd764105610 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.683+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c01baf0 con 0x7fd764105610 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.683+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7641a3820 con 0x7fd764105610 2023-10-08T13:06:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.683+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764100c70 con 0x7fd764105610 2023-10-08T13:06:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.685+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fd75c01daa0 con 0x7fd764105610 2023-10-08T13:06:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.685+0000 7fd760ff9700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd74c0a14d0 0x7fd74c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.685+0000 7fd7637fe700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd74c0a14d0 0x7fd74c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.685+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd75c0ced70 con 0x7fd764105610 2023-10-08T13:06:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.686+0000 7fd7637fe700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd74c0a14d0 0x7fd74c0a3990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd754005950 tx=0x7fd7540058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.689+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd75c098000 con 0x7fd764105610 2023-10-08T13:06:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.889+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd76410f470 con 0x7fd74c0a14d0 2023-10-08T13:06:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.904+0000 7fd760ff9700 1 -- 172.21.15.5:0/1156567461 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426753 (secure 0 0 0) 0x7fd76410f470 con 0x7fd74c0a14d0 2023-10-08T13:06:01.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd74c0a14d0 msgr2=0x7fd74c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd74c0a14d0 0x7fd74c0a3990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd754005950 tx=0x7fd7540058e0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 msgr2=0x7fd764196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 0x7fd764196960 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00bd50 tx=0x7fd75c00be30 comp rx=0 tx=0).stop 2023-10-08T13:06:01.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 shutdown_connections 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd74c0a14d0 0x7fd74c0a3990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd764105610 0x7fd764196960 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7640ff550 0x7fd76419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 --2- 172.21.15.5:0/1156567461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7640fff10 0x7fd76419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 >> 172.21.15.5:0/1156567461 conn(0x7fd7640fb040 msgr2=0x7fd7640fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 shutdown_connections 2023-10-08T13:06:01.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:01.908+0000 7fd76a071700 1 -- 172.21.15.5:0/1156567461 wait complete. 2023-10-08T13:06:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:06:01.922 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-10-08T13:06:01.115198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658005,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1022,"num_read_kb":631,"num_write":435,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181626,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361,"ondisk_log_size":361,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338668,"kb_used_data":14416,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603156,"statfs":{"total":1151940427776,"available":1151593631744,"internally_reserved":0,"allocated":14761984,"data_stored":8238697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":636,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":52,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900610+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:05:37.900610+0000","last_peered":"2023-10-08T13:05:37.900610+0000","last_clean":"2023-10-08T13:05:37.900610+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:05:37.900610+0000","last_undegraded":"2023-10-08T13:05:37.900610+0000","last_fullsized":"2023-10-08T13:05:37.900610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476427+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:05:38.476427+0000","last_peered":"2023-10-08T13:05:38.476427+0000","last_clean":"2023-10-08T13:05:38.476427+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:05:38.476427+0000","last_undegraded":"2023-10-08T13:05:38.476427+0000","last_fullsized":"2023-10-08T13:05:38.476427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476391+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:05:38.476391+0000","last_peered":"2023-10-08T13:05:38.476391+0000","last_clean":"2023-10-08T13:05:38.476391+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:05:38.476391+0000","last_undegraded":"2023-10-08T13:05:38.476391+0000","last_fullsized":"2023-10-08T13:05:38.476391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907637+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:05:37.907637+0000","last_peered":"2023-10-08T13:05:37.907637+0000","last_clean":"2023-10-08T13:05:37.907637+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:05:37.907637+0000","last_undegraded":"2023-10-08T13:05:37.907637+0000","last_fullsized":"2023-10-08T13:05:37.907637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900586+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:05:37.900586+0000","last_peered":"2023-10-08T13:05:37.900586+0000","last_clean":"2023-10-08T13:05:37.900586+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:05:37.900586+0000","last_undegraded":"2023-10-08T13:05:37.900586+0000","last_fullsized":"2023-10-08T13:05:37.900586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253010+0000","last_change":"2023-10-08T13:04:38.210845+0000","last_active":"2023-10-08T13:05:38.253010+0000","last_peered":"2023-10-08T13:05:38.253010+0000","last_clean":"2023-10-08T13:05:38.253010+0000","last_became_active":"2023-10-08T13:04:38.210454+0000","last_became_peered":"2023-10-08T13:04:38.210454+0000","last_unstale":"2023-10-08T13:05:38.253010+0000","last_undegraded":"2023-10-08T13:05:38.253010+0000","last_fullsized":"2023-10-08T13:05:38.253010+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:10.493230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897780+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:05:37.897780+0000","last_peered":"2023-10-08T13:05:37.897780+0000","last_clean":"2023-10-08T13:05:37.897780+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:05:37.897780+0000","last_undegraded":"2023-10-08T13:05:37.897780+0000","last_fullsized":"2023-10-08T13:05:37.897780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898702+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:05:37.898702+0000","last_peered":"2023-10-08T13:05:37.898702+0000","last_clean":"2023-10-08T13:05:37.898702+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:05:37.898702+0000","last_undegraded":"2023-10-08T13:05:37.898702+0000","last_fullsized":"2023-10-08T13:05:37.898702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903390+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:05:37.903390+0000","last_peered":"2023-10-08T13:05:37.903390+0000","last_clean":"2023-10-08T13:05:37.903390+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:05:37.903390+0000","last_undegraded":"2023-10-08T13:05:37.903390+0000","last_fullsized":"2023-10-08T13:05:37.903390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253803+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:05:38.253803+0000","last_peered":"2023-10-08T13:05:38.253803+0000","last_clean":"2023-10-08T13:05:38.253803+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:05:38.253803+0000","last_undegraded":"2023-10-08T13:05:38.253803+0000","last_fullsized":"2023-10-08T13:05:38.253803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898482+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:05:37.898482+0000","last_peered":"2023-10-08T13:05:37.898482+0000","last_clean":"2023-10-08T13:05:37.898482+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:05:37.898482+0000","last_undegraded":"2023-10-08T13:05:37.898482+0000","last_fullsized":"2023-10-08T13:05:37.898482+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908109+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:05:37.908109+0000","last_peered":"2023-10-08T13:05:37.908109+0000","last_clean":"2023-10-08T13:05:37.908109+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:05:37.908109+0000","last_undegraded":"2023-10-08T13:05:37.908109+0000","last_fullsized":"2023-10-08T13:05:37.908109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252566+0000","last_change":"2023-10-08T13:04:38.209983+0000","last_active":"2023-10-08T13:05:38.252566+0000","last_peered":"2023-10-08T13:05:38.252566+0000","last_clean":"2023-10-08T13:05:38.252566+0000","last_became_active":"2023-10-08T13:04:38.209572+0000","last_became_peered":"2023-10-08T13:04:38.209572+0000","last_unstale":"2023-10-08T13:05:38.252566+0000","last_undegraded":"2023-10-08T13:05:38.252566+0000","last_fullsized":"2023-10-08T13:05:38.252566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:01.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476539+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:05:38.476539+0000","last_peered":"2023-10-08T13:05:38.476539+0000","last_clean":"2023-10-08T13:05:38.476539+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:05:38.476539+0000","last_undegraded":"2023-10-08T13:05:38.476539+0000","last_fullsized":"2023-10-08T13:05:38.476539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476214+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:05:38.476214+0000","last_peered":"2023-10-08T13:05:38.476214+0000","last_clean":"2023-10-08T13:05:38.476214+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:05:38.476214+0000","last_undegraded":"2023-10-08T13:05:38.476214+0000","last_fullsized":"2023-10-08T13:05:38.476214+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900738+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:05:37.900738+0000","last_peered":"2023-10-08T13:05:37.900738+0000","last_clean":"2023-10-08T13:05:37.900738+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:05:37.900738+0000","last_undegraded":"2023-10-08T13:05:37.900738+0000","last_fullsized":"2023-10-08T13:05:37.900738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900396+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:05:37.900396+0000","last_peered":"2023-10-08T13:05:37.900396+0000","last_clean":"2023-10-08T13:05:37.900396+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:05:37.900396+0000","last_undegraded":"2023-10-08T13:05:37.900396+0000","last_fullsized":"2023-10-08T13:05:37.900396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897250+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:05:37.897250+0000","last_peered":"2023-10-08T13:05:37.897250+0000","last_clean":"2023-10-08T13:05:37.897250+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:05:37.897250+0000","last_undegraded":"2023-10-08T13:05:37.897250+0000","last_fullsized":"2023-10-08T13:05:37.897250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898635+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:05:37.898635+0000","last_peered":"2023-10-08T13:05:37.898635+0000","last_clean":"2023-10-08T13:05:37.898635+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:05:37.898635+0000","last_undegraded":"2023-10-08T13:05:37.898635+0000","last_fullsized":"2023-10-08T13:05:37.898635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898186+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:05:37.898186+0000","last_peered":"2023-10-08T13:05:37.898186+0000","last_clean":"2023-10-08T13:05:37.898186+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:05:37.898186+0000","last_undegraded":"2023-10-08T13:05:37.898186+0000","last_fullsized":"2023-10-08T13:05:37.898186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'14","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:55.273216+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:05:55.273216+0000","last_peered":"2023-10-08T13:05:55.273216+0000","last_clean":"2023-10-08T13:05:55.273216+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:05:55.273216+0000","last_undegraded":"2023-10-08T13:05:55.273216+0000","last_fullsized":"2023-10-08T13:05:55.273216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899378+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:05:37.899378+0000","last_peered":"2023-10-08T13:05:37.899378+0000","last_clean":"2023-10-08T13:05:37.899378+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:05:37.899378+0000","last_undegraded":"2023-10-08T13:05:37.899378+0000","last_fullsized":"2023-10-08T13:05:37.899378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907193+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:05:37.907193+0000","last_peered":"2023-10-08T13:05:37.907193+0000","last_clean":"2023-10-08T13:05:37.907193+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:05:37.907193+0000","last_undegraded":"2023-10-08T13:05:37.907193+0000","last_fullsized":"2023-10-08T13:05:37.907193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899457+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:05:37.899457+0000","last_peered":"2023-10-08T13:05:37.899457+0000","last_clean":"2023-10-08T13:05:37.899457+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:05:37.899457+0000","last_undegraded":"2023-10-08T13:05:37.899457+0000","last_fullsized":"2023-10-08T13:05:37.899457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476398+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:05:38.476398+0000","last_peered":"2023-10-08T13:05:38.476398+0000","last_clean":"2023-10-08T13:05:38.476398+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:05:38.476398+0000","last_undegraded":"2023-10-08T13:05:38.476398+0000","last_fullsized":"2023-10-08T13:05:38.476398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907687+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:05:37.907687+0000","last_peered":"2023-10-08T13:05:37.907687+0000","last_clean":"2023-10-08T13:05:37.907687+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:05:37.907687+0000","last_undegraded":"2023-10-08T13:05:37.907687+0000","last_fullsized":"2023-10-08T13:05:37.907687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900891+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:05:37.900891+0000","last_peered":"2023-10-08T13:05:37.900891+0000","last_clean":"2023-10-08T13:05:37.900891+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:05:37.900891+0000","last_undegraded":"2023-10-08T13:05:37.900891+0000","last_fullsized":"2023-10-08T13:05:37.900891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.902964+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:05:37.902964+0000","last_peered":"2023-10-08T13:05:37.902964+0000","last_clean":"2023-10-08T13:05:37.902964+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:05:37.902964+0000","last_undegraded":"2023-10-08T13:05:37.902964+0000","last_fullsized":"2023-10-08T13:05:37.902964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908056+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:05:37.908056+0000","last_peered":"2023-10-08T13:05:37.908056+0000","last_clean":"2023-10-08T13:05:37.908056+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:05:37.908056+0000","last_undegraded":"2023-10-08T13:05:37.908056+0000","last_fullsized":"2023-10-08T13:05:37.908056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899629+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:05:37.899629+0000","last_peered":"2023-10-08T13:05:37.899629+0000","last_clean":"2023-10-08T13:05:37.899629+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:05:37.899629+0000","last_undegraded":"2023-10-08T13:05:37.899629+0000","last_fullsized":"2023-10-08T13:05:37.899629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906227+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:05:37.906227+0000","last_peered":"2023-10-08T13:05:37.906227+0000","last_clean":"2023-10-08T13:05:37.906227+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:05:37.906227+0000","last_undegraded":"2023-10-08T13:05:37.906227+0000","last_fullsized":"2023-10-08T13:05:37.906227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898495+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:05:37.898495+0000","last_peered":"2023-10-08T13:05:37.898495+0000","last_clean":"2023-10-08T13:05:37.898495+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:05:37.898495+0000","last_undegraded":"2023-10-08T13:05:37.898495+0000","last_fullsized":"2023-10-08T13:05:37.898495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:58.934882+0000","last_change":"2023-10-08T13:05:38.910616+0000","last_active":"2023-10-08T13:05:58.934882+0000","last_peered":"2023-10-08T13:05:58.934882+0000","last_clean":"2023-10-08T13:05:58.934882+0000","last_became_active":"2023-10-08T13:05:38.904333+0000","last_became_peered":"2023-10-08T13:05:38.904333+0000","last_unstale":"2023-10-08T13:05:58.934882+0000","last_undegraded":"2023-10-08T13:05:58.934882+0000","last_fullsized":"2023-10-08T13:05:58.934882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.582828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900271+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:05:37.900271+0000","last_peered":"2023-10-08T13:05:37.900271+0000","last_clean":"2023-10-08T13:05:37.900271+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:05:37.900271+0000","last_undegraded":"2023-10-08T13:05:37.900271+0000","last_fullsized":"2023-10-08T13:05:37.900271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899181+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:05:37.899181+0000","last_peered":"2023-10-08T13:05:37.899181+0000","last_clean":"2023-10-08T13:05:37.899181+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:05:37.899181+0000","last_undegraded":"2023-10-08T13:05:37.899181+0000","last_fullsized":"2023-10-08T13:05:37.899181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253006+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:05:38.253006+0000","last_peered":"2023-10-08T13:05:38.253006+0000","last_clean":"2023-10-08T13:05:38.253006+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:05:38.253006+0000","last_undegraded":"2023-10-08T13:05:38.253006+0000","last_fullsized":"2023-10-08T13:05:38.253006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908802+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:05:37.908802+0000","last_peered":"2023-10-08T13:05:37.908802+0000","last_clean":"2023-10-08T13:05:37.908802+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:05:37.908802+0000","last_undegraded":"2023-10-08T13:05:37.908802+0000","last_fullsized":"2023-10-08T13:05:37.908802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900285+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:05:37.900285+0000","last_peered":"2023-10-08T13:05:37.900285+0000","last_clean":"2023-10-08T13:05:37.900285+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:05:37.900285+0000","last_undegraded":"2023-10-08T13:05:37.900285+0000","last_fullsized":"2023-10-08T13:05:37.900285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252345+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:05:38.252345+0000","last_peered":"2023-10-08T13:05:38.252345+0000","last_clean":"2023-10-08T13:05:38.252345+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:05:38.252345+0000","last_undegraded":"2023-10-08T13:05:38.252345+0000","last_fullsized":"2023-10-08T13:05:38.252345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898798+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:05:37.898798+0000","last_peered":"2023-10-08T13:05:37.898798+0000","last_clean":"2023-10-08T13:05:37.898798+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:05:37.898798+0000","last_undegraded":"2023-10-08T13:05:37.898798+0000","last_fullsized":"2023-10-08T13:05:37.898798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476427+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:05:38.476427+0000","last_peered":"2023-10-08T13:05:38.476427+0000","last_clean":"2023-10-08T13:05:38.476427+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:05:38.476427+0000","last_undegraded":"2023-10-08T13:05:38.476427+0000","last_fullsized":"2023-10-08T13:05:38.476427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907441+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:05:37.907441+0000","last_peered":"2023-10-08T13:05:37.907441+0000","last_clean":"2023-10-08T13:05:37.907441+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:05:37.907441+0000","last_undegraded":"2023-10-08T13:05:37.907441+0000","last_fullsized":"2023-10-08T13:05:37.907441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896350+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:05:37.896350+0000","last_peered":"2023-10-08T13:05:37.896350+0000","last_clean":"2023-10-08T13:05:37.896350+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:05:37.896350+0000","last_undegraded":"2023-10-08T13:05:37.896350+0000","last_fullsized":"2023-10-08T13:05:37.896350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898929+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:05:37.898929+0000","last_peered":"2023-10-08T13:05:37.898929+0000","last_clean":"2023-10-08T13:05:37.898929+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:05:37.898929+0000","last_undegraded":"2023-10-08T13:05:37.898929+0000","last_fullsized":"2023-10-08T13:05:37.898929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.931304+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:05:56.931304+0000","last_peered":"2023-10-08T13:05:56.931304+0000","last_clean":"2023-10-08T13:05:56.931304+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:05:56.931304+0000","last_undegraded":"2023-10-08T13:05:56.931304+0000","last_fullsized":"2023-10-08T13:05:56.931304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":167,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903624+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:05:37.903624+0000","last_peered":"2023-10-08T13:05:37.903624+0000","last_clean":"2023-10-08T13:05:37.903624+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:05:37.903624+0000","last_undegraded":"2023-10-08T13:05:37.903624+0000","last_fullsized":"2023-10-08T13:05:37.903624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896284+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:05:37.896284+0000","last_peered":"2023-10-08T13:05:37.896284+0000","last_clean":"2023-10-08T13:05:37.896284+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:05:37.896284+0000","last_undegraded":"2023-10-08T13:05:37.896284+0000","last_fullsized":"2023-10-08T13:05:37.896284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.915250+0000","last_change":"2023-10-08T13:05:38.915250+0000","last_active":"2023-10-08T13:05:38.915250+0000","last_peered":"2023-10-08T13:05:38.915250+0000","last_clean":"2023-10-08T13:05:38.915250+0000","last_became_active":"2023-10-08T13:05:38.906992+0000","last_became_peered":"2023-10-08T13:05:38.906992+0000","last_unstale":"2023-10-08T13:05:38.915250+0000","last_undegraded":"2023-10-08T13:05:38.915250+0000","last_fullsized":"2023-10-08T13:05:38.915250+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:54:53.798551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476385+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:05:38.476385+0000","last_peered":"2023-10-08T13:05:38.476385+0000","last_clean":"2023-10-08T13:05:38.476385+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:05:38.476385+0000","last_undegraded":"2023-10-08T13:05:38.476385+0000","last_fullsized":"2023-10-08T13:05:38.476385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908045+0000","last_change":"2023-10-08T13:04:38.220707+0000","last_active":"2023-10-08T13:05:37.908045+0000","last_peered":"2023-10-08T13:05:37.908045+0000","last_clean":"2023-10-08T13:05:37.908045+0000","last_became_active":"2023-10-08T13:04:38.215253+0000","last_became_peered":"2023-10-08T13:04:38.215253+0000","last_unstale":"2023-10-08T13:05:37.908045+0000","last_undegraded":"2023-10-08T13:05:37.908045+0000","last_fullsized":"2023-10-08T13:05:37.908045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:15.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906126+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:05:37.906126+0000","last_peered":"2023-10-08T13:05:37.906126+0000","last_clean":"2023-10-08T13:05:37.906126+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:05:37.906126+0000","last_undegraded":"2023-10-08T13:05:37.906126+0000","last_fullsized":"2023-10-08T13:05:37.906126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903154+0000","last_change":"2023-10-08T13:04:38.214872+0000","last_active":"2023-10-08T13:05:37.903154+0000","last_peered":"2023-10-08T13:05:37.903154+0000","last_clean":"2023-10-08T13:05:37.903154+0000","last_became_active":"2023-10-08T13:04:38.214480+0000","last_became_peered":"2023-10-08T13:04:38.214480+0000","last_unstale":"2023-10-08T13:05:37.903154+0000","last_undegraded":"2023-10-08T13:05:37.903154+0000","last_fullsized":"2023-10-08T13:05:37.903154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:05.108568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896367+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:05:37.896367+0000","last_peered":"2023-10-08T13:05:37.896367+0000","last_clean":"2023-10-08T13:05:37.896367+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:05:37.896367+0000","last_undegraded":"2023-10-08T13:05:37.896367+0000","last_fullsized":"2023-10-08T13:05:37.896367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":234,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.932082+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:05:56.932082+0000","last_peered":"2023-10-08T13:05:56.932082+0000","last_clean":"2023-10-08T13:05:56.932082+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:05:56.932082+0000","last_undegraded":"2023-10-08T13:05:56.932082+0000","last_fullsized":"2023-10-08T13:05:56.932082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":145,"num_write":40,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901149+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:05:37.901149+0000","last_peered":"2023-10-08T13:05:37.901149+0000","last_clean":"2023-10-08T13:05:37.901149+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:05:37.901149+0000","last_undegraded":"2023-10-08T13:05:37.901149+0000","last_fullsized":"2023-10-08T13:05:37.901149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906509+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:05:37.906509+0000","last_peered":"2023-10-08T13:05:37.906509+0000","last_clean":"2023-10-08T13:05:37.906509+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:05:37.906509+0000","last_undegraded":"2023-10-08T13:05:37.906509+0000","last_fullsized":"2023-10-08T13:05:37.906509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899085+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:05:37.899085+0000","last_peered":"2023-10-08T13:05:37.899085+0000","last_clean":"2023-10-08T13:05:37.899085+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:05:37.899085+0000","last_undegraded":"2023-10-08T13:05:37.899085+0000","last_fullsized":"2023-10-08T13:05:37.899085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252481+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:05:38.252481+0000","last_peered":"2023-10-08T13:05:38.252481+0000","last_clean":"2023-10-08T13:05:38.252481+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:05:38.252481+0000","last_undegraded":"2023-10-08T13:05:38.252481+0000","last_fullsized":"2023-10-08T13:05:38.252481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899743+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:05:37.899743+0000","last_peered":"2023-10-08T13:05:37.899743+0000","last_clean":"2023-10-08T13:05:37.899743+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:05:37.899743+0000","last_undegraded":"2023-10-08T13:05:37.899743+0000","last_fullsized":"2023-10-08T13:05:37.899743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907936+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:05:37.907936+0000","last_peered":"2023-10-08T13:05:37.907936+0000","last_clean":"2023-10-08T13:05:37.907936+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:05:37.907936+0000","last_undegraded":"2023-10-08T13:05:37.907936+0000","last_fullsized":"2023-10-08T13:05:37.907936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908912+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:05:37.908912+0000","last_peered":"2023-10-08T13:05:37.908912+0000","last_clean":"2023-10-08T13:05:37.908912+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:05:37.908912+0000","last_undegraded":"2023-10-08T13:05:37.908912+0000","last_fullsized":"2023-10-08T13:05:37.908912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896715+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:05:37.896715+0000","last_peered":"2023-10-08T13:05:37.896715+0000","last_clean":"2023-10-08T13:05:37.896715+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:05:37.896715+0000","last_undegraded":"2023-10-08T13:05:37.896715+0000","last_fullsized":"2023-10-08T13:05:37.896715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'7","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:58.278385+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:05:58.278385+0000","last_peered":"2023-10-08T13:05:58.278385+0000","last_clean":"2023-10-08T13:05:58.278385+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:05:58.278385+0000","last_undegraded":"2023-10-08T13:05:58.278385+0000","last_fullsized":"2023-10-08T13:05:58.278385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897800+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:05:37.897800+0000","last_peered":"2023-10-08T13:05:37.897800+0000","last_clean":"2023-10-08T13:05:37.897800+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:05:37.897800+0000","last_undegraded":"2023-10-08T13:05:37.897800+0000","last_fullsized":"2023-10-08T13:05:37.897800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252637+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:05:38.252637+0000","last_peered":"2023-10-08T13:05:38.252637+0000","last_clean":"2023-10-08T13:05:38.252637+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:05:38.252637+0000","last_undegraded":"2023-10-08T13:05:38.252637+0000","last_fullsized":"2023-10-08T13:05:38.252637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899678+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:05:37.899678+0000","last_peered":"2023-10-08T13:05:37.899678+0000","last_clean":"2023-10-08T13:05:37.899678+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:05:37.899678+0000","last_undegraded":"2023-10-08T13:05:37.899678+0000","last_fullsized":"2023-10-08T13:05:37.899678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896291+0000","last_change":"2023-10-08T13:04:38.213542+0000","last_active":"2023-10-08T13:05:37.896291+0000","last_peered":"2023-10-08T13:05:37.896291+0000","last_clean":"2023-10-08T13:05:37.896291+0000","last_became_active":"2023-10-08T13:04:38.213218+0000","last_became_peered":"2023-10-08T13:04:38.213218+0000","last_unstale":"2023-10-08T13:05:37.896291+0000","last_undegraded":"2023-10-08T13:05:37.896291+0000","last_fullsized":"2023-10-08T13:05:37.896291+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:51.125175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906002+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:05:37.906002+0000","last_peered":"2023-10-08T13:05:37.906002+0000","last_clean":"2023-10-08T13:05:37.906002+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:05:37.906002+0000","last_undegraded":"2023-10-08T13:05:37.906002+0000","last_fullsized":"2023-10-08T13:05:37.906002+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.912207+0000","last_change":"2023-10-08T13:05:38.912207+0000","last_active":"2023-10-08T13:05:38.912207+0000","last_peered":"2023-10-08T13:05:38.912207+0000","last_clean":"2023-10-08T13:05:38.912207+0000","last_became_active":"2023-10-08T13:05:38.907286+0000","last_became_peered":"2023-10-08T13:05:38.907286+0000","last_unstale":"2023-10-08T13:05:38.912207+0000","last_undegraded":"2023-10-08T13:05:38.912207+0000","last_fullsized":"2023-10-08T13:05:38.912207+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:18.606537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900044+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:05:37.900044+0000","last_peered":"2023-10-08T13:05:37.900044+0000","last_clean":"2023-10-08T13:05:37.900044+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:05:37.900044+0000","last_undegraded":"2023-10-08T13:05:37.900044+0000","last_fullsized":"2023-10-08T13:05:37.900044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900177+0000","last_change":"2023-10-08T13:04:38.215172+0000","last_active":"2023-10-08T13:05:37.900177+0000","last_peered":"2023-10-08T13:05:37.900177+0000","last_clean":"2023-10-08T13:05:37.900177+0000","last_became_active":"2023-10-08T13:04:38.214666+0000","last_became_peered":"2023-10-08T13:04:38.214666+0000","last_unstale":"2023-10-08T13:05:37.900177+0000","last_undegraded":"2023-10-08T13:05:37.900177+0000","last_fullsized":"2023-10-08T13:05:37.900177+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:45.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896579+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:05:37.896579+0000","last_peered":"2023-10-08T13:05:37.896579+0000","last_clean":"2023-10-08T13:05:37.896579+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:05:37.896579+0000","last_undegraded":"2023-10-08T13:05:37.896579+0000","last_fullsized":"2023-10-08T13:05:37.896579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253485+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:05:38.253485+0000","last_peered":"2023-10-08T13:05:38.253485+0000","last_clean":"2023-10-08T13:05:38.253485+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:05:38.253485+0000","last_undegraded":"2023-10-08T13:05:38.253485+0000","last_fullsized":"2023-10-08T13:05:38.253485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252686+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:05:38.252686+0000","last_peered":"2023-10-08T13:05:38.252686+0000","last_clean":"2023-10-08T13:05:38.252686+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:05:38.252686+0000","last_undegraded":"2023-10-08T13:05:38.252686+0000","last_fullsized":"2023-10-08T13:05:38.252686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'7","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:57.276797+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:05:57.276797+0000","last_peered":"2023-10-08T13:05:57.276797+0000","last_clean":"2023-10-08T13:05:57.276797+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:05:57.276797+0000","last_undegraded":"2023-10-08T13:05:57.276797+0000","last_fullsized":"2023-10-08T13:05:57.276797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":87,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253216+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:05:38.253216+0000","last_peered":"2023-10-08T13:05:38.253216+0000","last_clean":"2023-10-08T13:05:38.253216+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:05:38.253216+0000","last_undegraded":"2023-10-08T13:05:38.253216+0000","last_fullsized":"2023-10-08T13:05:38.253216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252605+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:05:38.252605+0000","last_peered":"2023-10-08T13:05:38.252605+0000","last_clean":"2023-10-08T13:05:38.252605+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:05:38.252605+0000","last_undegraded":"2023-10-08T13:05:38.252605+0000","last_fullsized":"2023-10-08T13:05:38.252605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907529+0000","last_change":"2023-10-08T13:04:38.213418+0000","last_active":"2023-10-08T13:05:37.907529+0000","last_peered":"2023-10-08T13:05:37.907529+0000","last_clean":"2023-10-08T13:05:37.907529+0000","last_became_active":"2023-10-08T13:04:38.213000+0000","last_became_peered":"2023-10-08T13:04:38.213000+0000","last_unstale":"2023-10-08T13:05:37.907529+0000","last_undegraded":"2023-10-08T13:05:37.907529+0000","last_fullsized":"2023-10-08T13:05:37.907529+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:20.821412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.275275+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:05:56.275275+0000","last_peered":"2023-10-08T13:05:56.275275+0000","last_clean":"2023-10-08T13:05:56.275275+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:05:56.275275+0000","last_undegraded":"2023-10-08T13:05:56.275275+0000","last_fullsized":"2023-10-08T13:05:56.275275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898219+0000","last_change":"2023-10-08T13:04:38.218150+0000","last_active":"2023-10-08T13:05:37.898219+0000","last_peered":"2023-10-08T13:05:37.898219+0000","last_clean":"2023-10-08T13:05:37.898219+0000","last_became_active":"2023-10-08T13:04:38.210481+0000","last_became_peered":"2023-10-08T13:04:38.210481+0000","last_unstale":"2023-10-08T13:05:37.898219+0000","last_undegraded":"2023-10-08T13:05:37.898219+0000","last_fullsized":"2023-10-08T13:05:37.898219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:42.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899075+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:05:37.899075+0000","last_peered":"2023-10-08T13:05:37.899075+0000","last_clean":"2023-10-08T13:05:37.899075+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:05:37.899075+0000","last_undegraded":"2023-10-08T13:05:37.899075+0000","last_fullsized":"2023-10-08T13:05:37.899075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907817+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:05:37.907817+0000","last_peered":"2023-10-08T13:05:37.907817+0000","last_clean":"2023-10-08T13:05:37.907817+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:05:37.907817+0000","last_undegraded":"2023-10-08T13:05:37.907817+0000","last_fullsized":"2023-10-08T13:05:37.907817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":325,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897664+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:05:37.897664+0000","last_peered":"2023-10-08T13:05:37.897664+0000","last_clean":"2023-10-08T13:05:37.897664+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:05:37.897664+0000","last_undegraded":"2023-10-08T13:05:37.897664+0000","last_fullsized":"2023-10-08T13:05:37.897664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906676+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:05:37.906676+0000","last_peered":"2023-10-08T13:05:37.906676+0000","last_clean":"2023-10-08T13:05:37.906676+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:05:37.906676+0000","last_undegraded":"2023-10-08T13:05:37.906676+0000","last_fullsized":"2023-10-08T13:05:37.906676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252246+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:05:38.252246+0000","last_peered":"2023-10-08T13:05:38.252246+0000","last_clean":"2023-10-08T13:05:38.252246+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:05:38.252246+0000","last_undegraded":"2023-10-08T13:05:38.252246+0000","last_fullsized":"2023-10-08T13:05:38.252246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897795+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:05:37.897795+0000","last_peered":"2023-10-08T13:05:37.897795+0000","last_clean":"2023-10-08T13:05:37.897795+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:05:37.897795+0000","last_undegraded":"2023-10-08T13:05:37.897795+0000","last_fullsized":"2023-10-08T13:05:37.897795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899769+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:05:37.899769+0000","last_peered":"2023-10-08T13:05:37.899769+0000","last_clean":"2023-10-08T13:05:37.899769+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:05:37.899769+0000","last_undegraded":"2023-10-08T13:05:37.899769+0000","last_fullsized":"2023-10-08T13:05:37.899769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901058+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:05:37.901058+0000","last_peered":"2023-10-08T13:05:37.901058+0000","last_clean":"2023-10-08T13:05:37.901058+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:05:37.901058+0000","last_undegraded":"2023-10-08T13:05:37.901058+0000","last_fullsized":"2023-10-08T13:05:37.901058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252656+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:05:38.252656+0000","last_peered":"2023-10-08T13:05:38.252656+0000","last_clean":"2023-10-08T13:05:38.252656+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:05:38.252656+0000","last_undegraded":"2023-10-08T13:05:38.252656+0000","last_fullsized":"2023-10-08T13:05:38.252656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898746+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:05:37.898746+0000","last_peered":"2023-10-08T13:05:37.898746+0000","last_clean":"2023-10-08T13:05:37.898746+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:05:37.898746+0000","last_undegraded":"2023-10-08T13:05:37.898746+0000","last_fullsized":"2023-10-08T13:05:37.898746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.911816+0000","last_change":"2023-10-08T13:05:38.911816+0000","last_active":"2023-10-08T13:05:38.911816+0000","last_peered":"2023-10-08T13:05:38.911816+0000","last_clean":"2023-10-08T13:05:38.911816+0000","last_became_active":"2023-10-08T13:05:38.904337+0000","last_became_peered":"2023-10-08T13:05:38.904337+0000","last_unstale":"2023-10-08T13:05:38.911816+0000","last_undegraded":"2023-10-08T13:05:38.911816+0000","last_fullsized":"2023-10-08T13:05:38.911816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:26.645712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899892+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:05:37.899892+0000","last_peered":"2023-10-08T13:05:37.899892+0000","last_clean":"2023-10-08T13:05:37.899892+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:05:37.899892+0000","last_undegraded":"2023-10-08T13:05:37.899892+0000","last_fullsized":"2023-10-08T13:05:37.899892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897964+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:05:37.897964+0000","last_peered":"2023-10-08T13:05:37.897964+0000","last_clean":"2023-10-08T13:05:37.897964+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:05:37.897964+0000","last_undegraded":"2023-10-08T13:05:37.897964+0000","last_fullsized":"2023-10-08T13:05:37.897964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908096+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:05:37.908096+0000","last_peered":"2023-10-08T13:05:37.908096+0000","last_clean":"2023-10-08T13:05:37.908096+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:05:37.908096+0000","last_undegraded":"2023-10-08T13:05:37.908096+0000","last_fullsized":"2023-10-08T13:05:37.908096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476501+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:05:38.476501+0000","last_peered":"2023-10-08T13:05:38.476501+0000","last_clean":"2023-10-08T13:05:38.476501+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:05:38.476501+0000","last_undegraded":"2023-10-08T13:05:38.476501+0000","last_fullsized":"2023-10-08T13:05:38.476501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907477+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:05:37.907477+0000","last_peered":"2023-10-08T13:05:37.907477+0000","last_clean":"2023-10-08T13:05:37.907477+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:05:37.907477+0000","last_undegraded":"2023-10-08T13:05:37.907477+0000","last_fullsized":"2023-10-08T13:05:37.907477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900849+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:05:37.900849+0000","last_peered":"2023-10-08T13:05:37.900849+0000","last_clean":"2023-10-08T13:05:37.900849+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:05:37.900849+0000","last_undegraded":"2023-10-08T13:05:37.900849+0000","last_fullsized":"2023-10-08T13:05:37.900849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899579+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:05:37.899579+0000","last_peered":"2023-10-08T13:05:37.899579+0000","last_clean":"2023-10-08T13:05:37.899579+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:05:37.899579+0000","last_undegraded":"2023-10-08T13:05:37.899579+0000","last_fullsized":"2023-10-08T13:05:37.899579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896881+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:05:37.896881+0000","last_peered":"2023-10-08T13:05:37.896881+0000","last_clean":"2023-10-08T13:05:37.896881+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:05:37.896881+0000","last_undegraded":"2023-10-08T13:05:37.896881+0000","last_fullsized":"2023-10-08T13:05:37.896881+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898821+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:05:37.898821+0000","last_peered":"2023-10-08T13:05:37.898821+0000","last_clean":"2023-10-08T13:05:37.898821+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:05:37.898821+0000","last_undegraded":"2023-10-08T13:05:37.898821+0000","last_fullsized":"2023-10-08T13:05:37.898821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899446+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:05:37.899446+0000","last_peered":"2023-10-08T13:05:37.899446+0000","last_clean":"2023-10-08T13:05:37.899446+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:05:37.899446+0000","last_undegraded":"2023-10-08T13:05:37.899446+0000","last_fullsized":"2023-10-08T13:05:37.899446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907324+0000","last_change":"2023-10-08T13:04:38.213883+0000","last_active":"2023-10-08T13:05:37.907324+0000","last_peered":"2023-10-08T13:05:37.907324+0000","last_clean":"2023-10-08T13:05:37.907324+0000","last_became_active":"2023-10-08T13:04:38.212887+0000","last_became_peered":"2023-10-08T13:04:38.212887+0000","last_unstale":"2023-10-08T13:05:37.907324+0000","last_undegraded":"2023-10-08T13:05:37.907324+0000","last_fullsized":"2023-10-08T13:05:37.907324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:14.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.902351+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:05:38.902351+0000","last_peered":"2023-10-08T13:05:38.902351+0000","last_clean":"2023-10-08T13:05:38.902351+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:05:38.902351+0000","last_undegraded":"2023-10-08T13:05:38.902351+0000","last_fullsized":"2023-10-08T13:05:38.902351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899561+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:05:37.899561+0000","last_peered":"2023-10-08T13:05:37.899561+0000","last_clean":"2023-10-08T13:05:37.899561+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:05:37.899561+0000","last_undegraded":"2023-10-08T13:05:37.899561+0000","last_fullsized":"2023-10-08T13:05:37.899561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907877+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:05:37.907877+0000","last_peered":"2023-10-08T13:05:37.907877+0000","last_clean":"2023-10-08T13:05:37.907877+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:05:37.907877+0000","last_undegraded":"2023-10-08T13:05:37.907877+0000","last_fullsized":"2023-10-08T13:05:37.907877+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900486+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:05:37.900486+0000","last_peered":"2023-10-08T13:05:37.900486+0000","last_clean":"2023-10-08T13:05:37.900486+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:05:37.900486+0000","last_undegraded":"2023-10-08T13:05:37.900486+0000","last_fullsized":"2023-10-08T13:05:37.900486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897912+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:05:37.897912+0000","last_peered":"2023-10-08T13:05:37.897912+0000","last_clean":"2023-10-08T13:05:37.897912+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:05:37.897912+0000","last_undegraded":"2023-10-08T13:05:37.897912+0000","last_fullsized":"2023-10-08T13:05:37.897912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901970+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:05:37.901970+0000","last_peered":"2023-10-08T13:05:37.901970+0000","last_clean":"2023-10-08T13:05:37.901970+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:05:37.901970+0000","last_undegraded":"2023-10-08T13:05:37.901970+0000","last_fullsized":"2023-10-08T13:05:37.901970+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'8","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:59.296360+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:05:59.296360+0000","last_peered":"2023-10-08T13:05:59.296360+0000","last_clean":"2023-10-08T13:05:59.296360+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:05:59.296360+0000","last_undegraded":"2023-10-08T13:05:59.296360+0000","last_fullsized":"2023-10-08T13:05:59.296360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2019,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898498+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:05:37.898498+0000","last_peered":"2023-10-08T13:05:37.898498+0000","last_clean":"2023-10-08T13:05:37.898498+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:05:37.898498+0000","last_undegraded":"2023-10-08T13:05:37.898498+0000","last_fullsized":"2023-10-08T13:05:37.898498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476182+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:05:38.476182+0000","last_peered":"2023-10-08T13:05:38.476182+0000","last_clean":"2023-10-08T13:05:38.476182+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:05:38.476182+0000","last_undegraded":"2023-10-08T13:05:38.476182+0000","last_fullsized":"2023-10-08T13:05:38.476182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906326+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:05:37.906326+0000","last_peered":"2023-10-08T13:05:37.906326+0000","last_clean":"2023-10-08T13:05:37.906326+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:05:37.906326+0000","last_undegraded":"2023-10-08T13:05:37.906326+0000","last_fullsized":"2023-10-08T13:05:37.906326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898116+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:05:37.898116+0000","last_peered":"2023-10-08T13:05:37.898116+0000","last_clean":"2023-10-08T13:05:37.898116+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:05:37.898116+0000","last_undegraded":"2023-10-08T13:05:37.898116+0000","last_fullsized":"2023-10-08T13:05:37.898116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.904627+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:05:37.904627+0000","last_peered":"2023-10-08T13:05:37.904627+0000","last_clean":"2023-10-08T13:05:37.904627+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:05:37.904627+0000","last_undegraded":"2023-10-08T13:05:37.904627+0000","last_fullsized":"2023-10-08T13:05:37.904627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252671+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:05:38.252671+0000","last_peered":"2023-10-08T13:05:38.252671+0000","last_clean":"2023-10-08T13:05:38.252671+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:05:38.252671+0000","last_undegraded":"2023-10-08T13:05:38.252671+0000","last_fullsized":"2023-10-08T13:05:38.252671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898426+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:05:37.898426+0000","last_peered":"2023-10-08T13:05:37.898426+0000","last_clean":"2023-10-08T13:05:37.898426+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:05:37.898426+0000","last_undegraded":"2023-10-08T13:05:37.898426+0000","last_fullsized":"2023-10-08T13:05:37.898426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899508+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:05:37.899508+0000","last_peered":"2023-10-08T13:05:37.899508+0000","last_clean":"2023-10-08T13:05:37.899508+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:05:37.899508+0000","last_undegraded":"2023-10-08T13:05:37.899508+0000","last_fullsized":"2023-10-08T13:05:37.899508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898361+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:05:37.898361+0000","last_peered":"2023-10-08T13:05:37.898361+0000","last_clean":"2023-10-08T13:05:37.898361+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:05:37.898361+0000","last_undegraded":"2023-10-08T13:05:37.898361+0000","last_fullsized":"2023-10-08T13:05:37.898361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898299+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:05:37.898299+0000","last_peered":"2023-10-08T13:05:37.898299+0000","last_clean":"2023-10-08T13:05:37.898299+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:05:37.898299+0000","last_undegraded":"2023-10-08T13:05:37.898299+0000","last_fullsized":"2023-10-08T13:05:37.898299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476442+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:05:38.476442+0000","last_peered":"2023-10-08T13:05:38.476442+0000","last_clean":"2023-10-08T13:05:38.476442+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:05:38.476442+0000","last_undegraded":"2023-10-08T13:05:38.476442+0000","last_fullsized":"2023-10-08T13:05:38.476442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252558+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:05:38.252558+0000","last_peered":"2023-10-08T13:05:38.252558+0000","last_clean":"2023-10-08T13:05:38.252558+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:05:38.252558+0000","last_undegraded":"2023-10-08T13:05:38.252558+0000","last_fullsized":"2023-10-08T13:05:38.252558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900173+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:05:37.900173+0000","last_peered":"2023-10-08T13:05:37.900173+0000","last_clean":"2023-10-08T13:05:37.900173+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:05:37.900173+0000","last_undegraded":"2023-10-08T13:05:37.900173+0000","last_fullsized":"2023-10-08T13:05:37.900173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898897+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:05:37.898897+0000","last_peered":"2023-10-08T13:05:37.898897+0000","last_clean":"2023-10-08T13:05:37.898897+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:05:37.898897+0000","last_undegraded":"2023-10-08T13:05:37.898897+0000","last_fullsized":"2023-10-08T13:05:37.898897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900027+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:05:37.900027+0000","last_peered":"2023-10-08T13:05:37.900027+0000","last_clean":"2023-10-08T13:05:37.900027+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:05:37.900027+0000","last_undegraded":"2023-10-08T13:05:37.900027+0000","last_fullsized":"2023-10-08T13:05:37.900027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907520+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:05:37.907520+0000","last_peered":"2023-10-08T13:05:37.907520+0000","last_clean":"2023-10-08T13:05:37.907520+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:05:37.907520+0000","last_undegraded":"2023-10-08T13:05:37.907520+0000","last_fullsized":"2023-10-08T13:05:37.907520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896505+0000","last_change":"2023-10-08T13:04:38.213278+0000","last_active":"2023-10-08T13:05:37.896505+0000","last_peered":"2023-10-08T13:05:37.896505+0000","last_clean":"2023-10-08T13:05:37.896505+0000","last_became_active":"2023-10-08T13:04:38.213016+0000","last_became_peered":"2023-10-08T13:04:38.213016+0000","last_unstale":"2023-10-08T13:05:37.896505+0000","last_undegraded":"2023-10-08T13:05:37.896505+0000","last_fullsized":"2023-10-08T13:05:37.896505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:49.650606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.902188+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:05:37.902188+0000","last_peered":"2023-10-08T13:05:37.902188+0000","last_clean":"2023-10-08T13:05:37.902188+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:05:37.902188+0000","last_undegraded":"2023-10-08T13:05:37.902188+0000","last_fullsized":"2023-10-08T13:05:37.902188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252491+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:05:38.252491+0000","last_peered":"2023-10-08T13:05:38.252491+0000","last_clean":"2023-10-08T13:05:38.252491+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:05:38.252491+0000","last_undegraded":"2023-10-08T13:05:38.252491+0000","last_fullsized":"2023-10-08T13:05:38.252491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900063+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:05:37.900063+0000","last_peered":"2023-10-08T13:05:37.900063+0000","last_clean":"2023-10-08T13:05:37.900063+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:05:37.900063+0000","last_undegraded":"2023-10-08T13:05:37.900063+0000","last_fullsized":"2023-10-08T13:05:37.900063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67391,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":886,"num_read_kb":512,"num_write":252,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":644,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":210813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":525237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53100000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.45600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":1.165,"15min":1.165},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.40400000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88600000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.57299999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.747,"15min":0.73399999999999999},"min":{"1min":0.68700000000000006,"5min":0.439,"15min":0.439},"max":{"1min":0.97599999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.997,"5min":1.419,"15min":1.419},"last":0.83299999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.77000000000000002,"15min":0.754},"min":{"1min":0.626,"5min":0.44,"15min":0.44},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.76900000000000002},"min":{"1min":0.65700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.048,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82199999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.66500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78700000000000003,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.78700000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678053,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1170771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.503},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":1.456,"15min":1.456},"last":0.38600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.383,"15min":1.383},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93400000000000005,"5min":1.085,"15min":1.085},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":1.337,"15min":1.337},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78200000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.88700000000000001},"min":{"1min":0.66900000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98899999999999999,"5min":1.637,"15min":1.637},"last":0.57799999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.89100000000000001},"min":{"1min":0.68999999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1459999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.627,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.748,"15min":1.748},"last":0.59999999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.0780000000000003,"5min":6.0780000000000003,"15min":6.0780000000000003},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":0.96499999999999997,"15min":0.91500000000000004},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":6.1289999999999996,"5min":6.1289999999999996,"15min":6.1289999999999996},"last":0.90900000000000003}]}]},{"osd":9,"up_from":66,"seq":283467841578,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":524296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56000000000000005,"5min":0.625,"15min":0.625},"last":0.378},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.44400000000000001,"15min":0.46400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57499999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.875,"15min":0.875},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.64500000000000002},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.502}]},{"osd":3,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52900000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.56399999999999995,"15min":0.60399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63500000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.84299999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80600000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90500000000000003,"5min":1.123,"15min":1.123},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.85599999999999998,"5min":1.109,"15min":1.109},"last":0.624}]},{"osd":10,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.871,"5min":1.095,"15min":1.095},"last":0.73599999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65600000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103215,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":528417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90400000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.626,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0489999999999999,"5min":1.127,"15min":1.127},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.878}]},{"osd":5,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83299999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.0369999999999999,"5min":1.127,"15min":1.127},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":1.048,"15min":1.048},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92900000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68999999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83799999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.755,"15min":0.746},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77900000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.64500000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.745},{"interface":"front","average":{"1min":0.88,"5min":0.77500000000000002,"15min":0.75700000000000001},"min":{"1min":0.69799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0189999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.90200000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.624},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85299999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1658880,"data_stored":1117473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.502},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.623},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84599999999999997,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.66200000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.748},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0049999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.747}]},{"osd":8,"last update":"Sun Oct 8 13:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.67000000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.23,"15min":1.23},"last":1.101},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.72899999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.82199999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.74199999999999999,"15min":0.73299999999999998},"min":{"1min":0.54500000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.103,"5min":1.266,"15min":1.266},"last":0.97299999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.90000000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.222},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.329}]}]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":520331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"min":{"1min":0.32600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.32100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76700000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80500000000000005,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.54000000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61499999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.167,"15min":1.167},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88800000000000001,"5min":1.075,"15min":1.075},"last":0.61099999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82699999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.502,"5min":0.377,"15min":0.377},"max":{"1min":0.88200000000000001,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.02,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77000000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.89000000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.627}]},{"osd":9,"last update":"Sun Oct 8 13:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.496,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78200000000000003,"15min":0.80800000000000005},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":585137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.59599999999999997,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80600000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.59399999999999997,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.59799999999999998,"15min":0.53300000000000003},"min":{"1min":0.501,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.93300000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.62,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63300000000000001,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.83199999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71499999999999997,"15min":0.66900000000000004},"min":{"1min":0.54900000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.98399999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.628,"15min":0.58199999999999996},"min":{"1min":0.53400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69199999999999995,"15min":0.64500000000000002},"min":{"1min":0.54300000000000004,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.083,"5min":1.173,"15min":1.173},"last":0.95599999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.61199999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.1499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.91600000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.81599999999999995,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0669999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.097,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.871},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.875,"15min":0.87},"min":{"1min":0.67800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.748}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0369999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":522105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":1.278,"15min":1.278},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.39900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70999999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.56499999999999995},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59099999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.316}]},{"osd":4,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88500000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.753,"5min":1.387,"15min":1.387},"last":0.53400000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.745,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71599999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69799999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":1.01,"15min":1.01},"last":0.34899999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68999999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.47499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55500000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.628},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77000000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.40200000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90800000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.095,"15min":1.095},"last":0.72699999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.57299999999999995}]}]},{"osd":2,"up_from":19,"seq":81604378696,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":588751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70899999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.434,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.70999999999999996,"5min":1.353,"15min":1.353},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.59499999999999997,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.89700000000000002,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.504,"5min":0.246,"15min":0.246},"max":{"1min":0.93300000000000005,"5min":1.248,"15min":1.248},"last":0.82999999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.89500000000000002,"5min":1.375,"15min":1.375},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.39800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85699999999999998,"5min":1.72,"15min":1.72},"last":0.62},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.54100000000000004,"15min":0.49099999999999999},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91400000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.624,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.91300000000000003,"5min":1.135,"15min":1.135},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.93300000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:05:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0009999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.63,"15min":0.59399999999999997},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.95899999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71499999999999997},"min":{"1min":0.63200000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96399999999999997,"5min":1.169,"15min":1.169},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98999999999999999,"5min":1.397,"15min":1.397},"last":0.878}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.054,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.073,"5min":1.296,"15min":1.296},"last":1.016}]},{"osd":11,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.999}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":519508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.42699999999999999,"15min":0.371},"min":{"1min":0.313,"5min":0.222,"15min":0.222},"max":{"1min":3.96,"5min":3.96,"15min":3.96},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.35299999999999998},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.46600000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.622},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59499999999999997,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.81899999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.84199999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.754}]},{"osd":6,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80000000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.76400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93700000000000006,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.74099999999999999},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89000000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72999999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.085,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64600000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.86199999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":524405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.747}]},{"osd":3,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61699999999999999,"15min":0.58499999999999996},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.437}]},{"osd":5,"last update":"Sun Oct 8 13:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70999999999999996,"15min":0.68799999999999994},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.871}]},{"osd":6,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.67300000000000004},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94899999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68899999999999995,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.044,"15min":1.044},"last":0.72799999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92100000000000004,"5min":1.075,"15min":1.075},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.68899999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0229999999999999,"5min":1.071,"15min":1.071},"last":0.83499999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83099999999999996,"15min":0.83199999999999996},"min":{"1min":0.69599999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98999999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.623}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.081,"5min":1.137,"15min":1.137},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70199999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.90200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1112266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.32400000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.5},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.7869999999999999,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.62,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.39100000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82199999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.36199999999999999},"min":{"1min":0.317,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68300000000000005,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.52200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.437},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69599999999999995,"5min":2.085,"15min":2.085},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.56299999999999994},"min":{"1min":0.47199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":1.962,"15min":1.962},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83999999999999997,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61299999999999999,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90900000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93400000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88500000000000001,"5min":2.113,"15min":2.113},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97499999999999998,"5min":2.198,"15min":2.198},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66500000000000004,"15min":0.67900000000000005},"min":{"1min":0.44900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89800000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.67000000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.56799999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92900000000000005,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0569999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.72399999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":1.99,"15min":1.99},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:06:01.935 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-08T13:06:01.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:06:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 -- 172.21.15.5:0/3755788795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41008b0 msgr2=0x7f21d41041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 --2- 172.21.15.5:0/3755788795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41008b0 0x7f21d41041e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21d00099c0 tx=0x7f21d0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 -- 172.21.15.5:0/3755788795 shutdown_connections 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 --2- 172.21.15.5:0/3755788795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 0x7f21d410c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 --2- 172.21.15.5:0/3755788795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40fff00 0x7f21d41002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 --2- 172.21.15.5:0/3755788795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41008b0 0x7f21d41041e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 -- 172.21.15.5:0/3755788795 >> 172.21.15.5:0/3755788795 conn(0x7f21d4075b40 msgr2=0x7f21d40fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 -- 172.21.15.5:0/3755788795 shutdown_connections 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.088+0000 7f21db58d700 1 -- 172.21.15.5:0/3755788795 wait complete. 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 Processor -- start 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 -- start start 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40fff00 0x7f21d4195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 0x7f21d4195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 0x7f21d41a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41a52f0 con 0x7f21d41961b0 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41a5430 con 0x7f21d40fff00 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21db58d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41a55a0 con 0x7f21d4104910 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 0x7f21d41a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 0x7f21d41a4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34560/0 (socket says 172.21.15.5:34560) 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 -- 172.21.15.5:0/2214613905 learned_addr learned my addr 172.21.15.5:0/2214613905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9329700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40fff00 0x7f21d4195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d8b28700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 0x7f21d4195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 -- 172.21.15.5:0/2214613905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 msgr2=0x7f21d4195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 0x7f21d4195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 -- 172.21.15.5:0/2214613905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40fff00 msgr2=0x7f21d4195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40fff00 0x7f21d4195730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d9b2a700 1 -- 172.21.15.5:0/2214613905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00095f0 con 0x7f21d41961b0 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.089+0000 7f21d8b28700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 0x7f21d4195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.090+0000 7f21d9b2a700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 0x7f21d41a4db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00ef30 tx=0x7f21cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.090+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc018070 con 0x7f21d41961b0 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.090+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21cc00f040 con 0x7f21d41961b0 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.090+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d41a5820 con 0x7f21d41961b0 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.090+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00cdb0 con 0x7f21d41961b0 2023-10-08T13:06:02.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.090+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d41a5ce0 con 0x7f21d41961b0 2023-10-08T13:06:02.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.091+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4107b70 con 0x7f21d41961b0 2023-10-08T13:06:02.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.092+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f21cc003a00 con 0x7f21d41961b0 2023-10-08T13:06:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.092+0000 7f21ca7fc700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f21c00a14d0 0x7f21c00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.093+0000 7f21d9329700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f21c00a14d0 0x7f21c00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.093+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f21cc0ccd80 con 0x7f21d41961b0 2023-10-08T13:06:02.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.093+0000 7f21d9329700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f21c00a14d0 0x7f21c00a3990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007c60 tx=0x7f21c40073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:02.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.097+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f21cc096010 con 0x7f21d41961b0 2023-10-08T13:06:02.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.298+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21d410f510 con 0x7f21c00a14d0 2023-10-08T13:06:02.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.313+0000 7f21ca7fc700 1 -- 172.21.15.5:0/2214613905 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426753 (secure 0 0 0) 0x7f21d410f510 con 0x7f21c00a14d0 2023-10-08T13:06:02.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:02.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f21c00a14d0 msgr2=0x7f21c00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f21c00a14d0 0x7f21c00a3990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007c60 tx=0x7f21c40073d0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 msgr2=0x7f21d41a4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 0x7f21d41a4db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00ef30 tx=0x7f21cc00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 shutdown_connections 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f21c00a14d0 0x7f21c00a3990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d41961b0 0x7f21d41a4db0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d40fff00 0x7f21d4195730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 --2- 172.21.15.5:0/2214613905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21d4104910 0x7f21d4195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 >> 172.21.15.5:0/2214613905 conn(0x7f21d4075b40 msgr2=0x7f21d4102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 shutdown_connections 2023-10-08T13:06:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.317+0000 7f21db58d700 1 -- 172.21.15.5:0/2214613905 wait complete. 2023-10-08T13:06:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-10-08T13:06:02.331 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-10-08T13:06:01.115198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658005,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1022,"num_read_kb":631,"num_write":435,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1181626,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":361,"ondisk_log_size":361,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338668,"kb_used_data":14416,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603156,"statfs":{"total":1151940427776,"available":1151593631744,"internally_reserved":0,"allocated":14761984,"data_stored":8238697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":636,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":52,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900610+0000","last_change":"2023-10-08T13:04:10.755416+0000","last_active":"2023-10-08T13:05:37.900610+0000","last_peered":"2023-10-08T13:05:37.900610+0000","last_clean":"2023-10-08T13:05:37.900610+0000","last_became_active":"2023-10-08T13:04:10.755096+0000","last_became_peered":"2023-10-08T13:04:10.755096+0000","last_unstale":"2023-10-08T13:05:37.900610+0000","last_undegraded":"2023-10-08T13:05:37.900610+0000","last_fullsized":"2023-10-08T13:05:37.900610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:27.901390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476427+0000","last_change":"2023-10-08T13:04:10.757742+0000","last_active":"2023-10-08T13:05:38.476427+0000","last_peered":"2023-10-08T13:05:38.476427+0000","last_clean":"2023-10-08T13:05:38.476427+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:05:38.476427+0000","last_undegraded":"2023-10-08T13:05:38.476427+0000","last_fullsized":"2023-10-08T13:05:38.476427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:33.694190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476391+0000","last_change":"2023-10-08T13:04:10.762152+0000","last_active":"2023-10-08T13:05:38.476391+0000","last_peered":"2023-10-08T13:05:38.476391+0000","last_clean":"2023-10-08T13:05:38.476391+0000","last_became_active":"2023-10-08T13:04:10.761833+0000","last_became_peered":"2023-10-08T13:04:10.761833+0000","last_unstale":"2023-10-08T13:05:38.476391+0000","last_undegraded":"2023-10-08T13:05:38.476391+0000","last_fullsized":"2023-10-08T13:05:38.476391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:57.253051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907637+0000","last_change":"2023-10-08T13:04:10.750728+0000","last_active":"2023-10-08T13:05:37.907637+0000","last_peered":"2023-10-08T13:05:37.907637+0000","last_clean":"2023-10-08T13:05:37.907637+0000","last_became_active":"2023-10-08T13:04:10.750332+0000","last_became_peered":"2023-10-08T13:04:10.750332+0000","last_unstale":"2023-10-08T13:05:37.907637+0000","last_undegraded":"2023-10-08T13:05:37.907637+0000","last_fullsized":"2023-10-08T13:05:37.907637+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:56.677921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900586+0000","last_change":"2023-10-08T13:04:10.756996+0000","last_active":"2023-10-08T13:05:37.900586+0000","last_peered":"2023-10-08T13:05:37.900586+0000","last_clean":"2023-10-08T13:05:37.900586+0000","last_became_active":"2023-10-08T13:04:10.756778+0000","last_became_peered":"2023-10-08T13:04:10.756778+0000","last_unstale":"2023-10-08T13:05:37.900586+0000","last_undegraded":"2023-10-08T13:05:37.900586+0000","last_fullsized":"2023-10-08T13:05:37.900586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:04.728845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253010+0000","last_change":"2023-10-08T13:04:38.210845+0000","last_active":"2023-10-08T13:05:38.253010+0000","last_peered":"2023-10-08T13:05:38.253010+0000","last_clean":"2023-10-08T13:05:38.253010+0000","last_became_active":"2023-10-08T13:04:38.210454+0000","last_became_peered":"2023-10-08T13:04:38.210454+0000","last_unstale":"2023-10-08T13:05:38.253010+0000","last_undegraded":"2023-10-08T13:05:38.253010+0000","last_fullsized":"2023-10-08T13:05:38.253010+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:10.493230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897780+0000","last_change":"2023-10-08T13:04:10.764603+0000","last_active":"2023-10-08T13:05:37.897780+0000","last_peered":"2023-10-08T13:05:37.897780+0000","last_clean":"2023-10-08T13:05:37.897780+0000","last_became_active":"2023-10-08T13:04:10.762055+0000","last_became_peered":"2023-10-08T13:04:10.762055+0000","last_unstale":"2023-10-08T13:05:37.897780+0000","last_undegraded":"2023-10-08T13:05:37.897780+0000","last_fullsized":"2023-10-08T13:05:37.897780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:00.347169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898702+0000","last_change":"2023-10-08T13:04:10.759815+0000","last_active":"2023-10-08T13:05:37.898702+0000","last_peered":"2023-10-08T13:05:37.898702+0000","last_clean":"2023-10-08T13:05:37.898702+0000","last_became_active":"2023-10-08T13:04:10.759489+0000","last_became_peered":"2023-10-08T13:04:10.759489+0000","last_unstale":"2023-10-08T13:05:37.898702+0000","last_undegraded":"2023-10-08T13:05:37.898702+0000","last_fullsized":"2023-10-08T13:05:37.898702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:02.870001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903390+0000","last_change":"2023-10-08T13:04:10.750264+0000","last_active":"2023-10-08T13:05:37.903390+0000","last_peered":"2023-10-08T13:05:37.903390+0000","last_clean":"2023-10-08T13:05:37.903390+0000","last_became_active":"2023-10-08T13:04:10.749938+0000","last_became_peered":"2023-10-08T13:04:10.749938+0000","last_unstale":"2023-10-08T13:05:37.903390+0000","last_undegraded":"2023-10-08T13:05:37.903390+0000","last_fullsized":"2023-10-08T13:05:37.903390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:53.072173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253803+0000","last_change":"2023-10-08T13:04:10.750861+0000","last_active":"2023-10-08T13:05:38.253803+0000","last_peered":"2023-10-08T13:05:38.253803+0000","last_clean":"2023-10-08T13:05:38.253803+0000","last_became_active":"2023-10-08T13:04:10.750527+0000","last_became_peered":"2023-10-08T13:04:10.750527+0000","last_unstale":"2023-10-08T13:05:38.253803+0000","last_undegraded":"2023-10-08T13:05:38.253803+0000","last_fullsized":"2023-10-08T13:05:38.253803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:46.870582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898482+0000","last_change":"2023-10-08T13:04:10.761222+0000","last_active":"2023-10-08T13:05:37.898482+0000","last_peered":"2023-10-08T13:05:37.898482+0000","last_clean":"2023-10-08T13:05:37.898482+0000","last_became_active":"2023-10-08T13:04:10.760931+0000","last_became_peered":"2023-10-08T13:04:10.760931+0000","last_unstale":"2023-10-08T13:05:37.898482+0000","last_undegraded":"2023-10-08T13:05:37.898482+0000","last_fullsized":"2023-10-08T13:05:37.898482+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:41.997867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908109+0000","last_change":"2023-10-08T13:04:10.759613+0000","last_active":"2023-10-08T13:05:37.908109+0000","last_peered":"2023-10-08T13:05:37.908109+0000","last_clean":"2023-10-08T13:05:37.908109+0000","last_became_active":"2023-10-08T13:04:10.759305+0000","last_became_peered":"2023-10-08T13:04:10.759305+0000","last_unstale":"2023-10-08T13:05:37.908109+0000","last_undegraded":"2023-10-08T13:05:37.908109+0000","last_fullsized":"2023-10-08T13:05:37.908109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:31.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252566+0000","last_change":"2023-10-08T13:04:38.209983+0000","last_active":"2023-10-08T13:05:38.252566+0000","last_peered":"2023-10-08T13:05:38.252566+0000","last_clean":"2023-10-08T13:05:38.252566+0000","last_became_active":"2023-10-08T13:04:38.209572+0000","last_became_peered":"2023-10-08T13:04:38.209572+0000","last_unstale":"2023-10-08T13:05:38.252566+0000","last_undegraded":"2023-10-08T13:05:38.252566+0000","last_fullsized":"2023-10-08T13:05:38.252566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:01.843544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476539+0000","last_change":"2023-10-08T13:04:10.757791+0000","last_active":"2023-10-08T13:05:38.476539+0000","last_peered":"2023-10-08T13:05:38.476539+0000","last_clean":"2023-10-08T13:05:38.476539+0000","last_became_active":"2023-10-08T13:04:10.757476+0000","last_became_peered":"2023-10-08T13:04:10.757476+0000","last_unstale":"2023-10-08T13:05:38.476539+0000","last_undegraded":"2023-10-08T13:05:38.476539+0000","last_fullsized":"2023-10-08T13:05:38.476539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:23.603409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476214+0000","last_change":"2023-10-08T13:04:10.754654+0000","last_active":"2023-10-08T13:05:38.476214+0000","last_peered":"2023-10-08T13:05:38.476214+0000","last_clean":"2023-10-08T13:05:38.476214+0000","last_became_active":"2023-10-08T13:04:10.754319+0000","last_became_peered":"2023-10-08T13:04:10.754319+0000","last_unstale":"2023-10-08T13:05:38.476214+0000","last_undegraded":"2023-10-08T13:05:38.476214+0000","last_fullsized":"2023-10-08T13:05:38.476214+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:55.128550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900738+0000","last_change":"2023-10-08T13:04:10.755675+0000","last_active":"2023-10-08T13:05:37.900738+0000","last_peered":"2023-10-08T13:05:37.900738+0000","last_clean":"2023-10-08T13:05:37.900738+0000","last_became_active":"2023-10-08T13:04:10.755339+0000","last_became_peered":"2023-10-08T13:04:10.755339+0000","last_unstale":"2023-10-08T13:05:37.900738+0000","last_undegraded":"2023-10-08T13:05:37.900738+0000","last_fullsized":"2023-10-08T13:05:37.900738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:47.793236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900396+0000","last_change":"2023-10-08T13:04:10.754657+0000","last_active":"2023-10-08T13:05:37.900396+0000","last_peered":"2023-10-08T13:05:37.900396+0000","last_clean":"2023-10-08T13:05:37.900396+0000","last_became_active":"2023-10-08T13:04:10.754369+0000","last_became_peered":"2023-10-08T13:04:10.754369+0000","last_unstale":"2023-10-08T13:05:37.900396+0000","last_undegraded":"2023-10-08T13:05:37.900396+0000","last_fullsized":"2023-10-08T13:05:37.900396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:38:01.826552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897250+0000","last_change":"2023-10-08T13:04:10.757516+0000","last_active":"2023-10-08T13:05:37.897250+0000","last_peered":"2023-10-08T13:05:37.897250+0000","last_clean":"2023-10-08T13:05:37.897250+0000","last_became_active":"2023-10-08T13:04:10.757209+0000","last_became_peered":"2023-10-08T13:04:10.757209+0000","last_unstale":"2023-10-08T13:05:37.897250+0000","last_undegraded":"2023-10-08T13:05:37.897250+0000","last_fullsized":"2023-10-08T13:05:37.897250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:41.804784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898635+0000","last_change":"2023-10-08T13:04:10.755061+0000","last_active":"2023-10-08T13:05:37.898635+0000","last_peered":"2023-10-08T13:05:37.898635+0000","last_clean":"2023-10-08T13:05:37.898635+0000","last_became_active":"2023-10-08T13:04:10.754769+0000","last_became_peered":"2023-10-08T13:04:10.754769+0000","last_unstale":"2023-10-08T13:05:37.898635+0000","last_undegraded":"2023-10-08T13:05:37.898635+0000","last_fullsized":"2023-10-08T13:05:37.898635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:46.959542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898186+0000","last_change":"2023-10-08T13:04:15.148025+0000","last_active":"2023-10-08T13:05:37.898186+0000","last_peered":"2023-10-08T13:05:37.898186+0000","last_clean":"2023-10-08T13:05:37.898186+0000","last_became_active":"2023-10-08T13:04:15.147615+0000","last_became_peered":"2023-10-08T13:04:15.147615+0000","last_unstale":"2023-10-08T13:05:37.898186+0000","last_undegraded":"2023-10-08T13:05:37.898186+0000","last_fullsized":"2023-10-08T13:05:37.898186+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:24.129411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'14","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:55.273216+0000","last_change":"2023-10-08T13:04:09.756480+0000","last_active":"2023-10-08T13:05:55.273216+0000","last_peered":"2023-10-08T13:05:55.273216+0000","last_clean":"2023-10-08T13:05:55.273216+0000","last_became_active":"2023-10-08T13:04:09.756265+0000","last_became_peered":"2023-10-08T13:04:09.756265+0000","last_unstale":"2023-10-08T13:05:55.273216+0000","last_undegraded":"2023-10-08T13:05:55.273216+0000","last_fullsized":"2023-10-08T13:05:55.273216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:26.900802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899378+0000","last_change":"2023-10-08T13:04:10.755056+0000","last_active":"2023-10-08T13:05:37.899378+0000","last_peered":"2023-10-08T13:05:37.899378+0000","last_clean":"2023-10-08T13:05:37.899378+0000","last_became_active":"2023-10-08T13:04:10.754740+0000","last_became_peered":"2023-10-08T13:04:10.754740+0000","last_unstale":"2023-10-08T13:05:37.899378+0000","last_undegraded":"2023-10-08T13:05:37.899378+0000","last_fullsized":"2023-10-08T13:05:37.899378+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:05.447697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907193+0000","last_change":"2023-10-08T13:04:15.154279+0000","last_active":"2023-10-08T13:05:37.907193+0000","last_peered":"2023-10-08T13:05:37.907193+0000","last_clean":"2023-10-08T13:05:37.907193+0000","last_became_active":"2023-10-08T13:04:15.153804+0000","last_became_peered":"2023-10-08T13:04:15.153804+0000","last_unstale":"2023-10-08T13:05:37.907193+0000","last_undegraded":"2023-10-08T13:05:37.907193+0000","last_fullsized":"2023-10-08T13:05:37.907193+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:23:22.592414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899457+0000","last_change":"2023-10-08T13:04:09.745025+0000","last_active":"2023-10-08T13:05:37.899457+0000","last_peered":"2023-10-08T13:05:37.899457+0000","last_clean":"2023-10-08T13:05:37.899457+0000","last_became_active":"2023-10-08T13:04:09.744178+0000","last_became_peered":"2023-10-08T13:04:09.744178+0000","last_unstale":"2023-10-08T13:05:37.899457+0000","last_undegraded":"2023-10-08T13:05:37.899457+0000","last_fullsized":"2023-10-08T13:05:37.899457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:45.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476398+0000","last_change":"2023-10-08T13:04:10.752762+0000","last_active":"2023-10-08T13:05:38.476398+0000","last_peered":"2023-10-08T13:05:38.476398+0000","last_clean":"2023-10-08T13:05:38.476398+0000","last_became_active":"2023-10-08T13:04:10.752384+0000","last_became_peered":"2023-10-08T13:04:10.752384+0000","last_unstale":"2023-10-08T13:05:38.476398+0000","last_undegraded":"2023-10-08T13:05:38.476398+0000","last_fullsized":"2023-10-08T13:05:38.476398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:04:06.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907687+0000","last_change":"2023-10-08T13:04:15.152029+0000","last_active":"2023-10-08T13:05:37.907687+0000","last_peered":"2023-10-08T13:05:37.907687+0000","last_clean":"2023-10-08T13:05:37.907687+0000","last_became_active":"2023-10-08T13:04:15.151471+0000","last_became_peered":"2023-10-08T13:04:15.151471+0000","last_unstale":"2023-10-08T13:05:37.907687+0000","last_undegraded":"2023-10-08T13:05:37.907687+0000","last_fullsized":"2023-10-08T13:05:37.907687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:14:42.020385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900891+0000","last_change":"2023-10-08T13:04:09.751144+0000","last_active":"2023-10-08T13:05:37.900891+0000","last_peered":"2023-10-08T13:05:37.900891+0000","last_clean":"2023-10-08T13:05:37.900891+0000","last_became_active":"2023-10-08T13:04:09.750695+0000","last_became_peered":"2023-10-08T13:04:09.750695+0000","last_unstale":"2023-10-08T13:05:37.900891+0000","last_undegraded":"2023-10-08T13:05:37.900891+0000","last_fullsized":"2023-10-08T13:05:37.900891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:05.693666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.902964+0000","last_change":"2023-10-08T13:04:10.758620+0000","last_active":"2023-10-08T13:05:37.902964+0000","last_peered":"2023-10-08T13:05:37.902964+0000","last_clean":"2023-10-08T13:05:37.902964+0000","last_became_active":"2023-10-08T13:04:10.758258+0000","last_became_peered":"2023-10-08T13:04:10.758258+0000","last_unstale":"2023-10-08T13:05:37.902964+0000","last_undegraded":"2023-10-08T13:05:37.902964+0000","last_fullsized":"2023-10-08T13:05:37.902964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:25.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908056+0000","last_change":"2023-10-08T13:04:15.147425+0000","last_active":"2023-10-08T13:05:37.908056+0000","last_peered":"2023-10-08T13:05:37.908056+0000","last_clean":"2023-10-08T13:05:37.908056+0000","last_became_active":"2023-10-08T13:04:15.146931+0000","last_became_peered":"2023-10-08T13:04:15.146931+0000","last_unstale":"2023-10-08T13:05:37.908056+0000","last_undegraded":"2023-10-08T13:05:37.908056+0000","last_fullsized":"2023-10-08T13:05:37.908056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:54.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899629+0000","last_change":"2023-10-08T13:04:09.747219+0000","last_active":"2023-10-08T13:05:37.899629+0000","last_peered":"2023-10-08T13:05:37.899629+0000","last_clean":"2023-10-08T13:05:37.899629+0000","last_became_active":"2023-10-08T13:04:09.746897+0000","last_became_peered":"2023-10-08T13:04:09.746897+0000","last_unstale":"2023-10-08T13:05:37.899629+0000","last_undegraded":"2023-10-08T13:05:37.899629+0000","last_fullsized":"2023-10-08T13:05:37.899629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:10:13.025578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906227+0000","last_change":"2023-10-08T13:04:10.751820+0000","last_active":"2023-10-08T13:05:37.906227+0000","last_peered":"2023-10-08T13:05:37.906227+0000","last_clean":"2023-10-08T13:05:37.906227+0000","last_became_active":"2023-10-08T13:04:10.751523+0000","last_became_peered":"2023-10-08T13:04:10.751523+0000","last_unstale":"2023-10-08T13:05:37.906227+0000","last_undegraded":"2023-10-08T13:05:37.906227+0000","last_fullsized":"2023-10-08T13:05:37.906227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:11.190024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898495+0000","last_change":"2023-10-08T13:04:15.141914+0000","last_active":"2023-10-08T13:05:37.898495+0000","last_peered":"2023-10-08T13:05:37.898495+0000","last_clean":"2023-10-08T13:05:37.898495+0000","last_became_active":"2023-10-08T13:04:15.141575+0000","last_became_peered":"2023-10-08T13:04:15.141575+0000","last_unstale":"2023-10-08T13:05:37.898495+0000","last_undegraded":"2023-10-08T13:05:37.898495+0000","last_fullsized":"2023-10-08T13:05:37.898495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:50.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:58.934882+0000","last_change":"2023-10-08T13:05:38.910616+0000","last_active":"2023-10-08T13:05:58.934882+0000","last_peered":"2023-10-08T13:05:58.934882+0000","last_clean":"2023-10-08T13:05:58.934882+0000","last_became_active":"2023-10-08T13:05:38.904333+0000","last_became_peered":"2023-10-08T13:05:38.904333+0000","last_unstale":"2023-10-08T13:05:58.934882+0000","last_undegraded":"2023-10-08T13:05:58.934882+0000","last_fullsized":"2023-10-08T13:05:58.934882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:59:47.582828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900271+0000","last_change":"2023-10-08T13:04:10.749172+0000","last_active":"2023-10-08T13:05:37.900271+0000","last_peered":"2023-10-08T13:05:37.900271+0000","last_clean":"2023-10-08T13:05:37.900271+0000","last_became_active":"2023-10-08T13:04:10.748889+0000","last_became_peered":"2023-10-08T13:04:10.748889+0000","last_unstale":"2023-10-08T13:05:37.900271+0000","last_undegraded":"2023-10-08T13:05:37.900271+0000","last_fullsized":"2023-10-08T13:05:37.900271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:42.626863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899181+0000","last_change":"2023-10-08T13:04:15.153510+0000","last_active":"2023-10-08T13:05:37.899181+0000","last_peered":"2023-10-08T13:05:37.899181+0000","last_clean":"2023-10-08T13:05:37.899181+0000","last_became_active":"2023-10-08T13:04:15.153120+0000","last_became_peered":"2023-10-08T13:04:15.153120+0000","last_unstale":"2023-10-08T13:05:37.899181+0000","last_undegraded":"2023-10-08T13:05:37.899181+0000","last_fullsized":"2023-10-08T13:05:37.899181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:13:44.836138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253006+0000","last_change":"2023-10-08T13:04:09.748790+0000","last_active":"2023-10-08T13:05:38.253006+0000","last_peered":"2023-10-08T13:05:38.253006+0000","last_clean":"2023-10-08T13:05:38.253006+0000","last_became_active":"2023-10-08T13:04:09.748179+0000","last_became_peered":"2023-10-08T13:04:09.748179+0000","last_unstale":"2023-10-08T13:05:38.253006+0000","last_undegraded":"2023-10-08T13:05:38.253006+0000","last_fullsized":"2023-10-08T13:05:38.253006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:35.786620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908802+0000","last_change":"2023-10-08T13:04:10.758524+0000","last_active":"2023-10-08T13:05:37.908802+0000","last_peered":"2023-10-08T13:05:37.908802+0000","last_clean":"2023-10-08T13:05:37.908802+0000","last_became_active":"2023-10-08T13:04:10.758222+0000","last_became_peered":"2023-10-08T13:04:10.758222+0000","last_unstale":"2023-10-08T13:05:37.908802+0000","last_undegraded":"2023-10-08T13:05:37.908802+0000","last_fullsized":"2023-10-08T13:05:37.908802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:37:10.001215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900285+0000","last_change":"2023-10-08T13:04:15.156997+0000","last_active":"2023-10-08T13:05:37.900285+0000","last_peered":"2023-10-08T13:05:37.900285+0000","last_clean":"2023-10-08T13:05:37.900285+0000","last_became_active":"2023-10-08T13:04:15.156639+0000","last_became_peered":"2023-10-08T13:04:15.156639+0000","last_unstale":"2023-10-08T13:05:37.900285+0000","last_undegraded":"2023-10-08T13:05:37.900285+0000","last_fullsized":"2023-10-08T13:05:37.900285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:46:38.117245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252345+0000","last_change":"2023-10-08T13:04:09.752284+0000","last_active":"2023-10-08T13:05:38.252345+0000","last_peered":"2023-10-08T13:05:38.252345+0000","last_clean":"2023-10-08T13:05:38.252345+0000","last_became_active":"2023-10-08T13:04:09.751942+0000","last_became_peered":"2023-10-08T13:04:09.751942+0000","last_unstale":"2023-10-08T13:05:38.252345+0000","last_undegraded":"2023-10-08T13:05:38.252345+0000","last_fullsized":"2023-10-08T13:05:38.252345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:32.353267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898798+0000","last_change":"2023-10-08T13:04:10.755903+0000","last_active":"2023-10-08T13:05:37.898798+0000","last_peered":"2023-10-08T13:05:37.898798+0000","last_clean":"2023-10-08T13:05:37.898798+0000","last_became_active":"2023-10-08T13:04:10.755589+0000","last_became_peered":"2023-10-08T13:04:10.755589+0000","last_unstale":"2023-10-08T13:05:37.898798+0000","last_undegraded":"2023-10-08T13:05:37.898798+0000","last_fullsized":"2023-10-08T13:05:37.898798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:22.065982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476427+0000","last_change":"2023-10-08T13:04:15.144641+0000","last_active":"2023-10-08T13:05:38.476427+0000","last_peered":"2023-10-08T13:05:38.476427+0000","last_clean":"2023-10-08T13:05:38.476427+0000","last_became_active":"2023-10-08T13:04:15.144186+0000","last_became_peered":"2023-10-08T13:04:15.144186+0000","last_unstale":"2023-10-08T13:05:38.476427+0000","last_undegraded":"2023-10-08T13:05:38.476427+0000","last_fullsized":"2023-10-08T13:05:38.476427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:08.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907441+0000","last_change":"2023-10-08T13:04:09.752032+0000","last_active":"2023-10-08T13:05:37.907441+0000","last_peered":"2023-10-08T13:05:37.907441+0000","last_clean":"2023-10-08T13:05:37.907441+0000","last_became_active":"2023-10-08T13:04:09.751700+0000","last_became_peered":"2023-10-08T13:04:09.751700+0000","last_unstale":"2023-10-08T13:05:37.907441+0000","last_undegraded":"2023-10-08T13:05:37.907441+0000","last_fullsized":"2023-10-08T13:05:37.907441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:50:59.361403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896350+0000","last_change":"2023-10-08T13:04:10.756672+0000","last_active":"2023-10-08T13:05:37.896350+0000","last_peered":"2023-10-08T13:05:37.896350+0000","last_clean":"2023-10-08T13:05:37.896350+0000","last_became_active":"2023-10-08T13:04:10.756339+0000","last_became_peered":"2023-10-08T13:04:10.756339+0000","last_unstale":"2023-10-08T13:05:37.896350+0000","last_undegraded":"2023-10-08T13:05:37.896350+0000","last_fullsized":"2023-10-08T13:05:37.896350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:07.183447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898929+0000","last_change":"2023-10-08T13:04:15.146091+0000","last_active":"2023-10-08T13:05:37.898929+0000","last_peered":"2023-10-08T13:05:37.898929+0000","last_clean":"2023-10-08T13:05:37.898929+0000","last_became_active":"2023-10-08T13:04:15.145781+0000","last_became_peered":"2023-10-08T13:04:15.145781+0000","last_unstale":"2023-10-08T13:05:37.898929+0000","last_undegraded":"2023-10-08T13:05:37.898929+0000","last_fullsized":"2023-10-08T13:05:37.898929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:32.217072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":194,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.931304+0000","last_change":"2023-10-08T13:04:09.751672+0000","last_active":"2023-10-08T13:05:56.931304+0000","last_peered":"2023-10-08T13:05:56.931304+0000","last_clean":"2023-10-08T13:05:56.931304+0000","last_became_active":"2023-10-08T13:04:09.751291+0000","last_became_peered":"2023-10-08T13:04:09.751291+0000","last_unstale":"2023-10-08T13:05:56.931304+0000","last_undegraded":"2023-10-08T13:05:56.931304+0000","last_fullsized":"2023-10-08T13:05:56.931304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:17:09.497538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":167,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903624+0000","last_change":"2023-10-08T13:04:10.757875+0000","last_active":"2023-10-08T13:05:37.903624+0000","last_peered":"2023-10-08T13:05:37.903624+0000","last_clean":"2023-10-08T13:05:37.903624+0000","last_became_active":"2023-10-08T13:04:10.757562+0000","last_became_peered":"2023-10-08T13:04:10.757562+0000","last_unstale":"2023-10-08T13:05:37.903624+0000","last_undegraded":"2023-10-08T13:05:37.903624+0000","last_fullsized":"2023-10-08T13:05:37.903624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:39.178778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896284+0000","last_change":"2023-10-08T13:04:15.151348+0000","last_active":"2023-10-08T13:05:37.896284+0000","last_peered":"2023-10-08T13:05:37.896284+0000","last_clean":"2023-10-08T13:05:37.896284+0000","last_became_active":"2023-10-08T13:04:15.150877+0000","last_became_peered":"2023-10-08T13:04:15.150877+0000","last_unstale":"2023-10-08T13:05:37.896284+0000","last_undegraded":"2023-10-08T13:05:37.896284+0000","last_fullsized":"2023-10-08T13:05:37.896284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:33:26.840520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.915250+0000","last_change":"2023-10-08T13:05:38.915250+0000","last_active":"2023-10-08T13:05:38.915250+0000","last_peered":"2023-10-08T13:05:38.915250+0000","last_clean":"2023-10-08T13:05:38.915250+0000","last_became_active":"2023-10-08T13:05:38.906992+0000","last_became_peered":"2023-10-08T13:05:38.906992+0000","last_unstale":"2023-10-08T13:05:38.915250+0000","last_undegraded":"2023-10-08T13:05:38.915250+0000","last_fullsized":"2023-10-08T13:05:38.915250+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:54:53.798551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476385+0000","last_change":"2023-10-08T13:04:10.749709+0000","last_active":"2023-10-08T13:05:38.476385+0000","last_peered":"2023-10-08T13:05:38.476385+0000","last_clean":"2023-10-08T13:05:38.476385+0000","last_became_active":"2023-10-08T13:04:10.749353+0000","last_became_peered":"2023-10-08T13:04:10.749353+0000","last_unstale":"2023-10-08T13:05:38.476385+0000","last_undegraded":"2023-10-08T13:05:38.476385+0000","last_fullsized":"2023-10-08T13:05:38.476385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:10.424191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908045+0000","last_change":"2023-10-08T13:04:38.220707+0000","last_active":"2023-10-08T13:05:37.908045+0000","last_peered":"2023-10-08T13:05:37.908045+0000","last_clean":"2023-10-08T13:05:37.908045+0000","last_became_active":"2023-10-08T13:04:38.215253+0000","last_became_peered":"2023-10-08T13:04:38.215253+0000","last_unstale":"2023-10-08T13:05:37.908045+0000","last_undegraded":"2023-10-08T13:05:37.908045+0000","last_fullsized":"2023-10-08T13:05:37.908045+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:15.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906126+0000","last_change":"2023-10-08T13:04:09.744544+0000","last_active":"2023-10-08T13:05:37.906126+0000","last_peered":"2023-10-08T13:05:37.906126+0000","last_clean":"2023-10-08T13:05:37.906126+0000","last_became_active":"2023-10-08T13:04:09.744207+0000","last_became_peered":"2023-10-08T13:04:09.744207+0000","last_unstale":"2023-10-08T13:05:37.906126+0000","last_undegraded":"2023-10-08T13:05:37.906126+0000","last_fullsized":"2023-10-08T13:05:37.906126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:38.130460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.903154+0000","last_change":"2023-10-08T13:04:38.214872+0000","last_active":"2023-10-08T13:05:37.903154+0000","last_peered":"2023-10-08T13:05:37.903154+0000","last_clean":"2023-10-08T13:05:37.903154+0000","last_became_active":"2023-10-08T13:04:38.214480+0000","last_became_peered":"2023-10-08T13:04:38.214480+0000","last_unstale":"2023-10-08T13:05:37.903154+0000","last_undegraded":"2023-10-08T13:05:37.903154+0000","last_fullsized":"2023-10-08T13:05:37.903154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:22:05.108568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896367+0000","last_change":"2023-10-08T13:04:15.152347+0000","last_active":"2023-10-08T13:05:37.896367+0000","last_peered":"2023-10-08T13:05:37.896367+0000","last_clean":"2023-10-08T13:05:37.896367+0000","last_became_active":"2023-10-08T13:04:15.151894+0000","last_became_peered":"2023-10-08T13:04:15.151894+0000","last_unstale":"2023-10-08T13:05:37.896367+0000","last_undegraded":"2023-10-08T13:05:37.896367+0000","last_fullsized":"2023-10-08T13:05:37.896367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:25:49.583798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'38","reported_seq":234,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.932082+0000","last_change":"2023-10-08T13:04:09.748999+0000","last_active":"2023-10-08T13:05:56.932082+0000","last_peered":"2023-10-08T13:05:56.932082+0000","last_clean":"2023-10-08T13:05:56.932082+0000","last_became_active":"2023-10-08T13:04:09.748316+0000","last_became_peered":"2023-10-08T13:04:09.748316+0000","last_unstale":"2023-10-08T13:05:56.932082+0000","last_undegraded":"2023-10-08T13:05:56.932082+0000","last_fullsized":"2023-10-08T13:05:56.932082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:10.836824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":145,"num_write":40,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901149+0000","last_change":"2023-10-08T13:04:10.759151+0000","last_active":"2023-10-08T13:05:37.901149+0000","last_peered":"2023-10-08T13:05:37.901149+0000","last_clean":"2023-10-08T13:05:37.901149+0000","last_became_active":"2023-10-08T13:04:10.758852+0000","last_became_peered":"2023-10-08T13:04:10.758852+0000","last_unstale":"2023-10-08T13:05:37.901149+0000","last_undegraded":"2023-10-08T13:05:37.901149+0000","last_fullsized":"2023-10-08T13:05:37.901149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:36.514815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906509+0000","last_change":"2023-10-08T13:04:15.148734+0000","last_active":"2023-10-08T13:05:37.906509+0000","last_peered":"2023-10-08T13:05:37.906509+0000","last_clean":"2023-10-08T13:05:37.906509+0000","last_became_active":"2023-10-08T13:04:15.148350+0000","last_became_peered":"2023-10-08T13:04:15.148350+0000","last_unstale":"2023-10-08T13:05:37.906509+0000","last_undegraded":"2023-10-08T13:05:37.906509+0000","last_fullsized":"2023-10-08T13:05:37.906509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:18:03.339837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899085+0000","last_change":"2023-10-08T13:04:09.747667+0000","last_active":"2023-10-08T13:05:37.899085+0000","last_peered":"2023-10-08T13:05:37.899085+0000","last_clean":"2023-10-08T13:05:37.899085+0000","last_became_active":"2023-10-08T13:04:09.747347+0000","last_became_peered":"2023-10-08T13:04:09.747347+0000","last_unstale":"2023-10-08T13:05:37.899085+0000","last_undegraded":"2023-10-08T13:05:37.899085+0000","last_fullsized":"2023-10-08T13:05:37.899085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:12:45.780996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252481+0000","last_change":"2023-10-08T13:04:10.757564+0000","last_active":"2023-10-08T13:05:38.252481+0000","last_peered":"2023-10-08T13:05:38.252481+0000","last_clean":"2023-10-08T13:05:38.252481+0000","last_became_active":"2023-10-08T13:04:10.757269+0000","last_became_peered":"2023-10-08T13:04:10.757269+0000","last_unstale":"2023-10-08T13:05:38.252481+0000","last_undegraded":"2023-10-08T13:05:38.252481+0000","last_fullsized":"2023-10-08T13:05:38.252481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:43.102997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899743+0000","last_change":"2023-10-08T13:04:15.156927+0000","last_active":"2023-10-08T13:05:37.899743+0000","last_peered":"2023-10-08T13:05:37.899743+0000","last_clean":"2023-10-08T13:05:37.899743+0000","last_became_active":"2023-10-08T13:04:15.156522+0000","last_became_peered":"2023-10-08T13:04:15.156522+0000","last_unstale":"2023-10-08T13:05:37.899743+0000","last_undegraded":"2023-10-08T13:05:37.899743+0000","last_fullsized":"2023-10-08T13:05:37.899743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:29.840915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907936+0000","last_change":"2023-10-08T13:04:09.752158+0000","last_active":"2023-10-08T13:05:37.907936+0000","last_peered":"2023-10-08T13:05:37.907936+0000","last_clean":"2023-10-08T13:05:37.907936+0000","last_became_active":"2023-10-08T13:04:09.751505+0000","last_became_peered":"2023-10-08T13:04:09.751505+0000","last_unstale":"2023-10-08T13:05:37.907936+0000","last_undegraded":"2023-10-08T13:05:37.907936+0000","last_fullsized":"2023-10-08T13:05:37.907936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:45.254042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908912+0000","last_change":"2023-10-08T13:04:10.759551+0000","last_active":"2023-10-08T13:05:37.908912+0000","last_peered":"2023-10-08T13:05:37.908912+0000","last_clean":"2023-10-08T13:05:37.908912+0000","last_became_active":"2023-10-08T13:04:10.759225+0000","last_became_peered":"2023-10-08T13:04:10.759225+0000","last_unstale":"2023-10-08T13:05:37.908912+0000","last_undegraded":"2023-10-08T13:05:37.908912+0000","last_fullsized":"2023-10-08T13:05:37.908912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:27.255506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896715+0000","last_change":"2023-10-08T13:04:15.153329+0000","last_active":"2023-10-08T13:05:37.896715+0000","last_peered":"2023-10-08T13:05:37.896715+0000","last_clean":"2023-10-08T13:05:37.896715+0000","last_became_active":"2023-10-08T13:04:15.152026+0000","last_became_peered":"2023-10-08T13:04:15.152026+0000","last_unstale":"2023-10-08T13:05:37.896715+0000","last_undegraded":"2023-10-08T13:05:37.896715+0000","last_fullsized":"2023-10-08T13:05:37.896715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:02.016315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"89'7","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:58.278385+0000","last_change":"2023-10-08T13:04:09.750748+0000","last_active":"2023-10-08T13:05:58.278385+0000","last_peered":"2023-10-08T13:05:58.278385+0000","last_clean":"2023-10-08T13:05:58.278385+0000","last_became_active":"2023-10-08T13:04:09.750361+0000","last_became_peered":"2023-10-08T13:04:09.750361+0000","last_unstale":"2023-10-08T13:05:58.278385+0000","last_undegraded":"2023-10-08T13:05:58.278385+0000","last_fullsized":"2023-10-08T13:05:58.278385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:53.300374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897800+0000","last_change":"2023-10-08T13:04:10.764275+0000","last_active":"2023-10-08T13:05:37.897800+0000","last_peered":"2023-10-08T13:05:37.897800+0000","last_clean":"2023-10-08T13:05:37.897800+0000","last_became_active":"2023-10-08T13:04:10.763903+0000","last_became_peered":"2023-10-08T13:04:10.763903+0000","last_unstale":"2023-10-08T13:05:37.897800+0000","last_undegraded":"2023-10-08T13:05:37.897800+0000","last_fullsized":"2023-10-08T13:05:37.897800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:16.763712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252637+0000","last_change":"2023-10-08T13:04:15.155702+0000","last_active":"2023-10-08T13:05:38.252637+0000","last_peered":"2023-10-08T13:05:38.252637+0000","last_clean":"2023-10-08T13:05:38.252637+0000","last_became_active":"2023-10-08T13:04:15.155249+0000","last_became_peered":"2023-10-08T13:04:15.155249+0000","last_unstale":"2023-10-08T13:05:38.252637+0000","last_undegraded":"2023-10-08T13:05:38.252637+0000","last_fullsized":"2023-10-08T13:05:38.252637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:10:07.029254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899678+0000","last_change":"2023-10-08T13:04:09.753106+0000","last_active":"2023-10-08T13:05:37.899678+0000","last_peered":"2023-10-08T13:05:37.899678+0000","last_clean":"2023-10-08T13:05:37.899678+0000","last_became_active":"2023-10-08T13:04:09.752778+0000","last_became_peered":"2023-10-08T13:04:09.752778+0000","last_unstale":"2023-10-08T13:05:37.899678+0000","last_undegraded":"2023-10-08T13:05:37.899678+0000","last_fullsized":"2023-10-08T13:05:37.899678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:13.097508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896291+0000","last_change":"2023-10-08T13:04:38.213542+0000","last_active":"2023-10-08T13:05:37.896291+0000","last_peered":"2023-10-08T13:05:37.896291+0000","last_clean":"2023-10-08T13:05:37.896291+0000","last_became_active":"2023-10-08T13:04:38.213218+0000","last_became_peered":"2023-10-08T13:04:38.213218+0000","last_unstale":"2023-10-08T13:05:37.896291+0000","last_undegraded":"2023-10-08T13:05:37.896291+0000","last_fullsized":"2023-10-08T13:05:37.896291+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:55:51.125175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906002+0000","last_change":"2023-10-08T13:04:15.150462+0000","last_active":"2023-10-08T13:05:37.906002+0000","last_peered":"2023-10-08T13:05:37.906002+0000","last_clean":"2023-10-08T13:05:37.906002+0000","last_became_active":"2023-10-08T13:04:15.149876+0000","last_became_peered":"2023-10-08T13:04:15.149876+0000","last_unstale":"2023-10-08T13:05:37.906002+0000","last_undegraded":"2023-10-08T13:05:37.906002+0000","last_fullsized":"2023-10-08T13:05:37.906002+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:10:59.078858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.912207+0000","last_change":"2023-10-08T13:05:38.912207+0000","last_active":"2023-10-08T13:05:38.912207+0000","last_peered":"2023-10-08T13:05:38.912207+0000","last_clean":"2023-10-08T13:05:38.912207+0000","last_became_active":"2023-10-08T13:05:38.907286+0000","last_became_peered":"2023-10-08T13:05:38.907286+0000","last_unstale":"2023-10-08T13:05:38.912207+0000","last_undegraded":"2023-10-08T13:05:38.912207+0000","last_fullsized":"2023-10-08T13:05:38.912207+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:18.606537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900044+0000","last_change":"2023-10-08T13:04:10.753509+0000","last_active":"2023-10-08T13:05:37.900044+0000","last_peered":"2023-10-08T13:05:37.900044+0000","last_clean":"2023-10-08T13:05:37.900044+0000","last_became_active":"2023-10-08T13:04:10.752977+0000","last_became_peered":"2023-10-08T13:04:10.752977+0000","last_unstale":"2023-10-08T13:05:37.900044+0000","last_undegraded":"2023-10-08T13:05:37.900044+0000","last_fullsized":"2023-10-08T13:05:37.900044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:44.247552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900177+0000","last_change":"2023-10-08T13:04:38.215172+0000","last_active":"2023-10-08T13:05:37.900177+0000","last_peered":"2023-10-08T13:05:37.900177+0000","last_clean":"2023-10-08T13:05:37.900177+0000","last_became_active":"2023-10-08T13:04:38.214666+0000","last_became_peered":"2023-10-08T13:04:38.214666+0000","last_unstale":"2023-10-08T13:05:37.900177+0000","last_undegraded":"2023-10-08T13:05:37.900177+0000","last_fullsized":"2023-10-08T13:05:37.900177+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:40:45.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896579+0000","last_change":"2023-10-08T13:04:09.755049+0000","last_active":"2023-10-08T13:05:37.896579+0000","last_peered":"2023-10-08T13:05:37.896579+0000","last_clean":"2023-10-08T13:05:37.896579+0000","last_became_active":"2023-10-08T13:04:09.754723+0000","last_became_peered":"2023-10-08T13:04:09.754723+0000","last_unstale":"2023-10-08T13:05:37.896579+0000","last_undegraded":"2023-10-08T13:05:37.896579+0000","last_fullsized":"2023-10-08T13:05:37.896579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:18.283063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253485+0000","last_change":"2023-10-08T13:04:10.756311+0000","last_active":"2023-10-08T13:05:38.253485+0000","last_peered":"2023-10-08T13:05:38.253485+0000","last_clean":"2023-10-08T13:05:38.253485+0000","last_became_active":"2023-10-08T13:04:10.756014+0000","last_became_peered":"2023-10-08T13:04:10.756014+0000","last_unstale":"2023-10-08T13:05:38.253485+0000","last_undegraded":"2023-10-08T13:05:38.253485+0000","last_fullsized":"2023-10-08T13:05:38.253485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:46.402573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252686+0000","last_change":"2023-10-08T13:04:15.143504+0000","last_active":"2023-10-08T13:05:38.252686+0000","last_peered":"2023-10-08T13:05:38.252686+0000","last_clean":"2023-10-08T13:05:38.252686+0000","last_became_active":"2023-10-08T13:04:15.143037+0000","last_became_peered":"2023-10-08T13:04:15.143037+0000","last_unstale":"2023-10-08T13:05:38.252686+0000","last_undegraded":"2023-10-08T13:05:38.252686+0000","last_fullsized":"2023-10-08T13:05:38.252686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:03.247752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"89'7","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:57.276797+0000","last_change":"2023-10-08T13:04:09.755114+0000","last_active":"2023-10-08T13:05:57.276797+0000","last_peered":"2023-10-08T13:05:57.276797+0000","last_clean":"2023-10-08T13:05:57.276797+0000","last_became_active":"2023-10-08T13:04:09.754223+0000","last_became_peered":"2023-10-08T13:04:09.754223+0000","last_unstale":"2023-10-08T13:05:57.276797+0000","last_undegraded":"2023-10-08T13:05:57.276797+0000","last_fullsized":"2023-10-08T13:05:57.276797+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:56:04.032803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":87,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.253216+0000","last_change":"2023-10-08T13:04:10.754342+0000","last_active":"2023-10-08T13:05:38.253216+0000","last_peered":"2023-10-08T13:05:38.253216+0000","last_clean":"2023-10-08T13:05:38.253216+0000","last_became_active":"2023-10-08T13:04:10.754022+0000","last_became_peered":"2023-10-08T13:04:10.754022+0000","last_unstale":"2023-10-08T13:05:38.253216+0000","last_undegraded":"2023-10-08T13:05:38.253216+0000","last_fullsized":"2023-10-08T13:05:38.253216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:46.850998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252605+0000","last_change":"2023-10-08T13:04:15.505395+0000","last_active":"2023-10-08T13:05:38.252605+0000","last_peered":"2023-10-08T13:05:38.252605+0000","last_clean":"2023-10-08T13:05:38.252605+0000","last_became_active":"2023-10-08T13:04:15.504929+0000","last_became_peered":"2023-10-08T13:04:15.504929+0000","last_unstale":"2023-10-08T13:05:38.252605+0000","last_undegraded":"2023-10-08T13:05:38.252605+0000","last_fullsized":"2023-10-08T13:05:38.252605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:28.963912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907529+0000","last_change":"2023-10-08T13:04:38.213418+0000","last_active":"2023-10-08T13:05:37.907529+0000","last_peered":"2023-10-08T13:05:37.907529+0000","last_clean":"2023-10-08T13:05:37.907529+0000","last_became_active":"2023-10-08T13:04:38.213000+0000","last_became_peered":"2023-10-08T13:04:38.213000+0000","last_unstale":"2023-10-08T13:05:37.907529+0000","last_undegraded":"2023-10-08T13:05:37.907529+0000","last_fullsized":"2023-10-08T13:05:37.907529+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:20.821412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:56.275275+0000","last_change":"2023-10-08T13:04:09.752244+0000","last_active":"2023-10-08T13:05:56.275275+0000","last_peered":"2023-10-08T13:05:56.275275+0000","last_clean":"2023-10-08T13:05:56.275275+0000","last_became_active":"2023-10-08T13:04:09.751893+0000","last_became_peered":"2023-10-08T13:04:09.751893+0000","last_unstale":"2023-10-08T13:05:56.275275+0000","last_undegraded":"2023-10-08T13:05:56.275275+0000","last_fullsized":"2023-10-08T13:05:56.275275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:11.631943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898219+0000","last_change":"2023-10-08T13:04:38.218150+0000","last_active":"2023-10-08T13:05:37.898219+0000","last_peered":"2023-10-08T13:05:37.898219+0000","last_clean":"2023-10-08T13:05:37.898219+0000","last_became_active":"2023-10-08T13:04:38.210481+0000","last_became_peered":"2023-10-08T13:04:38.210481+0000","last_unstale":"2023-10-08T13:05:37.898219+0000","last_undegraded":"2023-10-08T13:05:37.898219+0000","last_fullsized":"2023-10-08T13:05:37.898219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:42.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899075+0000","last_change":"2023-10-08T13:04:10.750783+0000","last_active":"2023-10-08T13:05:37.899075+0000","last_peered":"2023-10-08T13:05:37.899075+0000","last_clean":"2023-10-08T13:05:37.899075+0000","last_became_active":"2023-10-08T13:04:10.750307+0000","last_became_peered":"2023-10-08T13:04:10.750307+0000","last_unstale":"2023-10-08T13:05:37.899075+0000","last_undegraded":"2023-10-08T13:05:37.899075+0000","last_fullsized":"2023-10-08T13:05:37.899075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:08.862408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907817+0000","last_change":"2023-10-08T13:04:09.752620+0000","last_active":"2023-10-08T13:05:37.907817+0000","last_peered":"2023-10-08T13:05:37.907817+0000","last_clean":"2023-10-08T13:05:37.907817+0000","last_became_active":"2023-10-08T13:04:09.752267+0000","last_became_peered":"2023-10-08T13:04:09.752267+0000","last_unstale":"2023-10-08T13:05:37.907817+0000","last_undegraded":"2023-10-08T13:05:37.907817+0000","last_fullsized":"2023-10-08T13:05:37.907817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:05.930963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":325,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897664+0000","last_change":"2023-10-08T13:03:10.842750+0000","last_active":"2023-10-08T13:05:37.897664+0000","last_peered":"2023-10-08T13:05:37.897664+0000","last_clean":"2023-10-08T13:05:37.897664+0000","last_became_active":"2023-10-08T13:03:10.842296+0000","last_became_peered":"2023-10-08T13:03:10.842296+0000","last_unstale":"2023-10-08T13:05:37.897664+0000","last_undegraded":"2023-10-08T13:05:37.897664+0000","last_fullsized":"2023-10-08T13:05:37.897664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:00:15.662526+0000","last_clean_scrub_stamp":"2023-10-08T13:00:15.662526+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:43.104795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906676+0000","last_change":"2023-10-08T13:04:15.505930+0000","last_active":"2023-10-08T13:05:37.906676+0000","last_peered":"2023-10-08T13:05:37.906676+0000","last_clean":"2023-10-08T13:05:37.906676+0000","last_became_active":"2023-10-08T13:04:15.505341+0000","last_became_peered":"2023-10-08T13:04:15.505341+0000","last_unstale":"2023-10-08T13:05:37.906676+0000","last_undegraded":"2023-10-08T13:05:37.906676+0000","last_fullsized":"2023-10-08T13:05:37.906676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:00.206063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252246+0000","last_change":"2023-10-08T13:04:10.752823+0000","last_active":"2023-10-08T13:05:38.252246+0000","last_peered":"2023-10-08T13:05:38.252246+0000","last_clean":"2023-10-08T13:05:38.252246+0000","last_became_active":"2023-10-08T13:04:10.752476+0000","last_became_peered":"2023-10-08T13:04:10.752476+0000","last_unstale":"2023-10-08T13:05:38.252246+0000","last_undegraded":"2023-10-08T13:05:38.252246+0000","last_fullsized":"2023-10-08T13:05:38.252246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:15.574521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897795+0000","last_change":"2023-10-08T13:04:09.755020+0000","last_active":"2023-10-08T13:05:37.897795+0000","last_peered":"2023-10-08T13:05:37.897795+0000","last_clean":"2023-10-08T13:05:37.897795+0000","last_became_active":"2023-10-08T13:04:09.754643+0000","last_became_peered":"2023-10-08T13:04:09.754643+0000","last_unstale":"2023-10-08T13:05:37.897795+0000","last_undegraded":"2023-10-08T13:05:37.897795+0000","last_fullsized":"2023-10-08T13:05:37.897795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:33:38.949568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899769+0000","last_change":"2023-10-08T13:04:15.146746+0000","last_active":"2023-10-08T13:05:37.899769+0000","last_peered":"2023-10-08T13:05:37.899769+0000","last_clean":"2023-10-08T13:05:37.899769+0000","last_became_active":"2023-10-08T13:04:15.146295+0000","last_became_peered":"2023-10-08T13:04:15.146295+0000","last_unstale":"2023-10-08T13:05:37.899769+0000","last_undegraded":"2023-10-08T13:05:37.899769+0000","last_fullsized":"2023-10-08T13:05:37.899769+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:57.543098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901058+0000","last_change":"2023-10-08T13:04:09.755010+0000","last_active":"2023-10-08T13:05:37.901058+0000","last_peered":"2023-10-08T13:05:37.901058+0000","last_clean":"2023-10-08T13:05:37.901058+0000","last_became_active":"2023-10-08T13:04:09.754667+0000","last_became_peered":"2023-10-08T13:04:09.754667+0000","last_unstale":"2023-10-08T13:05:37.901058+0000","last_undegraded":"2023-10-08T13:05:37.901058+0000","last_fullsized":"2023-10-08T13:05:37.901058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:55.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252656+0000","last_change":"2023-10-08T13:04:10.751045+0000","last_active":"2023-10-08T13:05:38.252656+0000","last_peered":"2023-10-08T13:05:38.252656+0000","last_clean":"2023-10-08T13:05:38.252656+0000","last_became_active":"2023-10-08T13:04:10.750733+0000","last_became_peered":"2023-10-08T13:04:10.750733+0000","last_unstale":"2023-10-08T13:05:38.252656+0000","last_undegraded":"2023-10-08T13:05:38.252656+0000","last_fullsized":"2023-10-08T13:05:38.252656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:21:29.400933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898746+0000","last_change":"2023-10-08T13:04:15.505527+0000","last_active":"2023-10-08T13:05:37.898746+0000","last_peered":"2023-10-08T13:05:37.898746+0000","last_clean":"2023-10-08T13:05:37.898746+0000","last_became_active":"2023-10-08T13:04:15.505082+0000","last_became_peered":"2023-10-08T13:04:15.505082+0000","last_unstale":"2023-10-08T13:05:37.898746+0000","last_undegraded":"2023-10-08T13:05:37.898746+0000","last_fullsized":"2023-10-08T13:05:37.898746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:18:36.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.911816+0000","last_change":"2023-10-08T13:05:38.911816+0000","last_active":"2023-10-08T13:05:38.911816+0000","last_peered":"2023-10-08T13:05:38.911816+0000","last_clean":"2023-10-08T13:05:38.911816+0000","last_became_active":"2023-10-08T13:05:38.904337+0000","last_became_peered":"2023-10-08T13:05:38.904337+0000","last_unstale":"2023-10-08T13:05:38.911816+0000","last_undegraded":"2023-10-08T13:05:38.911816+0000","last_fullsized":"2023-10-08T13:05:38.911816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:26.645712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899892+0000","last_change":"2023-10-08T13:04:10.758514+0000","last_active":"2023-10-08T13:05:37.899892+0000","last_peered":"2023-10-08T13:05:37.899892+0000","last_clean":"2023-10-08T13:05:37.899892+0000","last_became_active":"2023-10-08T13:04:10.758224+0000","last_became_peered":"2023-10-08T13:04:10.758224+0000","last_unstale":"2023-10-08T13:05:37.899892+0000","last_undegraded":"2023-10-08T13:05:37.899892+0000","last_fullsized":"2023-10-08T13:05:37.899892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.562831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897964+0000","last_change":"2023-10-08T13:04:15.139813+0000","last_active":"2023-10-08T13:05:37.897964+0000","last_peered":"2023-10-08T13:05:37.897964+0000","last_clean":"2023-10-08T13:05:37.897964+0000","last_became_active":"2023-10-08T13:04:15.139362+0000","last_became_peered":"2023-10-08T13:04:15.139362+0000","last_unstale":"2023-10-08T13:05:37.897964+0000","last_undegraded":"2023-10-08T13:05:37.897964+0000","last_fullsized":"2023-10-08T13:05:37.897964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:07.179469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.908096+0000","last_change":"2023-10-08T13:04:09.756388+0000","last_active":"2023-10-08T13:05:37.908096+0000","last_peered":"2023-10-08T13:05:37.908096+0000","last_clean":"2023-10-08T13:05:37.908096+0000","last_became_active":"2023-10-08T13:04:09.756035+0000","last_became_peered":"2023-10-08T13:04:09.756035+0000","last_unstale":"2023-10-08T13:05:37.908096+0000","last_undegraded":"2023-10-08T13:05:37.908096+0000","last_fullsized":"2023-10-08T13:05:37.908096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:52.674614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476501+0000","last_change":"2023-10-08T13:04:10.755170+0000","last_active":"2023-10-08T13:05:38.476501+0000","last_peered":"2023-10-08T13:05:38.476501+0000","last_clean":"2023-10-08T13:05:38.476501+0000","last_became_active":"2023-10-08T13:04:10.754886+0000","last_became_peered":"2023-10-08T13:04:10.754886+0000","last_unstale":"2023-10-08T13:05:38.476501+0000","last_undegraded":"2023-10-08T13:05:38.476501+0000","last_fullsized":"2023-10-08T13:05:38.476501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:44.182332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907477+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:05:37.907477+0000","last_peered":"2023-10-08T13:05:37.907477+0000","last_clean":"2023-10-08T13:05:37.907477+0000","last_became_active":"2023-10-08T13:04:15.505288+0000","last_became_peered":"2023-10-08T13:04:15.505288+0000","last_unstale":"2023-10-08T13:05:37.907477+0000","last_undegraded":"2023-10-08T13:05:37.907477+0000","last_fullsized":"2023-10-08T13:05:37.907477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:25.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900849+0000","last_change":"2023-10-08T13:04:09.752303+0000","last_active":"2023-10-08T13:05:37.900849+0000","last_peered":"2023-10-08T13:05:37.900849+0000","last_clean":"2023-10-08T13:05:37.900849+0000","last_became_active":"2023-10-08T13:04:09.751935+0000","last_became_peered":"2023-10-08T13:04:09.751935+0000","last_unstale":"2023-10-08T13:05:37.900849+0000","last_undegraded":"2023-10-08T13:05:37.900849+0000","last_fullsized":"2023-10-08T13:05:37.900849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:08.270987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899579+0000","last_change":"2023-10-08T13:04:10.757744+0000","last_active":"2023-10-08T13:05:37.899579+0000","last_peered":"2023-10-08T13:05:37.899579+0000","last_clean":"2023-10-08T13:05:37.899579+0000","last_became_active":"2023-10-08T13:04:10.757466+0000","last_became_peered":"2023-10-08T13:04:10.757466+0000","last_unstale":"2023-10-08T13:05:37.899579+0000","last_undegraded":"2023-10-08T13:05:37.899579+0000","last_fullsized":"2023-10-08T13:05:37.899579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:49.560453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896881+0000","last_change":"2023-10-08T13:04:15.153072+0000","last_active":"2023-10-08T13:05:37.896881+0000","last_peered":"2023-10-08T13:05:37.896881+0000","last_clean":"2023-10-08T13:05:37.896881+0000","last_became_active":"2023-10-08T13:04:15.152345+0000","last_became_peered":"2023-10-08T13:04:15.152345+0000","last_unstale":"2023-10-08T13:05:37.896881+0000","last_undegraded":"2023-10-08T13:05:37.896881+0000","last_fullsized":"2023-10-08T13:05:37.896881+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:11.392430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898821+0000","last_change":"2023-10-08T13:04:09.751567+0000","last_active":"2023-10-08T13:05:37.898821+0000","last_peered":"2023-10-08T13:05:37.898821+0000","last_clean":"2023-10-08T13:05:37.898821+0000","last_became_active":"2023-10-08T13:04:09.751257+0000","last_became_peered":"2023-10-08T13:04:09.751257+0000","last_unstale":"2023-10-08T13:05:37.898821+0000","last_undegraded":"2023-10-08T13:05:37.898821+0000","last_fullsized":"2023-10-08T13:05:37.898821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:38:03.335622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899446+0000","last_change":"2023-10-08T13:04:10.755402+0000","last_active":"2023-10-08T13:05:37.899446+0000","last_peered":"2023-10-08T13:05:37.899446+0000","last_clean":"2023-10-08T13:05:37.899446+0000","last_became_active":"2023-10-08T13:04:10.755055+0000","last_became_peered":"2023-10-08T13:04:10.755055+0000","last_unstale":"2023-10-08T13:05:37.899446+0000","last_undegraded":"2023-10-08T13:05:37.899446+0000","last_fullsized":"2023-10-08T13:05:37.899446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:16:33.877093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907324+0000","last_change":"2023-10-08T13:04:38.213883+0000","last_active":"2023-10-08T13:05:37.907324+0000","last_peered":"2023-10-08T13:05:37.907324+0000","last_clean":"2023-10-08T13:05:37.907324+0000","last_became_active":"2023-10-08T13:04:38.212887+0000","last_became_peered":"2023-10-08T13:04:38.212887+0000","last_unstale":"2023-10-08T13:05:37.907324+0000","last_undegraded":"2023-10-08T13:05:37.907324+0000","last_fullsized":"2023-10-08T13:05:37.907324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:14.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.902351+0000","last_change":"2023-10-08T13:04:09.748670+0000","last_active":"2023-10-08T13:05:38.902351+0000","last_peered":"2023-10-08T13:05:38.902351+0000","last_clean":"2023-10-08T13:05:38.902351+0000","last_became_active":"2023-10-08T13:04:09.748138+0000","last_became_peered":"2023-10-08T13:04:09.748138+0000","last_unstale":"2023-10-08T13:05:38.902351+0000","last_undegraded":"2023-10-08T13:05:38.902351+0000","last_fullsized":"2023-10-08T13:05:38.902351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:26.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899561+0000","last_change":"2023-10-08T13:04:10.759523+0000","last_active":"2023-10-08T13:05:37.899561+0000","last_peered":"2023-10-08T13:05:37.899561+0000","last_clean":"2023-10-08T13:05:37.899561+0000","last_became_active":"2023-10-08T13:04:10.759186+0000","last_became_peered":"2023-10-08T13:04:10.759186+0000","last_unstale":"2023-10-08T13:05:37.899561+0000","last_undegraded":"2023-10-08T13:05:37.899561+0000","last_fullsized":"2023-10-08T13:05:37.899561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:37.596399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907877+0000","last_change":"2023-10-08T13:04:15.505913+0000","last_active":"2023-10-08T13:05:37.907877+0000","last_peered":"2023-10-08T13:05:37.907877+0000","last_clean":"2023-10-08T13:05:37.907877+0000","last_became_active":"2023-10-08T13:04:15.505242+0000","last_became_peered":"2023-10-08T13:04:15.505242+0000","last_unstale":"2023-10-08T13:05:37.907877+0000","last_undegraded":"2023-10-08T13:05:37.907877+0000","last_fullsized":"2023-10-08T13:05:37.907877+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:00:58.069245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900486+0000","last_change":"2023-10-08T13:04:09.751764+0000","last_active":"2023-10-08T13:05:37.900486+0000","last_peered":"2023-10-08T13:05:37.900486+0000","last_clean":"2023-10-08T13:05:37.900486+0000","last_became_active":"2023-10-08T13:04:09.751477+0000","last_became_peered":"2023-10-08T13:04:09.751477+0000","last_unstale":"2023-10-08T13:05:37.900486+0000","last_undegraded":"2023-10-08T13:05:37.900486+0000","last_fullsized":"2023-10-08T13:05:37.900486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:46:12.663827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.897912+0000","last_change":"2023-10-08T13:04:10.764281+0000","last_active":"2023-10-08T13:05:37.897912+0000","last_peered":"2023-10-08T13:05:37.897912+0000","last_clean":"2023-10-08T13:05:37.897912+0000","last_became_active":"2023-10-08T13:04:10.763890+0000","last_became_peered":"2023-10-08T13:04:10.763890+0000","last_unstale":"2023-10-08T13:05:37.897912+0000","last_undegraded":"2023-10-08T13:05:37.897912+0000","last_fullsized":"2023-10-08T13:05:37.897912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:13.850677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.901970+0000","last_change":"2023-10-08T13:04:15.141197+0000","last_active":"2023-10-08T13:05:37.901970+0000","last_peered":"2023-10-08T13:05:37.901970+0000","last_clean":"2023-10-08T13:05:37.901970+0000","last_became_active":"2023-10-08T13:04:15.140741+0000","last_became_peered":"2023-10-08T13:04:15.140741+0000","last_unstale":"2023-10-08T13:05:37.901970+0000","last_undegraded":"2023-10-08T13:05:37.901970+0000","last_fullsized":"2023-10-08T13:05:37.901970+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:55.554419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'8","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:05:59.296360+0000","last_change":"2023-10-08T13:04:09.750515+0000","last_active":"2023-10-08T13:05:59.296360+0000","last_peered":"2023-10-08T13:05:59.296360+0000","last_clean":"2023-10-08T13:05:59.296360+0000","last_became_active":"2023-10-08T13:04:09.750169+0000","last_became_peered":"2023-10-08T13:04:09.750169+0000","last_unstale":"2023-10-08T13:05:59.296360+0000","last_undegraded":"2023-10-08T13:05:59.296360+0000","last_fullsized":"2023-10-08T13:05:59.296360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:35.549208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2019,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898498+0000","last_change":"2023-10-08T13:04:10.764378+0000","last_active":"2023-10-08T13:05:37.898498+0000","last_peered":"2023-10-08T13:05:37.898498+0000","last_clean":"2023-10-08T13:05:37.898498+0000","last_became_active":"2023-10-08T13:04:10.763933+0000","last_became_peered":"2023-10-08T13:04:10.763933+0000","last_unstale":"2023-10-08T13:05:37.898498+0000","last_undegraded":"2023-10-08T13:05:37.898498+0000","last_fullsized":"2023-10-08T13:05:37.898498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:44.515845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476182+0000","last_change":"2023-10-08T13:04:15.152155+0000","last_active":"2023-10-08T13:05:38.476182+0000","last_peered":"2023-10-08T13:05:38.476182+0000","last_clean":"2023-10-08T13:05:38.476182+0000","last_became_active":"2023-10-08T13:04:15.151702+0000","last_became_peered":"2023-10-08T13:04:15.151702+0000","last_unstale":"2023-10-08T13:05:38.476182+0000","last_undegraded":"2023-10-08T13:05:38.476182+0000","last_fullsized":"2023-10-08T13:05:38.476182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:41.402680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.906326+0000","last_change":"2023-10-08T13:04:09.747130+0000","last_active":"2023-10-08T13:05:37.906326+0000","last_peered":"2023-10-08T13:05:37.906326+0000","last_clean":"2023-10-08T13:05:37.906326+0000","last_became_active":"2023-10-08T13:04:09.746789+0000","last_became_peered":"2023-10-08T13:04:09.746789+0000","last_unstale":"2023-10-08T13:05:37.906326+0000","last_undegraded":"2023-10-08T13:05:37.906326+0000","last_fullsized":"2023-10-08T13:05:37.906326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:13.003950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898116+0000","last_change":"2023-10-08T13:04:10.764347+0000","last_active":"2023-10-08T13:05:37.898116+0000","last_peered":"2023-10-08T13:05:37.898116+0000","last_clean":"2023-10-08T13:05:37.898116+0000","last_became_active":"2023-10-08T13:04:10.763922+0000","last_became_peered":"2023-10-08T13:04:10.763922+0000","last_unstale":"2023-10-08T13:05:37.898116+0000","last_undegraded":"2023-10-08T13:05:37.898116+0000","last_fullsized":"2023-10-08T13:05:37.898116+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:51.277980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.904627+0000","last_change":"2023-10-08T13:04:15.144037+0000","last_active":"2023-10-08T13:05:37.904627+0000","last_peered":"2023-10-08T13:05:37.904627+0000","last_clean":"2023-10-08T13:05:37.904627+0000","last_became_active":"2023-10-08T13:04:15.143681+0000","last_became_peered":"2023-10-08T13:04:15.143681+0000","last_unstale":"2023-10-08T13:05:37.904627+0000","last_undegraded":"2023-10-08T13:05:37.904627+0000","last_fullsized":"2023-10-08T13:05:37.904627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:14.116428+0000","last_clean_scrub_stamp":"2023-10-08T13:04:14.116428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:53.952396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252671+0000","last_change":"2023-10-08T13:04:09.748721+0000","last_active":"2023-10-08T13:05:38.252671+0000","last_peered":"2023-10-08T13:05:38.252671+0000","last_clean":"2023-10-08T13:05:38.252671+0000","last_became_active":"2023-10-08T13:04:09.748395+0000","last_became_peered":"2023-10-08T13:04:09.748395+0000","last_unstale":"2023-10-08T13:05:38.252671+0000","last_undegraded":"2023-10-08T13:05:38.252671+0000","last_fullsized":"2023-10-08T13:05:38.252671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:08.723531+0000","last_clean_scrub_stamp":"2023-10-08T13:04:08.723531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:17.040373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898426+0000","last_change":"2023-10-08T13:04:10.760985+0000","last_active":"2023-10-08T13:05:37.898426+0000","last_peered":"2023-10-08T13:05:37.898426+0000","last_clean":"2023-10-08T13:05:37.898426+0000","last_became_active":"2023-10-08T13:04:10.760439+0000","last_became_peered":"2023-10-08T13:04:10.760439+0000","last_unstale":"2023-10-08T13:05:37.898426+0000","last_undegraded":"2023-10-08T13:05:37.898426+0000","last_fullsized":"2023-10-08T13:05:37.898426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:49.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.899508+0000","last_change":"2023-10-08T13:04:10.752896+0000","last_active":"2023-10-08T13:05:37.899508+0000","last_peered":"2023-10-08T13:05:37.899508+0000","last_clean":"2023-10-08T13:05:37.899508+0000","last_became_active":"2023-10-08T13:04:10.752569+0000","last_became_peered":"2023-10-08T13:04:10.752569+0000","last_unstale":"2023-10-08T13:05:37.899508+0000","last_undegraded":"2023-10-08T13:05:37.899508+0000","last_fullsized":"2023-10-08T13:05:37.899508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:08:19.026814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898361+0000","last_change":"2023-10-08T13:04:10.754944+0000","last_active":"2023-10-08T13:05:37.898361+0000","last_peered":"2023-10-08T13:05:37.898361+0000","last_clean":"2023-10-08T13:05:37.898361+0000","last_became_active":"2023-10-08T13:04:10.754370+0000","last_became_peered":"2023-10-08T13:04:10.754370+0000","last_unstale":"2023-10-08T13:05:37.898361+0000","last_undegraded":"2023-10-08T13:05:37.898361+0000","last_fullsized":"2023-10-08T13:05:37.898361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:14.039916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898299+0000","last_change":"2023-10-08T13:04:10.759418+0000","last_active":"2023-10-08T13:05:37.898299+0000","last_peered":"2023-10-08T13:05:37.898299+0000","last_clean":"2023-10-08T13:05:37.898299+0000","last_became_active":"2023-10-08T13:04:10.758994+0000","last_became_peered":"2023-10-08T13:04:10.758994+0000","last_unstale":"2023-10-08T13:05:37.898299+0000","last_undegraded":"2023-10-08T13:05:37.898299+0000","last_fullsized":"2023-10-08T13:05:37.898299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:52.509422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.476442+0000","last_change":"2023-10-08T13:04:10.756899+0000","last_active":"2023-10-08T13:05:38.476442+0000","last_peered":"2023-10-08T13:05:38.476442+0000","last_clean":"2023-10-08T13:05:38.476442+0000","last_became_active":"2023-10-08T13:04:10.756604+0000","last_became_peered":"2023-10-08T13:04:10.756604+0000","last_unstale":"2023-10-08T13:05:38.476442+0000","last_undegraded":"2023-10-08T13:05:38.476442+0000","last_fullsized":"2023-10-08T13:05:38.476442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:13:40.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252558+0000","last_change":"2023-10-08T13:04:10.751896+0000","last_active":"2023-10-08T13:05:38.252558+0000","last_peered":"2023-10-08T13:05:38.252558+0000","last_clean":"2023-10-08T13:05:38.252558+0000","last_became_active":"2023-10-08T13:04:10.751639+0000","last_became_peered":"2023-10-08T13:04:10.751639+0000","last_unstale":"2023-10-08T13:05:38.252558+0000","last_undegraded":"2023-10-08T13:05:38.252558+0000","last_fullsized":"2023-10-08T13:05:38.252558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:34:40.230363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900173+0000","last_change":"2023-10-08T13:04:10.757416+0000","last_active":"2023-10-08T13:05:37.900173+0000","last_peered":"2023-10-08T13:05:37.900173+0000","last_clean":"2023-10-08T13:05:37.900173+0000","last_became_active":"2023-10-08T13:04:10.757115+0000","last_became_peered":"2023-10-08T13:04:10.757115+0000","last_unstale":"2023-10-08T13:05:37.900173+0000","last_undegraded":"2023-10-08T13:05:37.900173+0000","last_fullsized":"2023-10-08T13:05:37.900173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:06:00.472475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.898897+0000","last_change":"2023-10-08T13:04:10.763437+0000","last_active":"2023-10-08T13:05:37.898897+0000","last_peered":"2023-10-08T13:05:37.898897+0000","last_clean":"2023-10-08T13:05:37.898897+0000","last_became_active":"2023-10-08T13:04:10.763174+0000","last_became_peered":"2023-10-08T13:04:10.763174+0000","last_unstale":"2023-10-08T13:05:37.898897+0000","last_undegraded":"2023-10-08T13:05:37.898897+0000","last_fullsized":"2023-10-08T13:05:37.898897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:04.940315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900027+0000","last_change":"2023-10-08T13:04:10.751258+0000","last_active":"2023-10-08T13:05:37.900027+0000","last_peered":"2023-10-08T13:05:37.900027+0000","last_clean":"2023-10-08T13:05:37.900027+0000","last_became_active":"2023-10-08T13:04:10.750952+0000","last_became_peered":"2023-10-08T13:04:10.750952+0000","last_unstale":"2023-10-08T13:05:37.900027+0000","last_undegraded":"2023-10-08T13:05:37.900027+0000","last_fullsized":"2023-10-08T13:05:37.900027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:57.676629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.907520+0000","last_change":"2023-10-08T13:04:10.753809+0000","last_active":"2023-10-08T13:05:37.907520+0000","last_peered":"2023-10-08T13:05:37.907520+0000","last_clean":"2023-10-08T13:05:37.907520+0000","last_became_active":"2023-10-08T13:04:10.753498+0000","last_became_peered":"2023-10-08T13:04:10.753498+0000","last_unstale":"2023-10-08T13:05:37.907520+0000","last_undegraded":"2023-10-08T13:05:37.907520+0000","last_fullsized":"2023-10-08T13:05:37.907520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:31.093679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.896505+0000","last_change":"2023-10-08T13:04:38.213278+0000","last_active":"2023-10-08T13:05:37.896505+0000","last_peered":"2023-10-08T13:05:37.896505+0000","last_clean":"2023-10-08T13:05:37.896505+0000","last_became_active":"2023-10-08T13:04:38.213016+0000","last_became_peered":"2023-10-08T13:04:38.213016+0000","last_unstale":"2023-10-08T13:05:37.896505+0000","last_undegraded":"2023-10-08T13:05:37.896505+0000","last_fullsized":"2023-10-08T13:05:37.896505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:49.650606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.902188+0000","last_change":"2023-10-08T13:04:10.756089+0000","last_active":"2023-10-08T13:05:37.902188+0000","last_peered":"2023-10-08T13:05:37.902188+0000","last_clean":"2023-10-08T13:05:37.902188+0000","last_became_active":"2023-10-08T13:04:10.755786+0000","last_became_peered":"2023-10-08T13:04:10.755786+0000","last_unstale":"2023-10-08T13:05:37.902188+0000","last_undegraded":"2023-10-08T13:05:37.902188+0000","last_fullsized":"2023-10-08T13:05:37.902188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:28.229945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:38.252491+0000","last_change":"2023-10-08T13:04:10.755493+0000","last_active":"2023-10-08T13:05:38.252491+0000","last_peered":"2023-10-08T13:05:38.252491+0000","last_clean":"2023-10-08T13:05:38.252491+0000","last_became_active":"2023-10-08T13:04:10.755156+0000","last_became_peered":"2023-10-08T13:04:10.755156+0000","last_unstale":"2023-10-08T13:05:38.252491+0000","last_undegraded":"2023-10-08T13:05:38.252491+0000","last_fullsized":"2023-10-08T13:05:38.252491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:15.913139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:05:37.900063+0000","last_change":"2023-10-08T13:04:10.752978+0000","last_active":"2023-10-08T13:05:37.900063+0000","last_peered":"2023-10-08T13:05:37.900063+0000","last_clean":"2023-10-08T13:05:37.900063+0000","last_became_active":"2023-10-08T13:04:10.752651+0000","last_became_peered":"2023-10-08T13:04:10.752651+0000","last_unstale":"2023-10-08T13:05:37.900063+0000","last_undegraded":"2023-10-08T13:05:37.900063+0000","last_fullsized":"2023-10-08T13:05:37.900063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:04:09.729188+0000","last_clean_scrub_stamp":"2023-10-08T13:04:09.729188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:27:17.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67391,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":886,"num_read_kb":512,"num_write":252,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":644,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":210813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":525237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53100000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.45600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":1.165,"15min":1.165},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.40400000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.41199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88600000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86599999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.6840000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.57299999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.747,"15min":0.73399999999999999},"min":{"1min":0.68700000000000006,"5min":0.439,"15min":0.439},"max":{"1min":0.97599999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.55200000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.997,"5min":1.419,"15min":1.419},"last":0.83299999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.86699999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.77000000000000002,"15min":0.754},"min":{"1min":0.626,"5min":0.44,"15min":0.44},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.77900000000000003,"15min":0.76900000000000002},"min":{"1min":0.65700000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.048,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82199999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.77400000000000002,"15min":0.76400000000000001},"min":{"1min":0.66500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0309999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78700000000000003,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.78700000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678053,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1740800,"data_stored":1170771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.34100000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.51700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.503},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86899999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":1.456,"15min":1.456},"last":0.38600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.383,"15min":1.383},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93400000000000005,"5min":1.085,"15min":1.085},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83799999999999997,"15min":0.84099999999999997},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":1.337,"15min":1.337},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78200000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.56499999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.879,"15min":0.88700000000000001},"min":{"1min":0.66900000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98899999999999999,"5min":1.637,"15min":1.637},"last":0.57799999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89200000000000002,"15min":0.89100000000000001},"min":{"1min":0.68999999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1459999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.89500000000000002,"15min":0.90300000000000002},"min":{"1min":0.627,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.748,"15min":1.748},"last":0.59999999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.0780000000000003,"5min":6.0780000000000003,"15min":6.0780000000000003},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":0.96499999999999997,"15min":0.91500000000000004},"min":{"1min":0.81899999999999995,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":6.1289999999999996,"5min":6.1289999999999996,"15min":6.1289999999999996},"last":0.90900000000000003}]}]},{"osd":9,"up_from":66,"seq":283467841578,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":524296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.443},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56000000000000005,"5min":0.625,"15min":0.625},"last":0.378},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.44400000000000001,"15min":0.46400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57499999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78000000000000003,"5min":0.875,"15min":0.875},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.64500000000000002},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79300000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.502}]},{"osd":3,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52900000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.56399999999999995,"15min":0.60399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63500000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81200000000000006,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.81200000000000006,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.84299999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.72199999999999998,"15min":0.751},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.80600000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.52800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90500000000000003,"5min":1.123,"15min":1.123},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.85599999999999998,"5min":1.109,"15min":1.109},"last":0.624}]},{"osd":10,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0189999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.79200000000000004,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.871,"5min":1.095,"15min":1.095},"last":0.73599999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65600000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103215,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":528417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90400000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.35099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73799999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.503},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78500000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.626,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0489999999999999,"5min":1.127,"15min":1.127},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.878}]},{"osd":5,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.83299999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59599999999999997,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":1.0369999999999999,"5min":1.127,"15min":1.127},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93999999999999995,"5min":1.048,"15min":1.048},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92900000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68999999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.56399999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83799999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.755,"15min":0.746},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77900000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72599999999999998},"min":{"1min":0.64500000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.745},{"interface":"front","average":{"1min":0.88,"5min":0.77500000000000002,"15min":0.75700000000000001},"min":{"1min":0.69799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0189999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.90200000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.624},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85299999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1658880,"data_stored":1117473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92700000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53900000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.502},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.623},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84599999999999997,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.66200000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.748},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0049999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":1,"15min":1},"last":0.747}]},{"osd":8,"last update":"Sun Oct 8 13:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.67000000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.23,"15min":1.23},"last":1.101},{"interface":"front","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.72899999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.82199999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.74199999999999999,"15min":0.73299999999999998},"min":{"1min":0.54500000000000004,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.69399999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.103,"5min":1.266,"15min":1.266},"last":0.97299999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.04},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.58099999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.90000000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.222},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.329}]}]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":520331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.38900000000000001},"min":{"1min":0.32600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.32100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79400000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76700000000000002,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.59499999999999997},"min":{"1min":0.44600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.80500000000000005,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.54000000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52600000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42999999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61499999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.167,"15min":1.167},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88800000000000001,"5min":1.075,"15min":1.075},"last":0.61099999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82699999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.502,"5min":0.377,"15min":0.377},"max":{"1min":0.88200000000000001,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.57999999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.78200000000000003},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.02,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77000000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77300000000000002,"15min":0.77800000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.89000000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.627}]},{"osd":9,"last update":"Sun Oct 8 13:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.496,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78200000000000003,"15min":0.80800000000000005},"min":{"1min":0.45500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71299999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.86899999999999999},"min":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.137,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78800000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.65900000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":585137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.59599999999999997,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0860000000000003,"5min":6.0860000000000003,"15min":6.0860000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.51700000000000002},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80600000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.59399999999999997,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85499999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.59799999999999998,"15min":0.53300000000000003},"min":{"1min":0.501,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.93300000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.62,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63300000000000001,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.83199999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.47999999999999998},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51600000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.71499999999999997,"15min":0.66900000000000004},"min":{"1min":0.54900000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.98399999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71799999999999997,"15min":0.67400000000000004},"min":{"1min":0.56699999999999995,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.628,"15min":0.58199999999999996},"min":{"1min":0.53400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.69199999999999995,"15min":0.64500000000000002},"min":{"1min":0.54300000000000004,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.083,"5min":1.173,"15min":1.173},"last":0.95599999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.61199999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.1499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.91600000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.81599999999999995,"15min":0.78600000000000003},"min":{"1min":0.63300000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0669999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.097,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.871},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.875,"15min":0.87},"min":{"1min":0.67800000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.748}]},{"osd":11,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0369999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":522105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":1.278,"15min":1.278},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.5},"min":{"1min":0.36199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.80300000000000005,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.39900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70999999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.56499999999999995},"min":{"1min":0.30499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59099999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.316}]},{"osd":4,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88500000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58899999999999997,"15min":0.55000000000000004},"min":{"1min":0.442,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.753,"5min":1.387,"15min":1.387},"last":0.53400000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.745,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71599999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69799999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.433},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.879,"5min":1.01,"15min":1.01},"last":0.34899999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68999999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.47499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.55500000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.625,"15min":0.628},"min":{"1min":0.36199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77000000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90000000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.40200000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90800000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.095,"15min":1.095},"last":0.72699999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:05:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78400000000000003,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91200000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.57299999999999995}]}]},{"osd":2,"up_from":19,"seq":81604378696,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":588751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70899999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.434,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.70999999999999996,"5min":1.353,"15min":1.353},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.59499999999999997,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.89700000000000002,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.504,"5min":0.246,"15min":0.246},"max":{"1min":0.93300000000000005,"5min":1.248,"15min":1.248},"last":0.82999999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61799999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94999999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.89500000000000002,"5min":1.375,"15min":1.375},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.441},"min":{"1min":0.39800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.85699999999999998,"5min":1.72,"15min":1.72},"last":0.62},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.54100000000000004,"15min":0.49099999999999999},"min":{"1min":0.46100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91400000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.624,"15min":0.58799999999999997},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.91300000000000003,"5min":1.135,"15min":1.135},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Oct 8 13:05:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.93300000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:05:33 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0009999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.63,"15min":0.59399999999999997},"min":{"1min":0.45500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.95899999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73599999999999999,"15min":0.71499999999999997},"min":{"1min":0.63200000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96399999999999997,"5min":1.169,"15min":1.169},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.65700000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98999999999999999,"5min":1.397,"15min":1.397},"last":0.878}]},{"osd":10,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.054,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.073,"5min":1.296,"15min":1.296},"last":1.016}]},{"osd":11,"last update":"Sun Oct 8 13:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.999}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":519508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.42699999999999999,"15min":0.371},"min":{"1min":0.313,"5min":0.222,"15min":0.222},"max":{"1min":3.96,"5min":3.96,"15min":3.96},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.35299999999999998},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.253},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.46600000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.622},{"interface":"front","average":{"1min":0.625,"5min":0.57299999999999995,"15min":0.53900000000000003},"min":{"1min":0.373,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59499999999999997,"15min":0.55800000000000005},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.871,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.81899999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.47899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79500000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.84199999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:05:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.754}]},{"osd":6,"last update":"Sun Oct 8 13:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72699999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.5270000000000001,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80000000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.76400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93700000000000006,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72199999999999998,"15min":0.74099999999999999},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89000000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72999999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.085,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64600000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:05:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.86199999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":524405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:04:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80900000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.747}]},{"osd":3,"last update":"Sun Oct 8 13:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61699999999999999,"15min":0.58499999999999996},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.437}]},{"osd":5,"last update":"Sun Oct 8 13:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.70999999999999996,"15min":0.68799999999999994},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.871}]},{"osd":6,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.5,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84599999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.67300000000000004},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.86099999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.64700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94899999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68899999999999995,"15min":0.66100000000000003},"min":{"1min":0.57499999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":1.044,"15min":1.044},"last":0.72799999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92100000000000004,"5min":1.075,"15min":1.075},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.68899999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0229999999999999,"5min":1.071,"15min":1.071},"last":0.83499999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83099999999999996,"15min":0.83199999999999996},"min":{"1min":0.69599999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98999999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95799999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.623}]},{"osd":10,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.081,"5min":1.137,"15min":1.137},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0409999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70199999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.90200000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1112266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52200000000000002,"15min":0.501},"min":{"1min":0.32400000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68200000000000005,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.5},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.7869999999999999,"5min":2.7869999999999999,"15min":2.7869999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.62,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42599999999999999,"15min":0.39100000000000001},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82199999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.36199999999999999},"min":{"1min":0.317,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68300000000000005,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.52200000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72199999999999998,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.437},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69599999999999995,"5min":2.085,"15min":2.085},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60699999999999998,"15min":0.56299999999999994},"min":{"1min":0.47199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":1.962,"15min":1.962},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83999999999999997,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61299999999999999,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86099999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90900000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.93400000000000005,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88500000000000001,"5min":2.113,"15min":2.113},"last":0.63900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97499999999999998,"5min":2.198,"15min":2.198},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66500000000000004,"15min":0.67900000000000005},"min":{"1min":0.44900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89800000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.67000000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.56799999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92900000000000005,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0569999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.72399999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":1.99,"15min":1.99},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94799999999999995,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.73499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:06:02.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:06:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 -- 172.21.15.5:0/3455677113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0ff550 msgr2=0x7faeac0ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/3455677113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0ff550 0x7faeac0ff9d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fae9c0099c0 tx=0x7fae9c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 -- 172.21.15.5:0/3455677113 shutdown_connections 2023-10-08T13:06:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/3455677113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeac0fff10 0x7faeac10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/3455677113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac105610 0x7faeac1059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/3455677113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0ff550 0x7faeac0ff9d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 -- 172.21.15.5:0/3455677113 >> 172.21.15.5:0/3455677113 conn(0x7faeac0fb040 msgr2=0x7faeac0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 -- 172.21.15.5:0/3455677113 shutdown_connections 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.496+0000 7faeb3bb2700 1 -- 172.21.15.5:0/3455677113 wait complete. 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 Processor -- start 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 -- start start 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac0ff550 0x7faeac197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 0x7faeac197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeac105610 0x7faeac1a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1985d0 con 0x7faeac0fff10 2023-10-08T13:06:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1a2de0 con 0x7faeac0ff550 2023-10-08T13:06:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb3bb2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1a2f20 con 0x7faeac105610 2023-10-08T13:06:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb114d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 0x7faeac197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb114d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 0x7faeac197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34572/0 (socket says 172.21.15.5:34572) 2023-10-08T13:06:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.497+0000 7faeb114d700 1 -- 172.21.15.5:0/77926634 learned_addr learned my addr 172.21.15.5:0/77926634 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb194e700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac0ff550 0x7faeac197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb214f700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeac105610 0x7faeac1a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb114d700 1 -- 172.21.15.5:0/77926634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeac105610 msgr2=0x7faeac1a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb114d700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeac105610 0x7faeac1a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb114d700 1 -- 172.21.15.5:0/77926634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac0ff550 msgr2=0x7faeac197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb114d700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac0ff550 0x7faeac197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb114d700 1 -- 172.21.15.5:0/77926634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0095f0 con 0x7faeac0fff10 2023-10-08T13:06:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb194e700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac0ff550 0x7faeac197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb114d700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 0x7faeac197d60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009990 tx=0x7fae9c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c01d070 con 0x7faeac0fff10 2023-10-08T13:06:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae9c004ca0 con 0x7faeac0fff10 2023-10-08T13:06:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac1a3150 con 0x7faeac0fff10 2023-10-08T13:06:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00f9d0 con 0x7faeac0fff10 2023-10-08T13:06:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.498+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac1a3570 con 0x7faeac0fff10 2023-10-08T13:06:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.499+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac107ab0 con 0x7faeac0fff10 2023-10-08T13:06:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.500+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fae9c0047e0 con 0x7faeac0fff10 2023-10-08T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.501+0000 7faea2ffd700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae980a1550 0x7fae980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.501+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fae9c0cdf40 con 0x7faeac0fff10 2023-10-08T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.501+0000 7faeb194e700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae980a1550 0x7fae980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.501+0000 7faeb194e700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae980a1550 0x7fae980a3a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faea8005fd0 tx=0x7faea8005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.504+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae9c0971d0 con 0x7faeac0fff10 2023-10-08T13:06:02.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:02 smithi118 ceph-mon[104234]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:06:02.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:02 smithi118 ceph-mon[104234]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:02.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:02 smithi118 ceph-mon[104234]: from='client.15765 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:02.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:02 smithi060 ceph-mon[103190]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:06:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:02 smithi060 ceph-mon[103190]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:02.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:02 smithi060 ceph-mon[103190]: from='client.15765 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:02.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:02 smithi005 ceph-mon[99496]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:06:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:02 smithi005 ceph-mon[99496]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:02 smithi005 ceph-mon[99496]: from='client.15765 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:02.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.706+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeac100c70 con 0x7faeac0fff10 2023-10-08T13:06:02.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.708+0000 7faea2ffd700 1 -- 172.21.15.5:0/77926634 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7fae9c0203b0 con 0x7faeac0fff10 2023-10-08T13:06:02.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:02.710 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:06:02.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae980a1550 msgr2=0x7fae980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae980a1550 0x7fae980a3a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faea8005fd0 tx=0x7faea8005e30 comp rx=0 tx=0).stop 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 msgr2=0x7faeac197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 0x7faeac197d60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009990 tx=0x7fae9c005e80 comp rx=0 tx=0).stop 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 shutdown_connections 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fae980a1550 0x7fae980a3a10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeac105610 0x7faeac1a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeac0ff550 0x7faeac197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 --2- 172.21.15.5:0/77926634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeac0fff10 0x7faeac197d60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 >> 172.21.15.5:0/77926634 conn(0x7faeac0fb040 msgr2=0x7faeac0fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 shutdown_connections 2023-10-08T13:06:02.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.710+0000 7faeb3bb2700 1 -- 172.21.15.5:0/77926634 wait complete. 2023-10-08T13:06:02.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:06:02.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:06:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 -- 172.21.15.5:0/552454191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac1055f0 msgr2=0x7feaac1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 --2- 172.21.15.5:0/552454191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac1055f0 0x7feaac1059d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0099c0 tx=0x7fea9c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 -- 172.21.15.5:0/552454191 shutdown_connections 2023-10-08T13:06:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 --2- 172.21.15.5:0/552454191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaac0ffef0 0x7feaac10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 --2- 172.21.15.5:0/552454191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac1055f0 0x7feaac1059d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 --2- 172.21.15.5:0/552454191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac0ff530 0x7feaac0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 -- 172.21.15.5:0/552454191 >> 172.21.15.5:0/552454191 conn(0x7feaac0fafc0 msgr2=0x7feaac0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 -- 172.21.15.5:0/552454191 shutdown_connections 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.855+0000 7feab26ab700 1 -- 172.21.15.5:0/552454191 wait complete. 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 Processor -- start 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 -- start start 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 0x7feaac19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaac0ffef0 0x7feaac19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac1055f0 0x7feaac196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac196df0 con 0x7feaac0ff530 2023-10-08T13:06:02.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac196f60 con 0x7feaac1055f0 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab26ab700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac197120 con 0x7feaac0ffef0 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feaabfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 0x7feaac19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feaabfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 0x7feaac19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34584/0 (socket says 172.21.15.5:34584) 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feaabfff700 1 -- 172.21.15.5:0/928782826 learned_addr learned my addr 172.21.15.5:0/928782826 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.856+0000 7feab0c48700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac1055f0 0x7feaac196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaab7fe700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaac0ffef0 0x7feaac19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaabfff700 1 -- 172.21.15.5:0/928782826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaac0ffef0 msgr2=0x7feaac19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaabfff700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaac0ffef0 0x7feaac19cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaabfff700 1 -- 172.21.15.5:0/928782826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac1055f0 msgr2=0x7feaac196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:02.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaabfff700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac1055f0 0x7feaac196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaabfff700 1 -- 172.21.15.5:0/928782826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0095f0 con 0x7feaac0ff530 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feab0c48700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac1055f0 0x7feaac196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaabfff700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 0x7feaac19c650 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098e0 tx=0x7fea9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c01d070 con 0x7feaac0ff530 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea9c00fcb0 con 0x7feaac0ff530 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac1973a0 con 0x7feaac0ff530 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c022e40 con 0x7feaac0ff530 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.857+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac1a3640 con 0x7feaac0ff530 2023-10-08T13:06:02.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.858+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac100c50 con 0x7feaac0ff530 2023-10-08T13:06:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.859+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fea9c022570 con 0x7feaac0ff530 2023-10-08T13:06:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.860+0000 7feaa97fa700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fea940a1550 0x7fea940a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:02.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.860+0000 7feaab7fe700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fea940a1550 0x7fea940a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.860+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fea9c0ce860 con 0x7feaac0ff530 2023-10-08T13:06:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.860+0000 7feaab7fe700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fea940a1550 0x7fea940a3a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feaac197ba0 tx=0x7feaa0005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:02.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:02.863+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea9c097af0 con 0x7feaac0ff530 2023-10-08T13:06:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.068+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feaac197c40 con 0x7feaac0ff530 2023-10-08T13:06:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.068+0000 7feaa97fa700 1 -- 172.21.15.5:0/928782826 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea9c027020 con 0x7feaac0ff530 2023-10-08T13:06:03.070 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:06:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fea940a1550 msgr2=0x7fea940a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fea940a1550 0x7fea940a3a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feaac197ba0 tx=0x7feaa0005d50 comp rx=0 tx=0).stop 2023-10-08T13:06:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 msgr2=0x7feaac19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 0x7feaac19c650 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0098e0 tx=0x7fea9c0057f0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 shutdown_connections 2023-10-08T13:06:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fea940a1550 0x7fea940a3a10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaac1055f0 0x7feaac196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaac0ff530 0x7feaac19c650 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 --2- 172.21.15.5:0/928782826 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaac0ffef0 0x7feaac19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 >> 172.21.15.5:0/928782826 conn(0x7feaac0fafc0 msgr2=0x7feaac0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 shutdown_connections 2023-10-08T13:06:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.071+0000 7feab26ab700 1 -- 172.21.15.5:0/928782826 wait complete. 2023-10-08T13:06:03.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:06:03.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 -- 172.21.15.5:0/4089943117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0500ffc90 msgr2=0x7fe050100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 --2- 172.21.15.5:0/4089943117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0500ffc90 0x7fe050100110 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe0380099c0 tx=0x7fe038009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 -- 172.21.15.5:0/4089943117 shutdown_connections 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 --2- 172.21.15.5:0/4089943117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe050100650 0x7fe05010c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 --2- 172.21.15.5:0/4089943117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 0x7fe050105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 --2- 172.21.15.5:0/4089943117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0500ffc90 0x7fe050100110 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 -- 172.21.15.5:0/4089943117 >> 172.21.15.5:0/4089943117 conn(0x7fe050075b10 msgr2=0x7fe0500fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 -- 172.21.15.5:0/4089943117 shutdown_connections 2023-10-08T13:06:03.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.215+0000 7fe054996700 1 -- 172.21.15.5:0/4089943117 wait complete. 2023-10-08T13:06:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 Processor -- start 2023-10-08T13:06:03.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 -- start start 2023-10-08T13:06:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0500ffc90 0x7fe05019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 0x7fe05019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 0x7fe0501957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050195e30 con 0x7fe050100650 2023-10-08T13:06:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050195fa0 con 0x7fe0500ffc90 2023-10-08T13:06:03.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe054996700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050196160 con 0x7fe0501056a0 2023-10-08T13:06:03.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe047fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 0x7fe05019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe047fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 0x7fe05019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34600/0 (socket says 172.21.15.5:34600) 2023-10-08T13:06:03.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe047fff700 1 -- 172.21.15.5:0/3490730021 learned_addr learned my addr 172.21.15.5:0/3490730021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe04e59c700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0500ffc90 0x7fe05019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.216+0000 7fe04ed9d700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 0x7fe0501957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe047fff700 1 -- 172.21.15.5:0/3490730021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 msgr2=0x7fe0501957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe047fff700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 0x7fe0501957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe047fff700 1 -- 172.21.15.5:0/3490730021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0500ffc90 msgr2=0x7fe05019b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe047fff700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0500ffc90 0x7fe05019b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe047fff700 1 -- 172.21.15.5:0/3490730021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380095f0 con 0x7fe050100650 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe04ed9d700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 0x7fe0501957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe047fff700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 0x7fe05019bbd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe038009990 tx=0x7fe038004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:03.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03801f070 con 0x7fe050100650 2023-10-08T13:06:03.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe038019cd0 con 0x7fe050100650 2023-10-08T13:06:03.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0501963e0 con 0x7fe050100650 2023-10-08T13:06:03.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800fd10 con 0x7fe050100650 2023-10-08T13:06:03.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.217+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0500fed60 con 0x7fe050100650 2023-10-08T13:06:03.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.218+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe050100ca0 con 0x7fe050100650 2023-10-08T13:06:03.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.219+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fe03800f460 con 0x7fe050100650 2023-10-08T13:06:03.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.219+0000 7fe0477fe700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe03c0a14d0 0x7fe03c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.220+0000 7fe04e59c700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe03c0a14d0 0x7fe03c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.220+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe0380d03e0 con 0x7fe050100650 2023-10-08T13:06:03.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.220+0000 7fe04e59c700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe03c0a14d0 0x7fe03c0a3990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe050072be0 tx=0x7fe04000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:03.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.223+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe038099670 con 0x7fe050100650 2023-10-08T13:06:03.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:03 smithi005 ceph-mon[99496]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:03.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:03 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/77926634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:03.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:03 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/928782826' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:06:03.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.426+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe050196c80 con 0x7fe050100650 2023-10-08T13:06:03.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.427+0000 7fe0477fe700 1 -- 172.21.15.5:0/3490730021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe03809cc90 con 0x7fe050100650 2023-10-08T13:06:03.428 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:06:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe03c0a14d0 msgr2=0x7fe03c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe03c0a14d0 0x7fe03c0a3990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe050072be0 tx=0x7fe04000b410 comp rx=0 tx=0).stop 2023-10-08T13:06:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 msgr2=0x7fe05019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 0x7fe05019bbd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe038009990 tx=0x7fe038004730 comp rx=0 tx=0).stop 2023-10-08T13:06:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 shutdown_connections 2023-10-08T13:06:03.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe03c0a14d0 0x7fe03c0a3990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0501056a0 0x7fe0501957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0500ffc90 0x7fe05019b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 --2- 172.21.15.5:0/3490730021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe050100650 0x7fe05019bbd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 >> 172.21.15.5:0/3490730021 conn(0x7fe050075b10 msgr2=0x7fe0500fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:03.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 shutdown_connections 2023-10-08T13:06:03.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.429+0000 7fe054996700 1 -- 172.21.15.5:0/3490730021 wait complete. 2023-10-08T13:06:03.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:06:03.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:03 smithi118 ceph-mon[104234]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:03 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/77926634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:03.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:03 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/928782826' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:06:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 -- 172.21.15.5:0/450908869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040fff00 msgr2=0x7f3b0410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 --2- 172.21.15.5:0/450908869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040fff00 0x7f3b0410c3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00b0d0 tx=0x7f3afc00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 -- 172.21.15.5:0/450908869 shutdown_connections 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 --2- 172.21.15.5:0/450908869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040fff00 0x7f3b0410c3c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 --2- 172.21.15.5:0/450908869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04105600 0x7f3b041059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 --2- 172.21.15.5:0/450908869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b040ff540 0x7f3b040ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 -- 172.21.15.5:0/450908869 >> 172.21.15.5:0/450908869 conn(0x7f3b040fb010 msgr2=0x7f3b040fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 -- 172.21.15.5:0/450908869 shutdown_connections 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.572+0000 7f3b096b8700 1 -- 172.21.15.5:0/450908869 wait complete. 2023-10-08T13:06:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 Processor -- start 2023-10-08T13:06:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 -- start start 2023-10-08T13:06:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 0x7f3b0419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b040fff00 0x7f3b0419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04105600 0x7f3b04195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04195ed0 con 0x7f3b040ff540 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04196040 con 0x7f3b040fff00 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b096b8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04196200 con 0x7f3b04105600 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 0x7f3b0419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 0x7f3b0419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34612/0 (socket says 172.21.15.5:34612) 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b02ffd700 1 -- 172.21.15.5:0/287984731 learned_addr learned my addr 172.21.15.5:0/287984731 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b027fc700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b040fff00 0x7f3b0419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.573+0000 7f3b037fe700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04105600 0x7f3b04195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b02ffd700 1 -- 172.21.15.5:0/287984731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04105600 msgr2=0x7f3b04195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b02ffd700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04105600 0x7f3b04195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b02ffd700 1 -- 172.21.15.5:0/287984731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b040fff00 msgr2=0x7f3b0419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b02ffd700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b040fff00 0x7f3b0419bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b02ffd700 1 -- 172.21.15.5:0/287984731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009d00 con 0x7f3b040ff540 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b02ffd700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 0x7f3b0419b6e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9a0 tx=0x7f3aec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec009790 con 0x7f3b040ff540 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3aec00c540 con 0x7f3b040ff540 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b041964e0 con 0x7f3b040ff540 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec015ea0 con 0x7f3b040ff540 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.574+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b04068a90 con 0x7f3b040ff540 2023-10-08T13:06:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.575+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b04100c60 con 0x7f3b040ff540 2023-10-08T13:06:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.576+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f3aec00c6b0 con 0x7f3b040ff540 2023-10-08T13:06:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.577+0000 7f3afbfff700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3af00a1550 0x7f3af00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.577+0000 7f3b027fc700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3af00a1550 0x7f3af00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.577+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3aec0d17e0 con 0x7f3b040ff540 2023-10-08T13:06:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.577+0000 7f3b027fc700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3af00a1550 0x7f3af00a3a10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b04196c30 tx=0x7f3af400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:03.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.580+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3aec09aa00 con 0x7f3b040ff540 2023-10-08T13:06:03.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:03 smithi060 ceph-mon[103190]: from='client.15771 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:06:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:03 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/77926634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:03.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:03 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/928782826' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:06:03.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.781+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b0410f460 con 0x7f3b040ff540 2023-10-08T13:06:03.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.781+0000 7f3afbfff700 1 -- 172.21.15.5:0/287984731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3aec09e020 con 0x7f3b040ff540 2023-10-08T13:06:03.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3af00a1550 msgr2=0x7f3af00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3af00a1550 0x7f3af00a3a10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b04196c30 tx=0x7f3af400b410 comp rx=0 tx=0).stop 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 msgr2=0x7f3b0419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 0x7f3b0419b6e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9a0 tx=0x7f3aec00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 shutdown_connections 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3af00a1550 0x7f3af00a3a10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b04105600 0x7f3b04195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b040ff540 0x7f3b0419b6e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 --2- 172.21.15.5:0/287984731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b040fff00 0x7f3b0419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 >> 172.21.15.5:0/287984731 conn(0x7f3b040fb010 msgr2=0x7f3b040fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:03.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 shutdown_connections 2023-10-08T13:06:03.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.784+0000 7f3b096b8700 1 -- 172.21.15.5:0/287984731 wait complete. 2023-10-08T13:06:03.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:06:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 -- 172.21.15.5:0/1052027640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9350105590 msgr2=0x7f9350105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 --2- 172.21.15.5:0/1052027640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9350105590 0x7f9350105970 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f934c0099c0 tx=0x7f934c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 -- 172.21.15.5:0/1052027640 shutdown_connections 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 --2- 172.21.15.5:0/1052027640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93500ffe90 0x7f935010c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 --2- 172.21.15.5:0/1052027640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9350105590 0x7f9350105970 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 --2- 172.21.15.5:0/1052027640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93500ff4d0 0x7f93500ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 -- 172.21.15.5:0/1052027640 >> 172.21.15.5:0/1052027640 conn(0x7f93500fafa0 msgr2=0x7f93500fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 -- 172.21.15.5:0/1052027640 shutdown_connections 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 -- 172.21.15.5:0/1052027640 wait complete. 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 Processor -- start 2023-10-08T13:06:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.926+0000 7f9357f82700 1 -- start start 2023-10-08T13:06:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9357f82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93500ff4d0 0x7f93501978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9357f82700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 0x7f9350197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9357f82700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9350105590 0x7f93501a2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9357f82700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350198680 con 0x7f93500ffe90 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9357f82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501a2e80 con 0x7f93500ff4d0 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9357f82700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501a2fc0 con 0x7f9350105590 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 0x7f9350197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 0x7f9350197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34628/0 (socket says 172.21.15.5:34628) 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 -- 172.21.15.5:0/792571325 learned_addr learned my addr 172.21.15.5:0/792571325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9355d1e700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93500ff4d0 0x7f93501978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935651f700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9350105590 0x7f93501a2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 -- 172.21.15.5:0/792571325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9350105590 msgr2=0x7f93501a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9350105590 0x7f93501a2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 -- 172.21.15.5:0/792571325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93500ff4d0 msgr2=0x7f93501978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93500ff4d0 0x7f93501978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 -- 172.21.15.5:0/792571325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0095f0 con 0x7f93500ffe90 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935651f700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9350105590 0x7f93501a2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f935551d700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 0x7f9350197e00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f934000d950 tx=0x7f934000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.927+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93400098e0 con 0x7f93500ffe90 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.928+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9340010460 con 0x7f93500ffe90 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.928+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93501a3250 con 0x7f93500ffe90 2023-10-08T13:06:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.928+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000f620 con 0x7f93500ffe90 2023-10-08T13:06:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.928+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501a37b0 con 0x7f93500ffe90 2023-10-08T13:06:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.928+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350107a10 con 0x7f93500ffe90 2023-10-08T13:06:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.930+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f93400108d0 con 0x7f93500ffe90 2023-10-08T13:06:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.930+0000 7f9346ffd700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f933c0a1550 0x7f933c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.930+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f93400ccf30 con 0x7f93500ffe90 2023-10-08T13:06:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.930+0000 7f9355d1e700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f933c0a1550 0x7f933c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.931+0000 7f9355d1e700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f933c0a1550 0x7f933c0a3a10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f934c009990 tx=0x7f934c019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:03.934+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9340096130 con 0x7f93500ffe90 2023-10-08T13:06:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.135+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9350067ef0 con 0x7f93500ffe90 2023-10-08T13:06:04.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.135+0000 7f9346ffd700 1 -- 172.21.15.5:0/792571325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f93400200a0 con 0x7f93500ffe90 2023-10-08T13:06:04.137 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:06:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f933c0a1550 msgr2=0x7f933c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f933c0a1550 0x7f933c0a3a10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f934c009990 tx=0x7f934c019040 comp rx=0 tx=0).stop 2023-10-08T13:06:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 msgr2=0x7f9350197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 0x7f9350197e00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f934000d950 tx=0x7f934000dc60 comp rx=0 tx=0).stop 2023-10-08T13:06:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 shutdown_connections 2023-10-08T13:06:04.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f933c0a1550 0x7f933c0a3a10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9350105590 0x7f93501a2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93500ff4d0 0x7f93501978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.137+0000 7f9357f82700 1 --2- 172.21.15.5:0/792571325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93500ffe90 0x7f9350197e00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.138+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 >> 172.21.15.5:0/792571325 conn(0x7f93500fafa0 msgr2=0x7f93500fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.138+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 shutdown_connections 2023-10-08T13:06:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.138+0000 7f9357f82700 1 -- 172.21.15.5:0/792571325 wait complete. 2023-10-08T13:06:04.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:06:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.276+0000 7fb452c07700 1 -- 172.21.15.5:0/1330585576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 msgr2=0x7fb44c10c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.276+0000 7fb452c07700 1 --2- 172.21.15.5:0/1330585576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c10c3d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b0d0 tx=0x7fb44400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 -- 172.21.15.5:0/1330585576 shutdown_connections 2023-10-08T13:06:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 --2- 172.21.15.5:0/1330585576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c10c3d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 --2- 172.21.15.5:0/1330585576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c105610 0x7fb44c1059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 --2- 172.21.15.5:0/1330585576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb44c0ff550 0x7fb44c0ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 -- 172.21.15.5:0/1330585576 >> 172.21.15.5:0/1330585576 conn(0x7fb44c0fb020 msgr2=0x7fb44c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 -- 172.21.15.5:0/1330585576 shutdown_connections 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 -- 172.21.15.5:0/1330585576 wait complete. 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 Processor -- start 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 -- start start 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.277+0000 7fb452c07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c0ff550 0x7fb44c197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb452c07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb452c07700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb44c105610 0x7fb44c1a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb452c07700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c198700 con 0x7fb44c0fff10 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb452c07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c1a2f10 con 0x7fb44c0ff550 2023-10-08T13:06:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb452c07700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c1a3050 con 0x7fb44c105610 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34642/0 (socket says 172.21.15.5:34642) 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 -- 172.21.15.5:0/1277168451 learned_addr learned my addr 172.21.15.5:0/1277168451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb4511a4700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb44c105610 0x7fb44c1a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb4509a3700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c0ff550 0x7fb44c197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 -- 172.21.15.5:0/1277168451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb44c105610 msgr2=0x7fb44c1a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb44c105610 0x7fb44c1a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 -- 172.21.15.5:0/1277168451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c0ff550 msgr2=0x7fb44c197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c0ff550 0x7fb44c197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 -- 172.21.15.5:0/1277168451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444009d00 con 0x7fb44c0fff10 2023-10-08T13:06:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb4509a3700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c0ff550 0x7fb44c197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb44bfff700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c197e90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb43800d950 tx=0x7fb43800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438009940 con 0x7fb44c0fff10 2023-10-08T13:06:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb438010460 con 0x7fb44c0fff10 2023-10-08T13:06:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800f620 con 0x7fb44c0fff10 2023-10-08T13:06:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.278+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c1a32e0 con 0x7fb44c0fff10 2023-10-08T13:06:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.279+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c1a37f0 con 0x7fb44c0fff10 2023-10-08T13:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.279+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c107ab0 con 0x7fb44c0fff10 2023-10-08T13:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.280+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb4380108d0 con 0x7fb44c0fff10 2023-10-08T13:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.281+0000 7fb449ffb700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb43c0a1550 0x7fb43c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.281+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb4380ccf90 con 0x7fb44c0fff10 2023-10-08T13:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.281+0000 7fb4509a3700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb43c0a1550 0x7fb43c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.281+0000 7fb4509a3700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb43c0a1550 0x7fb43c0a3a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb440005d90 tx=0x7fb440005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.285+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb438096190 con 0x7fb44c0fff10 2023-10-08T13:06:04.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:04 smithi005 ceph-mon[99496]: pgmap v302: 129 pgs: 129 active+clean; 647 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T13:06:04.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3490730021' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/287984731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:04 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/792571325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:04 smithi118 ceph-mon[104234]: pgmap v302: 129 pgs: 129 active+clean; 647 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T13:06:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3490730021' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/287984731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:04 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/792571325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.537+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb44c100c70 con 0x7fb44c0fff10 2023-10-08T13:06:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.538+0000 7fb449ffb700 1 -- 172.21.15.5:0/1277168451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11353 (secure 0 0 0) 0x7fb438020090 con 0x7fb44c0fff10 2023-10-08T13:06:04.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:04.539 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:04:34.149988+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:06:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb43c0a1550 msgr2=0x7fb43c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb43c0a1550 0x7fb43c0a3a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb440005d90 tx=0x7fb440005d00 comp rx=0 tx=0).stop 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 msgr2=0x7fb44c197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c197e90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb43800d950 tx=0x7fb43800dc60 comp rx=0 tx=0).stop 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 shutdown_connections 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb43c0a1550 0x7fb43c0a3a10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb44c105610 0x7fb44c1a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb44c0ff550 0x7fb44c197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 --2- 172.21.15.5:0/1277168451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44c0fff10 0x7fb44c197e90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 >> 172.21.15.5:0/1277168451 conn(0x7fb44c0fb020 msgr2=0x7fb44c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:04.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 shutdown_connections 2023-10-08T13:06:04.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.540+0000 7fb452c07700 1 -- 172.21.15.5:0/1277168451 wait complete. 2023-10-08T13:06:04.543 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-10-08T13:06:04.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:06:04.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:04 smithi060 ceph-mon[103190]: pgmap v302: 129 pgs: 129 active+clean; 647 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T13:06:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3490730021' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/287984731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:04 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/792571325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 -- 172.21.15.5:0/2676775762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40ffc30 msgr2=0x7fcdd41039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 --2- 172.21.15.5:0/2676775762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40ffc30 0x7fcdd41039d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009990 tx=0x7fcdc0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 -- 172.21.15.5:0/2676775762 shutdown_connections 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 --2- 172.21.15.5:0/2676775762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd41040b0 0x7fcdd410bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 --2- 172.21.15.5:0/2676775762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 0x7fcdd40ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 --2- 172.21.15.5:0/2676775762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd40ffc30 0x7fcdd41039d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 -- 172.21.15.5:0/2676775762 >> 172.21.15.5:0/2676775762 conn(0x7fcdd4074890 msgr2=0x7fcdd4074ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 -- 172.21.15.5:0/2676775762 shutdown_connections 2023-10-08T13:06:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.679+0000 7fcddab83700 1 -- 172.21.15.5:0/2676775762 wait complete. 2023-10-08T13:06:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.680+0000 7fcddab83700 1 Processor -- start 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.680+0000 7fcddab83700 1 -- start start 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 0x7fcdd419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 0x7fcdd419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd4196950 0x7fcdd4196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4197450 con 0x7fcdd41040b0 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd41975c0 con 0x7fcdd4196950 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4197780 con 0x7fcdd40ff280 2023-10-08T13:06:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 0x7fcdd419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 0x7fcdd419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34656/0 (socket says 172.21.15.5:34656) 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 -- 172.21.15.5:0/96686170 learned_addr learned my addr 172.21.15.5:0/96686170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd9120700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd4196950 0x7fcdd4196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd891f700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 0x7fcdd419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 -- 172.21.15.5:0/96686170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 msgr2=0x7fcdd419c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 0x7fcdd419c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 -- 172.21.15.5:0/96686170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd4196950 msgr2=0x7fcdd4196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd4196950 0x7fcdd4196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 -- 172.21.15.5:0/96686170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00095f0 con 0x7fcdd41040b0 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd9120700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd4196950 0x7fcdd4196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd891f700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 0x7fcdd419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd3fff700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 0x7fcdd419cda0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00095c0 tx=0x7fcdc000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc001d070 con 0x7fcdd41040b0 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd41a3660 con 0x7fcdd41040b0 2023-10-08T13:06:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdc0005510 con 0x7fcdd41040b0 2023-10-08T13:06:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.681+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0004b90 con 0x7fcdd41040b0 2023-10-08T13:06:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.682+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd41a3b30 con 0x7fcdd41040b0 2023-10-08T13:06:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.682+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd4107360 con 0x7fcdd41040b0 2023-10-08T13:06:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.684+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fcdc0004cf0 con 0x7fcdd41040b0 2023-10-08T13:06:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.684+0000 7fcdd1ffb700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcdc40a14d0 0x7fcdc40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.684+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcdc00ce440 con 0x7fcdd41040b0 2023-10-08T13:06:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.684+0000 7fcdd891f700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcdc40a14d0 0x7fcdc40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:04.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.685+0000 7fcdd891f700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcdc40a14d0 0x7fcdc40a3990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4075fb0 tx=0x7fcdc800a680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.688+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcdc0097770 con 0x7fcdd41040b0 2023-10-08T13:06:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.891+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd40679a0 con 0x7fcdd41040b0 2023-10-08T13:06:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.893+0000 7fcdd1ffb700 1 -- 172.21.15.5:0/96686170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24883 (secure 0 0 0) 0x7fcdc009ad90 con 0x7fcdd41040b0 2023-10-08T13:06:04.894 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:04.894 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:05:38.894284+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:06:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcdc40a14d0 msgr2=0x7fcdc40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcdc40a14d0 0x7fcdc40a3990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4075fb0 tx=0x7fcdc800a680 comp rx=0 tx=0).stop 2023-10-08T13:06:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 msgr2=0x7fcdd419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 0x7fcdd419cda0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00095c0 tx=0x7fcdc000f690 comp rx=0 tx=0).stop 2023-10-08T13:06:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 shutdown_connections 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcdc40a14d0 0x7fcdc40a3990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd4196950 0x7fcdd4196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdd40ff280 0x7fcdd419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 --2- 172.21.15.5:0/96686170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdd41040b0 0x7fcdd419cda0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 >> 172.21.15.5:0/96686170 conn(0x7fcdd4074890 msgr2=0x7fcdd40fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 shutdown_connections 2023-10-08T13:06:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:04.895+0000 7fcddab83700 1 -- 172.21.15.5:0/96686170 wait complete. 2023-10-08T13:06:04.909 DEBUG:tasks.fwd_scrub:Yielding 2023-10-08T13:06:04.909 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T13:06:04.919 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T13:06:04.920 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:06:04.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-08T13:06:04.921 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-08T13:06:04.921 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:06:04.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 -- 172.21.15.5:0/861418988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 msgr2=0x7f23a40ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/861418988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ff190 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f23940099c0 tx=0x7f2394009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 -- 172.21.15.5:0/861418988 shutdown_connections 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/861418988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a41059b0 0x7f23a410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/861418988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ff190 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/861418988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a40ff760 0x7f23a4105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 -- 172.21.15.5:0/861418988 >> 172.21.15.5:0/861418988 conn(0x7f23a4075ac0 msgr2=0x7f23a40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 -- 172.21.15.5:0/861418988 shutdown_connections 2023-10-08T13:06:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f23a8ce6700 1 -- 172.21.15.5:0/861418988 wait complete. 2023-10-08T13:06:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f152c2fc700 1 -- 172.21.15.5:0/1878230481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524101030 msgr2=0x7f152410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.051+0000 7f152c2fc700 1 --2- 172.21.15.5:0/1878230481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524101030 0x7f152410d540 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f151c009f90 tx=0x7f151c00b330 comp rx=0 tx=0).stop 2023-10-08T13:06:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 -- 172.21.15.5:0/1878230481 shutdown_connections 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 --2- 172.21.15.5:0/1878230481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524101030 0x7f152410d540 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 --2- 172.21.15.5:0/1878230481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524106680 0x7f1524106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 --2- 172.21.15.5:0/1878230481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1524100670 0x7f1524100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 -- 172.21.15.5:0/1878230481 >> 172.21.15.5:0/1878230481 conn(0x7f15240fc140 msgr2=0x7f15240fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 -- 172.21.15.5:0/1878230481 shutdown_connections 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 -- 172.21.15.5:0/1878230481 wait complete. 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 Processor -- start 2023-10-08T13:06:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 -- start start 2023-10-08T13:06:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 Processor -- start 2023-10-08T13:06:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f152c2fc700 1 -- start start 2023-10-08T13:06:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a41059b0 0x7f23a4100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a41007a0 0x7f23a41a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41a5290 con 0x7f23a40fedb0 2023-10-08T13:06:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41a53d0 con 0x7f23a41007a0 2023-10-08T13:06:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a8ce6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41a5590 con 0x7f23a41059b0 2023-10-08T13:06:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34674/0 (socket says 172.21.15.5:34674) 2023-10-08T13:06:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.052+0000 7f23a259c700 1 -- 172.21.15.5:0/894655100 learned_addr learned my addr 172.21.15.5:0/894655100 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152c2fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1524100670 0x7f1524072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152c2fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 0x7f1524073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152c2fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524106680 0x7f1524073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152c2fc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15241a4e00 con 0x7f1524106680 2023-10-08T13:06:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152c2fc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15241a4f70 con 0x7f1524100670 2023-10-08T13:06:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152c2fc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15241a5130 con 0x7f1524101030 2023-10-08T13:06:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a2d9d700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a41007a0 0x7f23a41a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a1d9b700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a41059b0 0x7f23a4100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 0x7f1524073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 0x7f1524073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:47884/0 (socket says 172.21.15.5:47884) 2023-10-08T13:06:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 -- 172.21.15.5:0/2665728558 learned_addr learned my addr 172.21.15.5:0/2665728558 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a259c700 1 -- 172.21.15.5:0/894655100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a41059b0 msgr2=0x7f23a4100260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a259c700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a41059b0 0x7f23a4100260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152a098700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1524100670 0x7f1524072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a259c700 1 -- 172.21.15.5:0/894655100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a41007a0 msgr2=0x7f23a41a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a259c700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a41007a0 0x7f23a41a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a259c700 1 -- 172.21.15.5:0/894655100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940095f0 con 0x7f23a40fedb0 2023-10-08T13:06:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a1d9b700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a41059b0 0x7f23a4100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f152a899700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524106680 0x7f1524073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a259c700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ffd20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f239400f690 tx=0x7f239400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 -- 172.21.15.5:0/2665728558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1524100670 msgr2=0x7f1524072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1524100670 0x7f1524072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 -- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524106680 msgr2=0x7f1524073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524106680 0x7f1524073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 -- 172.21.15.5:0/2665728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c009c40 con 0x7f1524101030 2023-10-08T13:06:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239401d070 con 0x7f23a40fedb0 2023-10-08T13:06:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2394005510 con 0x7f23a40fedb0 2023-10-08T13:06:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394004af0 con 0x7f23a40fedb0 2023-10-08T13:06:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a41a5810 con 0x7f23a40fedb0 2023-10-08T13:06:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f1529897700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 0x7f1524073030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f151400d980 tx=0x7f151400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.053+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a41a5c30 con 0x7f23a40fedb0 2023-10-08T13:06:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.054+0000 7f151b7fe700 1 -- 172.21.15.5:0/2665728558 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514004220 con 0x7f1524101030 2023-10-08T13:06:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.054+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15241a5410 con 0x7f1524101030 2023-10-08T13:06:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.054+0000 7f151b7fe700 1 -- 172.21.15.5:0/2665728558 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1514007640 con 0x7f1524101030 2023-10-08T13:06:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.054+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15241a5970 con 0x7f1524101030 2023-10-08T13:06:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.054+0000 7f151b7fe700 1 -- 172.21.15.5:0/2665728558 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514005580 con 0x7f1524101030 2023-10-08T13:06:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.055+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a4108c80 con 0x7f23a40fedb0 2023-10-08T13:06:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.056+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f239400fbe0 con 0x7f23a40fedb0 2023-10-08T13:06:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.056+0000 7f151b7fe700 1 -- 172.21.15.5:0/2665728558 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1514004380 con 0x7f1524101030 2023-10-08T13:06:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.056+0000 7f23937fe700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f238c0a1540 0x7f238c0a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f151b7fe700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15100a1550 0x7f15100a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f23a1d9b700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f238c0a1540 0x7f238c0a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f23940cdf40 con 0x7f23a40fedb0 2023-10-08T13:06:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f151b7fe700 1 -- 172.21.15.5:0/2665728558 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f15140ccdb0 con 0x7f1524101030 2023-10-08T13:06:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f152a098700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15100a1550 0x7f15100a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f23a1d9b700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f238c0a1540 0x7f238c0a3a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2398005fd0 tx=0x7f2398005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.057+0000 7f152a098700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15100a1550 0x7f15100a3a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1520005fd0 tx=0x7f1520009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 Processor -- start 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 -- start start 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x55980934b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809356190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x559809358ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598092b44e0 con 0x55980934b820 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598092a5ca0 con 0x55980934af00 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f15384e5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598092a35c0 con 0x5598093566d0 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.058+0000 7f1529897700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809356190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809356190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34692/0 (socket says 172.21.15.5:34692) 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 -- 172.21.15.5:0/767017012 learned_addr learned my addr 172.21.15.5:0/767017012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f152a899700 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x559809358ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f152a098700 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x55980934b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 -- 172.21.15.5:0/767017012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 msgr2=0x559809358ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x559809358ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 -- 172.21.15.5:0/767017012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 msgr2=0x55980934b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x55980934b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 -- 172.21.15.5:0/767017012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598090c9e60 con 0x55980934b820 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f152a098700 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x55980934b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.059+0000 7f1529897700 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809356190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1514096170 tx=0x7f151409a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44237888d8effd72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.061+0000 7f1518d82700 1 -- 172.21.15.5:0/767017012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151409ddc0 con 0x55980934b820 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.061+0000 7f1518d82700 1 -- 172.21.15.5:0/767017012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15140a2000 con 0x55980934b820 2023-10-08T13:06:05.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.061+0000 7f1518d82700 1 -- 172.21.15.5:0/767017012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140993c0 con 0x55980934b820 2023-10-08T13:06:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.061+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f23940971d0 con 0x7f23a40fedb0 2023-10-08T13:06:05.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 -- 172.21.15.5:0/767017012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 msgr2=0x559809356190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809356190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1514096170 tx=0x7f151409a470 comp rx=0 tx=0).stop 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 -- 172.21.15.5:0/767017012 shutdown_connections 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x559809358ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x55980934b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 --2- 172.21.15.5:0/767017012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809356190 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 -- 172.21.15.5:0/767017012 >> 172.21.15.5:0/767017012 conn(0x5598092c02e0 msgr2=0x559809347350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 -- 172.21.15.5:0/767017012 shutdown_connections 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.062+0000 7f15384e5b80 1 -- 172.21.15.5:0/767017012 wait complete. 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 -- start start 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 Processor -- start 2023-10-08T13:06:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809356070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x5598093532f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x5598093538b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980929eeb0 con 0x55980934b820 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980923b790 con 0x55980934af00 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980923b430 con 0x5598093566d0 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f15384e5b80 10 client.0 _ll_register_callbacks cb 0x559809098880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f1529897700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x5598093532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f1529897700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x5598093532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34698/0 (socket says 172.21.15.5:34698) 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f152a098700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809356070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f1529897700 1 -- 172.21.15.5:0/1938870982 learned_addr learned my addr 172.21.15.5:0/1938870982 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.063+0000 7f152a899700 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x5598093538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f1529897700 1 -- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 msgr2=0x5598093538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f1529897700 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x5598093538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f1529897700 1 -- 172.21.15.5:0/1938870982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 msgr2=0x559809356070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f1529897700 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809356070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f1529897700 1 -- 172.21.15.5:0/1938870982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15241a5970 con 0x55980934b820 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f1529897700 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x5598093532f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1514012040 tx=0x7f1514098220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2394b9aee4029fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f150dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f150dffb700 1 -- 172.21.15.5:0/1938870982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151409de40 con 0x55980934b820 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f150dffb700 1 -- 172.21.15.5:0/1938870982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1514099160 con 0x55980934b820 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559809266f30 con 0x55980934b820 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f150dffb700 1 -- 172.21.15.5:0/1938870982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1514099320 con 0x55980934b820 2023-10-08T13:06:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f15384e5b80 10 client.15831 fetch_fsmap learned FSMap version 27 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5598090b2ce0 con 0x55980934b820 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f150dffb700 1 -- 172.21.15.5:0/1938870982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559809266f30 con 0x55980934b820 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f150dffb700 1 -- 172.21.15.5:0/1938870982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1514098bd0 con 0x55980934b820 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.064+0000 7f15384e5b80 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f15384e5b80 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f15384e5b80 20 client.15831 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559809365bb0 0x559809367fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f15384e5b80 4 client.15831 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559809297e90 con 0x559809365bb0 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f152a098700 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559809365bb0 0x559809367fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f150dffb700 10 client.15831 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.065+0000 7f152a098700 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559809365bb0 0x559809367fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7169920f4e43e38f server_cookie=92abdc8f578d91f9 in_seq=0 out_seq=0 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f150dffb700 1 -- 172.21.15.5:0/1938870982 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559809297e90 con 0x559809365bb0 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f150dffb700 10 client.15831 handle_command_reply: tid=0 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 client.15831 shutdown 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 msgr2=0x5598093532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x5598093532f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1514012040 tx=0x7f1514098220 comp rx=0 tx=0).stop 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 shutdown_connections 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x5598093538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559809365bb0 0x559809367fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809356070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f150dffb700 0 client.15831 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1938870982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x5598093532f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 >> 172.21.15.5:0/1938870982 conn(0x5598092c02e0 msgr2=0x559809346f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 shutdown_connections 2023-10-08T13:06:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 1 -- 172.21.15.5:0/1938870982 wait complete. 2023-10-08T13:06:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.066+0000 7f15384e5b80 20 client.15831 trim_cache size 0 max 16384 2023-10-08T13:06:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.083+0000 7f15384e5b80 1 Processor -- start 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.083+0000 7f15384e5b80 1 -- start start 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809352240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809361f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f15384e5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980911f9a0 con 0x55980934b820 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f15384e5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980935d630 con 0x55980934af00 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f15384e5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559809368630 con 0x5598093566d0 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809361f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809361f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34706/0 (socket says 172.21.15.5:34706) 2023-10-08T13:06:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 -- 172.21.15.5:0/1679105664 learned_addr learned my addr 172.21.15.5:0/1679105664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f152a899700 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 -- 172.21.15.5:0/1679105664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 msgr2=0x55980935d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f152a098700 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809352240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 -- 172.21.15.5:0/1679105664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 msgr2=0x559809352240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809352240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 -- 172.21.15.5:0/1679105664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598090f02d0 con 0x55980934b820 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f152a098700 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809352240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1529897700 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809361f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f151400b540 tx=0x7f1514022fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8637f47f6e4c4093 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.084+0000 7f1519583700 1 -- 172.21.15.5:0/1679105664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151409eb00 con 0x55980934b820 2023-10-08T13:06:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f1519583700 1 -- 172.21.15.5:0/1679105664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151409ddc0 con 0x55980934b820 2023-10-08T13:06:05.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f1519583700 1 -- 172.21.15.5:0/1679105664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140a1dd0 con 0x55980934b820 2023-10-08T13:06:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 -- 172.21.15.5:0/1679105664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 msgr2=0x559809361f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809361f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f151400b540 tx=0x7f1514022fe0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 -- 172.21.15.5:0/1679105664 shutdown_connections 2023-10-08T13:06:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934af00 0x559809352240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 --2- 172.21.15.5:0/1679105664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934b820 0x559809361f50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 -- 172.21.15.5:0/1679105664 >> 172.21.15.5:0/1679105664 conn(0x5598092c02e0 msgr2=0x559809361840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 -- 172.21.15.5:0/1679105664 shutdown_connections 2023-10-08T13:06:05.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.085+0000 7f15384e5b80 1 -- 172.21.15.5:0/1679105664 wait complete. 2023-10-08T13:06:05.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 -- start start 2023-10-08T13:06:05.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 Processor -- start 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 0x5598093b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934b820 0x5598093b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980935cb30 con 0x55980934af00 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980935cca0 con 0x55980934b820 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55980935ce60 con 0x5598093566d0 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f15384e5b80 10 client.0 _ll_register_callbacks cb 0x7f15200091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 0x5598093b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 0x5598093b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34710/0 (socket says 172.21.15.5:34710) 2023-10-08T13:06:05.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 -- 172.21.15.5:0/2583498806 learned_addr learned my addr 172.21.15.5:0/2583498806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f1529897700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934b820 0x5598093b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a899700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 -- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 msgr2=0x55980935c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 -- 172.21.15.5:0/2583498806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934b820 msgr2=0x5598093b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934b820 0x5598093b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.086+0000 7f152a098700 1 -- 172.21.15.5:0/2583498806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598090b2ce0 con 0x55980934af00 2023-10-08T13:06:05.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f152a098700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 0x5598093b3190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x559809368840 tx=0x7f1520004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff96db8a1402766 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f150dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f150dffb700 1 -- 172.21.15.5:0/2583498806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520024040 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f150dffb700 1 -- 172.21.15.5:0/2583498806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1520004320 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15140a2000 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f150dffb700 1 -- 172.21.15.5:0/2583498806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15200044e0 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 10 client.15837 fetch_fsmap learned FSMap version 27 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5598090c8330 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f150dffb700 1 -- 172.21.15.5:0/2583498806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15140a2000 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f150dffb700 1 -- 172.21.15.5:0/2583498806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f152001f6a0 con 0x55980934af00 2023-10-08T13:06:05.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 20 client.15837 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5598093bc1d0 0x5598093be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 4 client.15837 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.087+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559809297bb0 con 0x5598093bc1d0 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.088+0000 7f1529897700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5598093bc1d0 0x5598093be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.088+0000 7f150dffb700 10 client.15837 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.088+0000 7f1529897700 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5598093bc1d0 0x5598093be5f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6401dc15dcd07a server_cookie=c7c919c8a8566ae0 in_seq=0 out_seq=0 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.089+0000 7f150dffb700 1 -- 172.21.15.5:0/2583498806 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559809297bb0 con 0x5598093bc1d0 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.089+0000 7f150dffb700 10 client.15837 handle_command_reply: tid=0 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.089+0000 7f15384e5b80 1 client.15837 shutdown 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.089+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 msgr2=0x5598093b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 0x5598093b3190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x559809368840 tx=0x7f1520004750 comp rx=0 tx=0).stop 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 shutdown_connections 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5598093566d0 0x55980935c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55980934af00 0x5598093b3190 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5598093bc1d0 0x5598093be5f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 --2- 172.21.15.5:0/2583498806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55980934b820 0x5598093b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f150dffb700 0 client.15837 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 >> 172.21.15.5:0/2583498806 conn(0x5598092c02e0 msgr2=0x5598093620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 shutdown_connections 2023-10-08T13:06:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 1 -- 172.21.15.5:0/2583498806 wait complete. 2023-10-08T13:06:05.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f15384e5b80 20 client.15837 trim_cache size 0 max 16384 2023-10-08T13:06:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:06:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-08T13:06:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "d795645c-3c87-4610-a48e-190d8eda9ebc", 2023-10-08T13:06:05.101 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-08T13:06:05.101 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:06:05.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15100a1550 msgr2=0x7f15100a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15100a1550 0x7f15100a3a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1520005fd0 tx=0x7f1520009310 comp rx=0 tx=0).stop 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 msgr2=0x7f1524073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 0x7f1524073030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f151400d980 tx=0x7f151400dc90 comp rx=0 tx=0).stop 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 shutdown_connections 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f15100a1550 0x7f15100a3a10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1524106680 0x7f1524073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1524100670 0x7f1524072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 --2- 172.21.15.5:0/2665728558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1524101030 0x7f1524073030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.090+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 >> 172.21.15.5:0/2665728558 conn(0x7f15240fc140 msgr2=0x7f15240fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.091+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 shutdown_connections 2023-10-08T13:06:05.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.091+0000 7f152c2fc700 1 -- 172.21.15.5:0/2665728558 wait complete. 2023-10-08T13:06:05.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 -- 172.21.15.5:0/3212015469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa010ac10 msgr2=0x7fdaa010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/3212015469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa010ac10 0x7fdaa010d0b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fda9800b0a0 tx=0x7fda9800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 -- 172.21.15.5:0/3212015469 shutdown_connections 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/3212015469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa010ac10 0x7fdaa010d0b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/3212015469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaa0101840 0x7fdaa0101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/3212015469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaa0102160 0x7fdaa010a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 -- 172.21.15.5:0/3212015469 >> 172.21.15.5:0/3212015469 conn(0x7fdaa00fafc0 msgr2=0x7fdaa00fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.234+0000 7fdaa55f9700 1 -- 172.21.15.5:0/3212015469 shutdown_connections 2023-10-08T13:06:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.235+0000 7fdaa55f9700 1 -- 172.21.15.5:0/3212015469 wait complete. 2023-10-08T13:06:05.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.235+0000 7fdaa55f9700 1 Processor -- start 2023-10-08T13:06:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.235+0000 7fdaa55f9700 1 -- start start 2023-10-08T13:06:05.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.235+0000 7fdaa55f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 0x7fdaa019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.235+0000 7fdaa55f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaa0102160 0x7fdaa019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fdaa55f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaa010ac10 0x7fdaa0196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fdaa55f9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa01971f0 con 0x7fdaa0101840 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fdaa55f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0197360 con 0x7fdaa010ac10 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fdaa55f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0197520 con 0x7fdaa0102160 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 0x7fdaa019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 0x7fdaa019c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34724/0 (socket says 172.21.15.5:34724) 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 -- 172.21.15.5:0/605401193 learned_addr learned my addr 172.21.15.5:0/605401193 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaa0102160 0x7fdaa019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 -- 172.21.15.5:0/605401193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaa0102160 msgr2=0x7fdaa019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaa0102160 0x7fdaa019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 -- 172.21.15.5:0/605401193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaa010ac10 msgr2=0x7fdaa0196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaa010ac10 0x7fdaa0196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 -- 172.21.15.5:0/605401193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009d00 con 0x7fdaa0101840 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda9effd700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 0x7fdaa019c930 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e9a0 tx=0x7fda9000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda87fff700 1 -- 172.21.15.5:0/605401193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90009790 con 0x7fdaa0101840 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0197800 con 0x7fdaa0101840 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda87fff700 1 -- 172.21.15.5:0/605401193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda9000cbd0 con 0x7fdaa0101840 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fda87fff700 1 -- 172.21.15.5:0/605401193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90018680 con 0x7fdaa0101840 2023-10-08T13:06:05.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.236+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa01a38b0 con 0x7fdaa0101840 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.238+0000 7fda87fff700 1 -- 172.21.15.5:0/605401193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fda900187e0 con 0x7fdaa0101840 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.239+0000 7fda87fff700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda880a14d0 0x7fda880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.239+0000 7fda87fff700 1 -- 172.21.15.5:0/605401193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fda90014070 con 0x7fdaa0101840 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.239+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda880a14d0 0x7fda880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda880a14d0 0x7fda880a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0198140 tx=0x7fda9400d4b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 Processor -- start 2023-10-08T13:06:05.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 -- start start 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291343d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x562913448110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629133a6460 con 0x562913448650 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562913397c20 con 0x56291343d7a0 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562913395540 con 0x56291343ce80 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.240+0000 7fda9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34736/0 (socket says 172.21.15.5:34736) 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 -- 172.21.15.5:0/1662759396 learned_addr learned my addr 172.21.15.5:0/1662759396 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x562913448110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9effd700 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291343d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 -- 172.21.15.5:0/1662759396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 msgr2=0x56291343d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291343d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 -- 172.21.15.5:0/1662759396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 msgr2=0x562913448110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x562913448110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 -- 172.21.15.5:0/1662759396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629131bbde0 con 0x562913448650 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344aa40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fda98006130 tx=0x7fda98009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890b10364680a9b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda857fa700 1 -- 172.21.15.5:0/1662759396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9800e040 con 0x562913448650 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda857fa700 1 -- 172.21.15.5:0/1662759396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda98009460 con 0x562913448650 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.241+0000 7fda857fa700 1 -- 172.21.15.5:0/1662759396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98007740 con 0x562913448650 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1662759396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 msgr2=0x56291344aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344aa40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fda98006130 tx=0x7fda98009c40 comp rx=0 tx=0).stop 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1662759396 shutdown_connections 2023-10-08T13:06:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344aa40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291343d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1662759396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x562913448110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1662759396 >> 172.21.15.5:0/1662759396 conn(0x5629133b2260 msgr2=0x5629134392d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1662759396 shutdown_connections 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1662759396 wait complete. 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 -- start start 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.242+0000 7fdab17e2b80 1 Processor -- start 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x562913448100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 0x562913445420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562913448650 0x562913445b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562913390e30 con 0x56291343d7a0 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291332d710 con 0x562913448650 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291332d3b0 con 0x56291343ce80 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fdab17e2b80 10 client.0 _ll_register_callbacks cb 0x56291318a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 0x562913445420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 0x562913445420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34740/0 (socket says 172.21.15.5:34740) 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 -- 172.21.15.5:0/3632347641 learned_addr learned my addr 172.21.15.5:0/3632347641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x562913448100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562913448650 0x562913445b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 -- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 msgr2=0x562913448100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x562913448100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 -- 172.21.15.5:0/3632347641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562913448650 msgr2=0x562913445b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562913448650 0x562913445b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 -- 172.21.15.5:0/3632347641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa010dd70 con 0x56291343d7a0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9effd700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x562913448100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 0x562913445420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fda9400fe50 tx=0x7fda94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c94aa9a565abfc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.243+0000 7fda82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fda82ff5700 1 -- 172.21.15.5:0/3632347641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400f840 con 0x56291343d7a0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562913358eb0 con 0x56291343d7a0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fda82ff5700 1 -- 172.21.15.5:0/3632347641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fda94028670 con 0x56291343d7a0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fda82ff5700 1 -- 172.21.15.5:0/3632347641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda94011e70 con 0x56291343d7a0 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 10 client.15849 fetch_fsmap learned FSMap version 27 2023-10-08T13:06:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5629131a4c60 con 0x56291343d7a0 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fda82ff5700 1 -- 172.21.15.5:0/3632347641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562913358eb0 con 0x56291343d7a0 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fda82ff5700 1 -- 172.21.15.5:0/3632347641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fda9401e690 con 0x56291343d7a0 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 10 client.15849 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 20 client.15849 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562913458190 0x56291345a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 4 client.15849 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.244+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562913389e10 con 0x562913458190 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.245+0000 7fda9effd700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562913458190 0x56291345a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.245+0000 7fda82ff5700 10 client.15849 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.245+0000 7fda9effd700 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562913458190 0x56291345a5b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f16531388f8b854 server_cookie=cfa8f3d1fb9e5633 in_seq=0 out_seq=0 2023-10-08T13:06:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fda82ff5700 1 -- 172.21.15.5:0/3632347641 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562913389e10 con 0x562913458190 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fda82ff5700 10 client.15849 handle_command_reply: tid=0 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 client.15849 shutdown 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 msgr2=0x562913445420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 0x562913445420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fda9400fe50 tx=0x7fda94004750 comp rx=0 tx=0).stop 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 shutdown_connections 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562913458190 0x56291345a5b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562913448650 0x562913445b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fda82ff5700 0 client.15849 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x562913448100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3632347641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343d7a0 0x562913445420 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 >> 172.21.15.5:0/3632347641 conn(0x5629133b2260 msgr2=0x562913438ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 shutdown_connections 2023-10-08T13:06:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3632347641 wait complete. 2023-10-08T13:06:05.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.246+0000 7fdab17e2b80 20 client.15849 trim_cache size 0 max 16384 2023-10-08T13:06:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 Processor -- start 2023-10-08T13:06:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 -- start start 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 0x56291344f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x5629134407b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562913448650 0x562913440cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562913211920 con 0x56291343ce80 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291345a940 con 0x56291343d7a0 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562913446140 con 0x562913448650 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 0x56291344f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 0x56291344f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34746/0 (socket says 172.21.15.5:34746) 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 -- 172.21.15.5:0/1100561180 learned_addr learned my addr 172.21.15.5:0/1100561180 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562913448650 0x562913440cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x5629134407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 -- 172.21.15.5:0/1100561180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562913448650 msgr2=0x562913440cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562913448650 0x562913440cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 -- 172.21.15.5:0/1100561180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 msgr2=0x5629134407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x5629134407b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 -- 172.21.15.5:0/1100561180 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629131e2250 con 0x56291343ce80 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562913448650 0x562913440cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:05.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.263+0000 7fda9effd700 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 0x56291344f140 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fda90096850 tx=0x7fda90096040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f087a448f06717f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fda85ffb700 1 -- 172.21.15.5:0/1100561180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900af070 con 0x56291343ce80 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fda85ffb700 1 -- 172.21.15.5:0/1100561180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda9009e4a0 con 0x56291343ce80 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fda85ffb700 1 -- 172.21.15.5:0/1100561180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9009e170 con 0x56291343ce80 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1100561180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 msgr2=0x56291344f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 0x56291344f140 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fda90096850 tx=0x7fda90096040 comp rx=0 tx=0).stop 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1100561180 shutdown_connections 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562913448650 0x562913440cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56291343ce80 0x56291344f140 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/1100561180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x5629134407b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1100561180 >> 172.21.15.5:0/1100561180 conn(0x5629133b2260 msgr2=0x562913434f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1100561180 shutdown_connections 2023-10-08T13:06:05.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.264+0000 7fdab17e2b80 1 -- 172.21.15.5:0/1100561180 wait complete. 2023-10-08T13:06:05.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 -- start start 2023-10-08T13:06:05.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 Processor -- start 2023-10-08T13:06:05.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291344d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x56291344da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291344f510 con 0x562913448650 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629134abff0 con 0x56291343d7a0 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629134ac130 con 0x56291343ce80 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fdab17e2b80 10 client.0 _ll_register_callbacks cb 0x56291318a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fda9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fda9f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34756/0 (socket says 172.21.15.5:34756) 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fda9e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x56291344da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fda9f7fe700 1 -- 172.21.15.5:0/3597115348 learned_addr learned my addr 172.21.15.5:0/3597115348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.265+0000 7fda9effd700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291344d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9f7fe700 1 -- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 msgr2=0x56291344d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291344d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9f7fe700 1 -- 172.21.15.5:0/3597115348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 msgr2=0x56291344da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x56291344da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9f7fe700 1 -- 172.21.15.5:0/3597115348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa01a38b0 con 0x562913448650 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9e7fc700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x56291344da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda9f7fe700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344df90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fda9800b070 tx=0x7fda98007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63d53e30faa30bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda82ff5700 1 -- 172.21.15.5:0/3597115348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9800e040 con 0x562913448650 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda82ff5700 1 -- 172.21.15.5:0/3597115348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fda98003e40 con 0x562913448650 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda98009460 con 0x562913448650 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda82ff5700 1 -- 172.21.15.5:0/3597115348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda980074a0 con 0x562913448650 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fdab17e2b80 10 client.15855 fetch_fsmap learned FSMap version 27 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5629131ba2b0 con 0x562913448650 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.266+0000 7fda82ff5700 1 -- 172.21.15.5:0/3597115348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda98009460 con 0x562913448650 2023-10-08T13:06:05.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fda82ff5700 1 -- 172.21.15.5:0/3597115348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fda98019040 con 0x562913448650 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fdab17e2b80 10 client.15855 fetch_fsmap finished waiting for FSMap version 27 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fdab17e2b80 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fdab17e2b80 20 client.15855 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5629134ad5c0 0x5629134af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fdab17e2b80 4 client.15855 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562913389b30 con 0x5629134ad5c0 2023-10-08T13:06:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fda9effd700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5629134ad5c0 0x5629134af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fda82ff5700 10 client.15855 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.267+0000 7fda9effd700 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5629134ad5c0 0x5629134af9e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561706deab2d785e server_cookie=95a4d8149c3b5877 in_seq=0 out_seq=0 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fda82ff5700 1 -- 172.21.15.5:0/3597115348 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562913389b30 con 0x5629134ad5c0 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fda82ff5700 10 client.15855 handle_command_reply: tid=0 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 client.15855 shutdown 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 msgr2=0x56291344df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344df90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fda9800b070 tx=0x7fda98007dd0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 shutdown_connections 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562913448650 0x56291344df90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56291343ce80 0x56291344d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5629134ad5c0 0x5629134af9e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 --2- 172.21.15.5:0/3597115348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56291343d7a0 0x56291344da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fda82ff5700 0 client.15855 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 >> 172.21.15.5:0/3597115348 conn(0x5629133b2260 msgr2=0x5629134407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 shutdown_connections 2023-10-08T13:06:05.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 1 -- 172.21.15.5:0/3597115348 wait complete. 2023-10-08T13:06:05.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdab17e2b80 20 client.15855 trim_cache size 0 max 16384 2023-10-08T13:06:05.279 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:06:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:06:05.279 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "d795645c-3c87-4610-a48e-190d8eda9ebc": { 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "d795645c-3c87-4610-a48e-190d8eda9ebc", 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:06:05.280 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:06:05.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda880a14d0 msgr2=0x7fda880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda880a14d0 0x7fda880a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0198140 tx=0x7fda9400d4b0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 msgr2=0x7fdaa019c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 0x7fdaa019c930 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e9a0 tx=0x7fda9000ed60 comp rx=0 tx=0).stop 2023-10-08T13:06:05.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 shutdown_connections 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda880a14d0 0x7fda880a3990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaa010ac10 0x7fdaa0196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaa0101840 0x7fdaa019c930 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 --2- 172.21.15.5:0/605401193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaa0102160 0x7fdaa019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.268+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 >> 172.21.15.5:0/605401193 conn(0x7fdaa00fafc0 msgr2=0x7fdaa00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.269+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 shutdown_connections 2023-10-08T13:06:05.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.269+0000 7fdaa55f9700 1 -- 172.21.15.5:0/605401193 wait complete. 2023-10-08T13:06:05.284 INFO:tasks.cephfs.filesystem:scrub status for tag:d795645c-3c87-4610-a48e-190d8eda9ebc - {'path': '/', 'tag': 'd795645c-3c87-4610-a48e-190d8eda9ebc', 'options': 'recursive,force'} 2023-10-08T13:06:05.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.303+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a40ff6d0 con 0x7f238c0a1540 2023-10-08T13:06:05.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.412+0000 7f23937fe700 1 -- 172.21.15.5:0/894655100 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f23a40ff6d0 con 0x7f238c0a1540 2023-10-08T13:06:05.413 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path / 2023-10-08T13:06:05.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f238c0a1540 msgr2=0x7f238c0a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f238c0a1540 0x7f238c0a3a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2398005fd0 tx=0x7f2398005f60 comp rx=0 tx=0).stop 2023-10-08T13:06:05.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 msgr2=0x7f23a40ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ffd20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f239400f690 tx=0x7f239400f6c0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 shutdown_connections 2023-10-08T13:06:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f238c0a1540 0x7f238c0a3a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a41007a0 0x7f23a41a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a40fedb0 0x7f23a40ffd20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 --2- 172.21.15.5:0/894655100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23a41059b0 0x7f23a4100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 >> 172.21.15.5:0/894655100 conn(0x7f23a4075ac0 msgr2=0x7f23a4103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.414+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 shutdown_connections 2023-10-08T13:06:05.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.415+0000 7f23a8ce6700 1 -- 172.21.15.5:0/894655100 wait complete. 2023-10-08T13:06:05.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-08T13:06:05.492 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:05 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1277168451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:05.492 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:05 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/96686170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:05.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:05 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1277168451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:05.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:05 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/96686170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 -- 172.21.15.5:0/1819668602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c101860 msgr2=0x7fe20c101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 --2- 172.21.15.5:0/1819668602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c101860 0x7fe20c101c40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009990 tx=0x7fe1fc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 -- 172.21.15.5:0/1819668602 shutdown_connections 2023-10-08T13:06:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 --2- 172.21.15.5:0/1819668602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe20c10ac80 0x7fe20c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 --2- 172.21.15.5:0/1819668602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c101860 0x7fe20c101c40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 --2- 172.21.15.5:0/1819668602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c102180 0x7fe20c10a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 -- 172.21.15.5:0/1819668602 >> 172.21.15.5:0/1819668602 conn(0x7fe20c0fb080 msgr2=0x7fe20c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 -- 172.21.15.5:0/1819668602 shutdown_connections 2023-10-08T13:06:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.596+0000 7fe2110a0700 1 -- 172.21.15.5:0/1819668602 wait complete. 2023-10-08T13:06:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 Processor -- start 2023-10-08T13:06:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 -- start start 2023-10-08T13:06:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c101860 0x7fe20c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 0x7fe20c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe20c10ac80 0x7fe20c1968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c196f30 con 0x7fe20c102180 2023-10-08T13:06:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1970a0 con 0x7fe20c10ac80 2023-10-08T13:06:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe2110a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c197260 con 0x7fe20c101860 2023-10-08T13:06:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe20259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 0x7fe20c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe20259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 0x7fe20c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34790/0 (socket says 172.21.15.5:34790) 2023-10-08T13:06:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.597+0000 7fe20259c700 1 -- 172.21.15.5:0/2223890514 learned_addr learned my addr 172.21.15.5:0/2223890514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20ad9d700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c101860 0x7fe20c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20b59e700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe20c10ac80 0x7fe20c1968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20259c700 1 -- 172.21.15.5:0/2223890514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c101860 msgr2=0x7fe20c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20259c700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c101860 0x7fe20c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20259c700 1 -- 172.21.15.5:0/2223890514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe20c10ac80 msgr2=0x7fe20c1968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20259c700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe20c10ac80 0x7fe20c1968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20259c700 1 -- 172.21.15.5:0/2223890514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0095f0 con 0x7fe20c102180 2023-10-08T13:06:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20ad9d700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c101860 0x7fe20c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe20259c700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 0x7fe20c19cce0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400d980 tx=0x7fe1f400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400bb60 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c197540 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1f4007640 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4004e90 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.598+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c1a3790 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.599+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c105d90 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.600+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fe1f400bcc0 con 0x7fe20c102180 2023-10-08T13:06:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.601+0000 7fe208d99700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1f80a14c0 0x7fe1f80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.601+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe1f40cd5d0 con 0x7fe20c102180 2023-10-08T13:06:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.601+0000 7fe20ad9d700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1f80a14c0 0x7fe1f80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.601+0000 7fe20ad9d700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1f80a14c0 0x7fe1f80a3980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc000c00 tx=0x7fe1fc005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.605+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1f40967d0 con 0x7fe20c102180 2023-10-08T13:06:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:05 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1277168451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:05 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/96686170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:06:05.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.832+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fe20c1105f0 con 0x7fe1f80a14c0 2023-10-08T13:06:05.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.886+0000 7fe208d99700 1 -- 172.21.15.5:0/2223890514 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fe20c1105f0 con 0x7fe1f80a14c0 2023-10-08T13:06:05.888 INFO:teuthology.orchestra.run.smithi005.stdout:Retention added to path / 2023-10-08T13:06:05.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1f80a14c0 msgr2=0x7fe1f80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1f80a14c0 0x7fe1f80a3980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc000c00 tx=0x7fe1fc005fb0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 msgr2=0x7fe20c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 0x7fe20c19cce0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400d980 tx=0x7fe1f400dd40 comp rx=0 tx=0).stop 2023-10-08T13:06:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 shutdown_connections 2023-10-08T13:06:05.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe1f80a14c0 0x7fe1f80a3980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe20c10ac80 0x7fe20c1968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe20c101860 0x7fe20c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 --2- 172.21.15.5:0/2223890514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe20c102180 0x7fe20c19cce0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 >> 172.21.15.5:0/2223890514 conn(0x7fe20c0fb080 msgr2=0x7fe20c0fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:05.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 shutdown_connections 2023-10-08T13:06:05.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:05.889+0000 7fe2110a0700 1 -- 172.21.15.5:0/2223890514 wait complete. 2023-10-08T13:06:05.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T13:06:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 -- 172.21.15.5:0/2533662050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340ff570 msgr2=0x7f71340ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 --2- 172.21.15.5:0/2533662050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340ff570 0x7f71340ff9f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f71300099c0 tx=0x7f7130009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 -- 172.21.15.5:0/2533662050 shutdown_connections 2023-10-08T13:06:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 --2- 172.21.15.5:0/2533662050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71340fff30 0x7f713410c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 --2- 172.21.15.5:0/2533662050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134105630 0x7f7134105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 --2- 172.21.15.5:0/2533662050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340ff570 0x7f71340ff9f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 -- 172.21.15.5:0/2533662050 >> 172.21.15.5:0/2533662050 conn(0x7f71340fb080 msgr2=0x7f71340fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 -- 172.21.15.5:0/2533662050 shutdown_connections 2023-10-08T13:06:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 -- 172.21.15.5:0/2533662050 wait complete. 2023-10-08T13:06:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 Processor -- start 2023-10-08T13:06:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.072+0000 7f713c413700 1 -- start start 2023-10-08T13:06:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713c413700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340ff570 0x7f713419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713c413700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 0x7f713419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713c413700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7134105630 0x7f7134198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713c413700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71341992d0 con 0x7f71340fff30 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713c413700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7134199440 con 0x7f71340ff570 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713c413700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7134199600 con 0x7f7134105630 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 0x7f713419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 0x7f713419efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34804/0 (socket says 172.21.15.5:34804) 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 -- 172.21.15.5:0/1290975046 learned_addr learned my addr 172.21.15.5:0/1290975046 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713a9b0700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7134105630 0x7f7134198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713a1af700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340ff570 0x7f713419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 -- 172.21.15.5:0/1290975046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7134105630 msgr2=0x7f7134198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7134105630 0x7f7134198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 -- 172.21.15.5:0/1290975046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340ff570 msgr2=0x7f713419ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340ff570 0x7f713419ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 -- 172.21.15.5:0/1290975046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300095f0 con 0x7f71340fff30 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f713a1af700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340ff570 0x7f713419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71399ae700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 0x7f713419efa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f713000b580 tx=0x7f7130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.073+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713001d070 con 0x7f71340fff30 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.074+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f713000fd20 con 0x7f71340fff30 2023-10-08T13:06:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.074+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7134199880 con 0x7f71340fff30 2023-10-08T13:06:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.074+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130022e20 con 0x7f71340fff30 2023-10-08T13:06:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.074+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71341a59e0 con 0x7f71340fff30 2023-10-08T13:06:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.075+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7134100c90 con 0x7f71340fff30 2023-10-08T13:06:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.076+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f7130022470 con 0x7f71340fff30 2023-10-08T13:06:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.076+0000 7f71277fe700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71200a1540 0x7f71200a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.076+0000 7f713a1af700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71200a1540 0x7f71200a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.077+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f71300ce490 con 0x7f71340fff30 2023-10-08T13:06:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.077+0000 7f713a1af700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71200a1540 0x7f71200a3a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7128005950 tx=0x7f7128005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.081+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7130097720 con 0x7f71340fff30 2023-10-08T13:06:06.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.214+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f7130097af0 con 0x7f71340fff30 2023-10-08T13:06:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.322+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f713419a050 con 0x7f71200a1540 2023-10-08T13:06:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.331+0000 7f71277fe700 1 -- 172.21.15.5:0/1290975046 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f713419a050 con 0x7f71200a1540 2023-10-08T13:06:06.332 INFO:teuthology.orchestra.run.smithi005.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T13:06:05", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71200a1540 msgr2=0x7f71200a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71200a1540 0x7f71200a3a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7128005950 tx=0x7f7128005f50 comp rx=0 tx=0).stop 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 msgr2=0x7f713419efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 0x7f713419efa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f713000b580 tx=0x7f7130004730 comp rx=0 tx=0).stop 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 shutdown_connections 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f71200a1540 0x7f71200a3a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7134105630 0x7f7134198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71340ff570 0x7f713419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 --2- 172.21.15.5:0/1290975046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71340fff30 0x7f713419efa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 >> 172.21.15.5:0/1290975046 conn(0x7f71340fb080 msgr2=0x7f7134067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 shutdown_connections 2023-10-08T13:06:06.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.334+0000 7f713c413700 1 -- 172.21.15.5:0/1290975046 wait complete. 2023-10-08T13:06:06.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T13:06:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 -- 172.21.15.5:0/1008723072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 msgr2=0x7f637010a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 --2- 172.21.15.5:0/1008723072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637010a650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6364009990 tx=0x7f6364009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 -- 172.21.15.5:0/1008723072 shutdown_connections 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 --2- 172.21.15.5:0/1008723072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 0x7f637010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 --2- 172.21.15.5:0/1008723072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6370101850 0x7f6370101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 --2- 172.21.15.5:0/1008723072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637010a650 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 -- 172.21.15.5:0/1008723072 >> 172.21.15.5:0/1008723072 conn(0x7f63700fb090 msgr2=0x7f63700fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 -- 172.21.15.5:0/1008723072 shutdown_connections 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.474+0000 7f63765c5700 1 -- 172.21.15.5:0/1008723072 wait complete. 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 Processor -- start 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 -- start start 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6370101850 0x7f637019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 0x7f6370196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370196f70 con 0x7f6370102170 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63701970e0 con 0x7f637010ac70 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f63765c5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63701972a0 con 0x7f6370101850 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f636f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f636f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34816/0 (socket says 172.21.15.5:34816) 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f636f7fe700 1 -- 172.21.15.5:0/2198327044 learned_addr learned my addr 172.21.15.5:0/2198327044 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.475+0000 7f636ffff700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6370101850 0x7f637019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f6374b62700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 0x7f6370196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636f7fe700 1 -- 172.21.15.5:0/2198327044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6370101850 msgr2=0x7f637019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636f7fe700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6370101850 0x7f637019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636f7fe700 1 -- 172.21.15.5:0/2198327044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 msgr2=0x7f6370196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636f7fe700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 0x7f6370196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636f7fe700 1 -- 172.21.15.5:0/2198327044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640095f0 con 0x7f6370102170 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f6374b62700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 0x7f6370196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636f7fe700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637019cd20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6364000c00 tx=0x7f636400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636401d070 con 0x7f6370102170 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6370197520 con 0x7f6370102170 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63640054f0 con 0x7f6370102170 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364004b30 con 0x7f6370102170 2023-10-08T13:06:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.476+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63701a37d0 con 0x7f6370102170 2023-10-08T13:06:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.477+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6370105d40 con 0x7f6370102170 2023-10-08T13:06:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.478+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f6364004c90 con 0x7f6370102170 2023-10-08T13:06:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.479+0000 7f636d7fa700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f63580a1550 0x7f63580a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.479+0000 7f636ffff700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f63580a1550 0x7f63580a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.479+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f63640ce480 con 0x7f6370102170 2023-10-08T13:06:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.479+0000 7f636ffff700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f63580a1550 0x7f63580a3a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6360005950 tx=0x7f636000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.482+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f63640975b0 con 0x7f6370102170 2023-10-08T13:06:06.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: scrub queued for path: / 2023-10-08T13:06:06.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:06.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:06.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:06.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: pgmap v303: 129 pgs: 129 active+clean; 647 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-08T13:06:06.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: from='client.15822 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:06.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:06 smithi118 ceph-mon[104234]: from='client.15867 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:06.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: scrub queued for path: / 2023-10-08T13:06:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: pgmap v303: 129 pgs: 129 active+clean; 647 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-08T13:06:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: from='client.15822 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:06.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:06 smithi060 ceph-mon[103190]: from='client.15867 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:06.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: scrub queued for path: / 2023-10-08T13:06:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: pgmap v303: 129 pgs: 129 active+clean; 647 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-08T13:06:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: from='client.15822 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:06 smithi005 ceph-mon[99496]: from='client.15867 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:06.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.713+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6370110630 con 0x7f63580a1550 2023-10-08T13:06:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.721+0000 7f636d7fa700 1 -- 172.21.15.5:0/2198327044 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f6370110630 con 0x7f63580a1550 2023-10-08T13:06:06.722 INFO:teuthology.orchestra.run.smithi005.stdout:/ 1m 6m3h 2023-10-08T13:06:06.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f63580a1550 msgr2=0x7f63580a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f63580a1550 0x7f63580a3a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6360005950 tx=0x7f636000b410 comp rx=0 tx=0).stop 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 msgr2=0x7f637019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637019cd20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6364000c00 tx=0x7f636400f690 comp rx=0 tx=0).stop 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 shutdown_connections 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f63580a1550 0x7f63580a3a10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f637010ac70 0x7f6370196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6370101850 0x7f637019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 --2- 172.21.15.5:0/2198327044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6370102170 0x7f637019cd20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:06.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.723+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 >> 172.21.15.5:0/2198327044 conn(0x7f63700fb090 msgr2=0x7f63700fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.724+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 shutdown_connections 2023-10-08T13:06:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:06.724+0000 7f63765c5700 1 -- 172.21.15.5:0/2198327044 wait complete. 2023-10-08T13:06:06.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-08T13:06:06.766 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-08T13:06:06.777 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-08T13:06:06.798 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:06:06.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-08T13:06:06.808 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T13:06:06.856 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T13:06:06.856 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:06:06.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-10-08T13:06:06.894 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:06.955 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem Size Used Avail Use% Mounted on 2023-10-08T13:06:06.955 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:3300,172.21.15.60:3300,172.21.15.118:3300:/volumes/_nogroup/sv_1/f1ebe893-7572-4cde-a2d6-a4b7940d5d5a 1.1T 332M 1.1T 1% /tmp/cephfs 2023-10-08T13:06:06.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-10-08T13:06:07.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-10-08T13:06:07.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-10-08T13:06:07.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:07 smithi005 ceph-mon[99496]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T13:06:07.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:07 smithi005 ceph-mon[99496]: from='client.15873 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:07.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:07 smithi005 ceph-mon[99496]: from='client.15879 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:07.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:07 smithi118 ceph-mon[104234]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T13:06:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:07 smithi118 ceph-mon[104234]: from='client.15873 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:07 smithi118 ceph-mon[104234]: from='client.15879 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:07.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:07 smithi060 ceph-mon[103190]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T13:06:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:07 smithi060 ceph-mon[103190]: from='client.15873 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:07.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:07 smithi060 ceph-mon[103190]: from='client.15879 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:06:08.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:08 smithi118 ceph-mon[104234]: pgmap v304: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 104 KiB/s wr, 41 op/s 2023-10-08T13:06:08.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:08 smithi060 ceph-mon[103190]: pgmap v304: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 104 KiB/s wr, 41 op/s 2023-10-08T13:06:08.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:08 smithi005 ceph-mon[99496]: pgmap v304: 129 pgs: 129 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 104 KiB/s wr, 41 op/s 2023-10-08T13:06:09.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-10-08T13:06:09.553 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-10-08T13:06:09.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-10-08T13:06:09.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-08T13:06:09.716 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/: 2023-10-08T13:06:09.716 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:09.716 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:09.716 INFO:teuthology.orchestra.run.smithi005.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 .. 2023-10-08T13:06:09.716 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 data 2023-10-08T13:06:09.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:09.717 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data: 2023-10-08T13:06:09.717 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:09.717 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:09.717 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 .. 2023-10-08T13:06:09.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-10-08T13:06:09.806 INFO:teuthology.orchestra.run.smithi005.stdout:[Service] 2023-10-08T13:06:09.807 INFO:teuthology.orchestra.run.smithi005.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-10-08T13:06:09.807 INFO:teuthology.orchestra.run.smithi005.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-10-08T13:06:09.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-10-08T13:06:09.897 INFO:teuthology.orchestra.run.smithi005.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-10-08T13:06:10.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:10 smithi118 ceph-mon[104234]: pgmap v305: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 105 KiB/s wr, 43 op/s 2023-10-08T13:06:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:10 smithi060 ceph-mon[103190]: pgmap v305: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 105 KiB/s wr, 43 op/s 2023-10-08T13:06:10.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:10 smithi005 ceph-mon[99496]: pgmap v305: 129 pgs: 129 active+clean; 1.3 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 105 KiB/s wr, 43 op/s 2023-10-08T13:06:12.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:12 smithi118 ceph-mon[104234]: pgmap v306: 129 pgs: 129 active+clean; 1.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 119 KiB/s wr, 44 op/s 2023-10-08T13:06:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:12 smithi060 ceph-mon[103190]: pgmap v306: 129 pgs: 129 active+clean; 1.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 119 KiB/s wr, 44 op/s 2023-10-08T13:06:12.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:12 smithi005 ceph-mon[99496]: pgmap v306: 129 pgs: 129 active+clean; 1.3 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 119 KiB/s wr, 44 op/s 2023-10-08T13:06:14.446 INFO:teuthology.orchestra.run.smithi005.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-10-08T13:06:14.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-08T13:06:14.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:14 smithi005 ceph-mon[99496]: pgmap v307: 129 pgs: 129 active+clean; 9.5 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 824 KiB/s wr, 54 op/s 2023-10-08T13:06:14.493 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/: 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 .. 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 data 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data: 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:total 30 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 . 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 .. 2023-10-08T13:06:14.494 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 base 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Oct 8 13:06 global 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 log 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_commit_ts 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_dynshmem 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 8 13:06 pg_hba.conf 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 8 13:06 pg_ident.conf 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 pg_logical 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 pg_multixact 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 pg_notify 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_replslot 2023-10-08T13:06:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_serial 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_snapshots 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_stat 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_stat_tmp 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 pg_subtrans 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_tblspc 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_twophase 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 pg_wal 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 pg_xact 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 8 13:06 postgresql.auto.conf 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 8 13:06 postgresql.conf 2023-10-08T13:06:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base: 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 . 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 1 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 12346 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 12347 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:total 7209 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 . 2023-10-08T13:06:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 .. 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 112 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 113 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 13:06 12182 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12182_fsm 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12182_vm 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12184 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12186 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12187_fsm 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187_vm 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12189 2023-10-08T13:06:14.498 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12191 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12192_fsm 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192_vm 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12194 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12196 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12197_fsm 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197_vm 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12199 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12201 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202 2023-10-08T13:06:14.499 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12202_fsm 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202_vm 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12204 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12206 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12207_fsm 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207_vm 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12209 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12211 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12212 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12214 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12216 2023-10-08T13:06:14.500 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 13:06 1247 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1247_fsm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1247_vm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 13:06 1249 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1249_fsm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1249_vm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 13:06 1255 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1255_fsm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1255_vm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 13:06 1259 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1259_fsm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1259_vm 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417 2023-10-08T13:06:14.501 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417_vm 2023-10-08T13:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418 2023-10-08T13:06:14.502 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418_vm 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 174 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 175 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2187 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224_vm 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328_vm 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336_vm 2023-10-08T13:06:14.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2337 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2600 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2600_fsm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2600_vm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2601_fsm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601_vm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2602 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2602_fsm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2602_vm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2603 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2603_fsm 2023-10-08T13:06:14.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2603_vm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604_vm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2605 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2605_fsm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2605_vm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2606_fsm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606_vm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607_fsm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2607_vm 2023-10-08T13:06:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 13:06 2608 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2608_fsm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2608_vm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 13:06 2609 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2609_fsm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2609_vm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610_fsm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2610_vm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611_vm 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612 2023-10-08T13:06:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2612_fsm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612_vm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613_vm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2615_fsm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615_vm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616_fsm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2616_vm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 13:06 2617 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2617_fsm 2023-10-08T13:06:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2617_vm 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 13:06 2618 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2618_fsm 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2618_vm 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 13:06 2619 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2619_fsm 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2619_vm 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620_vm 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2650 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2651 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2652 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2653 2023-10-08T13:06:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2654 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2655 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2656 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2657 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 13:06 2658 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2659 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2660 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2661 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2662 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2663 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2664 2023-10-08T13:06:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2665 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2666 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2667 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2668 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2669 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2670 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Oct 8 13:06 2673 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Oct 8 13:06 2674 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:06 2675 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2678 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2679 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2680 2023-10-08T13:06:14.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2681 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2682 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2683 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2684 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2685 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2686 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2687 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2688 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2689 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2690 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 13:06 2691 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2692 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2693 2023-10-08T13:06:14.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2696 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2699 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2701 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2702 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2703 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2704 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2753 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2753_fsm 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2753_vm 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2754 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2755 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2756 2023-10-08T13:06:14.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2757 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830_vm 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2831 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832_vm 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2833 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834_vm 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2835 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836_vm 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2837 2023-10-08T13:06:14.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 13:06 2838 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2838_fsm 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2838_vm 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2839 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840_fsm 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2840_vm 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2841 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995_vm 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2996 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079 2023-10-08T13:06:14.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3079_fsm 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079_vm 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3080 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3081 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3085 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118_vm 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3119 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3164 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256_vm 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3257 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3258 2023-10-08T13:06:14.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350_vm 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3351 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3379 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3380 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381_vm 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3394 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3394_fsm 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3394_vm 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3395 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439 2023-10-08T13:06:14.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439_vm 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3440 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 3455 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3456 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3456_fsm 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3456_vm 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466_vm 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3467 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3468 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501_vm 2023-10-08T13:06:14.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3502 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3503 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3534 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3541_fsm 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541_vm 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3542 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3574 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3575 2023-10-08T13:06:14.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576_vm 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596_vm 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3597 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598_vm 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3599 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3600_fsm 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600_vm 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601 2023-10-08T13:06:14.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3601_fsm 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601_vm 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3602_fsm 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602_vm 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3603 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3603_fsm 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3603_vm 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3604 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3605 2023-10-08T13:06:14.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3606 2023-10-08T13:06:14.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:14 smithi118 ceph-mon[104234]: pgmap v307: 129 pgs: 129 active+clean; 9.5 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 824 KiB/s wr, 54 op/s 2023-10-08T13:06:14.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3607 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3608 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 3609 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3712 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3764_fsm 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764_vm 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3766 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3767 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3997 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 5002 2023-10-08T13:06:14.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 548 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 549 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102_vm 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104_vm 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106_vm 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6110 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6111 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6112 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6113 2023-10-08T13:06:14.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6117 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826_vm 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 827 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 828 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:total 7209 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 . 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 .. 2023-10-08T13:06:14.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 112 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 113 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 13:06 12182 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12182_fsm 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12182_vm 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12184 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12186 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12187_fsm 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187_vm 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12189 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12191 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192 2023-10-08T13:06:14.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12192_fsm 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192_vm 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12194 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12196 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12197_fsm 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197_vm 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12199 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12201 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12202_fsm 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202_vm 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12204 2023-10-08T13:06:14.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12206 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12207_fsm 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207_vm 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12209 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12211 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12212 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12214 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12216 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 13:06 1247 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1247_fsm 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1247_vm 2023-10-08T13:06:14.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 13:06 1249 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1249_fsm 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1249_vm 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 13:06 1255 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1255_fsm 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1255_vm 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 13:06 1259 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1259_fsm 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1259_vm 2023-10-08T13:06:14.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417_vm 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418_vm 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 174 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 175 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2187 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224_vm 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328_vm 2023-10-08T13:06:14.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336_vm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2337 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2600 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2600_fsm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2600_vm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2601_fsm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601_vm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2602 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2602_fsm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2602_vm 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2603 2023-10-08T13:06:14.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2603_fsm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2603_vm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604_vm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2605 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2605_fsm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2605_vm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2606_fsm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606_vm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607_fsm 2023-10-08T13:06:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2607_vm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 13:06 2608 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2608_fsm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2608_vm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 13:06 2609 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2609_fsm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2609_vm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610_fsm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2610_vm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611_vm 2023-10-08T13:06:14.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2612_fsm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612_vm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613_vm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2615_fsm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615_vm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616_fsm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2616_vm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 13:06 2617 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2617_fsm 2023-10-08T13:06:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2617_vm 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 13:06 2618 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2618_fsm 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2618_vm 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 13:06 2619 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2619_fsm 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2619_vm 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620_vm 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2650 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2651 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2652 2023-10-08T13:06:14.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2653 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2654 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2655 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2656 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2657 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 13:06 2658 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2659 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2660 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2661 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2662 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2663 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2664 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2665 2023-10-08T13:06:14.538 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2666 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2667 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2668 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2669 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2670 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Oct 8 13:06 2673 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Oct 8 13:06 2674 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:06 2675 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2678 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2679 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2680 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2681 2023-10-08T13:06:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2682 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2683 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2684 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2685 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2686 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2687 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2688 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2689 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2690 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 13:06 2691 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2692 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2693 2023-10-08T13:06:14.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2696 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2699 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2701 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2702 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2703 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2704 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2753 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2753_fsm 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2753_vm 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2754 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2755 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2756 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2757 2023-10-08T13:06:14.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830 2023-10-08T13:06:14.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830_vm 2023-10-08T13:06:14.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2831 2023-10-08T13:06:14.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832 2023-10-08T13:06:14.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832_vm 2023-10-08T13:06:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2833 2023-10-08T13:06:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834 2023-10-08T13:06:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834_vm 2023-10-08T13:06:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2835 2023-10-08T13:06:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836 2023-10-08T13:06:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836_vm 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2837 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 13:06 2838 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2838_fsm 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2838_vm 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2839 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840_fsm 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2840_vm 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2841 2023-10-08T13:06:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995_vm 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2996 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3079_fsm 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079_vm 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3080 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3081 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3085 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118_vm 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3119 2023-10-08T13:06:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3164 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256_vm 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3257 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3258 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350_vm 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3351 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3379 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3380 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381_vm 2023-10-08T13:06:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3394 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3394_fsm 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3394_vm 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3395 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439_vm 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3440 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 3455 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3456 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3456_fsm 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3456_vm 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466 2023-10-08T13:06:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466_vm 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3467 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3468 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501_vm 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3502 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3503 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3534 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3541_fsm 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541_vm 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3542 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3574 2023-10-08T13:06:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3575 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576_vm 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596_vm 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3597 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598_vm 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3599 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3600_fsm 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600_vm 2023-10-08T13:06:14.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3601_fsm 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601_vm 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3602_fsm 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602_vm 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3603 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3603_fsm 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3603_vm 2023-10-08T13:06:14.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3604 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3605 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3606 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3607 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3608 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 3609 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3712 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3764_fsm 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764_vm 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3766 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3767 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3997 2023-10-08T13:06:14.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 5002 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 548 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 549 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102_vm 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104_vm 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106_vm 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6110 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6111 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6112 2023-10-08T13:06:14.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6113 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6117 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826_vm 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 827 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 828 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:total 7209 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 . 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 .. 2023-10-08T13:06:14.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 112 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 113 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 13:06 12182 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12182_fsm 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12182_vm 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12184 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12186 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12187_fsm 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187_vm 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12189 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12191 2023-10-08T13:06:14.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12192_fsm 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192_vm 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12194 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12196 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12197_fsm 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197_vm 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12199 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12201 2023-10-08T13:06:14.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12202_fsm 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202_vm 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12204 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12206 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12207_fsm 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207_vm 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12209 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12211 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12212 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12214 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12216 2023-10-08T13:06:14.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 13:06 1247 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1247_fsm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1247_vm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 13:06 1249 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1249_fsm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1249_vm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 13:06 1255 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1255_fsm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1255_vm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 13:06 1259 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1259_fsm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1259_vm 2023-10-08T13:06:14.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417_vm 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418_vm 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 174 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 175 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2187 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224_vm 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328_vm 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336 2023-10-08T13:06:14.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336_vm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2337 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2600 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2600_fsm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2600_vm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2601_fsm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601_vm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2602 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2602_fsm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2602_vm 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2603 2023-10-08T13:06:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2603_fsm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2603_vm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604_vm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2605 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2605_fsm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2605_vm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2606_fsm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606_vm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607_fsm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2607_vm 2023-10-08T13:06:14.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 13:06 2608 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2608_fsm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2608_vm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 13:06 2609 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2609_fsm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2609_vm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610_fsm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2610_vm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611_vm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2612_fsm 2023-10-08T13:06:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612_vm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613_vm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2615_fsm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615_vm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616_fsm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2616_vm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 13:06 2617 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2617_fsm 2023-10-08T13:06:14.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2617_vm 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 13:06 2618 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2618_fsm 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2618_vm 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 13:06 2619 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2619_fsm 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2619_vm 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620_vm 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2650 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2651 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2652 2023-10-08T13:06:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2653 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2654 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2655 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2656 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2657 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 13:06 2658 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2659 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2660 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2661 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2662 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2663 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2664 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2665 2023-10-08T13:06:14.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2666 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2667 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2668 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2669 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2670 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Oct 8 13:06 2673 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Oct 8 13:06 2674 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:06 2675 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2678 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2679 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2680 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2681 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2682 2023-10-08T13:06:14.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2683 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2684 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2685 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2686 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2687 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2688 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2689 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2690 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 13:06 2691 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2692 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2693 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2696 2023-10-08T13:06:14.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2699 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2701 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2702 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2703 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2704 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2753 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2753_fsm 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2753_vm 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2754 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2755 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2756 2023-10-08T13:06:14.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2757 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830_vm 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2831 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832_vm 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2833 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834_vm 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2835 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836_vm 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2837 2023-10-08T13:06:14.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 13:06 2838 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2838_fsm 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2838_vm 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2839 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840_fsm 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2840_vm 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2841 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995_vm 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2996 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079 2023-10-08T13:06:14.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3079_fsm 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079_vm 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3080 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3081 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3085 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118_vm 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3119 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3164 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256_vm 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3257 2023-10-08T13:06:14.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3258 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350_vm 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3351 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3379 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3380 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381_vm 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3394 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3394_fsm 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3394_vm 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3395 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439 2023-10-08T13:06:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439_vm 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3440 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 3455 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3456 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3456_fsm 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3456_vm 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466_vm 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3467 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3468 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501_vm 2023-10-08T13:06:14.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3502 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3503 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3534 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3541_fsm 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541_vm 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3542 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3574 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3575 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576_vm 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596 2023-10-08T13:06:14.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596_vm 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3597 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598_vm 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3599 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3600_fsm 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600_vm 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3601_fsm 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601_vm 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602 2023-10-08T13:06:14.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3602_fsm 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602_vm 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3603 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3603_fsm 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3603_vm 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3604 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3605 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3606 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3607 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3608 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 3609 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3712 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764 2023-10-08T13:06:14.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3764_fsm 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764_vm 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3766 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3767 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3997 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 5002 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 548 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 549 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102_vm 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104_vm 2023-10-08T13:06:14.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106_vm 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6110 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6111 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6112 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6113 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6117 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826_vm 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 827 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 828 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:06:14.577 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/global: 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:total 553 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Oct 8 13:06 . 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1136 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1136_fsm 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1136_vm 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 1137 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1213 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1213_fsm 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1213_vm 2023-10-08T13:06:14.578 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1214 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1214_fsm 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1214_vm 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 1232 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 1233 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1260 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1260_fsm 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1260_vm 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1261 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1261_fsm 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1261_vm 2023-10-08T13:06:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1262 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1262_fsm 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1262_vm 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2396 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2396_fsm 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2396_vm 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2397 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2671 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2672 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2676 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2677 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2694 2023-10-08T13:06:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2695 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2697 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2698 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2846 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2846_vm 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2847 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2964 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2964_vm 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2965 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2966 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2966_vm 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2967 2023-10-08T13:06:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3592 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3592_vm 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3593 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 4060 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 4060_vm 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 4061 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6000 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6000_vm 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6001 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6002 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6100 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6100_vm 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6114 2023-10-08T13:06:14.582 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6115 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 pg_control 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/log: 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:total 1 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 . 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 mappings 2023-10-08T13:06:14.584 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 13:06 replorigin_checkpoint 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 snapshots 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 .. 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 .. 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.585 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 . 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 members 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 offsets 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 .. 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:06:14.586 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 .. 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.587 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.588 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-08T13:06:14.589 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.590 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:total 16384 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 . 2023-10-08T13:06:14.591 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:06 000000010000000000000001 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 archive_status 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 .. 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:06:14.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 8 13:06 .. 2023-10-08T13:06:14.593 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:06:14.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-10-08T13:06:14.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:14 smithi060 ceph-mon[103190]: pgmap v307: 129 pgs: 129 active+clean; 9.5 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 824 KiB/s wr, 54 op/s 2023-10-08T13:06:14.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2023-10-08T13:06:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-10-08T13:06:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-10-08T13:06:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-10-08T13:06:14.779 INFO:teuthology.orchestra.run.smithi005.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-10-08T13:06:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:creating tables... 2023-10-08T13:06:14.861 INFO:teuthology.orchestra.run.smithi005.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.86 s) 2023-10-08T13:06:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.25 s, remaining 3.73 s) 2023-10-08T13:06:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.35 s, remaining 3.41 s) 2023-10-08T13:06:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.50 s, remaining 3.53 s) 2023-10-08T13:06:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.68 s, remaining 3.68 s) 2023-10-08T13:06:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.85 s, remaining 3.66 s) 2023-10-08T13:06:15.729 INFO:teuthology.orchestra.run.smithi005.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.93 s, remaining 3.32 s) 2023-10-08T13:06:15.908 INFO:teuthology.orchestra.run.smithi005.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.11 s, remaining 3.32 s) 2023-10-08T13:06:16.020 INFO:teuthology.orchestra.run.smithi005.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.22 s, remaining 3.12 s) 2023-10-08T13:06:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.36 s, remaining 3.00 s) 2023-10-08T13:06:16.340 INFO:teuthology.orchestra.run.smithi005.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.54 s, remaining 2.94 s) 2023-10-08T13:06:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.61 s, remaining 2.68 s) 2023-10-08T13:06:16.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:16 smithi118 ceph-mon[104234]: pgmap v308: 129 pgs: 129 active+clean; 16 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2023-10-08T13:06:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.79 s, remaining 2.62 s) 2023-10-08T13:06:16.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:16 smithi060 ceph-mon[103190]: pgmap v308: 129 pgs: 129 active+clean; 16 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2023-10-08T13:06:16.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:16 smithi005 ceph-mon[99496]: pgmap v308: 129 pgs: 129 active+clean; 16 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 1.4 MiB/s wr, 74 op/s 2023-10-08T13:06:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.96 s, remaining 2.52 s) 2023-10-08T13:06:16.832 INFO:teuthology.orchestra.run.smithi005.stderr:1500000 of 3200000 tuples (46%) done (elapsed 2.03 s, remaining 2.30 s) 2023-10-08T13:06:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.22 s, remaining 2.22 s) 2023-10-08T13:06:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.40 s, remaining 2.12 s) 2023-10-08T13:06:17.283 INFO:teuthology.orchestra.run.smithi005.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.48 s, remaining 1.93 s) 2023-10-08T13:06:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.69 s, remaining 1.84 s) 2023-10-08T13:06:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.86 s, remaining 1.71 s) 2023-10-08T13:06:17.735 INFO:teuthology.orchestra.run.smithi005.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.93 s, remaining 1.54 s) 2023-10-08T13:06:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2200000 of 3200000 tuples (68%) done (elapsed 3.11 s, remaining 1.41 s) 2023-10-08T13:06:17.982 INFO:teuthology.orchestra.run.smithi005.stderr:2300000 of 3200000 tuples (71%) done (elapsed 3.18 s, remaining 1.24 s) 2023-10-08T13:06:18.158 INFO:teuthology.orchestra.run.smithi005.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.36 s, remaining 1.12 s) 2023-10-08T13:06:18.340 INFO:teuthology.orchestra.run.smithi005.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.54 s, remaining 0.99 s) 2023-10-08T13:06:18.406 INFO:teuthology.orchestra.run.smithi005.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.61 s, remaining 0.83 s) 2023-10-08T13:06:18.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:18 smithi118 ceph-mon[104234]: pgmap v309: 129 pgs: 129 active+clean; 71 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 9.2 MiB/s wr, 111 op/s 2023-10-08T13:06:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.79 s, remaining 0.70 s) 2023-10-08T13:06:18.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:18 smithi060 ceph-mon[103190]: pgmap v309: 129 pgs: 129 active+clean; 71 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 9.2 MiB/s wr, 111 op/s 2023-10-08T13:06:18.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:18 smithi005 ceph-mon[99496]: pgmap v309: 129 pgs: 129 active+clean; 71 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 9.2 MiB/s wr, 111 op/s 2023-10-08T13:06:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.88 s, remaining 0.55 s) 2023-10-08T13:06:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2900000 of 3200000 tuples (90%) done (elapsed 4.05 s, remaining 0.42 s) 2023-10-08T13:06:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:3000000 of 3200000 tuples (93%) done (elapsed 4.21 s, remaining 0.28 s) 2023-10-08T13:06:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.41 s, remaining 0.14 s) 2023-10-08T13:06:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.47 s, remaining 0.00 s) 2023-10-08T13:06:19.327 INFO:teuthology.orchestra.run.smithi005.stderr:vacuum... 2023-10-08T13:06:19.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:19 smithi118 ceph-mon[104234]: scrub summary: idle 2023-10-08T13:06:19.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:19 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:06:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:19 smithi060 ceph-mon[103190]: scrub summary: idle 2023-10-08T13:06:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:19 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:06:19.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:19 smithi005 ceph-mon[99496]: scrub summary: idle 2023-10-08T13:06:19.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:19 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:06:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 -- 172.21.15.5:0/888967637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680ff570 msgr2=0x7fb0680ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 --2- 172.21.15.5:0/888967637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680ff570 0x7fb0680ff9f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb0580099c0 tx=0x7fb058009cd0 comp rx=0 tx=0).stop 2023-10-08T13:06:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 -- 172.21.15.5:0/888967637 shutdown_connections 2023-10-08T13:06:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 --2- 172.21.15.5:0/888967637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0680fff30 0x7fb06810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 --2- 172.21.15.5:0/888967637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb068105630 0x7fb068105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 --2- 172.21.15.5:0/888967637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680ff570 0x7fb0680ff9f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 -- 172.21.15.5:0/888967637 >> 172.21.15.5:0/888967637 conn(0x7fb0680fb080 msgr2=0x7fb0680fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 -- 172.21.15.5:0/888967637 shutdown_connections 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.988+0000 7fb0707c8700 1 -- 172.21.15.5:0/888967637 wait complete. 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 Processor -- start 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 -- start start 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0680ff570 0x7fb06819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 0x7fb06819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb068105630 0x7fb068198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068199140 con 0x7fb0680fff30 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681992b0 con 0x7fb068105630 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb0707c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068199470 con 0x7fb0680ff570 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 0x7fb06819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 0x7fb06819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34856/0 (socket says 172.21.15.5:34856) 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 -- 172.21.15.5:0/402309554 learned_addr learned my addr 172.21.15.5:0/402309554 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06e564700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0680ff570 0x7fb06819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06ed65700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb068105630 0x7fb068198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 -- 172.21.15.5:0/402309554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0680ff570 msgr2=0x7fb06819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0680ff570 0x7fb06819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 -- 172.21.15.5:0/402309554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb068105630 msgr2=0x7fb068198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb068105630 0x7fb068198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06dd63700 1 -- 172.21.15.5:0/402309554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580095f0 con 0x7fb0680fff30 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.989+0000 7fb06e564700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0680ff570 0x7fb06819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.990+0000 7fb06dd63700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 0x7fb06819eef0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb05800c010 tx=0x7fb05800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.990+0000 7fb05f7fe700 1 -- 172.21.15.5:0/402309554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05801c070 con 0x7fb0680fff30 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.990+0000 7fb05f7fe700 1 -- 172.21.15.5:0/402309554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb05800fdb0 con 0x7fb0680fff30 2023-10-08T13:06:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.990+0000 7fb05f7fe700 1 -- 172.21.15.5:0/402309554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058022cd0 con 0x7fb0680fff30 2023-10-08T13:06:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.990+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0681996f0 con 0x7fb0680fff30 2023-10-08T13:06:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.990+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0681a59a0 con 0x7fb0680fff30 2023-10-08T13:06:19.997 INFO:teuthology.orchestra.run.smithi005.stderr:set primary keys... 2023-10-08T13:06:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.993+0000 7fb07c9b1b80 1 Processor -- start 2023-10-08T13:06:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.993+0000 7fb07c9b1b80 1 -- start start 2023-10-08T13:06:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e847222880 0x55e847222c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e84721cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84721d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e847185400 con 0x55e84721d0b0 2023-10-08T13:06:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e847176bc0 con 0x55e847222880 2023-10-08T13:06:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8471744e0 con 0x55e8472231a0 2023-10-08T13:06:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e84721cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e84721cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48066/0 (socket says 172.21.15.5:48066) 2023-10-08T13:06:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 -- 172.21.15.5:0/3401584968 learned_addr learned my addr 172.21.15.5:0/3401584968 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06ed65700 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e847222880 0x55e847222c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 -- 172.21.15.5:0/3401584968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e847222880 msgr2=0x55e847222c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e847222880 0x55e847222c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 -- 172.21.15.5:0/3401584968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 msgr2=0x55e84721d510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:06:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84721d510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 -- 172.21.15.5:0/3401584968 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e846f9ad80 con 0x55e8472231a0 2023-10-08T13:06:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.994+0000 7fb06e564700 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e84721cb70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0640115f0 tx=0x7fb064011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb0e4a0f0212aae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.995+0000 7fb05cff9700 1 -- 172.21.15.5:0/3401584968 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400f680 con 0x55e8472231a0 2023-10-08T13:06:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.995+0000 7fb05cff9700 1 -- 172.21.15.5:0/3401584968 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb06400fca0 con 0x55e8472231a0 2023-10-08T13:06:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.995+0000 7fb05cff9700 1 -- 172.21.15.5:0/3401584968 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064019d30 con 0x55e8472231a0 2023-10-08T13:06:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.995+0000 7fb05f7fe700 1 -- 172.21.15.5:0/402309554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fb058020070 con 0x7fb0680fff30 2023-10-08T13:06:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.995+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3401584968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 msgr2=0x55e84721cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.995+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e84721cb70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0640115f0 tx=0x7fb064011900 comp rx=0 tx=0).stop 2023-10-08T13:06:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3401584968 shutdown_connections 2023-10-08T13:06:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84721d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e847222880 0x55e847222c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3401584968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e84721cb70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3401584968 >> 172.21.15.5:0/3401584968 conn(0x55e847191200 msgr2=0x55e847217b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3401584968 shutdown_connections 2023-10-08T13:06:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb05f7fe700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb0540a1460 0x7fb0540a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3401584968 wait complete. 2023-10-08T13:06:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb06e564700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb0540a1460 0x7fb0540a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb05f7fe700 1 -- 172.21.15.5:0/402309554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb0580ce060 con 0x7fb0680fff30 2023-10-08T13:06:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.996+0000 7fb07c9b1b80 1 -- start start 2023-10-08T13:06:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 Processor -- start 2023-10-08T13:06:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb06e564700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb0540a1460 0x7fb0540a3920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb064011d00 tx=0x7fb0640198d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 0x55e8472266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e847226c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e847227140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84716fdd0 con 0x55e847222880 2023-10-08T13:06:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84710c6b0 con 0x55e84721d0b0 2023-10-08T13:06:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84710c350 con 0x55e8472231a0 2023-10-08T13:06:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb07c9b1b80 10 client.0 _ll_register_callbacks cb 0x55e846f697a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb06e564700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 0x55e8472266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb06e564700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 0x55e8472266c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58048/0 (socket says 172.21.15.5:58048) 2023-10-08T13:06:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.997+0000 7fb06e564700 1 -- 172.21.15.5:0/3499832776 learned_addr learned my addr 172.21.15.5:0/3499832776 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb06e564700 1 -- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 msgr2=0x55e847227140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb06e564700 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e847227140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb06e564700 1 -- 172.21.15.5:0/3499832776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 msgr2=0x55e847226c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb06e564700 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e847226c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb06e564700 1 -- 172.21.15.5:0/3499832776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb064009dd0 con 0x55e84721d0b0 2023-10-08T13:06:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb06e564700 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 0x55e8472266c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb06401b000 tx=0x7fb064011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a79a94008c75b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb051ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb051ffb700 1 -- 172.21.15.5:0/3499832776 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064005460 con 0x55e84721d0b0 2023-10-08T13:06:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e847137e50 con 0x55e84721d0b0 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb051ffb700 1 -- 172.21.15.5:0/3499832776 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb064029040 con 0x55e84721d0b0 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb051ffb700 1 -- 172.21.15.5:0/3499832776 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0640055c0 con 0x55e84721d0b0 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb07c9b1b80 10 client.25433 fetch_fsmap learned FSMap version 28 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.998+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e846f83c00 con 0x55e84721d0b0 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb051ffb700 1 -- 172.21.15.5:0/3499832776 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e847137e50 con 0x55e84721d0b0 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb051ffb700 1 -- 172.21.15.5:0/3499832776 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb064022590 con 0x55e84721d0b0 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb07c9b1b80 10 client.25433 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:06:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb07c9b1b80 10 client.25433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb07c9b1b80 20 client.25433 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e847236ce0 0x55e847239140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb07c9b1b80 4 client.25433 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e847168db0 con 0x55e847236ce0 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb06dd63700 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e847236ce0 0x55e847239140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb051ffb700 10 client.25433 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:19.999+0000 7fb06dd63700 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e847236ce0 0x55e847239140 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=347c56664c282644 server_cookie=dd5b2b2523721ce3 in_seq=0 out_seq=0 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb051ffb700 1 -- 172.21.15.5:0/3499832776 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e847168db0 con 0x55e847236ce0 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb051ffb700 10 client.25433 handle_command_reply: tid=0 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 client.25433 shutdown 2023-10-08T13:06:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 msgr2=0x55e8472266c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 0x55e8472266c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb06401b000 tx=0x7fb064011900 comp rx=0 tx=0).stop 2023-10-08T13:06:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 shutdown_connections 2023-10-08T13:06:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e8472231a0 0x55e847227140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e847236ce0 0x55e847239140 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e84721d0b0 0x55e8472266c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb051ffb700 0 client.25433 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/3499832776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e847226c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.000+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 >> 172.21.15.5:0/3499832776 conn(0x55e847191200 msgr2=0x55e847217010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.001+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 shutdown_connections 2023-10-08T13:06:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.001+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/3499832776 wait complete. 2023-10-08T13:06:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.001+0000 7fb07c9b1b80 20 client.25433 trim_cache size 0 max 16384 2023-10-08T13:06:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 Processor -- start 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 -- start start 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e84721d0b0 0x55e84721cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e8472390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e847226f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846ff08c0 con 0x55e847222880 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e847219330 con 0x55e8472231a0 2023-10-08T13:06:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.017+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84721dbd0 con 0x55e84721d0b0 2023-10-08T13:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e8472390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06e564700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e84721d0b0 0x55e84721cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e8472390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34876/0 (socket says 172.21.15.5:34876) 2023-10-08T13:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06ed65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e847226f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 -- 172.21.15.5:0/2825650963 learned_addr learned my addr 172.21.15.5:0/2825650963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 -- 172.21.15.5:0/2825650963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e84721d0b0 msgr2=0x55e84721cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e84721d0b0 0x55e84721cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 -- 172.21.15.5:0/2825650963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 msgr2=0x55e847226f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e847226f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 -- 172.21.15.5:0/2825650963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e846fc11f0 con 0x55e847222880 2023-10-08T13:06:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06e564700 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e84721d0b0 0x55e84721cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06ed65700 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e847226f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb06dd63700 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e8472390d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb058009520 tx=0x7fb05800ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a2a646261d3e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb05d7fa700 1 -- 172.21.15.5:0/2825650963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05809b550 con 0x55e847222880 2023-10-08T13:06:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb05d7fa700 1 -- 172.21.15.5:0/2825650963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb05809ae50 con 0x55e847222880 2023-10-08T13:06:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.018+0000 7fb05d7fa700 1 -- 172.21.15.5:0/2825650963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05809b310 con 0x55e847222880 2023-10-08T13:06:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2825650963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 msgr2=0x55e8472390d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e8472390d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb058009520 tx=0x7fb05800ff20 comp rx=0 tx=0).stop 2023-10-08T13:06:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2825650963 shutdown_connections 2023-10-08T13:06:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e847226f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e84721d0b0 0x55e84721cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2825650963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e847222880 0x55e8472390d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2825650963 >> 172.21.15.5:0/2825650963 conn(0x55e847191200 msgr2=0x55e847224fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2825650963 shutdown_connections 2023-10-08T13:06:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2825650963 wait complete. 2023-10-08T13:06:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.019+0000 7fb07c9b1b80 1 -- start start 2023-10-08T13:06:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 Processor -- start 2023-10-08T13:06:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84722bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e847222880 0x55e84722c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e84722c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e847289b90 con 0x55e84721d0b0 2023-10-08T13:06:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e847289cd0 con 0x55e8472231a0 2023-10-08T13:06:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e847289e10 con 0x55e847222880 2023-10-08T13:06:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb07c9b1b80 10 client.0 _ll_register_callbacks cb 0x7fb06401ac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06e564700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84722bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06dd63700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e847222880 0x55e84722c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06e564700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84722bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34880/0 (socket says 172.21.15.5:34880) 2023-10-08T13:06:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06e564700 1 -- 172.21.15.5:0/2236614846 learned_addr learned my addr 172.21.15.5:0/2236614846 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06ed65700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e84722c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06dd63700 1 -- 172.21.15.5:0/2236614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 msgr2=0x55e84722c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06dd63700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e84722c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06dd63700 1 -- 172.21.15.5:0/2236614846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 msgr2=0x55e84722bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06dd63700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84722bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06dd63700 1 -- 172.21.15.5:0/2236614846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e846f83c00 con 0x55e847222880 2023-10-08T13:06:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.020+0000 7fb06e564700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84722bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb06dd63700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e847222880 0x55e84722c140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb058009520 tx=0x7fb0580a3150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75ee001860da51cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb051ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb051ffb700 1 -- 172.21.15.5:0/2236614846 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05809efa0 con 0x55e847222880 2023-10-08T13:06:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb051ffb700 1 -- 172.21.15.5:0/2236614846 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb0580cb800 con 0x55e847222880 2023-10-08T13:06:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb06400fca0 con 0x55e847222880 2023-10-08T13:06:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb051ffb700 1 -- 172.21.15.5:0/2236614846 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb05809a340 con 0x55e847222880 2023-10-08T13:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 10 client.25483 fetch_fsmap learned FSMap version 28 2023-10-08T13:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fb060007da0 con 0x55e847222880 2023-10-08T13:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb051ffb700 1 -- 172.21.15.5:0/2236614846 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb06400fca0 con 0x55e847222880 2023-10-08T13:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb051ffb700 1 -- 172.21.15.5:0/2236614846 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb058060bd0 con 0x55e847222880 2023-10-08T13:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 10 client.25483 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:06:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 10 client.25483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 20 client.25483 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e84728b200 0x55e84728d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 4 client.25483 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:06:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.021+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e847168ad0 con 0x55e84728b200 2023-10-08T13:06:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.022+0000 7fb06e564700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e84728b200 0x55e84728d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.022+0000 7fb051ffb700 10 client.25483 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.022+0000 7fb06e564700 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e84728b200 0x55e84728d620 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f77ab60b54a3ce9 server_cookie=95eba8a46d6d5260 in_seq=0 out_seq=0 2023-10-08T13:06:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.421+0000 7fb051ffb700 1 -- 172.21.15.5:0/2236614846 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e847168ad0 con 0x55e84728b200 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.421+0000 7fb051ffb700 10 client.25483 handle_command_reply: tid=0 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.421+0000 7fb07c9b1b80 1 client.25483 shutdown 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e847222880 msgr2=0x55e84722c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e847222880 0x55e84722c140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb058009520 tx=0x7fb0580a3150 comp rx=0 tx=0).stop 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 shutdown_connections 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e84728b200 0x55e84728d620 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e8472231a0 0x55e84722c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb051ffb700 0 client.25483 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e84721d0b0 0x55e84722bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 --2- 172.21.15.5:0/2236614846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e847222880 0x55e84722c140 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 >> 172.21.15.5:0/2236614846 conn(0x55e847191200 msgr2=0x55e8472217a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 shutdown_connections 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 1 -- 172.21.15.5:0/2236614846 wait complete. 2023-10-08T13:06:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb07c9b1b80 20 client.25483 trim_cache size 0 max 16384 2023-10-08T13:06:20.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:06:20.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:06:20.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:06:20.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb0540a1460 msgr2=0x7fb0540a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb0707c8700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb0540a1460 0x7fb0540a3920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb064011d00 tx=0x7fb0640198d0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 msgr2=0x7fb06819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.422+0000 7fb0707c8700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 0x7fb06819eef0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb05800c010 tx=0x7fb05800f690 comp rx=0 tx=0).stop 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 shutdown_connections 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb0540a1460 0x7fb0540a3920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb068105630 0x7fb068198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0680ff570 0x7fb06819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 --2- 172.21.15.5:0/402309554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0680fff30 0x7fb06819eef0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 >> 172.21.15.5:0/402309554 conn(0x7fb0680fb080 msgr2=0x7fb068067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:20.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 shutdown_connections 2023-10-08T13:06:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:20.423+0000 7fb0707c8700 1 -- 172.21.15.5:0/402309554 wait complete. 2023-10-08T13:06:20.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:20 smithi060 ceph-mon[103190]: pgmap v310: 129 pgs: 129 active+clean; 131 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 19 MiB/s wr, 129 op/s 2023-10-08T13:06:20.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:20 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:20.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:20 smithi005 ceph-mon[99496]: pgmap v310: 129 pgs: 129 active+clean; 131 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 19 MiB/s wr, 129 op/s 2023-10-08T13:06:20.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:20 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:20.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:20 smithi118 ceph-mon[104234]: pgmap v310: 129 pgs: 129 active+clean; 131 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 19 MiB/s wr, 129 op/s 2023-10-08T13:06:20.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:20 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:done. 2023-10-08T13:06:21.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-10-08T13:06:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:starting vacuum...end. 2023-10-08T13:06:23.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: pgmap v311: 129 pgs: 129 active+clean; 299 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 46 MiB/s wr, 208 op/s 2023-10-08T13:06:23.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:22 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: pgmap v311: 129 pgs: 129 active+clean; 299 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 46 MiB/s wr, 208 op/s 2023-10-08T13:06:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:22 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: pgmap v311: 129 pgs: 129 active+clean; 299 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 46 MiB/s wr, 208 op/s 2023-10-08T13:06:23.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:23.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:22 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:24.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:23 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:06:24.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:23 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:06:24.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:23 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:24.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:23 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:06:24.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:23 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:06:24.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:23 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:24.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:23 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:06:24.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:23 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:06:24.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:23 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:06:25.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:24 smithi118 ceph-mon[104234]: pgmap v312: 129 pgs: 129 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 63 MiB/s wr, 311 op/s 2023-10-08T13:06:25.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:24 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:25.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:24 smithi060 ceph-mon[103190]: pgmap v312: 129 pgs: 129 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 63 MiB/s wr, 311 op/s 2023-10-08T13:06:25.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:24 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:24 smithi005 ceph-mon[99496]: pgmap v312: 129 pgs: 129 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 63 MiB/s wr, 311 op/s 2023-10-08T13:06:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:24 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 5.0 s, 2697.0 tps, lat 36.438 ms stddev 44.343 2023-10-08T13:06:27.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:26 smithi118 ceph-mon[104234]: pgmap v313: 129 pgs: 129 active+clean; 636 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 76 MiB/s wr, 440 op/s 2023-10-08T13:06:27.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:26 smithi060 ceph-mon[103190]: pgmap v313: 129 pgs: 129 active+clean; 636 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 76 MiB/s wr, 440 op/s 2023-10-08T13:06:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:26 smithi005 ceph-mon[99496]: pgmap v313: 129 pgs: 129 active+clean; 636 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 76 MiB/s wr, 440 op/s 2023-10-08T13:06:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:28 smithi118 ceph-mon[104234]: pgmap v314: 129 pgs: 129 active+clean; 887 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 90 MiB/s wr, 519 op/s 2023-10-08T13:06:29.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:28 smithi060 ceph-mon[103190]: pgmap v314: 129 pgs: 129 active+clean; 887 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 90 MiB/s wr, 519 op/s 2023-10-08T13:06:29.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:28 smithi005 ceph-mon[99496]: pgmap v314: 129 pgs: 129 active+clean; 887 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 90 MiB/s wr, 519 op/s 2023-10-08T13:06:30.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:30 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:30.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:30 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:30.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:30 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:31.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:31 smithi060 ceph-mon[103190]: pgmap v315: 129 pgs: 129 active+clean; 1008 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 89 MiB/s wr, 562 op/s 2023-10-08T13:06:31.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:31 smithi005 ceph-mon[99496]: pgmap v315: 129 pgs: 129 active+clean; 1008 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 89 MiB/s wr, 562 op/s 2023-10-08T13:06:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:31 smithi118 ceph-mon[104234]: pgmap v315: 129 pgs: 129 active+clean; 1008 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 89 MiB/s wr, 562 op/s 2023-10-08T13:06:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 10.0 s, 2652.3 tps, lat 37.632 ms stddev 58.582 2023-10-08T13:06:32.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:32 smithi118 ceph-mon[104234]: pgmap v316: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 103 MiB/s wr, 856 op/s 2023-10-08T13:06:32.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:32 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:32.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:32 smithi060 ceph-mon[103190]: pgmap v316: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 103 MiB/s wr, 856 op/s 2023-10-08T13:06:32.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:32 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:32.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:32 smithi005 ceph-mon[99496]: pgmap v316: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 103 MiB/s wr, 856 op/s 2023-10-08T13:06:32.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:32 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.607+0000 7f404b03e700 1 -- 172.21.15.5:0/1109802945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f404410ae60 msgr2=0x7f40441077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.607+0000 7f404b03e700 1 --2- 172.21.15.5:0/1109802945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f404410ae60 0x7f40441077f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f402c009990 tx=0x7f402c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.608+0000 7f404b03e700 1 -- 172.21.15.5:0/1109802945 shutdown_connections 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.608+0000 7f404b03e700 1 --2- 172.21.15.5:0/1109802945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40441157f0 0x7f4044117be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.608+0000 7f404b03e700 1 --2- 172.21.15.5:0/1109802945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f404410ae60 0x7f40441077f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.608+0000 7f404b03e700 1 --2- 172.21.15.5:0/1109802945 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4044107d30 0x7f40441081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.608+0000 7f404b03e700 1 -- 172.21.15.5:0/1109802945 >> 172.21.15.5:0/1109802945 conn(0x7f404406bc20 msgr2=0x7f404406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.608+0000 7f404b03e700 1 -- 172.21.15.5:0/1109802945 shutdown_connections 2023-10-08T13:06:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.609+0000 7f404b03e700 1 -- 172.21.15.5:0/1109802945 wait complete. 2023-10-08T13:06:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.609+0000 7f404b03e700 1 Processor -- start 2023-10-08T13:06:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.609+0000 7f404b03e700 1 -- start start 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f404b03e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 0x7f4044114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f404b03e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f404410ae60 0x7f4044112060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f404b03e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40441157f0 0x7f40441125a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f404b03e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044112c00 con 0x7f40441157f0 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f404b03e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044112d70 con 0x7f4044107d30 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f404b03e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044112f30 con 0x7f404410ae60 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 0x7f4044114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 0x7f4044114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58074/0 (socket says 172.21.15.5:58074) 2023-10-08T13:06:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 -- 172.21.15.5:0/1160681605 learned_addr learned my addr 172.21.15.5:0/1160681605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f40495db700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40441157f0 0x7f40441125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 -- 172.21.15.5:0/1160681605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f404410ae60 msgr2=0x7f4044112060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f404410ae60 0x7f4044112060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 -- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40441157f0 msgr2=0x7f40441125a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40441157f0 0x7f40441125a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.610+0000 7f4048dda700 1 -- 172.21.15.5:0/1160681605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c009c40 con 0x7f4044107d30 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.611+0000 7f4048dda700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 0x7f4044114f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f402c004730 tx=0x7f402c004760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.612+0000 7f40495db700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40441157f0 0x7f40441125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.612+0000 7f4041ffb700 1 -- 172.21.15.5:0/1160681605 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c01d070 con 0x7f4044107d30 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.612+0000 7f4041ffb700 1 -- 172.21.15.5:0/1160681605 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f402c021410 con 0x7f4044107d30 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.612+0000 7f4041ffb700 1 -- 172.21.15.5:0/1160681605 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c017650 con 0x7f4044107d30 2023-10-08T13:06:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.613+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c0095f0 con 0x7f4044107d30 2023-10-08T13:06:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.613+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40441b22c0 con 0x7f4044107d30 2023-10-08T13:06:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.616+0000 7f4041ffb700 1 -- 172.21.15.5:0/1160681605 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f402c021580 con 0x7f4044107d30 2023-10-08T13:06:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.617+0000 7f4041ffb700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f40300a1760 0x7f40300a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.617+0000 7f4041ffb700 1 -- 172.21.15.5:0/1160681605 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f402c0ce070 con 0x7f4044107d30 2023-10-08T13:06:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.617+0000 7f4043fff700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f40300a1760 0x7f40300a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 Processor -- start 2023-10-08T13:06:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4043fff700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f40300a1760 0x7f40300a3c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4044113790 tx=0x7f40340096c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 -- start start 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf93c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 0x55f85bf8db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bef6400 con 0x55f85bf941a0 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bee7bc0 con 0x55f85bf8e0b0 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.618+0000 7f4057227b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bee54e0 con 0x55f85bf93880 2023-10-08T13:06:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 0x55f85bf8db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 0x55f85bf8db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34900/0 (socket says 172.21.15.5:34900) 2023-10-08T13:06:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 -- 172.21.15.5:0/1555738464 learned_addr learned my addr 172.21.15.5:0/1555738464 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4048dda700 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf93c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 -- 172.21.15.5:0/1555738464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 msgr2=0x55f85bf93c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf93c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 -- 172.21.15.5:0/1555738464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf8e0b0 msgr2=0x55f85bf8e510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.619+0000 7f4043fff700 1 -- 172.21.15.5:0/1555738464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f85bd0bd80 con 0x55f85bf941a0 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.620+0000 7f4043fff700 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 0x55f85bf8db70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f403400ebc0 tx=0x7f4034009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98b7e9a041f389f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.621+0000 7f403affd700 1 -- 172.21.15.5:0/1555738464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034010ac0 con 0x55f85bf941a0 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.621+0000 7f403affd700 1 -- 172.21.15.5:0/1555738464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4034010c20 con 0x55f85bf941a0 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.621+0000 7f403affd700 1 -- 172.21.15.5:0/1555738464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403401c680 con 0x55f85bf941a0 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 -- 172.21.15.5:0/1555738464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 msgr2=0x55f85bf8db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 0x55f85bf8db70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f403400ebc0 tx=0x7f4034009f90 comp rx=0 tx=0).stop 2023-10-08T13:06:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 -- 172.21.15.5:0/1555738464 shutdown_connections 2023-10-08T13:06:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf93c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 --2- 172.21.15.5:0/1555738464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf941a0 0x55f85bf8db70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.622+0000 7f4057227b80 1 -- 172.21.15.5:0/1555738464 >> 172.21.15.5:0/1555738464 conn(0x55f85bf02200 msgr2=0x55f85bf88b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.623+0000 7f4057227b80 1 -- 172.21.15.5:0/1555738464 shutdown_connections 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.623+0000 7f4057227b80 1 -- 172.21.15.5:0/1555738464 wait complete. 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 -- start start 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 Processor -- start 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf97580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf93880 0x55f85bf97ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf941a0 0x55f85bf98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bee0dd0 con 0x55f85bf8e0b0 2023-10-08T13:06:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85be7d6b0 con 0x55f85bf93880 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85be7d350 con 0x55f85bf941a0 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.624+0000 7f4057227b80 10 client.0 _ll_register_callbacks cb 0x55f85bcda7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4048dda700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf97580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4048dda700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf97580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34906/0 (socket says 172.21.15.5:34906) 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4048dda700 1 -- 172.21.15.5:0/1687649164 learned_addr learned my addr 172.21.15.5:0/1687649164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf93880 0x55f85bf97ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f40495db700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf941a0 0x55f85bf98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 -- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf941a0 msgr2=0x55f85bf98000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf941a0 0x55f85bf98000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 -- 172.21.15.5:0/1687649164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 msgr2=0x55f85bf97580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf97580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 -- 172.21.15.5:0/1687649164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403400e8a0 con 0x55f85bf93880 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f40495db700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf941a0 0x55f85bf98000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4043fff700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf93880 0x55f85bf97ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4034010710 tx=0x7f40340098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f0fddaab93891c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.625+0000 7f4023fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.626+0000 7f4023fff700 1 -- 172.21.15.5:0/1687649164 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403401c420 con 0x55f85bf93880 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.626+0000 7f4023fff700 1 -- 172.21.15.5:0/1687649164 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f403401c580 con 0x55f85bf93880 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.626+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f85bea8e50 con 0x55f85bf93880 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.626+0000 7f4023fff700 1 -- 172.21.15.5:0/1687649164 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4034038740 con 0x55f85bf93880 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.626+0000 7f4057227b80 10 client.25448 fetch_fsmap learned FSMap version 31 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.626+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f85bcf4c00 con 0x55f85bf93880 2023-10-08T13:06:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.627+0000 7f4023fff700 1 -- 172.21.15.5:0/1687649164 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f85bea8e50 con 0x55f85bf93880 2023-10-08T13:06:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.627+0000 7f4023fff700 1 -- 172.21.15.5:0/1687649164 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f403402d070 con 0x55f85bf93880 2023-10-08T13:06:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4057227b80 10 client.25448 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T13:06:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4057227b80 10 client.25448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4057227b80 20 client.25448 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4057227b80 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bfa7ca0 0x55f85bfaa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4057227b80 4 client.25448 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f85bed9db0 con 0x55f85bfa7ca0 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.628+0000 7f4048dda700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bfa7ca0 0x55f85bfaa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.629+0000 7f4048dda700 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bfa7ca0 0x55f85bfaa0c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b136b06a36d9de server_cookie=6b72b641c26de9e4 in_seq=0 out_seq=0 2023-10-08T13:06:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.629+0000 7f4023fff700 10 client.25448 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4023fff700 1 -- 172.21.15.5:0/1687649164 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f85bed9db0 con 0x55f85bfa7ca0 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4023fff700 10 client.25448 handle_command_reply: tid=0 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 client.25448 shutdown 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf93880 msgr2=0x55f85bf97ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf93880 0x55f85bf97ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4034010710 tx=0x7f40340098f0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 shutdown_connections 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf941a0 0x55f85bf98000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf97580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bfa7ca0 0x55f85bfaa0c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 --2- 172.21.15.5:0/1687649164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf93880 0x55f85bf97ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.630+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 >> 172.21.15.5:0/1687649164 conn(0x55f85bf02200 msgr2=0x55f85bf88010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.631+0000 7f4023fff700 0 client.25448 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.631+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 shutdown_connections 2023-10-08T13:06:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.631+0000 7f4057227b80 1 -- 172.21.15.5:0/1687649164 wait complete. 2023-10-08T13:06:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.631+0000 7f4057227b80 20 client.25448 trim_cache size 0 max 16384 2023-10-08T13:06:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.660+0000 7f4057227b80 1 Processor -- start 2023-10-08T13:06:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 -- start start 2023-10-08T13:06:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 0x55f85bf92d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bd618c0 con 0x55f85bf93880 2023-10-08T13:06:33.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bf98b80 con 0x55f85bf941a0 2023-10-08T13:06:33.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.661+0000 7f4057227b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bfa79e0 con 0x55f85bf8e0b0 2023-10-08T13:06:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.662+0000 7f4043fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 0x55f85bf92d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.662+0000 7f4043fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 0x55f85bf92d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34916/0 (socket says 172.21.15.5:34916) 2023-10-08T13:06:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.662+0000 7f4043fff700 1 -- 172.21.15.5:0/58328275 learned_addr learned my addr 172.21.15.5:0/58328275 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.662+0000 7f4048dda700 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f4043fff700 1 -- 172.21.15.5:0/58328275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf8e0b0 msgr2=0x55f85bf8db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f4043fff700 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f4043fff700 1 -- 172.21.15.5:0/58328275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 msgr2=0x55f85bf9ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f4043fff700 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f4043fff700 1 -- 172.21.15.5:0/58328275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f85bd321f0 con 0x55f85bf93880 2023-10-08T13:06:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f4043fff700 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 0x55f85bf92d50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f403401cc30 tx=0x7f4034009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9462d19f75d79a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.663+0000 7f403b7fe700 1 -- 172.21.15.5:0/58328275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034025930 con 0x55f85bf93880 2023-10-08T13:06:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.664+0000 7f403b7fe700 1 -- 172.21.15.5:0/58328275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f403402a040 con 0x55f85bf93880 2023-10-08T13:06:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.664+0000 7f403b7fe700 1 -- 172.21.15.5:0/58328275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034041670 con 0x55f85bf93880 2023-10-08T13:06:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.665+0000 7f4057227b80 1 -- 172.21.15.5:0/58328275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 msgr2=0x55f85bf92d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.665+0000 7f4057227b80 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 0x55f85bf92d50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f403401cc30 tx=0x7f4034009f90 comp rx=0 tx=0).stop 2023-10-08T13:06:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.671+0000 7f4057227b80 1 -- 172.21.15.5:0/58328275 shutdown_connections 2023-10-08T13:06:33.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.671+0000 7f4057227b80 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.671+0000 7f4057227b80 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf8e0b0 0x55f85bf8db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.671+0000 7f4057227b80 1 --2- 172.21.15.5:0/58328275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf93880 0x55f85bf92d50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.671+0000 7f4057227b80 1 -- 172.21.15.5:0/58328275 >> 172.21.15.5:0/58328275 conn(0x55f85bf02200 msgr2=0x55f85bf92640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.676+0000 7f4057227b80 1 -- 172.21.15.5:0/58328275 shutdown_connections 2023-10-08T13:06:33.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.679+0000 7f4057227b80 1 -- 172.21.15.5:0/58328275 wait complete. 2023-10-08T13:06:33.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.679+0000 7f4057227b80 1 -- start start 2023-10-08T13:06:33.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.679+0000 7f4057227b80 1 Processor -- start 2023-10-08T13:06:33.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf9cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf9d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bffaa90 con 0x55f85bf8e0b0 2023-10-08T13:06:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bffabd0 con 0x55f85bf941a0 2023-10-08T13:06:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85bffad10 con 0x55f85bf93880 2023-10-08T13:06:33.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4057227b80 10 client.0 _ll_register_callbacks cb 0x7f403400eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f40495db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f40495db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58104/0 (socket says 172.21.15.5:58104) 2023-10-08T13:06:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f40495db700 1 -- 172.21.15.5:0/2447835348 learned_addr learned my addr 172.21.15.5:0/2447835348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.680+0000 7f4048dda700 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf9cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4048dda700 1 -- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 msgr2=0x55f85bf9d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4048dda700 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf9d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4048dda700 1 -- 172.21.15.5:0/2447835348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 msgr2=0x55f85bf9d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4048dda700 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4048dda700 1 -- 172.21.15.5:0/2447835348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f85bcf4c00 con 0x55f85bf8e0b0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4048dda700 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf9cc00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f402c097870 tx=0x7f402c021f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a801963d6288ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4023fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.681+0000 7f4023fff700 1 -- 172.21.15.5:0/2447835348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c09d070 con 0x55f85bf8e0b0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.682+0000 7f4023fff700 1 -- 172.21.15.5:0/2447835348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f402c09ef50 con 0x55f85bf8e0b0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.682+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4034010c20 con 0x55f85bf8e0b0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.682+0000 7f4023fff700 1 -- 172.21.15.5:0/2447835348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f402c0a3100 con 0x55f85bf8e0b0 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.682+0000 7f4057227b80 10 client.15909 fetch_fsmap learned FSMap version 31 2023-10-08T13:06:33.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.682+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f85bd0a250 con 0x55f85bf8e0b0 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.683+0000 7f4023fff700 1 -- 172.21.15.5:0/2447835348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4034010c20 con 0x55f85bf8e0b0 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.683+0000 7f4023fff700 1 -- 172.21.15.5:0/2447835348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f402c0a2c70 con 0x55f85bf8e0b0 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.684+0000 7f4057227b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.684+0000 7f4057227b80 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.684+0000 7f4057227b80 20 client.15909 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.684+0000 7f4057227b80 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bffc240 0x55f85bffe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.684+0000 7f4057227b80 4 client.15909 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:06:33.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.684+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f85bed9ad0 con 0x55f85bffc240 2023-10-08T13:06:33.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.688+0000 7f4043fff700 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bffc240 0x55f85bffe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.689+0000 7f4023fff700 10 client.15909 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.689+0000 7f4043fff700 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bffc240 0x55f85bffe660 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5841420b67aa5af3 server_cookie=427e676e67787a99 in_seq=0 out_seq=0 2023-10-08T13:06:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.710+0000 7f4023fff700 1 -- 172.21.15.5:0/2447835348 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f85bed9ad0 con 0x55f85bffc240 2023-10-08T13:06:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.710+0000 7f4023fff700 10 client.15909 handle_command_reply: tid=0 2023-10-08T13:06:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 client.15909 shutdown 2023-10-08T13:06:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 msgr2=0x55f85bf9cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf9cc00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f402c097870 tx=0x7f402c021f90 comp rx=0 tx=0).stop 2023-10-08T13:06:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 shutdown_connections 2023-10-08T13:06:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f85bffc240 0x55f85bffe660 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f85bf941a0 0x55f85bf9d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4023fff700 0 client.15909 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f85bf8e0b0 0x55f85bf9cc00 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 --2- 172.21.15.5:0/2447835348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f85bf93880 0x55f85bf9d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 >> 172.21.15.5:0/2447835348 conn(0x55f85bf02200 msgr2=0x55f85bf95d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 shutdown_connections 2023-10-08T13:06:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.711+0000 7f4057227b80 1 -- 172.21.15.5:0/2447835348 wait complete. 2023-10-08T13:06:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f4057227b80 20 client.15909 trim_cache size 0 max 16384 2023-10-08T13:06:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:06:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:06:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:06:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:06:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f40300a1760 msgr2=0x7f40300a3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f404b03e700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f40300a1760 0x7f40300a3c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4044113790 tx=0x7f40340096c0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 msgr2=0x7f4044114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f404b03e700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 0x7f4044114f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f402c004730 tx=0x7f402c004760 comp rx=0 tx=0).stop 2023-10-08T13:06:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 shutdown_connections 2023-10-08T13:06:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.714+0000 7f404b03e700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f40300a1760 0x7f40300a3c20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.715+0000 7f404b03e700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40441157f0 0x7f40441125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.715+0000 7f404b03e700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4044107d30 0x7f4044114f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.715+0000 7f404b03e700 1 --2- 172.21.15.5:0/1160681605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f404410ae60 0x7f4044112060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.715+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 >> 172.21.15.5:0/1160681605 conn(0x7f404406bc20 msgr2=0x7f4044117030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.715+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 shutdown_connections 2023-10-08T13:06:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:33.715+0000 7f404b03e700 1 -- 172.21.15.5:0/1160681605 wait complete. 2023-10-08T13:06:34.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:34 smithi118 ceph-mon[104234]: pgmap v317: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 92 MiB/s wr, 978 op/s 2023-10-08T13:06:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:34 smithi060 ceph-mon[103190]: pgmap v317: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 92 MiB/s wr, 978 op/s 2023-10-08T13:06:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:34 smithi005 ceph-mon[99496]: pgmap v317: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 92 MiB/s wr, 978 op/s 2023-10-08T13:06:35.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:06:35.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.500+0000 7fd4a475b700 1 -- 172.21.15.5:0/2432002019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0fff00 msgr2=0x7fd49c10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.500+0000 7fd4a475b700 1 --2- 172.21.15.5:0/2432002019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0fff00 0x7fd49c10c3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b0d0 tx=0x7fd49400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.502+0000 7fd4a475b700 1 -- 172.21.15.5:0/2432002019 shutdown_connections 2023-10-08T13:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.502+0000 7fd4a475b700 1 --2- 172.21.15.5:0/2432002019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0fff00 0x7fd49c10c3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.502+0000 7fd4a475b700 1 --2- 172.21.15.5:0/2432002019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.502+0000 7fd4a475b700 1 --2- 172.21.15.5:0/2432002019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd49c0ff540 0x7fd49c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.502+0000 7fd4a475b700 1 -- 172.21.15.5:0/2432002019 >> 172.21.15.5:0/2432002019 conn(0x7fd49c0fafb0 msgr2=0x7fd49c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.503+0000 7fd4a475b700 1 -- 172.21.15.5:0/2432002019 shutdown_connections 2023-10-08T13:06:35.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.503+0000 7fd4a475b700 1 -- 172.21.15.5:0/2432002019 wait complete. 2023-10-08T13:06:35.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.504+0000 7fd4a475b700 1 Processor -- start 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 -- start start 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0ff540 0x7fd49c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd49c0fff00 0x7fd49c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c06b800 con 0x7fd49c0fff00 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c06b970 con 0x7fd49c0ff540 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a475b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c06bb30 con 0x7fd49c105600 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48142/0 (socket says 172.21.15.5:48142) 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.505+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/1265754996 learned_addr learned my addr 172.21.15.5:0/1265754996 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:35.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0ff540 0x7fd49c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd49c0fff00 0x7fd49c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/1265754996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0ff540 msgr2=0x7fd49c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0ff540 0x7fd49c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd49c0fff00 msgr2=0x7fd49c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd49c0fff00 0x7fd49c0723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/1265754996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494009d00 con 0x7fd49c105600 2023-10-08T13:06:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.506+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c06b030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd49400bd40 tx=0x7fd49400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.508+0000 7fd4937fe700 1 -- 172.21.15.5:0/1265754996 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400e040 con 0x7fd49c105600 2023-10-08T13:06:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.508+0000 7fd4937fe700 1 -- 172.21.15.5:0/1265754996 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd494005110 con 0x7fd49c105600 2023-10-08T13:06:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.508+0000 7fd4937fe700 1 -- 172.21.15.5:0/1265754996 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49401b680 con 0x7fd49c105600 2023-10-08T13:06:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.508+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c06f9d0 con 0x7fd49c105600 2023-10-08T13:06:35.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.508+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c06fe90 con 0x7fd49c105600 2023-10-08T13:06:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.511+0000 7fd4937fe700 1 -- 172.21.15.5:0/1265754996 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fd494005580 con 0x7fd49c105600 2023-10-08T13:06:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.512+0000 7fd4937fe700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4880a1760 0x7fd4880a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.512+0000 7fd4937fe700 1 -- 172.21.15.5:0/1265754996 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd4940cde20 con 0x7fd49c105600 2023-10-08T13:06:35.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.513+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4880a1760 0x7fd4880a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 Processor -- start 2023-10-08T13:06:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 -- start start 2023-10-08T13:06:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba54260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba5f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba61a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb9bd460 con 0x55b8fba5f650 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb9aec20 con 0x55b8fba53e80 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb9ac540 con 0x55b8fba547a0 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.514+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4880a1760 0x7fd4880a3c20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd498009be0 tx=0x7fd498009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba61a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a24f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba54260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba61a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34948/0 (socket says 172.21.15.5:34948) 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a24f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba54260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58128/0 (socket says 172.21.15.5:58128) 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/75750170 learned_addr learned my addr 172.21.15.5:0/75750170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba5f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/75750170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 msgr2=0x55b8fba5f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba5f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/75750170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 msgr2=0x55b8fba54260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba54260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/75750170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8fb7d2de0 con 0x55b8fba5f650 2023-10-08T13:06:35.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.515+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba54260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.516+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba61a40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd4940090a0 tx=0x7fd49409aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c45b804799939 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.516+0000 7fd490ff9700 1 -- 172.21.15.5:0/75750170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49409b340 con 0x55b8fba5f650 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.516+0000 7fd490ff9700 1 -- 172.21.15.5:0/75750170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd49409ac40 con 0x55b8fba5f650 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.516+0000 7fd490ff9700 1 -- 172.21.15.5:0/75750170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940cb560 con 0x55b8fba5f650 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.517+0000 7fd4b0944b80 1 -- 172.21.15.5:0/75750170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 msgr2=0x55b8fba61a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.517+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba61a40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd4940090a0 tx=0x7fd49409aae0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 -- 172.21.15.5:0/75750170 shutdown_connections 2023-10-08T13:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba61a40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba54260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/75750170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba5f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 -- 172.21.15.5:0/75750170 >> 172.21.15.5:0/75750170 conn(0x55b8fb9c9260 msgr2=0x55b8fba502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 -- 172.21.15.5:0/75750170 shutdown_connections 2023-10-08T13:06:35.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.518+0000 7fd4b0944b80 1 -- 172.21.15.5:0/75750170 wait complete. 2023-10-08T13:06:35.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:35 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.519+0000 7fd4b0944b80 1 -- start start 2023-10-08T13:06:35.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.519+0000 7fd4b0944b80 1 Processor -- start 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba5fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 0x55b8fba5ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba5f650 0x55b8fba604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb9a7e30 con 0x55b8fba547a0 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb944710 con 0x55b8fba53e80 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb9443b0 con 0x55b8fba5f650 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4b0944b80 10 client.0 _ll_register_callbacks cb 0x55b8fb7a1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:35.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4a24f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba5fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4a24f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba5fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58132/0 (socket says 172.21.15.5:58132) 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.520+0000 7fd4a24f7700 1 -- 172.21.15.5:0/2261569410 learned_addr learned my addr 172.21.15.5:0/2261569410 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4a24f7700 1 -- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba5f650 msgr2=0x55b8fba604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba5f650 0x55b8fba604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4a24f7700 1 -- 172.21.15.5:0/2261569410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 msgr2=0x55b8fba5ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 0x55b8fba5ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4a24f7700 1 -- 172.21.15.5:0/2261569410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd498017070 con 0x55b8fba53e80 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba5fa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd49801fbf0 tx=0x7fd4980047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9396b99f4a90a98a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd485ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd485ffb700 1 -- 172.21.15.5:0/2261569410 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498004030 con 0x55b8fba53e80 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8fb96feb0 con 0x55b8fba53e80 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.521+0000 7fd485ffb700 1 -- 172.21.15.5:0/2261569410 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd498004190 con 0x55b8fba53e80 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.522+0000 7fd485ffb700 1 -- 172.21.15.5:0/2261569410 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd498004390 con 0x55b8fba53e80 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.522+0000 7fd4b0944b80 10 client.25463 fetch_fsmap learned FSMap version 32 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.522+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fd49c06fe90 con 0x55b8fba53e80 2023-10-08T13:06:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.522+0000 7fd485ffb700 1 -- 172.21.15.5:0/2261569410 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b8fb96feb0 con 0x55b8fba53e80 2023-10-08T13:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.522+0000 7fd485ffb700 1 -- 172.21.15.5:0/2261569410 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fd498003a80 con 0x55b8fba53e80 2023-10-08T13:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4b0944b80 10 client.25463 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T13:06:35.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4b0944b80 10 client.25463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4b0944b80 20 client.25463 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fba6ee30 0x55b8fba71270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4b0944b80 4 client.25463 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8fb9a0e10 con 0x55b8fba6ee30 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.524+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fba6ee30 0x55b8fba71270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd485ffb700 10 client.25463 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:35.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fba6ee30 0x55b8fba71270 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4b0fd536ce49e5 server_cookie=6058367afd6219fa in_seq=0 out_seq=0 2023-10-08T13:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd485ffb700 1 -- 172.21.15.5:0/2261569410 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b8fb9a0e10 con 0x55b8fba6ee30 2023-10-08T13:06:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd485ffb700 10 client.25463 handle_command_reply: tid=0 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd4b0944b80 1 client.25463 shutdown 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 msgr2=0x55b8fba5fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.525+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba5fa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd49801fbf0 tx=0x7fd4980047c0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 shutdown_connections 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba5f650 0x55b8fba604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fba6ee30 0x55b8fba71270 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba5fa30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd485ffb700 0 client.25463 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/2261569410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 0x55b8fba5ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 >> 172.21.15.5:0/2261569410 conn(0x55b8fb9c9260 msgr2=0x55b8fba4fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 shutdown_connections 2023-10-08T13:06:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 1 -- 172.21.15.5:0/2261569410 wait complete. 2023-10-08T13:06:35.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.526+0000 7fd4b0944b80 20 client.25463 trim_cache size 0 max 16384 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 Processor -- start 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 -- start start 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba63a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba59b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba5a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fb828920 con 0x55b8fba5f650 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fba5ee00 con 0x55b8fba53e80 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.558+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fba6b8b0 con 0x55b8fba547a0 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba5a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba5a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34958/0 (socket says 172.21.15.5:34958) 2023-10-08T13:06:35.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/854317659 learned_addr learned my addr 172.21.15.5:0/854317659 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:35.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba59b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba63a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/854317659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 msgr2=0x55b8fba59b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba59b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/854317659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 msgr2=0x55b8fba63a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba63a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.559+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/854317659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8fb7bbc60 con 0x55b8fba5f650 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.560+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba5a070 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd4940976b0 tx=0x7fd4940060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e812b468a7bd5fe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.560+0000 7fd4917fa700 1 -- 172.21.15.5:0/854317659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49409b340 con 0x55b8fba5f650 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.560+0000 7fd4917fa700 1 -- 172.21.15.5:0/854317659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4940a2f40 con 0x55b8fba5f650 2023-10-08T13:06:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.560+0000 7fd4917fa700 1 -- 172.21.15.5:0/854317659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940cb560 con 0x55b8fba5f650 2023-10-08T13:06:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 -- 172.21.15.5:0/854317659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 msgr2=0x55b8fba5a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba5a070 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd4940976b0 tx=0x7fd4940060c0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 -- 172.21.15.5:0/854317659 shutdown_connections 2023-10-08T13:06:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba5f650 0x55b8fba5a070 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba53e80 0x55b8fba63a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/854317659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba547a0 0x55b8fba59b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 -- 172.21.15.5:0/854317659 >> 172.21.15.5:0/854317659 conn(0x55b8fb9c9260 msgr2=0x55b8fba5e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 -- 172.21.15.5:0/854317659 shutdown_connections 2023-10-08T13:06:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.562+0000 7fd4b0944b80 1 -- 172.21.15.5:0/854317659 wait complete. 2023-10-08T13:06:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.563+0000 7fd4b0944b80 1 -- start start 2023-10-08T13:06:35.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.563+0000 7fd4b0944b80 1 Processor -- start 2023-10-08T13:06:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba53e80 0x55b8fbab6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 0x55b8fbab7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 0x55b8fbabbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fbabc330 con 0x55b8fba547a0 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fbabc4a0 con 0x55b8fba5f650 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fbabc660 con 0x55b8fba53e80 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4b0944b80 10 client.0 _ll_register_callbacks cb 0x7fd49801f7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 0x55b8fbabbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4a24f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba53e80 0x55b8fbab6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4a2cf8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 0x55b8fbabbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58148/0 (socket says 172.21.15.5:58148) 2023-10-08T13:06:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.565+0000 7fd4a2cf8700 1 -- 172.21.15.5:0/3069931620 learned_addr learned my addr 172.21.15.5:0/3069931620 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a24f7700 1 -- 172.21.15.5:0/3069931620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 msgr2=0x55b8fbabbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 0x55b8fbabbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a24f7700 1 -- 172.21.15.5:0/3069931620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 msgr2=0x55b8fbab7380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 0x55b8fbab7380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a24f7700 1 -- 172.21.15.5:0/3069931620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8fb7d2de0 con 0x55b8fba53e80 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a2cf8700 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 0x55b8fbabbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4a24f7700 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba53e80 0x55b8fbab6e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd498016040 tx=0x7fd4980039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f8b5445ea8348e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd485ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd485ffb700 1 -- 172.21.15.5:0/3069931620 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498004210 con 0x55b8fba53e80 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd485ffb700 1 -- 172.21.15.5:0/3069931620 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd498004370 con 0x55b8fba53e80 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.566+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd49409ac40 con 0x55b8fba53e80 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.567+0000 7fd485ffb700 1 -- 172.21.15.5:0/3069931620 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd498004530 con 0x55b8fba53e80 2023-10-08T13:06:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.567+0000 7fd4b0944b80 10 client.25507 fetch_fsmap learned FSMap version 32 2023-10-08T13:06:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.567+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b8fb7f9250 con 0x55b8fba53e80 2023-10-08T13:06:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.568+0000 7fd485ffb700 1 -- 172.21.15.5:0/3069931620 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd49409ac40 con 0x55b8fba53e80 2023-10-08T13:06:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.568+0000 7fd485ffb700 1 -- 172.21.15.5:0/3069931620 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fd49801daa0 con 0x55b8fba53e80 2023-10-08T13:06:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4b0944b80 10 client.25507 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T13:06:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4b0944b80 10 client.25507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4b0944b80 20 client.25507 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fbac3e50 0x55b8fbac6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4b0944b80 4 client.25507 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b8fb9a0b30 con 0x55b8fbac3e50 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.569+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fbac3e50 0x55b8fbac6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4a1cf6700 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fbac3e50 0x55b8fbac6270 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b05200af6e10c348 server_cookie=4b899508bd09c209 in_seq=0 out_seq=0 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd485ffb700 10 client.25507 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd485ffb700 1 -- 172.21.15.5:0/3069931620 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b8fb9a0b30 con 0x55b8fbac3e50 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd485ffb700 10 client.25507 handle_command_reply: tid=0 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 client.25507 shutdown 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba53e80 msgr2=0x55b8fbab6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba53e80 0x55b8fbab6e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd498016040 tx=0x7fd4980039f0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 shutdown_connections 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8fbac3e50 0x55b8fbac6270 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8fba5f650 0x55b8fbabbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd485ffb700 0 client.25507 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8fba53e80 0x55b8fbab6e40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 --2- 172.21.15.5:0/3069931620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8fba547a0 0x55b8fbab7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 >> 172.21.15.5:0/3069931620 conn(0x55b8fb9c9260 msgr2=0x55b8fba59b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 shutdown_connections 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 1 -- 172.21.15.5:0/3069931620 wait complete. 2023-10-08T13:06:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.570+0000 7fd4b0944b80 20 client.25507 trim_cache size 0 max 16384 2023-10-08T13:06:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:06:35.575 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2023-10-08T13:06:35.575 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2023-10-08T13:06:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:06:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.571+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4880a1760 msgr2=0x7fd4880a3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.571+0000 7fd4a475b700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4880a1760 0x7fd4880a3c20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd498009be0 tx=0x7fd498009260 comp rx=0 tx=0).stop 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.571+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 msgr2=0x7fd49c06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.571+0000 7fd4a475b700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c06b030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd49400bd40 tx=0x7fd49400bd70 comp rx=0 tx=0).stop 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.573+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 shutdown_connections 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.573+0000 7fd4a475b700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd4880a1760 0x7fd4880a3c20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.573+0000 7fd4a475b700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49c105600 0x7fd49c06b030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.573+0000 7fd4a475b700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd49c0ff540 0x7fd49c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.573+0000 7fd4a475b700 1 --2- 172.21.15.5:0/1265754996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd49c0fff00 0x7fd49c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.573+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 >> 172.21.15.5:0/1265754996 conn(0x7fd49c0fafb0 msgr2=0x7fd49c0fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.574+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 shutdown_connections 2023-10-08T13:06:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.575+0000 7fd4a475b700 1 -- 172.21.15.5:0/1265754996 wait complete. 2023-10-08T13:06:35.599 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T13:06:35.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:06:35.600 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:35 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:35.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:35 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 -- 172.21.15.5:0/2145795432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 msgr2=0x7f0d8c10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 --2- 172.21.15.5:0/2145795432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c10c3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009fc0 tx=0x7f0d8400b330 comp rx=0 tx=0).stop 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 -- 172.21.15.5:0/2145795432 shutdown_connections 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 --2- 172.21.15.5:0/2145795432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c10c3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 --2- 172.21.15.5:0/2145795432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c105600 0x7f0d8c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 --2- 172.21.15.5:0/2145795432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 0x7f0d8c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.814+0000 7f0d9163d700 1 -- 172.21.15.5:0/2145795432 >> 172.21.15.5:0/2145795432 conn(0x7f0d8c0fb010 msgr2=0x7f0d8c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.815+0000 7f0d9163d700 1 -- 172.21.15.5:0/2145795432 shutdown_connections 2023-10-08T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.815+0000 7f0d9163d700 1 -- 172.21.15.5:0/2145795432 wait complete. 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.816+0000 7f0d9163d700 1 Processor -- start 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 -- start start 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 0x7f0d8c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c105600 0x7f0d8c194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c195230 con 0x7f0d8c0ff540 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c1953a0 con 0x7f0d8c0fff00 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d9163d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c195560 con 0x7f0d8c105600 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d8a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d8a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58162/0 (socket says 172.21.15.5:58162) 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.817+0000 7f0d8a7fc700 1 -- 172.21.15.5:0/391950129 learned_addr learned my addr 172.21.15.5:0/391950129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8affd700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 0x7f0d8c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8a7fc700 1 -- 172.21.15.5:0/391950129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c105600 msgr2=0x7f0d8c194ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8a7fc700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c105600 0x7f0d8c194ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8a7fc700 1 -- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 msgr2=0x7f0d8c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8a7fc700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 0x7f0d8c1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8a7fc700 1 -- 172.21.15.5:0/391950129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800095f0 con 0x7f0d8c0fff00 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8affd700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 0x7f0d8c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d8a7fc700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c199cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000ec10 tx=0x7f0d8000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000cde0 con 0x7f0d8c0fff00 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d800044e0 con 0x7f0d8c0fff00 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84009c40 con 0x7f0d8c0fff00 2023-10-08T13:06:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80010690 con 0x7f0d8c0fff00 2023-10-08T13:06:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.818+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c1a1640 con 0x7f0d8c0fff00 2023-10-08T13:06:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.820+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c100c60 con 0x7f0d8c0fff00 2023-10-08T13:06:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.821+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f0d80004020 con 0x7f0d8c0fff00 2023-10-08T13:06:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.822+0000 7f0d73fff700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0d740e55f0 0x7f0d740e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.822+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0d80014070 con 0x7f0d8c0fff00 2023-10-08T13:06:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.822+0000 7f0d8affd700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0d740e55f0 0x7f0d740e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.823+0000 7f0d8affd700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0d740e55f0 0x7f0d740e7ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009c90 tx=0x7f0d7c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:35.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:35.827+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d80096970 con 0x7f0d8c0fff00 2023-10-08T13:06:36.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.279+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d8c0679a0 con 0x7f0d8c0fff00 2023-10-08T13:06:36.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.288+0000 7f0d73fff700 1 -- 172.21.15.5:0/391950129 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+11363 (secure 0 0 0) 0x7f0d80099f90 con 0x7f0d8c0fff00 2023-10-08T13:06:36.289 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:06:36.290 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:06:35.610314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:06:36.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.312+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0d740e55f0 msgr2=0x7f0d740e7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.312+0000 7f0d9163d700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0d740e55f0 0x7f0d740e7ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009c90 tx=0x7f0d7c009260 comp rx=0 tx=0).stop 2023-10-08T13:06:36.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.312+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 msgr2=0x7f0d8c199cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.312+0000 7f0d9163d700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c199cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000ec10 tx=0x7f0d8000c2d0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.316+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 shutdown_connections 2023-10-08T13:06:36.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.316+0000 7f0d9163d700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0d740e55f0 0x7f0d740e7ab0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.316+0000 7f0d9163d700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d8c105600 0x7f0d8c194ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.316+0000 7f0d9163d700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d8c0ff540 0x7f0d8c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.316+0000 7f0d9163d700 1 --2- 172.21.15.5:0/391950129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d8c0fff00 0x7f0d8c199cf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.316+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 >> 172.21.15.5:0/391950129 conn(0x7f0d8c0fb010 msgr2=0x7f0d8c0fb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.320+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 shutdown_connections 2023-10-08T13:06:36.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.321+0000 7f0d9163d700 1 -- 172.21.15.5:0/391950129 wait complete. 2023-10-08T13:06:36.334 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 33 2023-10-08T13:06:36.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T13:06:36.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:36 smithi118 ceph-mon[104234]: pgmap v318: 129 pgs: 129 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 91 MiB/s wr, 1.08k op/s 2023-10-08T13:06:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 -- 172.21.15.5:0/941124808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 msgr2=0x7f74cc1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/941124808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1077f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009990 tx=0x7f74bc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 -- 172.21.15.5:0/941124808 shutdown_connections 2023-10-08T13:06:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/941124808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 0x7f74cc117bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/941124808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1077f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/941124808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 0x7f74cc108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.566+0000 7f74d3c0c700 1 -- 172.21.15.5:0/941124808 >> 172.21.15.5:0/941124808 conn(0x7f74cc06b770 msgr2=0x7f74cc06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.567+0000 7f74d3c0c700 1 -- 172.21.15.5:0/941124808 shutdown_connections 2023-10-08T13:06:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.567+0000 7f74d3c0c700 1 -- 172.21.15.5:0/941124808 wait complete. 2023-10-08T13:06:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 Processor -- start 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 -- start start 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 0x7f74cc1abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 0x7f74cc1a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1a6220 con 0x7f74cc115800 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1a6390 con 0x7f74cc06cba0 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.568+0000 7f74d3c0c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1a6550 con 0x7f74cc107d30 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d21a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 0x7f74cc1a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d19a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d19a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58176/0 (socket says 172.21.15.5:58176) 2023-10-08T13:06:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d21a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 0x7f74cc1a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34990/0 (socket says 172.21.15.5:34990) 2023-10-08T13:06:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d19a8700 1 -- 172.21.15.5:0/2664913084 learned_addr learned my addr 172.21.15.5:0/2664913084 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d11a7700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 0x7f74cc1abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d11a7700 1 -- 172.21.15.5:0/2664913084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 msgr2=0x7f74cc1ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d11a7700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d11a7700 1 -- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 msgr2=0x7f74cc1a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d11a7700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 0x7f74cc1a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.569+0000 7f74d11a7700 1 -- 172.21.15.5:0/2664913084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc0095f0 con 0x7f74cc107d30 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.570+0000 7f74d11a7700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 0x7f74cc1abcf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74c000e9f0 tx=0x7f74c000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.571+0000 7f74caffd700 1 -- 172.21.15.5:0/2664913084 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c000c9c0 con 0x7f74cc107d30 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.571+0000 7f74caffd700 1 -- 172.21.15.5:0/2664913084 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74c0010430 con 0x7f74cc107d30 2023-10-08T13:06:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.571+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc1a6830 con 0x7f74cc107d30 2023-10-08T13:06:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.571+0000 7f74caffd700 1 -- 172.21.15.5:0/2664913084 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0018680 con 0x7f74cc107d30 2023-10-08T13:06:36.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.571+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc1b26c0 con 0x7f74cc107d30 2023-10-08T13:06:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.576+0000 7f74dfdf5b80 1 Processor -- start 2023-10-08T13:06:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.576+0000 7f74dfdf5b80 1 -- start start 2023-10-08T13:06:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.576+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe7f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.576+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.576+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe8ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fde8460 con 0x55f52fe8a650 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fdd9c20 con 0x55f52fe7ee80 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fdd7540 con 0x55f52fe7f7a0 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74d21a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe7f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74d21a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe7f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58178/0 (socket says 172.21.15.5:58178) 2023-10-08T13:06:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74d21a9700 1 -- 172.21.15.5:0/112805774 learned_addr learned my addr 172.21.15.5:0/112805774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.577+0000 7f74caffd700 1 -- 172.21.15.5:0/2664913084 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f74c00187e0 con 0x7f74cc107d30 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74d21a9700 1 -- 172.21.15.5:0/112805774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7f7a0 msgr2=0x55f52fe8a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74d21a9700 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74d21a9700 1 -- 172.21.15.5:0/112805774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 msgr2=0x55f52fe8ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74d21a9700 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe8ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74d21a9700 1 -- 172.21.15.5:0/112805774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f52fbfdde0 con 0x55f52fe7ee80 2023-10-08T13:06:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74caffd700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f74b40a1730 0x7f74b40a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.578+0000 7f74caffd700 1 -- 172.21.15.5:0/2664913084 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f74c0014070 con 0x7f74cc107d30 2023-10-08T13:06:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.579+0000 7f74d21a9700 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe7f260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74c4003df0 tx=0x7f74c4009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a0a374ca14860b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.579+0000 7f74b3fff700 1 -- 172.21.15.5:0/112805774 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4019070 con 0x55f52fe7ee80 2023-10-08T13:06:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.579+0000 7f74b3fff700 1 -- 172.21.15.5:0/112805774 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74c400f040 con 0x55f52fe7ee80 2023-10-08T13:06:36.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.579+0000 7f74b3fff700 1 -- 172.21.15.5:0/112805774 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4007ae0 con 0x55f52fe7ee80 2023-10-08T13:06:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74d19a8700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f74b40a1730 0x7f74b40a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/112805774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 msgr2=0x55f52fe7f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe7f260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74c4003df0 tx=0x7f74c4009c40 comp rx=0 tx=0).stop 2023-10-08T13:06:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/112805774 shutdown_connections 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe8ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe7f260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/112805774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.580+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/112805774 >> 172.21.15.5:0/112805774 conn(0x55f52fdf4260 msgr2=0x55f52fe7b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.581+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/112805774 shutdown_connections 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.581+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/112805774 wait complete. 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.581+0000 7f74d19a8700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f74b40a1730 0x7f74b40a3bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f74bc006010 tx=0x7f74bc00b690 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.581+0000 7f74dfdf5b80 1 -- start start 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.581+0000 7f74dfdf5b80 1 Processor -- start 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7ee80 0x55f52fe8a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe87410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe87b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fdd2e30 con 0x55f52fe8a650 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fd6f710 con 0x55f52fe7f7a0 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fd6f3b0 con 0x55f52fe7ee80 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74dfdf5b80 10 client.0 _ll_register_callbacks cb 0x55f52fbcc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74d21a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe87b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74d21a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe87b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35006/0 (socket says 172.21.15.5:35006) 2023-10-08T13:06:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74d21a9700 1 -- 172.21.15.5:0/924928706 learned_addr learned my addr 172.21.15.5:0/924928706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74d11a7700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe87410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.582+0000 7f74d19a8700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7ee80 0x55f52fe8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d19a8700 1 -- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 msgr2=0x55f52fe87410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d19a8700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe87410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d19a8700 1 -- 172.21.15.5:0/924928706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 msgr2=0x55f52fe87b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d19a8700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe87b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d19a8700 1 -- 172.21.15.5:0/924928706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c4003a20 con 0x55f52fe7ee80 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d11a7700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe87410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74d19a8700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7ee80 0x55f52fe8a080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0098e0 tx=0x7f74bc00b280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa5dbc29368fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74b17fa700 1 -- 172.21.15.5:0/924928706 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00f460 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74b17fa700 1 -- 172.21.15.5:0/924928706 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f74bc00f5c0 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.583+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f52fd9aeb0 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74b17fa700 1 -- 172.21.15.5:0/924928706 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74bc00f780 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 10 client.25519 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f52fbe6c60 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74b17fa700 1 -- 172.21.15.5:0/924928706 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f52fd9aeb0 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74b17fa700 1 -- 172.21.15.5:0/924928706 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f74bc037070 con 0x55f52fe7ee80 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 10 client.25519 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 10 client.25519 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:06:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 20 client.25519 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52fe9a130 0x55f52fe9c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 4 client.25519 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 --> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f52fdcbe10 con 0x55f52fe9a130 2023-10-08T13:06:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.584+0000 7f74d11a7700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52fe9a130 0x55f52fe9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.585+0000 7f74d11a7700 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52fe9a130 0x55f52fe9c520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=569d81e523011aa3 server_cookie=2df1336eb50b1bdd in_seq=0 out_seq=0 2023-10-08T13:06:36.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.585+0000 7f74b17fa700 10 client.25519 ms_handle_connect on v2:172.21.15.60:6836/529609492 2023-10-08T13:06:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.586+0000 7f74b17fa700 1 -- 172.21.15.5:0/924928706 <== mds.4 v2:172.21.15.60:6836/529609492 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f52fdcbe10 con 0x55f52fe9a130 2023-10-08T13:06:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.586+0000 7f74b17fa700 10 client.25519 handle_command_reply: tid=0 2023-10-08T13:06:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.586+0000 7f74dfdf5b80 1 client.25519 shutdown 2023-10-08T13:06:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.586+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7ee80 msgr2=0x55f52fe8a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.586+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7ee80 0x55f52fe8a080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0098e0 tx=0x7f74bc00b280 comp rx=0 tx=0).stop 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 shutdown_connections 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52fe9a130 0x55f52fe9c520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe8a650 0x55f52fe87b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe7ee80 0x55f52fe8a080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/924928706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe87410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 >> 172.21.15.5:0/924928706 conn(0x55f52fdf4260 msgr2=0x55f52fe7aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74b17fa700 0 client.25519 ms_handle_reset on v2:172.21.15.60:6836/529609492 2023-10-08T13:06:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 shutdown_connections 2023-10-08T13:06:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/924928706 wait complete. 2023-10-08T13:06:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.587+0000 7f74dfdf5b80 20 client.25519 trim_cache size 0 max 16384 2023-10-08T13:06:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 Processor -- start 2023-10-08T13:06:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 -- start start 2023-10-08T13:06:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 0x55f52fe911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe89cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fe86ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fc53920 con 0x55f52fe7ee80 2023-10-08T13:06:36.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fe7c890 con 0x55f52fe7f7a0 2023-10-08T13:06:36.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fe88940 con 0x55f52fe8a650 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74d19a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 0x55f52fe911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74d19a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 0x55f52fe911a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35012/0 (socket says 172.21.15.5:35012) 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74d19a8700 1 -- 172.21.15.5:0/844722401 learned_addr learned my addr 172.21.15.5:0/844722401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.613+0000 7f74d11a7700 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe89cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.614+0000 7f74d19a8700 1 -- 172.21.15.5:0/844722401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 msgr2=0x55f52fe86ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.614+0000 7f74d19a8700 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fe86ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.614+0000 7f74d19a8700 1 -- 172.21.15.5:0/844722401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 msgr2=0x55f52fe89cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.614+0000 7f74d19a8700 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe89cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.614+0000 7f74d19a8700 1 -- 172.21.15.5:0/844722401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f52fc24250 con 0x55f52fe7ee80 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.614+0000 7f74d19a8700 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 0x55f52fe911a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0051b0 tx=0x7f74bc00b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b41b95082ffb8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.615+0000 7f74c8d82700 1 -- 172.21.15.5:0/844722401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc004b70 con 0x55f52fe7ee80 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.615+0000 7f74c8d82700 1 -- 172.21.15.5:0/844722401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74bc01e040 con 0x55f52fe7ee80 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.615+0000 7f74c8d82700 1 -- 172.21.15.5:0/844722401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00f8f0 con 0x55f52fe7ee80 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/844722401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 msgr2=0x55f52fe911a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 0x55f52fe911a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0051b0 tx=0x7f74bc00b370 comp rx=0 tx=0).stop 2023-10-08T13:06:36.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/844722401 shutdown_connections 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fe86ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7ee80 0x55f52fe911a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/844722401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7f7a0 0x55f52fe89cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/844722401 >> 172.21.15.5:0/844722401 conn(0x55f52fdf4260 msgr2=0x55f52fe958f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/844722401 shutdown_connections 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.616+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/844722401 wait complete. 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.617+0000 7f74dfdf5b80 1 -- start start 2023-10-08T13:06:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.617+0000 7f74dfdf5b80 1 Processor -- start 2023-10-08T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.617+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe8f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.617+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74dfdf5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fef7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fef84e0 con 0x55f52fe7f7a0 2023-10-08T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fef8650 con 0x55f52fe7ee80 2023-10-08T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74dfdf5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52fef8810 con 0x55f52fe8a650 2023-10-08T13:06:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74dfdf5b80 10 client.0 _ll_register_callbacks cb 0x7f74bc00ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d11a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d19a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe8f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d11a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35022/0 (socket says 172.21.15.5:35022) 2023-10-08T13:06:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d11a7700 1 -- 172.21.15.5:0/3090948651 learned_addr learned my addr 172.21.15.5:0/3090948651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d21a9700 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fef7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d19a8700 1 -- 172.21.15.5:0/3090948651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 msgr2=0x55f52fef7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d19a8700 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fef7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d19a8700 1 -- 172.21.15.5:0/3090948651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7f7a0 msgr2=0x55f52fe8f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d19a8700 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.618+0000 7f74d19a8700 1 -- 172.21.15.5:0/3090948651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f52fbe6c60 con 0x55f52fe7ee80 2023-10-08T13:06:36.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.619+0000 7f74d19a8700 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe8f370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74bc024810 tx=0x7f74bc024640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb4c3be0c6b907d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.619+0000 7f74b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.619+0000 7f74b17fa700 1 -- 172.21.15.5:0/3090948651 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc024dc0 con 0x55f52fe7ee80 2023-10-08T13:06:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.619+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74c400f040 con 0x55f52fe7ee80 2023-10-08T13:06:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.619+0000 7f74b17fa700 1 -- 172.21.15.5:0/3090948651 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f74bc00f570 con 0x55f52fe7ee80 2023-10-08T13:06:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74b17fa700 1 -- 172.21.15.5:0/3090948651 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74bc00f730 con 0x55f52fe7ee80 2023-10-08T13:06:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 10 client.25493 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f52fbfc2b0 con 0x55f52fe7ee80 2023-10-08T13:06:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74b17fa700 1 -- 172.21.15.5:0/3090948651 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74c400f040 con 0x55f52fe7ee80 2023-10-08T13:06:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74b17fa700 1 -- 172.21.15.5:0/3090948651 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f74bc03f070 con 0x55f52fe7ee80 2023-10-08T13:06:36.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 10 client.25493 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:06:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 20 client.25493 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52feffa90 0x55f52ff01e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 4 client.25493 mds_command: new command op to 24611 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:06:36.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.620+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 --> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f52fdcbb30 con 0x55f52feffa90 2023-10-08T13:06:36.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.621+0000 7f74d11a7700 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52feffa90 0x55f52ff01e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74b17fa700 10 client.25493 ms_handle_connect on v2:172.21.15.60:6836/529609492 2023-10-08T13:06:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74d11a7700 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52feffa90 0x55f52ff01e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4b7df2f545f9f63 server_cookie=b76ed6f33e0b863c in_seq=0 out_seq=0 2023-10-08T13:06:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74b17fa700 1 -- 172.21.15.5:0/3090948651 <== mds.4 v2:172.21.15.60:6836/529609492 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f52fdcbb30 con 0x55f52feffa90 2023-10-08T13:06:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74b17fa700 10 client.25493 handle_command_reply: tid=0 2023-10-08T13:06:36.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 client.25493 shutdown 2023-10-08T13:06:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 msgr2=0x55f52fe8f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe8f370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f74bc024810 tx=0x7f74bc024640 comp rx=0 tx=0).stop 2023-10-08T13:06:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 shutdown_connections 2023-10-08T13:06:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:6836/529609492,v1:172.21.15.60:6837/529609492] conn(0x55f52feffa90 0x55f52ff01e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f52fe8a650 0x55f52fef7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f52fe7ee80 0x55f52fe8f370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74b17fa700 0 client.25493 ms_handle_reset on v2:172.21.15.60:6836/529609492 2023-10-08T13:06:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 --2- 172.21.15.5:0/3090948651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f52fe7f7a0 0x55f52fe8f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 >> 172.21.15.5:0/3090948651 conn(0x55f52fdf4260 msgr2=0x55f52fe89c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 shutdown_connections 2023-10-08T13:06:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.622+0000 7f74dfdf5b80 1 -- 172.21.15.5:0/3090948651 wait complete. 2023-10-08T13:06:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.624+0000 7f74dfdf5b80 20 client.25493 trim_cache size 0 max 16384 2023-10-08T13:06:36.633 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-08T13:06:36.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f74b40a1730 msgr2=0x7f74b40a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f74b40a1730 0x7f74b40a3bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f74bc006010 tx=0x7f74bc00b690 comp rx=0 tx=0).stop 2023-10-08T13:06:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 msgr2=0x7f74cc1abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 0x7f74cc1abcf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74c000e9f0 tx=0x7f74c000ed00 comp rx=0 tx=0).stop 2023-10-08T13:06:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 shutdown_connections 2023-10-08T13:06:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f74b40a1730 0x7f74b40a3bf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc115800 0x7f74cc1a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74cc06cba0 0x7f74cc1ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.625+0000 7f74d3c0c700 1 --2- 172.21.15.5:0/2664913084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74cc107d30 0x7f74cc1abcf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.626+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 >> 172.21.15.5:0/2664913084 conn(0x7f74cc06b770 msgr2=0x7f74cc0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.626+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 shutdown_connections 2023-10-08T13:06:36.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.626+0000 7f74d3c0c700 1 -- 172.21.15.5:0/2664913084 wait complete. 2023-10-08T13:06:36.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:36 smithi005 ceph-mon[99496]: pgmap v318: 129 pgs: 129 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 91 MiB/s wr, 1.08k op/s 2023-10-08T13:06:36.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T13:06:36.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:36 smithi060 ceph-mon[103190]: pgmap v318: 129 pgs: 129 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 91 MiB/s wr, 1.08k op/s 2023-10-08T13:06:36.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 15.0 s, 3022.1 tps, lat 32.840 ms stddev 38.827 2023-10-08T13:06:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 -- 172.21.15.5:0/1670613957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 msgr2=0x7f60440ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 --2- 172.21.15.5:0/1670613957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 0x7f60440ff850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6040009990 tx=0x7f6040009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 -- 172.21.15.5:0/1670613957 shutdown_connections 2023-10-08T13:06:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 --2- 172.21.15.5:0/1670613957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604410f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 --2- 172.21.15.5:0/1670613957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 0x7f60440ff850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 --2- 172.21.15.5:0/1670613957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 0x7f604410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 -- 172.21.15.5:0/1670613957 >> 172.21.15.5:0/1670613957 conn(0x7f6044075a40 msgr2=0x7f6044075e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 -- 172.21.15.5:0/1670613957 shutdown_connections 2023-10-08T13:06:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 -- 172.21.15.5:0/1670613957 wait complete. 2023-10-08T13:06:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 Processor -- start 2023-10-08T13:06:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.874+0000 7f604c72b700 1 -- start start 2023-10-08T13:06:36.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604c72b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 0x7f6044198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604c72b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 0x7f60441992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604c72b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604c72b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604419cb50 con 0x7f604410d020 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604c72b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604419ccc0 con 0x7f60440ff470 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604c72b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604419ce80 con 0x7f60440ffd90 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604419c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35036/0 (socket says 172.21.15.5:35036) 2023-10-08T13:06:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 -- 172.21.15.5:0/1522292000 learned_addr learned my addr 172.21.15.5:0/1522292000 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f6049cc6700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 0x7f60441992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604a4c7700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 0x7f6044198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 -- 172.21.15.5:0/1522292000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 msgr2=0x7f60441992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 0x7f60441992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 -- 172.21.15.5:0/1522292000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 msgr2=0x7f6044198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 0x7f6044198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 -- 172.21.15.5:0/1522292000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400095f0 con 0x7f604410d020 2023-10-08T13:06:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f6049cc6700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 0x7f60441992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f604acc8700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604419c550 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f603c00ef90 tx=0x7f603c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.875+0000 7f603b7fe700 1 -- 172.21.15.5:0/1522292000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c018070 con 0x7f604410d020 2023-10-08T13:06:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.876+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604419d100 con 0x7f604410d020 2023-10-08T13:06:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.876+0000 7f603b7fe700 1 -- 172.21.15.5:0/1522292000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603c00f040 con 0x7f604410d020 2023-10-08T13:06:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.876+0000 7f603b7fe700 1 -- 172.21.15.5:0/1522292000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c003dc0 con 0x7f604410d020 2023-10-08T13:06:36.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.876+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60441a5ac0 con 0x7f604410d020 2023-10-08T13:06:36.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.878+0000 7f603b7fe700 1 -- 172.21.15.5:0/1522292000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f603c00ca50 con 0x7f604410d020 2023-10-08T13:06:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.879+0000 7f603b7fe700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60300a1560 0x7f60300a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.879+0000 7f603b7fe700 1 -- 172.21.15.5:0/1522292000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f603c0ccfd0 con 0x7f604410d020 2023-10-08T13:06:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.879+0000 7f604a4c7700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60300a1560 0x7f60300a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.879+0000 7f604a4c7700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60300a1560 0x7f60300a3a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f604000b2e0 tx=0x7f6040005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.879+0000 7f6058914b80 1 Processor -- start 2023-10-08T13:06:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 -- start start 2023-10-08T13:06:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b101e80 0x56277b102260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b10d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b10fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b06b460 con 0x56277b10d650 2023-10-08T13:06:36.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b05cc20 con 0x56277b101e80 2023-10-08T13:06:36.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f6058914b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b05a540 con 0x56277b1027a0 2023-10-08T13:06:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f604acc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b10fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f604acc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b10fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35042/0 (socket says 172.21.15.5:35042) 2023-10-08T13:06:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f604a4c7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b101e80 0x56277b102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.880+0000 7f604acc8700 1 -- 172.21.15.5:0/1444913848 learned_addr learned my addr 172.21.15.5:0/1444913848 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f6049cc6700 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f604acc8700 1 -- 172.21.15.5:0/1444913848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 msgr2=0x56277b10d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f604acc8700 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b10d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f604acc8700 1 -- 172.21.15.5:0/1444913848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b101e80 msgr2=0x56277b102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f604acc8700 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b101e80 0x56277b102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f604acc8700 1 -- 172.21.15.5:0/1444913848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56277ae80de0 con 0x56277b10d650 2023-10-08T13:06:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f604acc8700 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b10fa40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f603c0967d0 tx=0x7f603c096120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8f955d90f3c94a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f6038ff9700 1 -- 172.21.15.5:0/1444913848 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0998a0 con 0x56277b10d650 2023-10-08T13:06:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f6038ff9700 1 -- 172.21.15.5:0/1444913848 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603c0996c0 con 0x56277b10d650 2023-10-08T13:06:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.881+0000 7f6038ff9700 1 -- 172.21.15.5:0/1444913848 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00cd00 con 0x56277b10d650 2023-10-08T13:06:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 -- 172.21.15.5:0/1444913848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 msgr2=0x56277b10fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b10fa40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f603c0967d0 tx=0x7f603c096120 comp rx=0 tx=0).stop 2023-10-08T13:06:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 -- 172.21.15.5:0/1444913848 shutdown_connections 2023-10-08T13:06:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b10fa40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b101e80 0x56277b102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 --2- 172.21.15.5:0/1444913848 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 -- 172.21.15.5:0/1444913848 >> 172.21.15.5:0/1444913848 conn(0x56277b077260 msgr2=0x56277b0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 -- 172.21.15.5:0/1444913848 shutdown_connections 2023-10-08T13:06:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.882+0000 7f6058914b80 1 -- 172.21.15.5:0/1444913848 wait complete. 2023-10-08T13:06:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 -- start start 2023-10-08T13:06:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 Processor -- start 2023-10-08T13:06:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 0x56277b10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b10aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b055e30 con 0x56277b1027a0 2023-10-08T13:06:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277aff2710 con 0x56277b10d650 2023-10-08T13:06:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.883+0000 7f6058914b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277aff23b0 con 0x56277b101e80 2023-10-08T13:06:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f6058914b80 10 client.0 _ll_register_callbacks cb 0x56277ae4f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 0x56277b10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 0x56277b10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48250/0 (socket says 172.21.15.5:48250) 2023-10-08T13:06:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 -- 172.21.15.5:0/2375228694 learned_addr learned my addr 172.21.15.5:0/2375228694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f6049cc6700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604acc8700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b10aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 -- 172.21.15.5:0/2375228694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 msgr2=0x56277b10aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b10aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 -- 172.21.15.5:0/2375228694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 msgr2=0x56277b10a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 -- 172.21.15.5:0/2375228694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60441a5ac0 con 0x56277b101e80 2023-10-08T13:06:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604acc8700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f6049cc6700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f604a4c7700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 0x56277b10d0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6040015000 tx=0x7f6040009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbc84a3905e41168 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f602dffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f602dffb700 1 -- 172.21.15.5:0/2375228694 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040004f30 con 0x56277b101e80 2023-10-08T13:06:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56277b01deb0 con 0x56277b101e80 2023-10-08T13:06:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f602dffb700 1 -- 172.21.15.5:0/2375228694 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f604000f460 con 0x56277b101e80 2023-10-08T13:06:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.884+0000 7f602dffb700 1 -- 172.21.15.5:0/2375228694 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60400397a0 con 0x56277b101e80 2023-10-08T13:06:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 10 client.25534 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56277ae69c60 con 0x56277b101e80 2023-10-08T13:06:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f602dffb700 1 -- 172.21.15.5:0/2375228694 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56277b01deb0 con 0x56277b101e80 2023-10-08T13:06:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f602dffb700 1 -- 172.21.15.5:0/2375228694 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f604002f070 con 0x56277b101e80 2023-10-08T13:06:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 10 client.25534 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 10 client.25534 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:06:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 20 client.25534 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b11d1a0 0x56277b11f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 4 client.25534 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 --> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56277b04ee10 con 0x56277b11d1a0 2023-10-08T13:06:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.885+0000 7f6049cc6700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b11d1a0 0x56277b11f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.886+0000 7f602dffb700 10 client.25534 ms_handle_connect on v2:172.21.15.118:6834/1209433325 2023-10-08T13:06:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.886+0000 7f6049cc6700 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b11d1a0 0x56277b11f5c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=876ed1a0db50105b server_cookie=dc0e6506f9df3b3c in_seq=0 out_seq=0 2023-10-08T13:06:36.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.886+0000 7f602dffb700 1 -- 172.21.15.5:0/2375228694 <== mds.3 v2:172.21.15.118:6834/1209433325 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56277b04ee10 con 0x56277b11d1a0 2023-10-08T13:06:36.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.886+0000 7f602dffb700 10 client.25534 handle_command_reply: tid=0 2023-10-08T13:06:36.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.886+0000 7f6058914b80 1 client.25534 shutdown 2023-10-08T13:06:36.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 msgr2=0x56277b10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 0x56277b10d0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6040015000 tx=0x7f6040009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 shutdown_connections 2023-10-08T13:06:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b11d1a0 0x56277b11f5c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f602dffb700 0 client.25534 ms_handle_reset on v2:172.21.15.118:6834/1209433325 2023-10-08T13:06:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b101e80 0x56277b10d0b0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6040015000 tx=0x7f6040009ca0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 --2- 172.21.15.5:0/2375228694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.887+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 >> 172.21.15.5:0/2375228694 conn(0x56277b077260 msgr2=0x56277b0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.899+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 shutdown_connections 2023-10-08T13:06:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.901+0000 7f6058914b80 1 -- 172.21.15.5:0/2375228694 wait complete. 2023-10-08T13:06:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.902+0000 7f6058914b80 20 client.25534 trim_cache size 0 max 16384 2023-10-08T13:06:36.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.927+0000 7f6058914b80 1 Processor -- start 2023-10-08T13:06:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.927+0000 7f6058914b80 1 -- start start 2023-10-08T13:06:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f6058914b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f6058914b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b1141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f6058914b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 0x56277b1056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f6058914b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277aed6920 con 0x56277b1027a0 2023-10-08T13:06:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f6058914b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b0f8570 con 0x56277b10d650 2023-10-08T13:06:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f6058914b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b1146e0 con 0x56277b0fd4d0 2023-10-08T13:06:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f604acc8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 0x56277b1056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f604acc8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 0x56277b1056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48260/0 (socket says 172.21.15.5:48260) 2023-10-08T13:06:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f604acc8700 1 -- 172.21.15.5:0/607046713 learned_addr learned my addr 172.21.15.5:0/607046713 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.928+0000 7f604a4c7700 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f604acc8700 1 -- 172.21.15.5:0/607046713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 msgr2=0x56277b1141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f604acc8700 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b1141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f604acc8700 1 -- 172.21.15.5:0/607046713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 msgr2=0x56277b10fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f604acc8700 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f604acc8700 1 -- 172.21.15.5:0/607046713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56277aea7250 con 0x56277b0fd4d0 2023-10-08T13:06:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f604acc8700 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 0x56277b1056b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f603c0090a0 tx=0x7f603c0a00c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c82facd8433ddc44 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f60397fa700 1 -- 172.21.15.5:0/607046713 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0998a0 con 0x56277b0fd4d0 2023-10-08T13:06:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f60397fa700 1 -- 172.21.15.5:0/607046713 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603c09deb0 con 0x56277b0fd4d0 2023-10-08T13:06:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.929+0000 7f60397fa700 1 -- 172.21.15.5:0/607046713 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c098100 con 0x56277b0fd4d0 2023-10-08T13:06:36.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.930+0000 7f6058914b80 1 -- 172.21.15.5:0/607046713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 msgr2=0x56277b1056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.930+0000 7f6058914b80 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 0x56277b1056b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f603c0090a0 tx=0x7f603c0a00c0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.934+0000 7f6058914b80 1 -- 172.21.15.5:0/607046713 shutdown_connections 2023-10-08T13:06:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.934+0000 7f6058914b80 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b0fd4d0 0x56277b1056b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.934+0000 7f6058914b80 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b1027a0 0x56277b10fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.934+0000 7f6058914b80 1 --2- 172.21.15.5:0/607046713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b10d650 0x56277b1141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.934+0000 7f6058914b80 1 -- 172.21.15.5:0/607046713 >> 172.21.15.5:0/607046713 conn(0x56277b077260 msgr2=0x56277b0f9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.940+0000 7f6058914b80 1 -- 172.21.15.5:0/607046713 shutdown_connections 2023-10-08T13:06:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.945+0000 7f6058914b80 1 -- 172.21.15.5:0/607046713 wait complete. 2023-10-08T13:06:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.945+0000 7f6058914b80 1 -- start start 2023-10-08T13:06:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.945+0000 7f6058914b80 1 Processor -- start 2023-10-08T13:06:36.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b0fd4d0 0x56277b113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b1757f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b175d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b176270 con 0x56277b10d650 2023-10-08T13:06:36.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b1763e0 con 0x56277b0fd4d0 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277b1765a0 con 0x56277b1027a0 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f6058914b80 10 client.0 _ll_register_callbacks cb 0x7f604000ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f604acc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b175d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f604acc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b175d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35064/0 (socket says 172.21.15.5:35064) 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.947+0000 7f604acc8700 1 -- 172.21.15.5:0/1926260405 learned_addr learned my addr 172.21.15.5:0/1926260405 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f604acc8700 1 -- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 msgr2=0x56277b1757f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f604acc8700 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b1757f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f604acc8700 1 -- 172.21.15.5:0/1926260405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b0fd4d0 msgr2=0x56277b113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f604acc8700 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b0fd4d0 0x56277b113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f604acc8700 1 -- 172.21.15.5:0/1926260405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56277ae80de0 con 0x56277b10d650 2023-10-08T13:06:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f604acc8700 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b175d30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f603c099a60 tx=0x7f603c0998a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37664d7d5d7283f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.948+0000 7f602dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.949+0000 7f602dffb700 1 -- 172.21.15.5:0/1926260405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c09a460 con 0x56277b10d650 2023-10-08T13:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.949+0000 7f602dffb700 1 -- 172.21.15.5:0/1926260405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f603c0a2060 con 0x56277b10d650 2023-10-08T13:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.949+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f603c0996c0 con 0x56277b10d650 2023-10-08T13:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.949+0000 7f602dffb700 1 -- 172.21.15.5:0/1926260405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f603c099d60 con 0x56277b10d650 2023-10-08T13:06:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.950+0000 7f6058914b80 10 client.15957 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.950+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56277ae7f2b0 con 0x56277b10d650 2023-10-08T13:06:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.951+0000 7f602dffb700 1 -- 172.21.15.5:0/1926260405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f603c0996c0 con 0x56277b10d650 2023-10-08T13:06:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f602dffb700 1 -- 172.21.15.5:0/1926260405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f603c05fae0 con 0x56277b10d650 2023-10-08T13:06:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f6058914b80 10 client.15957 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f6058914b80 10 client.15957 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:06:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f6058914b80 20 client.15957 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f6058914b80 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b18b810 0x56277b18dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f6058914b80 4 client.15957 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:06:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.952+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 --> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56277b04eb30 con 0x56277b18b810 2023-10-08T13:06:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.954+0000 7f604a4c7700 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b18b810 0x56277b18dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.955+0000 7f602dffb700 10 client.15957 ms_handle_connect on v2:172.21.15.118:6834/1209433325 2023-10-08T13:06:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.955+0000 7f604a4c7700 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b18b810 0x56277b18dc00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f94661b2925a66ed server_cookie=15f248b2533cb343 in_seq=0 out_seq=0 2023-10-08T13:06:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.955+0000 7f602dffb700 1 -- 172.21.15.5:0/1926260405 <== mds.3 v2:172.21.15.118:6834/1209433325 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56277b04eb30 con 0x56277b18b810 2023-10-08T13:06:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.955+0000 7f602dffb700 10 client.15957 handle_command_reply: tid=0 2023-10-08T13:06:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.955+0000 7f6058914b80 1 client.15957 shutdown 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.956+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 msgr2=0x56277b175d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.956+0000 7f6058914b80 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b175d30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f603c099a60 tx=0x7f603c0998a0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 shutdown_connections 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:6834/1209433325,v1:172.21.15.118:6835/1209433325] conn(0x56277b18b810 0x56277b18dc00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56277b10d650 0x56277b175d30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f602dffb700 0 client.15957 ms_handle_reset on v2:172.21.15.118:6834/1209433325 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56277b0fd4d0 0x56277b113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 --2- 172.21.15.5:0/1926260405 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56277b1027a0 0x56277b1757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 >> 172.21.15.5:0/1926260405 conn(0x56277b077260 msgr2=0x56277b1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 shutdown_connections 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 1 -- 172.21.15.5:0/1926260405 wait complete. 2023-10-08T13:06:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f6058914b80 20 client.15957 trim_cache size 0 max 16384 2023-10-08T13:06:36.960 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60300a1560 msgr2=0x7f60300a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f604c72b700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60300a1560 0x7f60300a3a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f604000b2e0 tx=0x7f6040005fd0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 msgr2=0x7f604419c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.957+0000 7f604c72b700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604419c550 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f603c00ef90 tx=0x7f603c00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 shutdown_connections 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60300a1560 0x7f60300a3a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f604410d020 0x7f604419c550 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60440ff470 0x7f6044198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 --2- 172.21.15.5:0/1522292000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60440ffd90 0x7f60441992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 >> 172.21.15.5:0/1522292000 conn(0x7f6044075a40 msgr2=0x7f604410e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 shutdown_connections 2023-10-08T13:06:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:36.958+0000 7f604c72b700 1 -- 172.21.15.5:0/1522292000 wait complete. 2023-10-08T13:06:36.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T13:06:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 -- 172.21.15.5:0/2786740374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c100ff0 msgr2=0x7fd68c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 --2- 172.21.15.5:0/2786740374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c100ff0 0x7fd68c10d610 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b0a0 tx=0x7fd68400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 -- 172.21.15.5:0/2786740374 shutdown_connections 2023-10-08T13:06:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 --2- 172.21.15.5:0/2786740374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c100ff0 0x7fd68c10d610 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 --2- 172.21.15.5:0/2786740374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c106750 0x7fd68c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 --2- 172.21.15.5:0/2786740374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.196+0000 7fd694156700 1 -- 172.21.15.5:0/2786740374 >> 172.21.15.5:0/2786740374 conn(0x7fd68c0fc100 msgr2=0x7fd68c0fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.197+0000 7fd694156700 1 -- 172.21.15.5:0/2786740374 shutdown_connections 2023-10-08T13:06:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.197+0000 7fd694156700 1 -- 172.21.15.5:0/2786740374 wait complete. 2023-10-08T13:06:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.198+0000 7fd694156700 1 Processor -- start 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.198+0000 7fd694156700 1 -- start start 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd694156700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd694156700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 0x7fd68c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd694156700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c106750 0x7fd68c196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd694156700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c197110 con 0x7fd68c106750 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd694156700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c197280 con 0x7fd68c100ff0 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd694156700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c197440 con 0x7fd68c100630 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd6916f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 0x7fd68c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48278/0 (socket says 172.21.15.5:48278) 2023-10-08T13:06:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd6916f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 0x7fd68c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58258/0 (socket says 172.21.15.5:58258) 2023-10-08T13:06:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c106750 0x7fd68c196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 -- 172.21.15.5:0/3466305281 learned_addr learned my addr 172.21.15.5:0/3466305281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 -- 172.21.15.5:0/3466305281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 msgr2=0x7fd68c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 0x7fd68c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 -- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c106750 msgr2=0x7fd68c196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c106750 0x7fd68c196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.199+0000 7fd691ef2700 1 -- 172.21.15.5:0/3466305281 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009d00 con 0x7fd68c100630 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.200+0000 7fd6916f1700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 0x7fd68c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.200+0000 7fd691ef2700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c19c8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c9b0 tx=0x7fd68800ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.200+0000 7fd682ffd700 1 -- 172.21.15.5:0/3466305281 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688007b00 con 0x7fd68c100630 2023-10-08T13:06:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.200+0000 7fd682ffd700 1 -- 172.21.15.5:0/3466305281 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd68800ce50 con 0x7fd68c100630 2023-10-08T13:06:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.200+0000 7fd682ffd700 1 -- 172.21.15.5:0/3466305281 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688018660 con 0x7fd68c100630 2023-10-08T13:06:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.201+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c1976c0 con 0x7fd68c100630 2023-10-08T13:06:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.201+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c072c00 con 0x7fd68c100630 2023-10-08T13:06:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 Processor -- start 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 -- start start 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 0x55b86be5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be67650 0x55b86be69a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bdc5460 con 0x55b86be67650 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bdb6c20 con 0x55b86be5c7a0 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bdb4540 con 0x55b86be5be80 2023-10-08T13:06:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.206+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 0x55b86be5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6916f1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be67650 0x55b86be69a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 0x55b86be5c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48284/0 (socket says 172.21.15.5:48284) 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 -- 172.21.15.5:0/2991250211 learned_addr learned my addr 172.21.15.5:0/2991250211 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 -- 172.21.15.5:0/2991250211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 msgr2=0x55b86be67110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be67110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 -- 172.21.15.5:0/2991250211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be67650 msgr2=0x55b86be69a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be67650 0x55b86be69a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 -- 172.21.15.5:0/2991250211 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b86bbdade0 con 0x55b86be5be80 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6916f1700 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be67650 0x55b86be69a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.207+0000 7fd6926f3700 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 0x55b86be5c260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd684015000 tx=0x7fd68400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4edae8315019ca4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.208+0000 7fd682ffd700 1 -- 172.21.15.5:0/3466305281 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fd68800f450 con 0x7fd68c100630 2023-10-08T13:06:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.208+0000 7fd677fff700 1 -- 172.21.15.5:0/2991250211 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400e040 con 0x55b86be5be80 2023-10-08T13:06:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.208+0000 7fd677fff700 1 -- 172.21.15.5:0/2991250211 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6840092d0 con 0x55b86be5be80 2023-10-08T13:06:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.208+0000 7fd677fff700 1 -- 172.21.15.5:0/2991250211 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840050b0 con 0x55b86be5be80 2023-10-08T13:06:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.209+0000 7fd682ffd700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6780a59f0 0x7fd6780a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.209+0000 7fd682ffd700 1 -- 172.21.15.5:0/3466305281 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd6880cd2a0 con 0x7fd68c100630 2023-10-08T13:06:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2991250211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 msgr2=0x55b86be5c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 0x55b86be5c260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd684015000 tx=0x7fd68400cef0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd691ef2700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6780a59f0 0x7fd6780a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2991250211 shutdown_connections 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be67650 0x55b86be69a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be5be80 0x55b86be5c260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2991250211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be67110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2991250211 >> 172.21.15.5:0/2991250211 conn(0x55b86bdd1260 msgr2=0x55b86be582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2991250211 shutdown_connections 2023-10-08T13:06:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.210+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2991250211 wait complete. 2023-10-08T13:06:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.211+0000 7fd6a033fb80 1 -- start start 2023-10-08T13:06:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.211+0000 7fd6a033fb80 1 Processor -- start 2023-10-08T13:06:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 0x55b86be67070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5c7a0 0x55b86be64400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bdafe30 con 0x55b86be5c7a0 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bd4c710 con 0x55b86be5be80 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bd4c3b0 con 0x55b86be67650 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6a033fb80 10 client.0 _ll_register_callbacks cb 0x55b86bba9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 0x55b86be67070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 0x55b86be67070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58270/0 (socket says 172.21.15.5:58270) 2023-10-08T13:06:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6926f3700 1 -- 172.21.15.5:0/993423066 learned_addr learned my addr 172.21.15.5:0/993423066 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.212+0000 7fd6926f3700 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6926f3700 1 -- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 msgr2=0x55b86be64aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6926f3700 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be64aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6926f3700 1 -- 172.21.15.5:0/993423066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5c7a0 msgr2=0x55b86be64400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6926f3700 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5c7a0 0x55b86be64400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd691ef2700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6780a59f0 0x7fd6780a7eb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd688099d00 tx=0x7fd6880cd520 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6926f3700 1 -- 172.21.15.5:0/993423066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c009a20 con 0x55b86be5be80 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6926f3700 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 0x55b86be67070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd684007c10 tx=0x7fd6840077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5f9ea83fd7ee4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6757fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6757fa700 1 -- 172.21.15.5:0/993423066 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400e040 con 0x55b86be5be80 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b86bd77eb0 con 0x55b86be5be80 2023-10-08T13:06:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.213+0000 7fd6757fa700 1 -- 172.21.15.5:0/993423066 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd6840054a0 con 0x55b86be5be80 2023-10-08T13:06:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.216+0000 7fd6757fa700 1 -- 172.21.15.5:0/993423066 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd684004ec0 con 0x55b86be5be80 2023-10-08T13:06:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.216+0000 7fd6a033fb80 10 client.25508 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.216+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fd68c10df10 con 0x55b86be5be80 2023-10-08T13:06:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.216+0000 7fd6757fa700 1 -- 172.21.15.5:0/993423066 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b86bd77eb0 con 0x55b86be5be80 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6757fa700 1 -- 172.21.15.5:0/993423066 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fd684019050 con 0x55b86be5be80 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6a033fb80 10 client.25508 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6a033fb80 10 client.25508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6a033fb80 20 client.25508 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86be87c60 0x55b86be8a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6a033fb80 4 client.25508 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.217+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 --> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b86bda8e10 con 0x55b86be87c60 2023-10-08T13:06:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.218+0000 7fd6916f1700 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86be87c60 0x55b86be8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6757fa700 10 client.25508 ms_handle_connect on v2:172.21.15.118:6836/1772997298 2023-10-08T13:06:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6916f1700 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86be87c60 0x55b86be8a080 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab55bb6f65b4f9ab server_cookie=9fb539c966f7401c in_seq=0 out_seq=0 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6757fa700 1 -- 172.21.15.5:0/993423066 <== mds.2 v2:172.21.15.118:6836/1772997298 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b86bda8e10 con 0x55b86be87c60 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6757fa700 10 client.25508 handle_command_reply: tid=0 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6a033fb80 1 client.25508 shutdown 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 msgr2=0x55b86be67070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.219+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 0x55b86be67070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd684007c10 tx=0x7fd6840077a0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 shutdown_connections 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be64aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5be80 0x55b86be67070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86be87c60 0x55b86be8a080 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/993423066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5c7a0 0x55b86be64400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6757fa700 0 client.25508 ms_handle_reset on v2:172.21.15.118:6836/1772997298 2023-10-08T13:06:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 >> 172.21.15.5:0/993423066 conn(0x55b86bdd1260 msgr2=0x55b86be57ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 shutdown_connections 2023-10-08T13:06:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 1 -- 172.21.15.5:0/993423066 wait complete. 2023-10-08T13:06:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.220+0000 7fd6a033fb80 20 client.25508 trim_cache size 0 max 16384 2023-10-08T13:06:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 Processor -- start 2023-10-08T13:06:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 -- start start 2023-10-08T13:06:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be83ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be61c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bc30920 con 0x55b86be5be80 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86be5d0d0 con 0x55b86be5c7a0 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86be5cd80 con 0x55b86be67650 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be83ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be83ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35096/0 (socket says 172.21.15.5:35096) 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6926f3700 1 -- 172.21.15.5:0/2373618910 learned_addr learned my addr 172.21.15.5:0/2373618910 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.242+0000 7fd6916f1700 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd6916f1700 1 -- 172.21.15.5:0/2373618910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 msgr2=0x55b86be61c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd6916f1700 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be61c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd6916f1700 1 -- 172.21.15.5:0/2373618910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 msgr2=0x55b86be83ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd6916f1700 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be83ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd6916f1700 1 -- 172.21.15.5:0/2373618910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b86bbc3c60 con 0x55b86be5c7a0 2023-10-08T13:06:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd6916f1700 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be616e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55b86be8a950 tx=0x7fd67c009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3248bacb409cd834 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.243+0000 7fd680ff9700 1 -- 172.21.15.5:0/2373618910 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c024470 con 0x55b86be5c7a0 2023-10-08T13:06:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.244+0000 7fd680ff9700 1 -- 172.21.15.5:0/2373618910 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd67c024a90 con 0x55b86be5c7a0 2023-10-08T13:06:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.244+0000 7fd680ff9700 1 -- 172.21.15.5:0/2373618910 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c014ae0 con 0x55b86be5c7a0 2023-10-08T13:06:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2373618910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 msgr2=0x55b86be616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be616e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55b86be8a950 tx=0x7fd67c009340 comp rx=0 tx=0).stop 2023-10-08T13:06:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2373618910 shutdown_connections 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be61c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be83ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/2373618910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be616e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2373618910 >> 172.21.15.5:0/2373618910 conn(0x55b86bdd1260 msgr2=0x55b86be838e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2373618910 shutdown_connections 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 -- 172.21.15.5:0/2373618910 wait complete. 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 -- start start 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.245+0000 7fd6a033fb80 1 Processor -- start 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be7d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be7de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be7e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bedba60 con 0x55b86be5be80 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bedbba0 con 0x55b86be5c7a0 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86bedbce0 con 0x55b86be67650 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6a033fb80 10 client.0 _ll_register_callbacks cb 0x7fd684004d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6916f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be7de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6926f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be7d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6916f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be7de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58284/0 (socket says 172.21.15.5:58284) 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6916f1700 1 -- 172.21.15.5:0/1614226132 learned_addr learned my addr 172.21.15.5:0/1614226132 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.246+0000 7fd6926f3700 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be7e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6916f1700 1 -- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 msgr2=0x55b86be7e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6916f1700 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be7e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6916f1700 1 -- 172.21.15.5:0/1614226132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 msgr2=0x55b86be7d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6916f1700 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be7d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6916f1700 1 -- 172.21.15.5:0/1614226132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c016420 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6916f1700 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be7de20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0093b0 tx=0x7fd67c024ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4d6e056db2629d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6757fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6757fa700 1 -- 172.21.15.5:0/1614226132 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c014760 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6757fa700 1 -- 172.21.15.5:0/1614226132 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd67c0148c0 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.247+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6840092d0 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.248+0000 7fd6757fa700 1 -- 172.21.15.5:0/1614226132 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd67c014a80 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.248+0000 7fd6a033fb80 10 client.25514 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.248+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b86bc01250 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.248+0000 7fd6757fa700 1 -- 172.21.15.5:0/1614226132 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6840092d0 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6757fa700 1 -- 172.21.15.5:0/1614226132 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fd67c02b020 con 0x55b86be5c7a0 2023-10-08T13:06:37.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6a033fb80 10 client.25514 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:37.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6a033fb80 10 client.25514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T13:06:37.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6a033fb80 20 client.25514 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:37.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86bedd290 0x55b86bedf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6a033fb80 4 client.25514 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:06:37.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 --> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b86bda8b30 con 0x55b86bedd290 2023-10-08T13:06:37.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.249+0000 7fd6926f3700 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86bedd290 0x55b86bedf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6757fa700 10 client.25514 ms_handle_connect on v2:172.21.15.118:6836/1772997298 2023-10-08T13:06:37.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6926f3700 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86bedd290 0x55b86bedf6b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc1bf8f1b07da0b1 server_cookie=8dabd2dde094eb09 in_seq=0 out_seq=0 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6757fa700 1 -- 172.21.15.5:0/1614226132 <== mds.2 v2:172.21.15.118:6836/1772997298 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b86bda8b30 con 0x55b86bedd290 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6757fa700 10 client.25514 handle_command_reply: tid=0 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 client.25514 shutdown 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 msgr2=0x55b86be7de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be7de20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0093b0 tx=0x7fd67c024ee0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 shutdown_connections 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b86be67650 0x55b86be7e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.118:6836/1772997298,v1:172.21.15.118:6837/1772997298] conn(0x55b86bedd290 0x55b86bedf6b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b86be5be80 0x55b86be7d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 --2- 172.21.15.5:0/1614226132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b86be5c7a0 0x55b86be7de20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 >> 172.21.15.5:0/1614226132 conn(0x55b86bdd1260 msgr2=0x55b86be65c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6757fa700 0 client.25514 ms_handle_reset on v2:172.21.15.118:6836/1772997298 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 shutdown_connections 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.250+0000 7fd6a033fb80 1 -- 172.21.15.5:0/1614226132 wait complete. 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.251+0000 7fd6a033fb80 20 client.25514 trim_cache size 0 max 16384 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-08T13:06:37.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.253+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6780a59f0 msgr2=0x7fd6780a7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.253+0000 7fd694156700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6780a59f0 0x7fd6780a7eb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd688099d00 tx=0x7fd6880cd520 comp rx=0 tx=0).stop 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.253+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 msgr2=0x7fd68c19c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.253+0000 7fd694156700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c19c8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c9b0 tx=0x7fd68800ccc0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 shutdown_connections 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd6780a59f0 0x7fd6780a7eb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd68c106750 0x7fd68c196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd68c100630 0x7fd68c19c8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 --2- 172.21.15.5:0/3466305281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd68c100ff0 0x7fd68c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 >> 172.21.15.5:0/3466305281 conn(0x7fd68c0fc100 msgr2=0x7fd68c0fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 shutdown_connections 2023-10-08T13:06:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.254+0000 7fd694156700 1 -- 172.21.15.5:0/3466305281 wait complete. 2023-10-08T13:06:37.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T13:06:37.274 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:37 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:37.274 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:37 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/391950129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 -- 172.21.15.5:0/1665570621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff998107950 msgr2=0x7ff99810b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 --2- 172.21.15.5:0/1665570621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff998107950 0x7ff99810b8e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0098f0 tx=0x7ff98c009c00 comp rx=0 tx=0).stop 2023-10-08T13:06:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 -- 172.21.15.5:0/1665570621 shutdown_connections 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 --2- 172.21.15.5:0/1665570621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff99810c010 0x7ff998113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 --2- 172.21.15.5:0/1665570621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 0x7ff998107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 --2- 172.21.15.5:0/1665570621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff998107950 0x7ff99810b8e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 -- 172.21.15.5:0/1665570621 >> 172.21.15.5:0/1665570621 conn(0x7ff998076630 msgr2=0x7ff998105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 -- 172.21.15.5:0/1665570621 shutdown_connections 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.457+0000 7ff99ea01700 1 -- 172.21.15.5:0/1665570621 wait complete. 2023-10-08T13:06:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.458+0000 7ff99ea01700 1 Processor -- start 2023-10-08T13:06:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 -- start start 2023-10-08T13:06:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 0x7ff998080d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99810c010 0x7ff998081280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 0x7ff99807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99807ab70 con 0x7ff99810c010 2023-10-08T13:06:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99807ace0 con 0x7ff998079f80 2023-10-08T13:06:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99ea01700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99807e910 con 0x7ff998106fa0 2023-10-08T13:06:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99cf9e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 0x7ff99807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff997fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 0x7ff998080d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99cf9e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 0x7ff99807a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58300/0 (socket says 172.21.15.5:58300) 2023-10-08T13:06:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.459+0000 7ff99cf9e700 1 -- 172.21.15.5:0/576465567 learned_addr learned my addr 172.21.15.5:0/576465567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff9977fe700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99810c010 0x7ff998081280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff99cf9e700 1 -- 172.21.15.5:0/576465567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 msgr2=0x7ff998080d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 0x7ff998080d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff99cf9e700 1 -- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99810c010 msgr2=0x7ff998081280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99810c010 0x7ff998081280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff99cf9e700 1 -- 172.21.15.5:0/576465567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009520 con 0x7ff998079f80 2023-10-08T13:06:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff9977fe700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99810c010 0x7ff998081280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff997fff700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 0x7ff998080d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.460+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 0x7ff99807a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff99000ef30 tx=0x7ff99000c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.461+0000 7ff9957fa700 1 -- 172.21.15.5:0/576465567 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990018070 con 0x7ff998079f80 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.461+0000 7ff9957fa700 1 -- 172.21.15.5:0/576465567 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff99000f040 con 0x7ff998079f80 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.461+0000 7ff9957fa700 1 -- 172.21.15.5:0/576465567 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000cda0 con 0x7ff998079f80 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.461+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99807eb90 con 0x7ff998079f80 2023-10-08T13:06:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.461+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99807f020 con 0x7ff998079f80 2023-10-08T13:06:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.465+0000 7ff9957fa700 1 -- 172.21.15.5:0/576465567 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7ff990004000 con 0x7ff998079f80 2023-10-08T13:06:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.466+0000 7ff9957fa700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff9800a16b0 0x7ff9800a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.466+0000 7ff9957fa700 1 -- 172.21.15.5:0/576465567 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff9900ccd60 con 0x7ff998079f80 2023-10-08T13:06:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.466+0000 7ff997fff700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff9800a16b0 0x7ff9800a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.467+0000 7ff9aabeab80 1 Processor -- start 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.467+0000 7ff997fff700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff9800a16b0 0x7ff9800a3b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff988005fd0 tx=0x7ff988009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 -- start start 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558285953460 con 0x5582859ea7a0 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558285944c20 con 0x5582859e9e80 2023-10-08T13:06:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558285942540 con 0x5582859f5650 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48330/0 (socket says 172.21.15.5:48330) 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 -- 172.21.15.5:0/22139468 learned_addr learned my addr 172.21.15.5:0/22139468 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff997fff700 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 -- 172.21.15.5:0/22139468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 msgr2=0x5582859ea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 -- 172.21.15.5:0/22139468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 msgr2=0x5582859f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.468+0000 7ff99cf9e700 1 -- 172.21.15.5:0/22139468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558285768de0 con 0x5582859f5650 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.469+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f7a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9900a27f0 tx=0x7ff99009a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976132327ecbc79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.469+0000 7ff97e7fc700 1 -- 172.21.15.5:0/22139468 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900092e0 con 0x5582859f5650 2023-10-08T13:06:37.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.469+0000 7ff97e7fc700 1 -- 172.21.15.5:0/22139468 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff99009b120 con 0x5582859f5650 2023-10-08T13:06:37.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.469+0000 7ff97e7fc700 1 -- 172.21.15.5:0/22139468 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990004ad0 con 0x5582859f5650 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.470+0000 7ff9aabeab80 1 -- 172.21.15.5:0/22139468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 msgr2=0x5582859f7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.470+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f7a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9900a27f0 tx=0x7ff99009a400 comp rx=0 tx=0).stop 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 -- 172.21.15.5:0/22139468 shutdown_connections 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f7a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/22139468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 -- 172.21.15.5:0/22139468 >> 172.21.15.5:0/22139468 conn(0x55828595f260 msgr2=0x5582859e62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 -- 172.21.15.5:0/22139468 shutdown_connections 2023-10-08T13:06:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 -- 172.21.15.5:0/22139468 wait complete. 2023-10-08T13:06:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.471+0000 7ff9aabeab80 1 -- start start 2023-10-08T13:06:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 Processor -- start 2023-10-08T13:06:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859e9e80 0x5582859f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 0x5582859f2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859f5650 0x5582859f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55828593de30 con 0x5582859f5650 2023-10-08T13:06:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582858da710 con 0x5582859ea7a0 2023-10-08T13:06:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582858da3b0 con 0x5582859e9e80 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9aabeab80 10 client.0 _ll_register_callbacks cb 0x558285737800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff997fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859e9e80 0x5582859f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 0x5582859f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 0x5582859f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58312/0 (socket says 172.21.15.5:58312) 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff997fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859e9e80 0x5582859f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48334/0 (socket says 172.21.15.5:48334) 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff9977fe700 1 -- 172.21.15.5:0/109347138 learned_addr learned my addr 172.21.15.5:0/109347138 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.472+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859f5650 0x5582859f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9977fe700 1 -- 172.21.15.5:0/109347138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859e9e80 msgr2=0x5582859f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9977fe700 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859e9e80 0x5582859f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9977fe700 1 -- 172.21.15.5:0/109347138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859f5650 msgr2=0x5582859f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9977fe700 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859f5650 0x5582859f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9977fe700 1 -- 172.21.15.5:0/109347138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99807f020 con 0x5582859ea7a0 2023-10-08T13:06:37.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9977fe700 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 0x5582859f2370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff998069e00 tx=0x7ff98c00ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99bf28abc3142ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9777fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:37.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9777fe700 1 -- 172.21.15.5:0/109347138 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c026070 con 0x5582859ea7a0 2023-10-08T13:06:37.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9777fe700 1 -- 172.21.15.5:0/109347138 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff98c0058e0 con 0x5582859ea7a0 2023-10-08T13:06:37.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.473+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558285905eb0 con 0x5582859ea7a0 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9777fe700 1 -- 172.21.15.5:0/109347138 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff98c01c070 con 0x5582859ea7a0 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 10 client.25526 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x558285751c60 con 0x5582859ea7a0 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9777fe700 1 -- 172.21.15.5:0/109347138 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558285905eb0 con 0x5582859ea7a0 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9777fe700 1 -- 172.21.15.5:0/109347138 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff98c029020 con 0x5582859ea7a0 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 10 client.25526 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:37.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 10 client.25526 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2023-10-08T13:06:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 20 client.25526 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a05350 0x558285a07770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 4 client.25526 mds_command: new command op to 24650 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.476+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 --> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558285936e10 con 0x558285a05350 2023-10-08T13:06:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.477+0000 7ff997fff700 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a05350 0x558285a07770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.477+0000 7ff997fff700 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a05350 0x558285a07770 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edf0cf5f81bd964f server_cookie=21fd4cb4f1792fd6 in_seq=0 out_seq=0 2023-10-08T13:06:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.478+0000 7ff9777fe700 10 client.25526 ms_handle_connect on v2:172.21.15.60:6838/2598964762 2023-10-08T13:06:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.478+0000 7ff9777fe700 1 -- 172.21.15.5:0/109347138 <== mds.1 v2:172.21.15.60:6838/2598964762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558285936e10 con 0x558285a05350 2023-10-08T13:06:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.478+0000 7ff9777fe700 10 client.25526 handle_command_reply: tid=0 2023-10-08T13:06:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.478+0000 7ff9aabeab80 1 client.25526 shutdown 2023-10-08T13:06:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 msgr2=0x5582859f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 0x5582859f2370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff998069e00 tx=0x7ff98c00ff90 comp rx=0 tx=0).stop 2023-10-08T13:06:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 shutdown_connections 2023-10-08T13:06:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a05350 0x558285a07770 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859f5650 0x5582859f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859e9e80 0x5582859f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/109347138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859ea7a0 0x5582859f2370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 >> 172.21.15.5:0/109347138 conn(0x55828595f260 msgr2=0x5582859e5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.479+0000 7ff9777fe700 0 client.25526 ms_handle_reset on v2:172.21.15.60:6838/2598964762 2023-10-08T13:06:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.480+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 shutdown_connections 2023-10-08T13:06:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.481+0000 7ff9aabeab80 1 -- 172.21.15.5:0/109347138 wait complete. 2023-10-08T13:06:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.481+0000 7ff9aabeab80 20 client.25526 trim_cache size 0 max 16384 2023-10-08T13:06:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.498+0000 7ff9aabeab80 1 Processor -- start 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 -- start start 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582857be920 con 0x5582859ea7a0 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582859eb9f0 con 0x5582859e9e80 2023-10-08T13:06:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582859f16e0 con 0x5582859f5650 2023-10-08T13:06:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35138/0 (socket says 172.21.15.5:35138) 2023-10-08T13:06:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff9977fe700 1 -- 172.21.15.5:0/1993689720 learned_addr learned my addr 172.21.15.5:0/1993689720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.499+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.500+0000 7ff99cf9e700 1 -- 172.21.15.5:0/1993689720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 msgr2=0x5582859ecdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:06:37.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.500+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ecdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.500+0000 7ff99cf9e700 1 -- 172.21.15.5:0/1993689720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 msgr2=0x5582859f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.500+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.500+0000 7ff99cf9e700 1 -- 172.21.15.5:0/1993689720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55828578f250 con 0x5582859f5650 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.500+0000 7ff99cf9e700 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f11a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff99009a9b0 tx=0x7ff99009a920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=858a5548e3a314fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.501+0000 7ff97effd700 1 -- 172.21.15.5:0/1993689720 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900a2d20 con 0x5582859f5650 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.501+0000 7ff97effd700 1 -- 172.21.15.5:0/1993689720 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9900092e0 con 0x5582859f5650 2023-10-08T13:06:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.501+0000 7ff97effd700 1 -- 172.21.15.5:0/1993689720 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990004ad0 con 0x5582859f5650 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1993689720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 msgr2=0x5582859f11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f11a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff99009a9b0 tx=0x7ff99009a920 comp rx=0 tx=0).stop 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1993689720 shutdown_connections 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859f5650 0x5582859f11a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859e9e80 0x5582859ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1993689720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859ea7a0 0x5582859f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.502+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1993689720 >> 172.21.15.5:0/1993689720 conn(0x55828595f260 msgr2=0x5582859ed6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:37 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:37.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:37 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/391950129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:37.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.514+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1993689720 shutdown_connections 2023-10-08T13:06:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.523+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1993689720 wait complete. 2023-10-08T13:06:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.523+0000 7ff9aabeab80 1 -- start start 2023-10-08T13:06:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.523+0000 7ff9aabeab80 1 Processor -- start 2023-10-08T13:06:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 0x5582859efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859ea7a0 0x5582859f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859f5650 0x5582859ee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582859eed60 con 0x5582859e9e80 2023-10-08T13:06:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582859eeed0 con 0x5582859f5650 2023-10-08T13:06:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582859ef090 con 0x5582859ea7a0 2023-10-08T13:06:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff9aabeab80 10 client.0 _ll_register_callbacks cb 0x7ff98c009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff997fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 0x5582859efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff997fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 0x5582859efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35142/0 (socket says 172.21.15.5:35142) 2023-10-08T13:06:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.524+0000 7ff997fff700 1 -- 172.21.15.5:0/1988284325 learned_addr learned my addr 172.21.15.5:0/1988284325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.525+0000 7ff9977fe700 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859ea7a0 0x5582859f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.525+0000 7ff997fff700 1 -- 172.21.15.5:0/1988284325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859ea7a0 msgr2=0x5582859f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.525+0000 7ff997fff700 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859ea7a0 0x5582859f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.525+0000 7ff997fff700 1 -- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859f5650 msgr2=0x5582859ee620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.525+0000 7ff997fff700 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859f5650 0x5582859ee620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.525+0000 7ff997fff700 1 -- 172.21.15.5:0/1988284325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558285768de0 con 0x5582859e9e80 2023-10-08T13:06:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.526+0000 7ff997fff700 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 0x5582859efb60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff988013010 tx=0x7ff9880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2118e1f44cd1d1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.526+0000 7ff9777fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.526+0000 7ff9777fe700 1 -- 172.21.15.5:0/1988284325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988024040 con 0x5582859e9e80 2023-10-08T13:06:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.526+0000 7ff9777fe700 1 -- 172.21.15.5:0/1988284325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff988003e30 con 0x5582859e9e80 2023-10-08T13:06:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.528+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff99009b120 con 0x5582859e9e80 2023-10-08T13:06:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.528+0000 7ff9777fe700 1 -- 172.21.15.5:0/1988284325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9880295c0 con 0x5582859e9e80 2023-10-08T13:06:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.528+0000 7ff9aabeab80 10 client.15990 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.528+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5582857672b0 con 0x5582859e9e80 2023-10-08T13:06:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.528+0000 7ff9777fe700 1 -- 172.21.15.5:0/1988284325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff99009b120 con 0x5582859e9e80 2023-10-08T13:06:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9777fe700 1 -- 172.21.15.5:0/1988284325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff988032d10 con 0x5582859e9e80 2023-10-08T13:06:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9aabeab80 10 client.15990 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9aabeab80 10 client.15990 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2023-10-08T13:06:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9aabeab80 20 client.15990 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a5a440 0x558285a5c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9aabeab80 4 client.15990 mds_command: new command op to 24650 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:06:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.530+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 --> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558285936b30 con 0x558285a5a440 2023-10-08T13:06:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.531+0000 7ff9977fe700 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a5a440 0x558285a5c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.532+0000 7ff9977fe700 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a5a440 0x558285a5c860 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edc448bb2bf87d14 server_cookie=bead3765c16e0643 in_seq=0 out_seq=0 2023-10-08T13:06:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.532+0000 7ff9777fe700 10 client.15990 ms_handle_connect on v2:172.21.15.60:6838/2598964762 2023-10-08T13:06:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.532+0000 7ff9777fe700 1 -- 172.21.15.5:0/1988284325 <== mds.1 v2:172.21.15.60:6838/2598964762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558285936b30 con 0x558285a5a440 2023-10-08T13:06:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.532+0000 7ff9777fe700 10 client.15990 handle_command_reply: tid=0 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.532+0000 7ff9aabeab80 1 client.15990 shutdown 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 msgr2=0x5582859efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 0x5582859efb60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff988013010 tx=0x7ff9880047c0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 shutdown_connections 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:6838/2598964762,v1:172.21.15.60:6839/2598964762] conn(0x558285a5a440 0x558285a5c860 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582859f5650 0x5582859ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9777fe700 0 client.15990 ms_handle_reset on v2:172.21.15.60:6838/2598964762 2023-10-08T13:06:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5582859e9e80 0x5582859efb60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 --2- 172.21.15.5:0/1988284325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5582859ea7a0 0x5582859f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.535+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 >> 172.21.15.5:0/1988284325 conn(0x55828595f260 msgr2=0x5582859f18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.536+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 shutdown_connections 2023-10-08T13:06:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.536+0000 7ff9aabeab80 1 -- 172.21.15.5:0/1988284325 wait complete. 2023-10-08T13:06:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.536+0000 7ff9aabeab80 20 client.15990 trim_cache size 0 max 16384 2023-10-08T13:06:37.539 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-08T13:06:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff9800a16b0 msgr2=0x7ff9800a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff9800a16b0 0x7ff9800a3b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff988005fd0 tx=0x7ff988009310 comp rx=0 tx=0).stop 2023-10-08T13:06:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 msgr2=0x7ff99807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 0x7ff99807a430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff99000ef30 tx=0x7ff99000c450 comp rx=0 tx=0).stop 2023-10-08T13:06:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 shutdown_connections 2023-10-08T13:06:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff9800a16b0 0x7ff9800a3b70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff998079f80 0x7ff99807a430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff998106fa0 0x7ff998080d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 --2- 172.21.15.5:0/576465567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff99810c010 0x7ff998081280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 >> 172.21.15.5:0/576465567 conn(0x7ff998076630 msgr2=0x7ff998078280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 shutdown_connections 2023-10-08T13:06:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.537+0000 7ff99ea01700 1 -- 172.21.15.5:0/576465567 wait complete. 2023-10-08T13:06:37.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:06:37.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:37 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:06:37.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:37 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/391950129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.770+0000 7fbcadb05700 1 -- 172.21.15.5:0/1792819849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 msgr2=0x7fbca80feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.771+0000 7fbcadb05700 1 --2- 172.21.15.5:0/1792819849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 0x7fbca80feb50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbca000b0a0 tx=0x7fbca000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.771+0000 7fbcadb05700 1 -- 172.21.15.5:0/1792819849 shutdown_connections 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.771+0000 7fbcadb05700 1 --2- 172.21.15.5:0/1792819849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8105a50 0x7fbca8113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.771+0000 7fbcadb05700 1 --2- 172.21.15.5:0/1792819849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 0x7fbca80feb50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.771+0000 7fbcadb05700 1 --2- 172.21.15.5:0/1792819849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca80ff090 0x7fbca80ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.771+0000 7fbcadb05700 1 -- 172.21.15.5:0/1792819849 >> 172.21.15.5:0/1792819849 conn(0x7fbca8075ae0 msgr2=0x7fbca80fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.772+0000 7fbcadb05700 1 -- 172.21.15.5:0/1792819849 shutdown_connections 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.772+0000 7fbcadb05700 1 -- 172.21.15.5:0/1792819849 wait complete. 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 Processor -- start 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 -- start start 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 0x7fbca81134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 0x7fbca8113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca8105a50 0x7fbca8072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca810f6a0 con 0x7fbca8105a50 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca810f810 con 0x7fbca80ff090 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.773+0000 7fbcadb05700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca810f9d0 con 0x7fbca8101570 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 0x7fbca81134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 0x7fbca81134c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58338/0 (socket says 172.21.15.5:58338) 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 -- 172.21.15.5:0/2903523669 learned_addr learned my addr 172.21.15.5:0/2903523669 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca7fff700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca8105a50 0x7fbca8072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 -- 172.21.15.5:0/2903523669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 msgr2=0x7fbca8113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 0x7fbca8113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 -- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca8105a50 msgr2=0x7fbca8072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca8105a50 0x7fbca8072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 -- 172.21.15.5:0/2903523669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009d00 con 0x7fbca80ff090 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca77fe700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 0x7fbca81134c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbca0006070 tx=0x7fbca0004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca4ff9700 1 -- 172.21.15.5:0/2903523669 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca000e040 con 0x7fbca80ff090 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca4ff9700 1 -- 172.21.15.5:0/2903523669 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbca0003a00 con 0x7fbca80ff090 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbca4ff9700 1 -- 172.21.15.5:0/2903523669 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00045d0 con 0x7fbca80ff090 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.774+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca810fc50 con 0x7fbca80ff090 2023-10-08T13:06:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.775+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca8110110 con 0x7fbca80ff090 2023-10-08T13:06:37.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.778+0000 7fbca4ff9700 1 -- 172.21.15.5:0/2903523669 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fbca0003b70 con 0x7fbca80ff090 2023-10-08T13:06:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.781+0000 7fbca4ff9700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc900a15e0 0x7fbc900a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.781+0000 7fbcb9ceeb80 1 Processor -- start 2023-10-08T13:06:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.781+0000 7fbcb9ceeb80 1 -- start start 2023-10-08T13:06:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc900a15e0 0x7fbc900a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca4ff9700 1 -- 172.21.15.5:0/2903523669 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbca00ce3c0 con 0x7fbca80ff090 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d777b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d7786110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7788a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d76e4460 con 0x55c8d7786650 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d76d5c20 con 0x55c8d777b7a0 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d76d3540 con 0x55c8d777ae80 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d777b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d777b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48368/0 (socket says 172.21.15.5:48368) 2023-10-08T13:06:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca7fff700 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7788a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 -- 172.21.15.5:0/1786895819 learned_addr learned my addr 172.21.15.5:0/1786895819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d7786110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc900a15e0 0x7fbc900a3aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc98005950 tx=0x7fbc98009e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 -- 172.21.15.5:0/1786895819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 msgr2=0x55c8d7786110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d7786110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 -- 172.21.15.5:0/1786895819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 msgr2=0x55c8d7788a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7788a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.782+0000 7fbca77fe700 1 -- 172.21.15.5:0/1786895819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8d74f9de0 con 0x55c8d777ae80 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.783+0000 7fbca77fe700 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d777b260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbca00976b0 tx=0x7fbca009b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2de81e430cc9048 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.784+0000 7fbc8dffb700 1 -- 172.21.15.5:0/1786895819 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca009f120 con 0x55c8d777ae80 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.784+0000 7fbc8dffb700 1 -- 172.21.15.5:0/1786895819 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbca009b1b0 con 0x55c8d777ae80 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.784+0000 7fbc8dffb700 1 -- 172.21.15.5:0/1786895819 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00978c0 con 0x55c8d777ae80 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1786895819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 msgr2=0x55c8d777b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d777b260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbca00976b0 tx=0x7fbca009b000 comp rx=0 tx=0).stop 2023-10-08T13:06:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1786895819 shutdown_connections 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7788a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d777b260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1786895819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d7786110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1786895819 >> 172.21.15.5:0/1786895819 conn(0x55c8d76f0260 msgr2=0x55c8d77772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1786895819 shutdown_connections 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1786895819 wait complete. 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.785+0000 7fbcb9ceeb80 1 -- start start 2023-10-08T13:06:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 Processor -- start 2023-10-08T13:06:37.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d7786070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d77833b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7783a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d76cee30 con 0x55c8d7786650 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d766b710 con 0x55c8d777b7a0 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d766b3b0 con 0x55c8d777ae80 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbcb9ceeb80 10 client.0 _ll_register_callbacks cb 0x55c8d74c8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.786+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7783a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.787+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7783a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35170/0 (socket says 172.21.15.5:35170) 2023-10-08T13:06:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.787+0000 7fbca7fff700 1 -- 172.21.15.5:0/1000680716 learned_addr learned my addr 172.21.15.5:0/1000680716 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.787+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d77833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca77fe700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d7786070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca6ffd700 1 -- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 msgr2=0x55c8d7786070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d7786070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca6ffd700 1 -- 172.21.15.5:0/1000680716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 msgr2=0x55c8d7783a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7783a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca6ffd700 1 -- 172.21.15.5:0/1000680716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca8110110 con 0x55c8d777b7a0 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.788+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d77833b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc98005d90 tx=0x7fbc98005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8956931f00548e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbc86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbc86ffd700 1 -- 172.21.15.5:0/1000680716 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98010450 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8d7696eb0 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbc86ffd700 1 -- 172.21.15.5:0/1000680716 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbc980105b0 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbc86ffd700 1 -- 172.21.15.5:0/1000680716 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc98010770 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbcb9ceeb80 10 client.25538 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c8d74e2c60 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.789+0000 7fbc86ffd700 1 -- 172.21.15.5:0/1000680716 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8d7696eb0 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbc86ffd700 1 -- 172.21.15.5:0/1000680716 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fbc9801da80 con 0x55c8d777b7a0 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbcb9ceeb80 10 client.25538 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbcb9ceeb80 10 client.25538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbcb9ceeb80 20 client.25538 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d7796040 0x55c8d7798460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbcb9ceeb80 4 client.25538 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.790+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8d76c7e10 con 0x55c8d7796040 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.791+0000 7fbca77fe700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d7796040 0x55c8d7798460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.791+0000 7fbc86ffd700 10 client.25538 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.791+0000 7fbca77fe700 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d7796040 0x55c8d7798460 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beb22d2e4ca2abbd server_cookie=6b57785fc9e36074 in_seq=0 out_seq=0 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbc86ffd700 1 -- 172.21.15.5:0/1000680716 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8d76c7e10 con 0x55c8d7796040 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbc86ffd700 10 client.25538 handle_command_reply: tid=0 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 client.25538 shutdown 2023-10-08T13:06:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 msgr2=0x55c8d77833b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d77833b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc98005d90 tx=0x7fbc98005d20 comp rx=0 tx=0).stop 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 shutdown_connections 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d7786650 0x55c8d7783a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d777ae80 0x55c8d7786070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d7796040 0x55c8d7798460 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/1000680716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777b7a0 0x55c8d77833b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbc86ffd700 0 client.25538 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 >> 172.21.15.5:0/1000680716 conn(0x55c8d76f0260 msgr2=0x55c8d7776e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 shutdown_connections 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.792+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/1000680716 wait complete. 2023-10-08T13:06:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.793+0000 7fbcb9ceeb80 20 client.25538 trim_cache size 0 max 16384 2023-10-08T13:06:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 Processor -- start 2023-10-08T13:06:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 -- start start 2023-10-08T13:06:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d7781c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d77821c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d754f920 con 0x55c8d777b7a0 2023-10-08T13:06:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7792af0 con 0x55c8d777ae80 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.816+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7771570 con 0x55c8d7786650 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d77821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d77821c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48382/0 (socket says 172.21.15.5:48382) 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca7fff700 1 -- 172.21.15.5:0/3724835882 learned_addr learned my addr 172.21.15.5:0/3724835882 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca77fe700 1 -- 172.21.15.5:0/3724835882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 msgr2=0x55c8d77821c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d77821c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d7781c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca77fe700 1 -- 172.21.15.5:0/3724835882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 msgr2=0x55c8d7781c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d7781c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca77fe700 1 -- 172.21.15.5:0/3724835882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8d779d090 con 0x55c8d777ae80 2023-10-08T13:06:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.817+0000 7fbca6ffd700 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d7781c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:06:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.818+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778d040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbca00cb990 tx=0x7fbca009b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a0809b58388c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.819+0000 7fbc8e7fc700 1 -- 172.21.15.5:0/3724835882 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca009f380 con 0x55c8d777ae80 2023-10-08T13:06:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.819+0000 7fbc8e7fc700 1 -- 172.21.15.5:0/3724835882 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbca0009b80 con 0x55c8d777ae80 2023-10-08T13:06:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.819+0000 7fbc8e7fc700 1 -- 172.21.15.5:0/3724835882 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0023360 con 0x55c8d777ae80 2023-10-08T13:06:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.820+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3724835882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 msgr2=0x55c8d778d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.820+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778d040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbca00cb990 tx=0x7fbca009b000 comp rx=0 tx=0).stop 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3724835882 shutdown_connections 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d77821c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778d040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3724835882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d7781c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3724835882 >> 172.21.15.5:0/3724835882 conn(0x55c8d76f0260 msgr2=0x55c8d777e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3724835882 shutdown_connections 2023-10-08T13:06:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3724835882 wait complete. 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.821+0000 7fbcb9ceeb80 1 -- start start 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 Processor -- start 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d778cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d778af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d778b640 con 0x55c8d777b7a0 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d778b7b0 con 0x55c8d777ae80 2023-10-08T13:06:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d778b970 con 0x55c8d7786650 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbcb9ceeb80 10 client.0 _ll_register_callbacks cb 0x7fbc9800d960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d778af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbca6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d778cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbca7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d778af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48390/0 (socket says 172.21.15.5:48390) 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbca6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d778cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35188/0 (socket says 172.21.15.5:35188) 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbca7fff700 1 -- 172.21.15.5:0/3168429171 learned_addr learned my addr 172.21.15.5:0/3168429171 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.822+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca7fff700 1 -- 172.21.15.5:0/3168429171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 msgr2=0x55c8d778ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca7fff700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca7fff700 1 -- 172.21.15.5:0/3168429171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 msgr2=0x55c8d778cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca7fff700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d778cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca7fff700 1 -- 172.21.15.5:0/3168429171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8d74f9de0 con 0x55c8d7786650 2023-10-08T13:06:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbca7fff700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d778af60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01cec0 tx=0x7fbc9c003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a1791dd7a91c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbc86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbc86ffd700 1 -- 172.21.15.5:0/3168429171 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c027070 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbc86ffd700 1 -- 172.21.15.5:0/3168429171 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbc9c004830 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.823+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8d76c7b30 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbc86ffd700 1 -- 172.21.15.5:0/3168429171 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc9c0049f0 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbcb9ceeb80 10 client.25576 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55c8d7520250 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbc86ffd700 1 -- 172.21.15.5:0/3168429171 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8d76c7b30 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbc86ffd700 1 -- 172.21.15.5:0/3168429171 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fbc9c02e6c0 con 0x55c8d7786650 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbcb9ceeb80 10 client.25576 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbcb9ceeb80 10 client.25576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbcb9ceeb80 20 client.25576 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.824+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d77eb150 0x55c8d77ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.825+0000 7fbcb9ceeb80 4 client.25576 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:06:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.825+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c8d751af70 con 0x55c8d77eb150 2023-10-08T13:06:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.825+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d77eb150 0x55c8d77ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbca77fe700 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d77eb150 0x55c8d77ed570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a043cd8c05cac00d server_cookie=e1308556ec4587a0 in_seq=0 out_seq=0 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbc86ffd700 10 client.25576 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbc86ffd700 1 -- 172.21.15.5:0/3168429171 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c8d751af70 con 0x55c8d77eb150 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbc86ffd700 10 client.25576 handle_command_reply: tid=0 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 client.25576 shutdown 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 msgr2=0x55c8d778af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d778af60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c01cec0 tx=0x7fbc9c003960 comp rx=0 tx=0).stop 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 shutdown_connections 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c8d7786650 0x55c8d778af60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c8d77eb150 0x55c8d77ed570 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c8d777ae80 0x55c8d778ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 --2- 172.21.15.5:0/3168429171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c8d777b7a0 0x55c8d778cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 >> 172.21.15.5:0/3168429171 conn(0x55c8d76f0260 msgr2=0x55c8d7776d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbc86ffd700 0 client.25576 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 shutdown_connections 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.826+0000 7fbcb9ceeb80 1 -- 172.21.15.5:0/3168429171 wait complete. 2023-10-08T13:06:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.827+0000 7fbcb9ceeb80 20 client.25576 trim_cache size 0 max 16384 2023-10-08T13:06:37.832 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2023-10-08T13:06:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc900a15e0 msgr2=0x7fbc900a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc900a15e0 0x7fbc900a3aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc98005950 tx=0x7fbc98009e40 comp rx=0 tx=0).stop 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 msgr2=0x7fbca81134c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 0x7fbca81134c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbca0006070 tx=0x7fbca0004a50 comp rx=0 tx=0).stop 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 shutdown_connections 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc900a15e0 0x7fbc900a3aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbca8105a50 0x7fbca8072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca80ff090 0x7fbca81134c0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbca0006070 tx=0x7fbca0004a50 comp rx=0 tx=0).stop 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 --2- 172.21.15.5:0/2903523669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbca8101570 0x7fbca8113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 >> 172.21.15.5:0/2903523669 conn(0x7fbca8075ae0 msgr2=0x7fbca8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 shutdown_connections 2023-10-08T13:06:37.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:37.829+0000 7fbcadb05700 1 -- 172.21.15.5:0/2903523669 wait complete. 2023-10-08T13:06:38.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:38 smithi118 ceph-mon[104234]: pgmap v319: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 MiB/s wr, 1.08k op/s 2023-10-08T13:06:38.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:38 smithi060 ceph-mon[103190]: pgmap v319: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 MiB/s wr, 1.08k op/s 2023-10-08T13:06:38.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:38 smithi005 ceph-mon[99496]: pgmap v319: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 MiB/s wr, 1.08k op/s 2023-10-08T13:06:38.852 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:06:38.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:06:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.075+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/163787505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 msgr2=0x7f6edc10ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.075+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/163787505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc10ca30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098f0 tx=0x7f6ed0009c00 comp rx=0 tx=0).stop 2023-10-08T13:06:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/163787505 shutdown_connections 2023-10-08T13:06:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/163787505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 0x7f6edc10f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/163787505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 0x7f6edc0ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/163787505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc10ca30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/163787505 >> 172.21.15.5:0/163787505 conn(0x7f6edc0fb020 msgr2=0x7f6edc0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/163787505 shutdown_connections 2023-10-08T13:06:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.077+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/163787505 wait complete. 2023-10-08T13:06:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.078+0000 7f6ee1ed7700 1 Processor -- start 2023-10-08T13:06:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.078+0000 7f6ee1ed7700 1 -- start start 2023-10-08T13:06:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6ee1ed7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 0x7f6edc1016a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6ee1ed7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc101be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6ee1ed7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 0x7f6edc102120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6ee1ed7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1a93f0 con 0x7f6edc0ffe00 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6ee1ed7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1a9530 con 0x7f6edc0ff450 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6ee1ed7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1a96c0 con 0x7f6edc10d000 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 0x7f6edc1016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 0x7f6edc1016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58380/0 (socket says 172.21.15.5:58380) 2023-10-08T13:06:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edb7fe700 1 -- 172.21.15.5:0/2719591794 learned_addr learned my addr 172.21.15.5:0/2719591794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edaffd700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 0x7f6edc102120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 -- 172.21.15.5:0/2719591794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 msgr2=0x7f6edc1016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 0x7f6edc1016a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 -- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 msgr2=0x7f6edc101be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc101be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 -- 172.21.15.5:0/2719591794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009520 con 0x7f6edc10d000 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edaffd700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.079+0000 7f6edbfff700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 0x7f6edc102120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400ef90 tx=0x7f6ed400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.080+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/2719591794 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4018070 con 0x7f6edc10d000 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.080+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc1a9940 con 0x7f6edc10d000 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.080+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/2719591794 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed400f040 con 0x7f6edc10d000 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.080+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/2719591794 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400cc30 con 0x7f6edc10d000 2023-10-08T13:06:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.080+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc1a9e20 con 0x7f6edc10d000 2023-10-08T13:06:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.086+0000 7f6eee0c0b80 1 Processor -- start 2023-10-08T13:06:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.086+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/2719591794 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f6ed4003a00 con 0x7f6edc10d000 2023-10-08T13:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.086+0000 7f6eee0c0b80 1 -- start start 2023-10-08T13:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c752e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c80190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c82ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671bde4e0 con 0x55d671c806d0 2023-10-08T13:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671bcfca0 con 0x55d671c75820 2023-10-08T13:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671bcd5c0 con 0x55d671c74f00 2023-10-08T13:06:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c752e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48408/0 (socket says 172.21.15.5:48408) 2023-10-08T13:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.087+0000 7f6edaffd700 1 -- 172.21.15.5:0/1097675718 learned_addr learned my addr 172.21.15.5:0/1097675718 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.088+0000 7f6edaffd700 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c82ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.088+0000 7f6edaffd700 1 -- 172.21.15.5:0/1097675718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 msgr2=0x55d671c80190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.088+0000 7f6edaffd700 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c80190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.088+0000 7f6edaffd700 1 -- 172.21.15.5:0/1097675718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 msgr2=0x55d671c82ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.088+0000 7f6edaffd700 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c82ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.088+0000 7f6edaffd700 1 -- 172.21.15.5:0/1097675718 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6719f3e60 con 0x55d671c74f00 2023-10-08T13:06:39.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6ed8ff9700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ec40a15e0 0x7f6ec40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6edaffd700 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c752e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed0019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d7e67521582c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ec40a15e0 0x7f6ec40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6ed8ff9700 1 -- 172.21.15.5:0/2719591794 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6ed40ccdb0 con 0x7f6edc10d000 2023-10-08T13:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6ec1ffb700 1 -- 172.21.15.5:0/1097675718 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000f670 con 0x55d671c74f00 2023-10-08T13:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6ec1ffb700 1 -- 172.21.15.5:0/1097675718 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed000f7d0 con 0x55d671c74f00 2023-10-08T13:06:39.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.089+0000 7f6ec1ffb700 1 -- 172.21.15.5:0/1097675718 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000bbc0 con 0x55d671c74f00 2023-10-08T13:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.090+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ec40a15e0 0x7f6ec40a3aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc005950 tx=0x7f6ecc0098e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.090+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1097675718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 msgr2=0x55d671c752e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.090+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c752e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed0019040 comp rx=0 tx=0).stop 2023-10-08T13:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1097675718 shutdown_connections 2023-10-08T13:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c82ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c752e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1097675718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c80190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1097675718 >> 172.21.15.5:0/1097675718 conn(0x55d671bea2e0 msgr2=0x55d671c71350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1097675718 shutdown_connections 2023-10-08T13:06:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1097675718 wait complete. 2023-10-08T13:06:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 -- start start 2023-10-08T13:06:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.092+0000 7f6eee0c0b80 1 Processor -- start 2023-10-08T13:06:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c80180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c7dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671bc8eb0 con 0x55d671c806d0 2023-10-08T13:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671b65790 con 0x55d671c75820 2023-10-08T13:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671b65430 con 0x55d671c74f00 2023-10-08T13:06:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6eee0c0b80 10 client.0 _ll_register_callbacks cb 0x55d6719c2880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:39.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58392/0 (socket says 172.21.15.5:58392) 2023-10-08T13:06:39.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6edaffd700 1 -- 172.21.15.5:0/19329957 learned_addr learned my addr 172.21.15.5:0/19329957 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.094+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6edb7fe700 1 -- 172.21.15.5:0/19329957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 msgr2=0x55d671c7d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6edb7fe700 1 -- 172.21.15.5:0/19329957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 msgr2=0x55d671c7dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c7dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6edb7fe700 1 -- 172.21.15.5:0/19329957 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed001f040 con 0x55d671c74f00 2023-10-08T13:06:39.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c80180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc011ab0 tx=0x7f6ecc009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f43bea6942565f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6ebaffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6ebaffd700 1 -- 172.21.15.5:0/19329957 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc01d8e0 con 0x55d671c74f00 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6ebaffd700 1 -- 172.21.15.5:0/19329957 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6ecc023070 con 0x55d671c74f00 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.095+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d671b90f30 con 0x55d671c74f00 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6ebaffd700 1 -- 172.21.15.5:0/19329957 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ecc01da40 con 0x55d671c74f00 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 10 client.25588 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d6719dcce0 con 0x55d671c74f00 2023-10-08T13:06:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6ebaffd700 1 -- 172.21.15.5:0/19329957 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d671b90f30 con 0x55d671c74f00 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6ebaffd700 1 -- 172.21.15.5:0/19329957 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f6ecc01a390 con 0x55d671c74f00 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 10 client.25588 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 10 client.25588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 20 client.25588 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671ca1370 0x55d671ca3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 4 client.25588 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d671bc1e90 con 0x55d671ca1370 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.096+0000 7f6edaffd700 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671ca1370 0x55d671ca3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.097+0000 7f6ebaffd700 10 client.25588 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.097+0000 7f6edaffd700 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671ca1370 0x55d671ca3790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=131cf71358cebb65 server_cookie=7aa66274187bd93b in_seq=0 out_seq=0 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.097+0000 7f6ebaffd700 1 -- 172.21.15.5:0/19329957 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d671bc1e90 con 0x55d671ca1370 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.097+0000 7f6ebaffd700 10 client.25588 handle_command_reply: tid=0 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.097+0000 7f6eee0c0b80 1 client.25588 shutdown 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 msgr2=0x55d671c80180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c80180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc011ab0 tx=0x7f6ecc009310 comp rx=0 tx=0).stop 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 shutdown_connections 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c806d0 0x55d671c7dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c74f00 0x55d671c80180 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc011ab0 tx=0x7f6ecc009310 comp rx=0 tx=0).stop 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671ca1370 0x55d671ca3790 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/19329957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 >> 172.21.15.5:0/19329957 conn(0x55d671bea2e0 msgr2=0x55d671c70f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6ebaffd700 0 client.25588 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.099+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 shutdown_connections 2023-10-08T13:06:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.100+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/19329957 wait complete. 2023-10-08T13:06:39.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.101+0000 7f6eee0c0b80 20 client.25588 trim_cache size 0 max 16384 2023-10-08T13:06:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.147+0000 7f6eee0c0b80 1 Processor -- start 2023-10-08T13:06:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.152+0000 7f6eee0c0b80 1 -- start start 2023-10-08T13:06:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c806d0 0x55d671c981d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c80130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671a499a0 con 0x55d671c7fcb0 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c75e00 con 0x55d671c75820 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671c7ea70 con 0x55d671c806d0 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c80130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c80130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35218/0 (socket says 172.21.15.5:35218) 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.153+0000 7f6edbfff700 1 -- 172.21.15.5:0/1880745778 learned_addr learned my addr 172.21.15.5:0/1880745778 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.154+0000 7f6edbfff700 1 -- 172.21.15.5:0/1880745778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c806d0 msgr2=0x55d671c981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.154+0000 7f6edbfff700 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c806d0 0x55d671c981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.154+0000 7f6edbfff700 1 -- 172.21.15.5:0/1880745778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 msgr2=0x55d671c7d440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.154+0000 7f6edbfff700 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.154+0000 7f6edbfff700 1 -- 172.21.15.5:0/1880745778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d671a1a2d0 con 0x55d671c7fcb0 2023-10-08T13:06:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.154+0000 7f6edbfff700 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c80130 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40090a0 tx=0x7f6ed4099aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368274bd037330d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.155+0000 7f6ec27fc700 1 -- 172.21.15.5:0/1880745778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed409a2a0 con 0x55d671c7fcb0 2023-10-08T13:06:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.155+0000 7f6ec27fc700 1 -- 172.21.15.5:0/1880745778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed4099ba0 con 0x55d671c7fcb0 2023-10-08T13:06:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.155+0000 7f6ec27fc700 1 -- 172.21.15.5:0/1880745778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40ca550 con 0x55d671c7fcb0 2023-10-08T13:06:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.162+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1880745778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 msgr2=0x55d671c80130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.163+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c80130 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40090a0 tx=0x7f6ed4099aa0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.163+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1880745778 shutdown_connections 2023-10-08T13:06:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.163+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c80130 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.163+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c75820 0x55d671c7d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.163+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/1880745778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c806d0 0x55d671c981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.163+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1880745778 >> 172.21.15.5:0/1880745778 conn(0x55d671bea2e0 msgr2=0x55d671c7cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.165+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1880745778 shutdown_connections 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.165+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/1880745778 wait complete. 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.165+0000 7f6eee0c0b80 1 -- start start 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 Processor -- start 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c75820 0x55d671cf0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c97310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c806d0 0x55d671c97850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671cf0ff0 con 0x55d671c7fcb0 2023-10-08T13:06:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671cf1160 con 0x55d671c806d0 2023-10-08T13:06:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d671cf1320 con 0x55d671c75820 2023-10-08T13:06:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.166+0000 7f6eee0c0b80 10 client.0 _ll_register_callbacks cb 0x7f6ecc01c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c97310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c97310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35224/0 (socket says 172.21.15.5:35224) 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 -- 172.21.15.5:0/3066933824 learned_addr learned my addr 172.21.15.5:0/3066933824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edbfff700 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c806d0 0x55d671c97850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 -- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c75820 msgr2=0x55d671cf0710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c75820 0x55d671cf0710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 -- 172.21.15.5:0/3066933824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c806d0 msgr2=0x55d671c97850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c806d0 0x55d671c97850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.167+0000 7f6edaffd700 1 -- 172.21.15.5:0/3066933824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc1a9e20 con 0x55d671c7fcb0 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.168+0000 7f6edaffd700 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c97310 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57af6bb09cd1d30f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.168+0000 7f6ebaffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.168+0000 7f6ebaffd700 1 -- 172.21.15.5:0/3066933824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed002c040 con 0x55d671c7fcb0 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.168+0000 7f6ebaffd700 1 -- 172.21.15.5:0/3066933824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6ed000b9c0 con 0x55d671c7fcb0 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ed000f7d0 con 0x55d671c7fcb0 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6ebaffd700 1 -- 172.21.15.5:0/3066933824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ed0010ed0 con 0x55d671c7fcb0 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 10 client.16020 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d6719f2330 con 0x55d671c7fcb0 2023-10-08T13:06:39.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6ebaffd700 1 -- 172.21.15.5:0/3066933824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed000f7d0 con 0x55d671c7fcb0 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6ebaffd700 1 -- 172.21.15.5:0/3066933824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f6ed0015020 con 0x55d671c7fcb0 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 10 client.16020 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 20 client.16020 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.169+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671cee250 0x55d671cee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.170+0000 7f6eee0c0b80 4 client.16020 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:06:39.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.170+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d671bc1bb0 con 0x55d671cee250 2023-10-08T13:06:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.170+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671cee250 0x55d671cee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.171+0000 7f6edb7fe700 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671cee250 0x55d671cee660 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f613b01d34d766b server_cookie=c319365ecc1f6b6d in_seq=0 out_seq=0 2023-10-08T13:06:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.171+0000 7f6ebaffd700 10 client.16020 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.171+0000 7f6ebaffd700 1 -- 172.21.15.5:0/3066933824 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d671bc1bb0 con 0x55d671cee250 2023-10-08T13:06:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.171+0000 7f6ebaffd700 10 client.16020 handle_command_reply: tid=0 2023-10-08T13:06:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.171+0000 7f6eee0c0b80 1 client.16020 shutdown 2023-10-08T13:06:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.176+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 msgr2=0x55d671c97310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.176+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c97310 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed0009c00 comp rx=0 tx=0).stop 2023-10-08T13:06:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 shutdown_connections 2023-10-08T13:06:39.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d671cee250 0x55d671cee660 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d671c806d0 0x55d671c97850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d671c75820 0x55d671cf0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6eee0c0b80 1 --2- 172.21.15.5:0/3066933824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d671c7fcb0 0x55d671c97310 secure :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed0009c00 comp rx=0 tx=0).stop 2023-10-08T13:06:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6ebaffd700 0 client.16020 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.178+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 >> 172.21.15.5:0/3066933824 conn(0x55d671bea2e0 msgr2=0x55d671c7bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.181+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 shutdown_connections 2023-10-08T13:06:39.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.183+0000 7f6eee0c0b80 1 -- 172.21.15.5:0/3066933824 wait complete. 2023-10-08T13:06:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.184+0000 7f6eee0c0b80 20 client.16020 trim_cache size 0 max 16384 2023-10-08T13:06:39.187 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:06:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2023-10-08T13:06:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:06:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2023-10-08T13:06:39.187 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:06:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ec40a15e0 msgr2=0x7f6ec40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ec40a15e0 0x7f6ec40a3aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc005950 tx=0x7f6ecc0098e0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 msgr2=0x7f6edc102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 0x7f6edc102120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400ef90 tx=0x7f6ed400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 shutdown_connections 2023-10-08T13:06:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ec40a15e0 0x7f6ec40a3aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc10d000 0x7f6edc102120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6edc0ff450 0x7f6edc1016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 --2- 172.21.15.5:0/2719591794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6edc0ffe00 0x7f6edc101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.186+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 >> 172.21.15.5:0/2719591794 conn(0x7f6edc0fb020 msgr2=0x7f6edc0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.187+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 shutdown_connections 2023-10-08T13:06:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.187+0000 7f6ee1ed7700 1 -- 172.21.15.5:0/2719591794 wait complete. 2023-10-08T13:06:39.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:06:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 -- 172.21.15.5:0/3498675975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00fff00 msgr2=0x7f07c010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 --2- 172.21.15.5:0/3498675975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00fff00 0x7f07c010c3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009fc0 tx=0x7f07b800b330 comp rx=0 tx=0).stop 2023-10-08T13:06:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 -- 172.21.15.5:0/3498675975 shutdown_connections 2023-10-08T13:06:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 --2- 172.21.15.5:0/3498675975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00fff00 0x7f07c010c3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 --2- 172.21.15.5:0/3498675975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 0x7f07c01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 --2- 172.21.15.5:0/3498675975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00ff540 0x7f07c00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 -- 172.21.15.5:0/3498675975 >> 172.21.15.5:0/3498675975 conn(0x7f07c00fafb0 msgr2=0x7f07c00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 -- 172.21.15.5:0/3498675975 shutdown_connections 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.431+0000 7f07c6c29700 1 -- 172.21.15.5:0/3498675975 wait complete. 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 Processor -- start 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 -- start start 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 0x7f07c019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00fff00 0x7f07c019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 0x7f07c0194630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0194c90 con 0x7f07c00fff00 2023-10-08T13:06:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0194e00 con 0x7f07c00ff540 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.432+0000 7f07c6c29700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0194fc0 con 0x7f07c0105600 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00fff00 0x7f07c019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 0x7f07c019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c51c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 0x7f07c0194630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 0x7f07c019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58418/0 (socket says 172.21.15.5:58418) 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00fff00 0x7f07c019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35236/0 (socket says 172.21.15.5:35236) 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c51c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 0x7f07c0194630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48440/0 (socket says 172.21.15.5:48440) 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 -- 172.21.15.5:0/2745843784 learned_addr learned my addr 172.21.15.5:0/2745843784 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 -- 172.21.15.5:0/2745843784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 msgr2=0x7f07c0194630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 0x7f07c0194630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 -- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00fff00 msgr2=0x7f07c019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00fff00 0x7f07c019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 -- 172.21.15.5:0/2745843784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009c40 con 0x7f07c00ff540 2023-10-08T13:06:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.433+0000 7f07c49c5700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 0x7f07c019a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07b400d950 tx=0x7f07b400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.434+0000 7f07bdffb700 1 -- 172.21.15.5:0/2745843784 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40098b0 con 0x7f07c00ff540 2023-10-08T13:06:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.434+0000 7f07bdffb700 1 -- 172.21.15.5:0/2745843784 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07b4010460 con 0x7f07c00ff540 2023-10-08T13:06:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.434+0000 7f07bdffb700 1 -- 172.21.15.5:0/2745843784 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400f620 con 0x7f07c00ff540 2023-10-08T13:06:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.434+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c01952a0 con 0x7f07c00ff540 2023-10-08T13:06:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.435+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c01a14f0 con 0x7f07c00ff540 2023-10-08T13:06:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.438+0000 7f07bdffb700 1 -- 172.21.15.5:0/2745843784 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f07b40108d0 con 0x7f07c00ff540 2023-10-08T13:06:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.439+0000 7f07bdffb700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07b00a1620 0x7f07b00a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.439+0000 7f07bdffb700 1 -- 172.21.15.5:0/2745843784 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f07b40ccfd0 con 0x7f07c00ff540 2023-10-08T13:06:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.439+0000 7f07bffff700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07b00a1620 0x7f07b00a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.439+0000 7f07d2e12b80 1 Processor -- start 2023-10-08T13:06:39.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 -- start start 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec3ff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec40a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec40ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec368460 con 0x5643ec3fee80 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec359c20 con 0x5643ec40a650 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec357540 con 0x5643ec3ff7a0 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07c49c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec3ff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07c49c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec3ff260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35246/0 (socket says 172.21.15.5:35246) 2023-10-08T13:06:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.440+0000 7f07c49c5700 1 -- 172.21.15.5:0/644420838 learned_addr learned my addr 172.21.15.5:0/644420838 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07c51c6700 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec40ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07bffff700 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec40a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07c49c5700 1 -- 172.21.15.5:0/644420838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 msgr2=0x5643ec40a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07c49c5700 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec40a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07c49c5700 1 -- 172.21.15.5:0/644420838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 msgr2=0x5643ec40ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07c49c5700 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec40ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.441+0000 7f07c49c5700 1 -- 172.21.15.5:0/644420838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643ec17dde0 con 0x5643ec3fee80 2023-10-08T13:06:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.442+0000 7f07bffff700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07b00a1620 0x7f07b00a3ae0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07c0195d40 tx=0x7f07ac009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.442+0000 7f07c49c5700 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec3ff260 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f07b40a1b90 tx=0x7f07b40997c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd8b0946f0173d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.443+0000 7f07aaffd700 1 -- 172.21.15.5:0/644420838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b409de80 con 0x5643ec3fee80 2023-10-08T13:06:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.443+0000 7f07aaffd700 1 -- 172.21.15.5:0/644420838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07b40a20c0 con 0x5643ec3fee80 2023-10-08T13:06:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.443+0000 7f07aaffd700 1 -- 172.21.15.5:0/644420838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4099480 con 0x5643ec3fee80 2023-10-08T13:06:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 -- 172.21.15.5:0/644420838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 msgr2=0x5643ec3ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec3ff260 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f07b40a1b90 tx=0x7f07b40997c0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 -- 172.21.15.5:0/644420838 shutdown_connections 2023-10-08T13:06:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec40ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec3ff260 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/644420838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec40a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 -- 172.21.15.5:0/644420838 >> 172.21.15.5:0/644420838 conn(0x5643ec374260 msgr2=0x5643ec3fb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.444+0000 7f07d2e12b80 1 -- 172.21.15.5:0/644420838 shutdown_connections 2023-10-08T13:06:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.445+0000 7f07d2e12b80 1 -- 172.21.15.5:0/644420838 wait complete. 2023-10-08T13:06:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.445+0000 7f07d2e12b80 1 -- start start 2023-10-08T13:06:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 Processor -- start 2023-10-08T13:06:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec3fee80 0x5643ec40a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3ff7a0 0x5643ec4073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 0x5643ec407aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec352e30 con 0x5643ec3ff7a0 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec2ef710 con 0x5643ec3fee80 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec2ef3b0 con 0x5643ec40a650 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07d2e12b80 10 client.0 _ll_register_callbacks cb 0x5643ec14c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.446+0000 7f07c51c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 0x5643ec407aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 0x5643ec407aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48458/0 (socket says 172.21.15.5:48458) 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 -- 172.21.15.5:0/794848324 learned_addr learned my addr 172.21.15.5:0/794848324 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c49c5700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec3fee80 0x5643ec40a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07bffff700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3ff7a0 0x5643ec4073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 -- 172.21.15.5:0/794848324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec3fee80 msgr2=0x5643ec40a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec3fee80 0x5643ec40a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 -- 172.21.15.5:0/794848324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3ff7a0 msgr2=0x5643ec4073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3ff7a0 0x5643ec4073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 -- 172.21.15.5:0/794848324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c01a14f0 con 0x5643ec40a650 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f07c51c6700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 0x5643ec407aa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07b8003d30 tx=0x7f07b8003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ceeb22c222dbcb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.447+0000 7f079ffff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.448+0000 7f079ffff700 1 -- 172.21.15.5:0/794848324 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800e070 con 0x5643ec40a650 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.448+0000 7f079ffff700 1 -- 172.21.15.5:0/794848324 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f07b800be00 con 0x5643ec40a650 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.448+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643ec31aeb0 con 0x5643ec40a650 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.448+0000 7f079ffff700 1 -- 172.21.15.5:0/794848324 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07b80073e0 con 0x5643ec40a650 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.448+0000 7f07d2e12b80 10 client.25600 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.448+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5643ec166c60 con 0x5643ec40a650 2023-10-08T13:06:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f079ffff700 1 -- 172.21.15.5:0/794848324 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5643ec31aeb0 con 0x5643ec40a650 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f079ffff700 1 -- 172.21.15.5:0/794848324 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f07b800b050 con 0x5643ec40a650 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f07d2e12b80 10 client.25600 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f07d2e12b80 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f07d2e12b80 20 client.25600 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec42b300 0x5643ec42d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f07d2e12b80 4 client.25600 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.449+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643ec34be10 con 0x5643ec42b300 2023-10-08T13:06:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.450+0000 7f07c49c5700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec42b300 0x5643ec42d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.450+0000 7f079ffff700 10 client.25600 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.450+0000 7f07c49c5700 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec42b300 0x5643ec42d720 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d5b25e940bfe22c server_cookie=d575529cbd33a3d4 in_seq=0 out_seq=0 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f079ffff700 1 -- 172.21.15.5:0/794848324 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5643ec34be10 con 0x5643ec42b300 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f079ffff700 10 client.25600 handle_command_reply: tid=0 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 client.25600 shutdown 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 msgr2=0x5643ec407aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 0x5643ec407aa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07b8003d30 tx=0x7f07b8003d60 comp rx=0 tx=0).stop 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 shutdown_connections 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec40a650 0x5643ec407aa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec42b300 0x5643ec42d720 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec3fee80 0x5643ec40a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/794848324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3ff7a0 0x5643ec4073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 >> 172.21.15.5:0/794848324 conn(0x5643ec374260 msgr2=0x5643ec3faec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f079ffff700 0 client.25600 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 shutdown_connections 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 1 -- 172.21.15.5:0/794848324 wait complete. 2023-10-08T13:06:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.453+0000 7f07d2e12b80 20 client.25600 trim_cache size 0 max 16384 2023-10-08T13:06:39.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 Processor -- start 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 -- start start 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec4221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec4026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec402bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec1d3920 con 0x5643ec3fee80 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec402200 con 0x5643ec40a650 2023-10-08T13:06:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.481+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec3fc080 con 0x5643ec3ff7a0 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec4026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec4026b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48462/0 (socket says 172.21.15.5:48462) 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 -- 172.21.15.5:0/325889805 learned_addr learned my addr 172.21.15.5:0/325889805 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07c49c5700 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec4221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 -- 172.21.15.5:0/325889805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 msgr2=0x5643ec402bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec402bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 -- 172.21.15.5:0/325889805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 msgr2=0x5643ec4221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec4221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 -- 172.21.15.5:0/325889805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643ec1a4250 con 0x5643ec3ff7a0 2023-10-08T13:06:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.482+0000 7f07bffff700 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec4026b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009f00 tx=0x7f07ac01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07bbce915733cb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.483+0000 7f07ab7fe700 1 -- 172.21.15.5:0/325889805 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac01cd70 con 0x5643ec3ff7a0 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.483+0000 7f07ab7fe700 1 -- 172.21.15.5:0/325889805 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07ac0044f0 con 0x5643ec3ff7a0 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.483+0000 7f07ab7fe700 1 -- 172.21.15.5:0/325889805 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac026420 con 0x5643ec3ff7a0 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 -- 172.21.15.5:0/325889805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 msgr2=0x5643ec4026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec4026b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009f00 tx=0x7f07ac01c000 comp rx=0 tx=0).stop 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 -- 172.21.15.5:0/325889805 shutdown_connections 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec402bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec4221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/325889805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec4026b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 -- 172.21.15.5:0/325889805 >> 172.21.15.5:0/325889805 conn(0x5643ec374260 msgr2=0x5643ec3fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 -- 172.21.15.5:0/325889805 shutdown_connections 2023-10-08T13:06:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 -- 172.21.15.5:0/325889805 wait complete. 2023-10-08T13:06:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.484+0000 7f07d2e12b80 1 -- start start 2023-10-08T13:06:39.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 Processor -- start 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec420640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec420b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec47b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec47b900 con 0x5643ec3fee80 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec47ba70 con 0x5643ec40a650 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ec47bc30 con 0x5643ec3ff7a0 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07d2e12b80 10 client.0 _ll_register_callbacks cb 0x7f07b8007e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07c49c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec420640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07c49c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec420640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35262/0 (socket says 172.21.15.5:35262) 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07c49c5700 1 -- 172.21.15.5:0/2806017354 learned_addr learned my addr 172.21.15.5:0/2806017354 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.485+0000 7f07c51c6700 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec47b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07c51c6700 1 -- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 msgr2=0x5643ec420b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07c51c6700 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec420b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07c51c6700 1 -- 172.21.15.5:0/2806017354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 msgr2=0x5643ec420640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07c51c6700 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec420640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07c51c6700 1 -- 172.21.15.5:0/2806017354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac017050 con 0x5643ec40a650 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07c51c6700 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec47b240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009fd0 tx=0x7f07b8007f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b927d9a9e9e9b441 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f079ffff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f079ffff700 1 -- 172.21.15.5:0/2806017354 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800e070 con 0x5643ec40a650 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07b40a20c0 con 0x5643ec40a650 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f079ffff700 1 -- 172.21.15.5:0/2806017354 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f07b80050b0 con 0x5643ec40a650 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f079ffff700 1 -- 172.21.15.5:0/2806017354 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07b8003e80 con 0x5643ec40a650 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.486+0000 7f07d2e12b80 10 client.25568 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.487+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5643ec17c2b0 con 0x5643ec40a650 2023-10-08T13:06:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.487+0000 7f079ffff700 1 -- 172.21.15.5:0/2806017354 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07b40a20c0 con 0x5643ec40a650 2023-10-08T13:06:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f079ffff700 1 -- 172.21.15.5:0/2806017354 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f07b8025670 con 0x5643ec40a650 2023-10-08T13:06:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07d2e12b80 10 client.25568 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07d2e12b80 10 client.25568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07d2e12b80 20 client.25568 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec4912e0 0x5643ec493700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07d2e12b80 4 client.25568 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5643ec34bb30 con 0x5643ec4912e0 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.488+0000 7f07c49c5700 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec4912e0 0x5643ec493700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f079ffff700 10 client.25568 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f07c49c5700 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec4912e0 0x5643ec493700 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92be4b7bcba4a7e9 server_cookie=77102f44b2dfbb52 in_seq=0 out_seq=0 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f079ffff700 1 -- 172.21.15.5:0/2806017354 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5643ec34bb30 con 0x5643ec4912e0 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f079ffff700 10 client.25568 handle_command_reply: tid=0 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f07d2e12b80 1 client.25568 shutdown 2023-10-08T13:06:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 msgr2=0x5643ec47b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.490+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec47b240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009fd0 tx=0x7f07b8007f00 comp rx=0 tx=0).stop 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.491+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 shutdown_connections 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.491+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5643ec4912e0 0x5643ec493700 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.491+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5643ec40a650 0x5643ec47b240 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.491+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5643ec3fee80 0x5643ec420640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.491+0000 7f07d2e12b80 1 --2- 172.21.15.5:0/2806017354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5643ec3ff7a0 0x5643ec420b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.491+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 >> 172.21.15.5:0/2806017354 conn(0x5643ec374260 msgr2=0x5643ec4026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.492+0000 7f079ffff700 0 client.25568 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:39.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.492+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 shutdown_connections 2023-10-08T13:06:39.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.492+0000 7f07d2e12b80 1 -- 172.21.15.5:0/2806017354 wait complete. 2023-10-08T13:06:39.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.492+0000 7f07d2e12b80 20 client.25568 trim_cache size 0 max 16384 2023-10-08T13:06:39.495 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:06:39.496 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:06:39.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07b00a1620 msgr2=0x7f07b00a3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07b00a1620 0x7f07b00a3ae0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07c0195d40 tx=0x7f07ac009310 comp rx=0 tx=0).stop 2023-10-08T13:06:39.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 msgr2=0x7f07c019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:39.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 0x7f07c019a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07b400d950 tx=0x7f07b400dc60 comp rx=0 tx=0).stop 2023-10-08T13:06:39.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 shutdown_connections 2023-10-08T13:06:39.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07b00a1620 0x7f07b00a3ae0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07c0105600 0x7f07c0194630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c00ff540 0x7f07c019a500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 --2- 172.21.15.5:0/2745843784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07c00fff00 0x7f07c019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 >> 172.21.15.5:0/2745843784 conn(0x7f07c00fafb0 msgr2=0x7f07c00fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 shutdown_connections 2023-10-08T13:06:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:06:39.493+0000 7f07c6c29700 1 -- 172.21.15.5:0/2745843784 wait complete. 2023-10-08T13:06:39.515 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:06:40.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: pgmap v320: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 73 MiB/s wr, 1.07k op/s 2023-10-08T13:06:40.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub queued for path: / 2023-10-08T13:06:40.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:06:40.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:40 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: pgmap v320: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 73 MiB/s wr, 1.07k op/s 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub queued for path: / 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:40 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: pgmap v320: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 73 MiB/s wr, 1.07k op/s 2023-10-08T13:06:40.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub queued for path: / 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:40.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:40 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:06:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 20.0 s, 3219.8 tps, lat 31.335 ms stddev 36.538 2023-10-08T13:06:42.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:42 smithi118 ceph-mon[104234]: pgmap v321: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2023-10-08T13:06:42.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:42 smithi060 ceph-mon[103190]: pgmap v321: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2023-10-08T13:06:42.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:42 smithi005 ceph-mon[99496]: pgmap v321: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 74 MiB/s wr, 1.18k op/s 2023-10-08T13:06:44.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:44 smithi118 ceph-mon[104234]: pgmap v322: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 54 MiB/s wr, 965 op/s 2023-10-08T13:06:44.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:44 smithi060 ceph-mon[103190]: pgmap v322: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 54 MiB/s wr, 965 op/s 2023-10-08T13:06:44.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:44 smithi005 ceph-mon[99496]: pgmap v322: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 54 MiB/s wr, 965 op/s 2023-10-08T13:06:46.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:46 smithi118 ceph-mon[104234]: pgmap v323: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 44 MiB/s wr, 920 op/s 2023-10-08T13:06:46.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:46 smithi060 ceph-mon[103190]: pgmap v323: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 44 MiB/s wr, 920 op/s 2023-10-08T13:06:46.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:46 smithi005 ceph-mon[99496]: pgmap v323: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 44 MiB/s wr, 920 op/s 2023-10-08T13:06:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 25.0 s, 3069.5 tps, lat 32.241 ms stddev 37.157 2023-10-08T13:06:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.917+0000 7fc751e24700 1 -- 172.21.15.5:0/3361188585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 msgr2=0x7fc74c104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.917+0000 7fc751e24700 1 --2- 172.21.15.5:0/3361188585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c104ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7400098f0 tx=0x7fc740009c00 comp rx=0 tx=0).stop 2023-10-08T13:06:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.918+0000 7fc751e24700 1 -- 172.21.15.5:0/3361188585 shutdown_connections 2023-10-08T13:06:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.918+0000 7fc751e24700 1 --2- 172.21.15.5:0/3361188585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c104ec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.918+0000 7fc751e24700 1 --2- 172.21.15.5:0/3361188585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c0ff610 0x7fc74c0ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.918+0000 7fc751e24700 1 --2- 172.21.15.5:0/3361188585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 0x7fc74c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.918+0000 7fc751e24700 1 -- 172.21.15.5:0/3361188585 >> 172.21.15.5:0/3361188585 conn(0x7fc74c0fb080 msgr2=0x7fc74c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.921+0000 7fc751e24700 1 -- 172.21.15.5:0/3361188585 shutdown_connections 2023-10-08T13:06:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.921+0000 7fc751e24700 1 -- 172.21.15.5:0/3361188585 wait complete. 2023-10-08T13:06:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.922+0000 7fc751e24700 1 Processor -- start 2023-10-08T13:06:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.922+0000 7fc751e24700 1 -- start start 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc751e24700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 0x7fc74c10bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc751e24700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c10c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc751e24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c070fe0 0x7fc74c113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc751e24700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0715b0 con 0x7fc74c0fff30 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc751e24700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c071720 con 0x7fc74c070fe0 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc751e24700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0718e0 con 0x7fc74c104a10 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 0x7fc74c10bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 0x7fc74c10bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35276/0 (socket says 172.21.15.5:35276) 2023-10-08T13:06:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74b7fe700 1 -- 172.21.15.5:0/2691798630 learned_addr learned my addr 172.21.15.5:0/2691798630 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74bfff700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c070fe0 0x7fc74c113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74affd700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c10c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74affd700 1 -- 172.21.15.5:0/2691798630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c070fe0 msgr2=0x7fc74c113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74affd700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c070fe0 0x7fc74c113c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74affd700 1 -- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 msgr2=0x7fc74c10bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74affd700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 0x7fc74c10bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74affd700 1 -- 172.21.15.5:0/2691798630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740009520 con 0x7fc74c104a10 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.923+0000 7fc74bfff700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c070fe0 0x7fc74c113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.924+0000 7fc74affd700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c10c2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00e9f0 tx=0x7fc73c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.924+0000 7fc748ff9700 1 -- 172.21.15.5:0/2691798630 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00c9c0 con 0x7fc74c104a10 2023-10-08T13:06:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.924+0000 7fc748ff9700 1 -- 172.21.15.5:0/2691798630 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc73c010430 con 0x7fc74c104a10 2023-10-08T13:06:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.924+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c071bc0 con 0x7fc74c104a10 2023-10-08T13:06:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.924+0000 7fc748ff9700 1 -- 172.21.15.5:0/2691798630 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c018680 con 0x7fc74c104a10 2023-10-08T13:06:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.924+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c1aa510 con 0x7fc74c104a10 2023-10-08T13:06:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.929+0000 7fc75e00db80 1 Processor -- start 2023-10-08T13:06:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.931+0000 7fc748ff9700 1 -- 172.21.15.5:0/2691798630 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fc73c010860 con 0x7fc74c104a10 2023-10-08T13:06:46.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.932+0000 7fc748ff9700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7340a15d0 0x7fc7340a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.932+0000 7fc748ff9700 1 -- 172.21.15.5:0/2691798630 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc73c014070 con 0x7fc74c104a10 2023-10-08T13:06:46.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 -- start start 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb20c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb1b0b0 0x55f6beb1b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea83400 con 0x55f6beb211a0 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea74bc0 con 0x55f6beb1b0b0 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc75e00db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea724e0 con 0x55f6beb20880 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc74bfff700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7340a15d0 0x7fc7340a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.934+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb20c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb20c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48490/0 (socket says 172.21.15.5:48490) 2023-10-08T13:06:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1721450240 learned_addr learned my addr 172.21.15.5:0/1721450240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74affd700 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74bfff700 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb1b0b0 0x55f6beb1b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1721450240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb1b0b0 msgr2=0x55f6beb1b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb1b0b0 0x55f6beb1b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1721450240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 msgr2=0x55f6beb1ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1721450240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6be898d80 con 0x55f6beb20880 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74affd700 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb20c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc744020610 tx=0x7fc74401a9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64af572e544d6cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.935+0000 7fc74bfff700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7340a15d0 0x7fc7340a3a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc740009fd0 tx=0x7fc74000bf50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.936+0000 7fc731ffb700 1 -- 172.21.15.5:0/1721450240 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74401f040 con 0x55f6beb20880 2023-10-08T13:06:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.936+0000 7fc731ffb700 1 -- 172.21.15.5:0/1721450240 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc744020040 con 0x55f6beb20880 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.936+0000 7fc731ffb700 1 -- 172.21.15.5:0/1721450240 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440267c0 con 0x55f6beb20880 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 -- 172.21.15.5:0/1721450240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 msgr2=0x55f6beb20c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb20c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc744020610 tx=0x7fc74401a9f0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 -- 172.21.15.5:0/1721450240 shutdown_connections 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb1b0b0 0x55f6beb1b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb20c60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1721450240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.937+0000 7fc75e00db80 1 -- 172.21.15.5:0/1721450240 >> 172.21.15.5:0/1721450240 conn(0x55f6bea8f200 msgr2=0x55f6beb15b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.938+0000 7fc75e00db80 1 -- 172.21.15.5:0/1721450240 shutdown_connections 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.938+0000 7fc75e00db80 1 -- 172.21.15.5:0/1721450240 wait complete. 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 -- start start 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 Processor -- start 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 0x55f6beb27170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb211a0 0x55f6beb24bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea6ddd0 con 0x55f6beb1b0b0 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea0a6b0 con 0x55f6beb20880 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea0a350 con 0x55f6beb211a0 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.939+0000 7fc75e00db80 10 client.0 _ll_register_callbacks cb 0x55f6be8677a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 0x55f6beb27170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 0x55f6beb27170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35290/0 (socket says 172.21.15.5:35290) 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1416142565 learned_addr learned my addr 172.21.15.5:0/1416142565 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74affd700 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb211a0 msgr2=0x55f6beb24bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb211a0 0x55f6beb24bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1416142565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 msgr2=0x55f6beb244b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb244b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 -- 172.21.15.5:0/1416142565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744020340 con 0x55f6beb1b0b0 2023-10-08T13:06:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 0x55f6beb27170 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc74401c010 tx=0x7fc7440188b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc5aebf4391e8a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.940+0000 7fc72affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.941+0000 7fc72affd700 1 -- 172.21.15.5:0/1416142565 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74401f030 con 0x55f6beb1b0b0 2023-10-08T13:06:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.941+0000 7fc72affd700 1 -- 172.21.15.5:0/1416142565 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc744026860 con 0x55f6beb1b0b0 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.941+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6bea35e50 con 0x55f6beb1b0b0 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.941+0000 7fc72affd700 1 -- 172.21.15.5:0/1416142565 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc744026a20 con 0x55f6beb1b0b0 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.941+0000 7fc75e00db80 10 client.16050 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.941+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f6be881c00 con 0x55f6beb1b0b0 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc72affd700 1 -- 172.21.15.5:0/1416142565 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f6bea35e50 con 0x55f6beb1b0b0 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc72affd700 1 -- 172.21.15.5:0/1416142565 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fc74402f420 con 0x55f6beb1b0b0 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc75e00db80 10 client.16050 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc75e00db80 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc75e00db80 20 client.16050 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb34b40 0x55f6beb36f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc75e00db80 4 client.16050 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:06:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6bea66db0 con 0x55f6beb34b40 2023-10-08T13:06:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.942+0000 7fc74affd700 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb34b40 0x55f6beb36f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.943+0000 7fc72affd700 10 client.16050 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.943+0000 7fc74affd700 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb34b40 0x55f6beb36f80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a686d1e5206e587 server_cookie=428f9afab9d246c8 in_seq=0 out_seq=0 2023-10-08T13:06:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.946+0000 7fc72affd700 1 -- 172.21.15.5:0/1416142565 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f6bea66db0 con 0x55f6beb34b40 2023-10-08T13:06:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.946+0000 7fc72affd700 10 client.16050 handle_command_reply: tid=0 2023-10-08T13:06:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.946+0000 7fc75e00db80 1 client.16050 shutdown 2023-10-08T13:06:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.948+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 msgr2=0x55f6beb27170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.948+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 0x55f6beb27170 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc74401c010 tx=0x7fc7440188b0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 shutdown_connections 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb211a0 0x55f6beb24bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb1b0b0 0x55f6beb27170 secure :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc74401c010 tx=0x7fc7440188b0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb34b40 0x55f6beb36f80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1416142565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb244b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 >> 172.21.15.5:0/1416142565 conn(0x55f6bea8f200 msgr2=0x55f6beb15010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.949+0000 7fc72affd700 0 client.16050 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.950+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 shutdown_connections 2023-10-08T13:06:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.950+0000 7fc75e00db80 1 -- 172.21.15.5:0/1416142565 wait complete. 2023-10-08T13:06:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.950+0000 7fc75e00db80 20 client.16050 trim_cache size 0 max 16384 2023-10-08T13:06:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 Processor -- start 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 -- start start 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb2bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb23d70 0x55f6beb26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6be8ee8c0 con 0x55f6beb211a0 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea66db0 con 0x55f6beb23d70 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.975+0000 7fc75e00db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6bea35e50 con 0x55f6beb20880 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35300/0 (socket says 172.21.15.5:35300) 2023-10-08T13:06:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 -- 172.21.15.5:0/1694938502 learned_addr learned my addr 172.21.15.5:0/1694938502 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74bfff700 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb23d70 0x55f6beb26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb2bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 -- 172.21.15.5:0/1694938502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 msgr2=0x55f6beb2bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb2bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 -- 172.21.15.5:0/1694938502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb23d70 msgr2=0x55f6beb26ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb23d70 0x55f6beb26ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 -- 172.21.15.5:0/1694938502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6be8bf1f0 con 0x55f6beb211a0 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74bfff700 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb23d70 0x55f6beb26ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc74affd700 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1fc90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc73c09a030 tx=0x7fc73c09e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc090c2e3bdcc322 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc7327fc700 1 -- 172.21.15.5:0/1694938502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0caea0 con 0x55f6beb211a0 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc7327fc700 1 -- 172.21.15.5:0/1694938502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc73c09a0a0 con 0x55f6beb211a0 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.976+0000 7fc7327fc700 1 -- 172.21.15.5:0/1694938502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0105a0 con 0x55f6beb211a0 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 -- 172.21.15.5:0/1694938502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 msgr2=0x55f6beb1fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1fc90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc73c09a030 tx=0x7fc73c09e040 comp rx=0 tx=0).stop 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 -- 172.21.15.5:0/1694938502 shutdown_connections 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb23d70 0x55f6beb26ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb20880 0x55f6beb2bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 --2- 172.21.15.5:0/1694938502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb1fc90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 -- 172.21.15.5:0/1694938502 >> 172.21.15.5:0/1694938502 conn(0x55f6bea8f200 msgr2=0x55f6beb1f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.977+0000 7fc75e00db80 1 -- 172.21.15.5:0/1694938502 shutdown_connections 2023-10-08T13:06:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.978+0000 7fc75e00db80 1 -- 172.21.15.5:0/1694938502 wait complete. 2023-10-08T13:06:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.978+0000 7fc75e00db80 1 -- start start 2023-10-08T13:06:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.978+0000 7fc75e00db80 1 Processor -- start 2023-10-08T13:06:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb2bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb2a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb23d70 0x55f6beb2a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6beb2ab90 con 0x55f6beb211a0 2023-10-08T13:06:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6beb2ad00 con 0x55f6beb20880 2023-10-08T13:06:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6beb2aec0 con 0x55f6beb23d70 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc75e00db80 10 client.0 _ll_register_callbacks cb 0x7fc744020560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb2a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35306/0 (socket says 172.21.15.5:35306) 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 -- 172.21.15.5:0/2895717963 learned_addr learned my addr 172.21.15.5:0/2895717963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74bfff700 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb23d70 0x55f6beb2a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 -- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb23d70 msgr2=0x55f6beb2a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb23d70 0x55f6beb2a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 -- 172.21.15.5:0/2895717963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 msgr2=0x55f6beb2bb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb2bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 -- 172.21.15.5:0/2895717963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c1aa510 con 0x55f6beb211a0 2023-10-08T13:06:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc74affd700 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb2a000 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc73c096b10 tx=0x7fc73c0a24b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101959dea05127fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.979+0000 7fc72affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc72affd700 1 -- 172.21.15.5:0/2895717963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0caea0 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc72affd700 1 -- 172.21.15.5:0/2895717963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc73c0caae0 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc744020040 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc72affd700 1 -- 172.21.15.5:0/2895717963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc73c0b8380 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 10 client.16056 fetch_fsmap learned FSMap version 33 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f6be897250 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc72affd700 1 -- 172.21.15.5:0/2895717963 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc73c0a6080 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc72affd700 1 -- 172.21.15.5:0/2895717963 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fc73c0a20c0 con 0x55f6beb211a0 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 10 client.16056 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 10 client.16056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:06:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 20 client.16056 populate_metadata read hostname 'smithi005' 2023-10-08T13:06:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb89fd0 0x55f6beb8c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:06:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 4 client.16056 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:06:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.980+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f6bea66ad0 con 0x55f6beb89fd0 2023-10-08T13:06:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.981+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb89fd0 0x55f6beb8c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:06:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.981+0000 7fc72affd700 10 client.16056 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:46.981+0000 7fc74b7fe700 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb89fd0 0x55f6beb8c3f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112876572a410d66 server_cookie=54a6bd74cb270040 in_seq=0 out_seq=0 2023-10-08T13:06:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.000+0000 7fc72affd700 1 -- 172.21.15.5:0/2895717963 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f6bea66ad0 con 0x55f6beb89fd0 2023-10-08T13:06:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.000+0000 7fc72affd700 10 client.16056 handle_command_reply: tid=0 2023-10-08T13:06:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.000+0000 7fc75e00db80 1 client.16056 shutdown 2023-10-08T13:06:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.000+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 msgr2=0x55f6beb2a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.000+0000 7fc75e00db80 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb2a000 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc73c096b10 tx=0x7fc73c0a24b0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 shutdown_connections 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f6beb23d70 0x55f6beb2a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f6beb89fd0 0x55f6beb8c3f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f6beb20880 0x55f6beb2bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc72affd700 0 client.16056 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 --2- 172.21.15.5:0/2895717963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6beb211a0 0x55f6beb2a000 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 >> 172.21.15.5:0/2895717963 conn(0x55f6bea8f200 msgr2=0x55f6beb23630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 shutdown_connections 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 1 -- 172.21.15.5:0/2895717963 wait complete. 2023-10-08T13:06:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.001+0000 7fc75e00db80 20 client.16056 trim_cache size 0 max 16384 2023-10-08T13:06:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:06:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:06:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:06:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7340a15d0 msgr2=0x7fc7340a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7340a15d0 0x7fc7340a3a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc740009fd0 tx=0x7fc74000bf50 comp rx=0 tx=0).stop 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 msgr2=0x7fc74c10c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c10c2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00e9f0 tx=0x7fc73c00ed00 comp rx=0 tx=0).stop 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 shutdown_connections 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc7340a15d0 0x7fc7340a3a90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc74c070fe0 0x7fc74c113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc74c0fff30 0x7fc74c10bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 --2- 172.21.15.5:0/2691798630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c104a10 0x7fc74c10c2b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:06:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.002+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 >> 172.21.15.5:0/2691798630 conn(0x7fc74c0fb080 msgr2=0x7fc74c1023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:06:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.004+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 shutdown_connections 2023-10-08T13:06:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:06:47.004+0000 7fc751e24700 1 -- 172.21.15.5:0/2691798630 wait complete. 2023-10-08T13:06:48.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:48 smithi118 ceph-mon[104234]: pgmap v324: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 32 MiB/s wr, 859 op/s 2023-10-08T13:06:48.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:48 smithi060 ceph-mon[103190]: pgmap v324: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 32 MiB/s wr, 859 op/s 2023-10-08T13:06:48.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:48 smithi005 ceph-mon[99496]: pgmap v324: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 32 MiB/s wr, 859 op/s 2023-10-08T13:06:50.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:50 smithi060 ceph-mon[103190]: pgmap v325: 129 pgs: 129 active+clean; 1.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 814 op/s 2023-10-08T13:06:50.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:50 smithi005 ceph-mon[99496]: pgmap v325: 129 pgs: 129 active+clean; 1.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 814 op/s 2023-10-08T13:06:50.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:50 smithi118 ceph-mon[104234]: pgmap v325: 129 pgs: 129 active+clean; 1.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 814 op/s 2023-10-08T13:06:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 30.0 s, 1761.9 tps, lat 56.940 ms stddev 71.813 2023-10-08T13:06:52.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:52 smithi060 ceph-mon[103190]: pgmap v326: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 34 MiB/s wr, 1.05k op/s 2023-10-08T13:06:52.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:52 smithi005 ceph-mon[99496]: pgmap v326: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 34 MiB/s wr, 1.05k op/s 2023-10-08T13:06:52.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:52 smithi118 ceph-mon[104234]: pgmap v326: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 34 MiB/s wr, 1.05k op/s 2023-10-08T13:06:54.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:54 smithi060 ceph-mon[103190]: pgmap v327: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 MiB/s wr, 1.07k op/s 2023-10-08T13:06:54.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:54 smithi005 ceph-mon[99496]: pgmap v327: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 MiB/s wr, 1.07k op/s 2023-10-08T13:06:54.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:54 smithi118 ceph-mon[104234]: pgmap v327: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 MiB/s wr, 1.07k op/s 2023-10-08T13:06:56.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:56 smithi060 ceph-mon[103190]: pgmap v328: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 1.12k op/s 2023-10-08T13:06:56.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:56 smithi005 ceph-mon[99496]: pgmap v328: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 1.12k op/s 2023-10-08T13:06:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 35.0 s, 1940.8 tps, lat 51.626 ms stddev 68.183 2023-10-08T13:06:56.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:56 smithi118 ceph-mon[104234]: pgmap v328: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 1.12k op/s 2023-10-08T13:06:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:06:58 smithi060 ceph-mon[103190]: pgmap v329: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 42 MiB/s wr, 1.14k op/s 2023-10-08T13:06:58.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:06:58 smithi005 ceph-mon[99496]: pgmap v329: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 42 MiB/s wr, 1.14k op/s 2023-10-08T13:06:58.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:06:58 smithi118 ceph-mon[104234]: pgmap v329: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 42 MiB/s wr, 1.14k op/s 2023-10-08T13:07:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/2249857913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf8111680 msgr2=0x7fbdf8113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/2249857913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf8111680 0x7fbdf8113a70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009990 tx=0x7fbde8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/2249857913 shutdown_connections 2023-10-08T13:07:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/2249857913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf8111680 0x7fbdf8113a70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/2249857913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdf8072b90 0x7fbdf8072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/2249857913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf80734b0 0x7fbdf8111140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/2249857913 >> 172.21.15.5:0/2249857913 conn(0x7fbdf80fc1c0 msgr2=0x7fbdf80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/2249857913 shutdown_connections 2023-10-08T13:07:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.227+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/2249857913 wait complete. 2023-10-08T13:07:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.228+0000 7fbdfd8b2700 1 Processor -- start 2023-10-08T13:07:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.228+0000 7fbdfd8b2700 1 -- start start 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.228+0000 7fbdfd8b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdf8072b90 0x7fbdf819d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.228+0000 7fbdfd8b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf80734b0 0x7fbdf819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdfd8b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 0x7fbdf81a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdfd8b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81a21c0 con 0x7fbdf80734b0 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdfd8b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81a2330 con 0x7fbdf8072b90 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdfd8b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81a24f0 con 0x7fbdf8111680 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 0x7fbdf81a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 0x7fbdf81a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48522/0 (socket says 172.21.15.5:48522) 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1528531841 learned_addr learned my addr 172.21.15.5:0/1528531841 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1528531841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdf8072b90 msgr2=0x7fbdf819d2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:07:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdf8072b90 0x7fbdf819d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf80734b0 msgr2=0x7fbdf819d830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:07:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf80734b0 0x7fbdf819d830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.229+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1528531841 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80095f0 con 0x7fbdf8111680 2023-10-08T13:07:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.230+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 0x7fbdf81a1b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbde800b5c0 tx=0x7fbde8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.230+0000 7fbdfc8b0700 1 -- 172.21.15.5:0/1528531841 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde801d070 con 0x7fbdf8111680 2023-10-08T13:07:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.230+0000 7fbdfc8b0700 1 -- 172.21.15.5:0/1528531841 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde8003e90 con 0x7fbdf8111680 2023-10-08T13:07:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.230+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf81a2770 con 0x7fbdf8111680 2023-10-08T13:07:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.230+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf8104af0 con 0x7fbdf8111680 2023-10-08T13:07:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.230+0000 7fbdfc8b0700 1 -- 172.21.15.5:0/1528531841 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8004890 con 0x7fbdf8111680 2023-10-08T13:07:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.234+0000 7fbdfc8b0700 1 -- 172.21.15.5:0/1528531841 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 23) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fbde80039d0 con 0x7fbdf8111680 2023-10-08T13:07:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.235+0000 7fbdfc8b0700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbde00a15a0 0x7fbde00a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.235+0000 7fbdfc8b0700 1 -- 172.21.15.5:0/1528531841 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbde80ce370 con 0x7fbdf8111680 2023-10-08T13:07:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.239+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbde00a15a0 0x7fbde00a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.240+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbde00a15a0 0x7fbde00a3a60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000abb0 tx=0x7fbdf0009250 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.242+0000 7fbe09a9bb80 1 Processor -- start 2023-10-08T13:07:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.242+0000 7fbe09a9bb80 1 -- start start 2023-10-08T13:07:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.242+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cecc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ced1a0 0x564233ce6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233c4f400 con 0x564233ce70b0 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233c40bc0 con 0x564233cec880 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233c3e4e0 con 0x564233ced1a0 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35324/0 (socket says 172.21.15.5:35324) 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 -- 172.21.15.5:0/667395285 learned_addr learned my addr 172.21.15.5:0/667395285 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 -- 172.21.15.5:0/667395285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ced1a0 msgr2=0x564233ce6b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ced1a0 0x564233ce6b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 -- 172.21.15.5:0/667395285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 msgr2=0x564233cecc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:07:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cecc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.243+0000 7fbdf77fe700 1 -- 172.21.15.5:0/667395285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564233a64d80 con 0x564233ce70b0 2023-10-08T13:07:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.244+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce7510 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbde8006010 tx=0x7fbde809ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851cc88634f0dcd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.244+0000 7fbdddffb700 1 -- 172.21.15.5:0/667395285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde809b160 con 0x564233ce70b0 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.244+0000 7fbdddffb700 1 -- 172.21.15.5:0/667395285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde809f2b0 con 0x564233ce70b0 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.244+0000 7fbdddffb700 1 -- 172.21.15.5:0/667395285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde809a650 con 0x564233ce70b0 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.245+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/667395285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 msgr2=0x564233ce7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.245+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce7510 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbde8006010 tx=0x7fbde809ab40 comp rx=0 tx=0).stop 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.246+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/667395285 shutdown_connections 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.246+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce7510 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.246+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.246+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/667395285 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ced1a0 0x564233ce6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.246+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/667395285 >> 172.21.15.5:0/667395285 conn(0x564233c5b200 msgr2=0x564233ce1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.247+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/667395285 shutdown_connections 2023-10-08T13:07:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.247+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/667395285 wait complete. 2023-10-08T13:07:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.248+0000 7fbe09a9bb80 1 -- start start 2023-10-08T13:07:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.248+0000 7fbe09a9bb80 1 Processor -- start 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233cf0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cec880 0x564233cf0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cf0fc0 0x564233cfc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233c39dd0 con 0x564233cec880 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233bd66b0 con 0x564233cf0fc0 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233bd6350 con 0x564233ce70b0 2023-10-08T13:07:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbe09a9bb80 10 client.0 _ll_register_callbacks cb 0x564233a337a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbdf6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233cf0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbdf6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233cf0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48532/0 (socket says 172.21.15.5:48532) 2023-10-08T13:07:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.249+0000 7fbdf6ffd700 1 -- 172.21.15.5:0/2286283628 learned_addr learned my addr 172.21.15.5:0/2286283628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.251+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cec880 0x564233cf0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.252+0000 7fbdf67fc700 1 -- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 msgr2=0x564233cf0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.252+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233cf0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.252+0000 7fbdf67fc700 1 -- 172.21.15.5:0/2286283628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cf0fc0 msgr2=0x564233cfc990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:07:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.252+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cf0fc0 0x564233cfc990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.252+0000 7fbdf67fc700 1 -- 172.21.15.5:0/2286283628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf8104af0 con 0x564233cec880 2023-10-08T13:07:00.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.255+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cec880 0x564233cf0a80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x564233ce2c70 tx=0x7fbdec00b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655dce244d9c77a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:00.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.255+0000 7fbdd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:07:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.256+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/2286283628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00be30 con 0x564233cec880 2023-10-08T13:07:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.256+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/2286283628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbdec011420 con 0x564233cec880 2023-10-08T13:07:00.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.256+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564233c01e50 con 0x564233cec880 2023-10-08T13:07:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.263+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/2286283628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdec0115e0 con 0x564233cec880 2023-10-08T13:07:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.263+0000 7fbe09a9bb80 10 client.16065 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.263+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564233a4dc00 con 0x564233cec880 2023-10-08T13:07:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/2286283628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564233c01e50 con 0x564233cec880 2023-10-08T13:07:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/2286283628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fbdec0197d0 con 0x564233cec880 2023-10-08T13:07:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbe09a9bb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:00.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbe09a9bb80 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbe09a9bb80 20 client.16065 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d00f50 0x564233d03370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbe09a9bb80 4 client.16065 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.266+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564233c32db0 con 0x564233d00f50 2023-10-08T13:07:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.268+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d00f50 0x564233d03370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.270+0000 7fbdd6ffd700 10 client.16065 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.270+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d00f50 0x564233d03370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5408dc54d3508c5e server_cookie=58aa14a829bd93c1 in_seq=0 out_seq=0 2023-10-08T13:07:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.271+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/2286283628 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564233c32db0 con 0x564233d00f50 2023-10-08T13:07:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.271+0000 7fbdd6ffd700 10 client.16065 handle_command_reply: tid=0 2023-10-08T13:07:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.271+0000 7fbe09a9bb80 1 client.16065 shutdown 2023-10-08T13:07:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.271+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cec880 msgr2=0x564233cf0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.271+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cec880 0x564233cf0a80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x564233ce2c70 tx=0x7fbdec00b3c0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 shutdown_connections 2023-10-08T13:07:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d00f50 0x564233d03370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cf0fc0 0x564233cfc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233cf0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/2286283628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cec880 0x564233cf0a80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 >> 172.21.15.5:0/2286283628 conn(0x564233c5b200 msgr2=0x564233ce1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.275+0000 7fbdd6ffd700 0 client.16065 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.285+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 shutdown_connections 2023-10-08T13:07:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.287+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/2286283628 wait complete. 2023-10-08T13:07:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.287+0000 7fbe09a9bb80 20 client.16065 trim_cache size 0 max 16384 2023-10-08T13:07:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 Processor -- start 2023-10-08T13:07:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 -- start start 2023-10-08T13:07:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233ce6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cef490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cf0fc0 0x564233cebe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233aba8c0 con 0x564233cf0fc0 2023-10-08T13:07:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233c01e50 con 0x564233cec880 2023-10-08T13:07:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.316+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233cde830 con 0x564233ce70b0 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58520/0 (socket says 172.21.15.5:58520) 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 -- 172.21.15.5:0/64617052 learned_addr learned my addr 172.21.15.5:0/64617052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 -- 172.21.15.5:0/64617052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 msgr2=0x564233ce6b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233ce6b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 -- 172.21.15.5:0/64617052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cf0fc0 msgr2=0x564233cebe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:07:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cf0fc0 0x564233cebe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.319+0000 7fbdf67fc700 1 -- 172.21.15.5:0/64617052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564233d07fa0 con 0x564233cec880 2023-10-08T13:07:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.321+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cef490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdec000c00 tx=0x7fbdec0103e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fdea5bb652ca61b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.321+0000 7fbdde7fc700 1 -- 172.21.15.5:0/64617052 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0197d0 con 0x564233cec880 2023-10-08T13:07:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.321+0000 7fbdde7fc700 1 -- 172.21.15.5:0/64617052 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdec019930 con 0x564233cec880 2023-10-08T13:07:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.321+0000 7fbdde7fc700 1 -- 172.21.15.5:0/64617052 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec010c60 con 0x564233cec880 2023-10-08T13:07:00.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/64617052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 msgr2=0x564233cef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cef490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdec000c00 tx=0x7fbdec0103e0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/64617052 shutdown_connections 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233cf0fc0 0x564233cebe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233ce70b0 0x564233ce6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/64617052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233cef490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/64617052 >> 172.21.15.5:0/64617052 conn(0x564233c5b200 msgr2=0x564233ced580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/64617052 shutdown_connections 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.322+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/64617052 wait complete. 2023-10-08T13:07:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.323+0000 7fbe09a9bb80 1 -- start start 2023-10-08T13:07:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.323+0000 7fbe09a9bb80 1 Processor -- start 2023-10-08T13:07:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.323+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.323+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233ce9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.323+0000 7fbe09a9bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 0x564233ce8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233ce8940 con 0x564233ce70b0 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233ce8ab0 con 0x564233cec880 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbe09a9bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564233ce8c70 con 0x564233cf0fc0 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbe09a9bb80 10 client.0 _ll_register_callbacks cb 0x7fbdec009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 0x564233ce8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 0x564233ce8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48544/0 (socket says 172.21.15.5:48544) 2023-10-08T13:07:00.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1326557785 learned_addr learned my addr 172.21.15.5:0/1326557785 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.324+0000 7fbdf67fc700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233ce9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1326557785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 msgr2=0x564233ce9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:00.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233ce9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1326557785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 msgr2=0x564233ce9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf77fe700 1 -- 172.21.15.5:0/1326557785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564233a4dc00 con 0x564233cf0fc0 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdf77fe700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 0x564233ce8400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbde80a2f30 tx=0x7fbde80cb800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba02f23f46f7795 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.325+0000 7fbdd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:07:00.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.326+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/1326557785 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde809b160 con 0x564233cf0fc0 2023-10-08T13:07:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.326+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/1326557785 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbde80a3460 con 0x564233cf0fc0 2023-10-08T13:07:00.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.326+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbde809f2b0 con 0x564233cf0fc0 2023-10-08T13:07:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.334+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/1326557785 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde80cbb10 con 0x564233cf0fc0 2023-10-08T13:07:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.334+0000 7fbe09a9bb80 10 client.25627 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.334+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564233a8b1f0 con 0x564233cf0fc0 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.334+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/1326557785 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde809f2b0 con 0x564233cf0fc0 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/1326557785 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fbde80b3b90 con 0x564233cf0fc0 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbe09a9bb80 10 client.25627 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbe09a9bb80 10 client.25627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbe09a9bb80 20 client.25627 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d55910 0x564233d57d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbe09a9bb80 4 client.25627 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:07:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564233c32ad0 con 0x564233d55910 2023-10-08T13:07:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.335+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d55910 0x564233d57d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.339+0000 7fbdf6ffd700 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d55910 0x564233d57d00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113d75256eb660ad server_cookie=c903ab427bb5e767 in_seq=0 out_seq=0 2023-10-08T13:07:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.340+0000 7fbdd6ffd700 10 client.25627 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbdd6ffd700 1 -- 172.21.15.5:0/1326557785 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564233c32ad0 con 0x564233d55910 2023-10-08T13:07:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbdd6ffd700 10 client.25627 handle_command_reply: tid=0 2023-10-08T13:07:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 client.25627 shutdown 2023-10-08T13:07:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 msgr2=0x564233ce8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 0x564233ce8400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbde80a2f30 tx=0x7fbde80cb800 comp rx=0 tx=0).stop 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 shutdown_connections 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564233cf0fc0 0x564233ce8400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564233ce70b0 0x564233ce9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564233d55910 0x564233d57d00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 --2- 172.21.15.5:0/1326557785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564233cec880 0x564233ce9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbdd6ffd700 0 client.25627 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.357+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 >> 172.21.15.5:0/1326557785 conn(0x564233c5b200 msgr2=0x564233cebcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 shutdown_connections 2023-10-08T13:07:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbe09a9bb80 1 -- 172.21.15.5:0/1326557785 wait complete. 2023-10-08T13:07:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbe09a9bb80 20 client.25627 trim_cache size 0 max 16384 2023-10-08T13:07:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:07:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:07:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:07:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:07:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbde00a15a0 msgr2=0x7fbde00a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbde00a15a0 0x7fbde00a3a60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000abb0 tx=0x7fbdf0009250 comp rx=0 tx=0).stop 2023-10-08T13:07:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 msgr2=0x7fbdf81a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 0x7fbdf81a1b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbde800b5c0 tx=0x7fbde8004390 comp rx=0 tx=0).stop 2023-10-08T13:07:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 shutdown_connections 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbde00a15a0 0x7fbde00a3a60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdf8111680 0x7fbdf81a1b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdf8072b90 0x7fbdf819d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 --2- 172.21.15.5:0/1528531841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbdf80734b0 0x7fbdf819d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 >> 172.21.15.5:0/1528531841 conn(0x7fbdf80fc1c0 msgr2=0x7fbdf80fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 shutdown_connections 2023-10-08T13:07:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:00.358+0000 7fbdfd8b2700 1 -- 172.21.15.5:0/1528531841 wait complete. 2023-10-08T13:07:00.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:00 smithi060 ceph-mon[103190]: pgmap v330: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 MiB/s wr, 1.12k op/s 2023-10-08T13:07:00.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:00 smithi005 ceph-mon[99496]: pgmap v330: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 MiB/s wr, 1.12k op/s 2023-10-08T13:07:00.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:00 smithi118 ceph-mon[104234]: pgmap v330: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 MiB/s wr, 1.12k op/s 2023-10-08T13:07:01.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 40.0 s, 1279.2 tps, lat 62.470 ms stddev 105.923 2023-10-08T13:07:02.172 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:07:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:07:01.882+0000 7f1c801b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:07:02.173 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:07:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:07:01.882+0000 7f1c801b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:07:02.173 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:07:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:07:01.882+0000 7f1c801b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:07:02.173 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:07:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:07:01.882+0000 7f1c801b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:07:02.173 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:07:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:07:01.882+0000 7f1c801b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:07:02.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:02 smithi060 ceph-mon[103190]: pgmap v331: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 49 MiB/s wr, 1.34k op/s 2023-10-08T13:07:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:02 smithi005 ceph-mon[99496]: pgmap v331: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 49 MiB/s wr, 1.34k op/s 2023-10-08T13:07:02.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:02 smithi118 ceph-mon[104234]: pgmap v331: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 49 MiB/s wr, 1.34k op/s 2023-10-08T13:07:04.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:04 smithi060 ceph-mon[103190]: pgmap v332: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 49 MiB/s wr, 1.58k op/s 2023-10-08T13:07:04.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:04 smithi005 ceph-mon[99496]: pgmap v332: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 49 MiB/s wr, 1.58k op/s 2023-10-08T13:07:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:04 smithi118 ceph-mon[104234]: pgmap v332: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 49 MiB/s wr, 1.58k op/s 2023-10-08T13:07:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:05 smithi060 ceph-mon[103190]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-08T13:07:05.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:05 smithi005 ceph-mon[99496]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-08T13:07:05.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:05 smithi118 ceph-mon[104234]: mgrmap e24: x(active, since 8m), standbys: z, y 2023-10-08T13:07:06.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:06 smithi060 ceph-mon[103190]: pgmap v333: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 52 MiB/s wr, 1.92k op/s 2023-10-08T13:07:06.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:06 smithi005 ceph-mon[99496]: pgmap v333: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 52 MiB/s wr, 1.92k op/s 2023-10-08T13:07:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 45.0 s, 2520.4 tps, lat 47.547 ms stddev 124.126 2023-10-08T13:07:06.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:06 smithi118 ceph-mon[104234]: pgmap v333: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 52 MiB/s wr, 1.92k op/s 2023-10-08T13:07:08.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:08 smithi060 ceph-mon[103190]: pgmap v334: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 MiB/s wr, 1.99k op/s 2023-10-08T13:07:08.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:08 smithi005 ceph-mon[99496]: pgmap v334: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 MiB/s wr, 1.99k op/s 2023-10-08T13:07:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:08 smithi118 ceph-mon[104234]: pgmap v334: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 MiB/s wr, 1.99k op/s 2023-10-08T13:07:09.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:07:09.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.753+0000 7f67eada4700 1 -- 172.21.15.5:0/2683085858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4100ff0 msgr2=0x7f67e410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.753+0000 7f67eada4700 1 --2- 172.21.15.5:0/2683085858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4100ff0 0x7f67e410d610 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0098f0 tx=0x7f67dc009c00 comp rx=0 tx=0).stop 2023-10-08T13:07:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 -- 172.21.15.5:0/2683085858 shutdown_connections 2023-10-08T13:07:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 --2- 172.21.15.5:0/2683085858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4100ff0 0x7f67e410d610 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 --2- 172.21.15.5:0/2683085858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4106750 0x7f67e4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 --2- 172.21.15.5:0/2683085858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67e4100630 0x7f67e4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 -- 172.21.15.5:0/2683085858 >> 172.21.15.5:0/2683085858 conn(0x7f67e40fc100 msgr2=0x7f67e40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 -- 172.21.15.5:0/2683085858 shutdown_connections 2023-10-08T13:07:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.754+0000 7f67eada4700 1 -- 172.21.15.5:0/2683085858 wait complete. 2023-10-08T13:07:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 Processor -- start 2023-10-08T13:07:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 -- start start 2023-10-08T13:07:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67e4100630 0x7f67e419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 0x7f67e419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4106750 0x7f67e41947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4194e30 con 0x7f67e4106750 2023-10-08T13:07:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4194fa0 con 0x7f67e4100ff0 2023-10-08T13:07:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.755+0000 7f67eada4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4195160 con 0x7f67e4100630 2023-10-08T13:07:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 0x7f67e419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 0x7f67e419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58558/0 (socket says 172.21.15.5:58558) 2023-10-08T13:07:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e9341700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4106750 0x7f67e41947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 -- 172.21.15.5:0/3505880141 learned_addr learned my addr 172.21.15.5:0/3505880141 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 -- 172.21.15.5:0/3505880141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67e4100630 msgr2=0x7f67e419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67e4100630 0x7f67e419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 -- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4106750 msgr2=0x7f67e41947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4106750 0x7f67e41947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 -- 172.21.15.5:0/3505880141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc009520 con 0x7f67e4100ff0 2023-10-08T13:07:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.756+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 0x7f67e419abd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00e5f0 tx=0x7f67cc00e900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.757+0000 7f67e1ffb700 1 -- 172.21.15.5:0/3505880141 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc004a30 con 0x7f67e4100ff0 2023-10-08T13:07:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.757+0000 7f67e1ffb700 1 -- 172.21.15.5:0/3505880141 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67cc017070 con 0x7f67e4100ff0 2023-10-08T13:07:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.757+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e4195440 con 0x7f67e4100ff0 2023-10-08T13:07:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.757+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e41a1680 con 0x7f67e4100ff0 2023-10-08T13:07:09.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.757+0000 7f67e1ffb700 1 -- 172.21.15.5:0/3505880141 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc005280 con 0x7f67e4100ff0 2023-10-08T13:07:09.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.760+0000 7f67e1ffb700 1 -- 172.21.15.5:0/3505880141 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f67cc0053e0 con 0x7f67e4100ff0 2023-10-08T13:07:09.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.761+0000 7f67e1ffb700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67d00b2700 0x7f67d00b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.761+0000 7f67e1ffb700 1 -- 172.21.15.5:0/3505880141 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f67cc0cd6f0 con 0x7f67e4100ff0 2023-10-08T13:07:09.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.762+0000 7f67f6f8db80 1 Processor -- start 2023-10-08T13:07:09.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.763+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67d00b2700 0x7f67d00b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67d00b2700 0x7f67d00b4bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f67d400dfd0 tx=0x7f67d400f040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:09.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 -- start start 2023-10-08T13:07:09.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938aee80 0x5622938af260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 0x5622938ba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938ba650 0x5622938bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562293818460 con 0x5622938ba650 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562293809c20 con 0x5622938aee80 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562293807540 con 0x5622938af7a0 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 0x5622938ba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67e9341700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938ba650 0x5622938bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 0x5622938ba110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48590/0 (socket says 172.21.15.5:48590) 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67e3fff700 1 -- 172.21.15.5:0/3299575572 learned_addr learned my addr 172.21.15.5:0/3299575572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.764+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938aee80 0x5622938af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e8b40700 1 -- 172.21.15.5:0/3299575572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 msgr2=0x5622938ba110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 0x5622938ba110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e8b40700 1 -- 172.21.15.5:0/3299575572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938ba650 msgr2=0x5622938bca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938ba650 0x5622938bca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e8b40700 1 -- 172.21.15.5:0/3299575572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56229362dde0 con 0x5622938aee80 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e9341700 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938ba650 0x5622938bca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 0x5622938ba110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:09.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938aee80 0x5622938af260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67d4018410 tx=0x7f67d4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca52bd2652b87f01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.765+0000 7f67daffd700 1 -- 172.21.15.5:0/3299575572 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d401d070 con 0x5622938aee80 2023-10-08T13:07:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.766+0000 7f67daffd700 1 -- 172.21.15.5:0/3299575572 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67d400c920 con 0x5622938aee80 2023-10-08T13:07:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.766+0000 7f67daffd700 1 -- 172.21.15.5:0/3299575572 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d400d3e0 con 0x5622938aee80 2023-10-08T13:07:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.767+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3299575572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938aee80 msgr2=0x5622938af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.767+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938aee80 0x5622938af260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67d4018410 tx=0x7f67d4011000 comp rx=0 tx=0).stop 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.768+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3299575572 shutdown_connections 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.768+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938ba650 0x5622938bca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.768+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938aee80 0x5622938af260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.768+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3299575572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938af7a0 0x5622938ba110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.768+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3299575572 >> 172.21.15.5:0/3299575572 conn(0x562293824260 msgr2=0x5622938ab2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.768+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3299575572 shutdown_connections 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.769+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3299575572 wait complete. 2023-10-08T13:07:09.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.769+0000 7f67f6f8db80 1 -- start start 2023-10-08T13:07:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.769+0000 7f67f6f8db80 1 Processor -- start 2023-10-08T13:07:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 0x5622938b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562293802e30 con 0x5622938aee80 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229379f710 con 0x5622938af7a0 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229379f3b0 con 0x5622938ba650 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67f6f8db80 10 client.0 _ll_register_callbacks cb 0x5622935fc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 0x5622938b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 0x5622938b72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58572/0 (socket says 172.21.15.5:58572) 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67e3fff700 1 -- 172.21.15.5:0/3600708198 learned_addr learned my addr 172.21.15.5:0/3600708198 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.770+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67e3fff700 1 -- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 msgr2=0x5622938b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67e3fff700 1 -- 172.21.15.5:0/3600708198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 msgr2=0x5622938b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67e3fff700 1 -- 172.21.15.5:0/3600708198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e41a1680 con 0x5622938af7a0 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 0x5622938b72d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67cc096eb0 tx=0x7f67cc099ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ceb7bc99c6beec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67c3fff700 1 -- 172.21.15.5:0/3600708198 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc09a440 con 0x5622938af7a0 2023-10-08T13:07:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622937caeb0 con 0x5622938af7a0 2023-10-08T13:07:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67c3fff700 1 -- 172.21.15.5:0/3600708198 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f67cc09e590 con 0x5622938af7a0 2023-10-08T13:07:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.771+0000 7f67c3fff700 1 -- 172.21.15.5:0/3600708198 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67cc0a27d0 con 0x5622938af7a0 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.772+0000 7f67f6f8db80 10 client.25604 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.772+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f67e410df10 con 0x5622938af7a0 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.772+0000 7f67c3fff700 1 -- 172.21.15.5:0/3600708198 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67cc081080 con 0x5622938af7a0 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.772+0000 7f67c3fff700 1 -- 172.21.15.5:0/3600708198 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f67cc09a6a0 con 0x5622938af7a0 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67f6f8db80 10 client.25604 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67f6f8db80 10 client.25604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67f6f8db80 20 client.25604 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5622938ca1f0 0x5622938cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67f6f8db80 4 client.25604 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622937fbe10 con 0x5622938ca1f0 2023-10-08T13:07:09.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5622938ca1f0 0x5622938cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.773+0000 7f67c3fff700 10 client.25604 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.774+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5622938ca1f0 0x5622938cc610 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d89ed0b1e4f2b5 server_cookie=c425aa2478f735bd in_seq=0 out_seq=0 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.774+0000 7f67c3fff700 1 -- 172.21.15.5:0/3600708198 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5622937fbe10 con 0x5622938ca1f0 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.774+0000 7f67c3fff700 10 client.25604 handle_command_reply: tid=0 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.774+0000 7f67f6f8db80 1 client.25604 shutdown 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 msgr2=0x5622938b72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 0x5622938b72d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67cc096eb0 tx=0x7f67cc099ed0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 shutdown_connections 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5622938ca1f0 0x5622938cc610 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3600708198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938af7a0 0x5622938b72d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67c3fff700 0 client.25604 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 >> 172.21.15.5:0/3600708198 conn(0x562293824260 msgr2=0x5622938aaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 shutdown_connections 2023-10-08T13:07:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3600708198 wait complete. 2023-10-08T13:07:09.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.775+0000 7f67f6f8db80 20 client.25604 trim_cache size 0 max 16384 2023-10-08T13:07:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.800+0000 7f67f6f8db80 1 Processor -- start 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.800+0000 7f67f6f8db80 1 -- start start 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562293683920 con 0x5622938aee80 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622938b7e30 con 0x5622938d11c0 2023-10-08T13:07:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622938b5820 con 0x5622938ba650 2023-10-08T13:07:09.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e9341700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48602/0 (socket says 172.21.15.5:48602) 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e3fff700 1 -- 172.21.15.5:0/75687887 learned_addr learned my addr 172.21.15.5:0/75687887 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e8b40700 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e9341700 1 -- 172.21.15.5:0/75687887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 msgr2=0x5622938c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e9341700 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e9341700 1 -- 172.21.15.5:0/75687887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 msgr2=0x5622938b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e9341700 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.801+0000 7f67e9341700 1 -- 172.21.15.5:0/75687887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4008d30 con 0x5622938d11c0 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.802+0000 7f67e9341700 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938b9ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f67dc005e90 tx=0x7f67dc00fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187fb8c07079db1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.802+0000 7f67db7fe700 1 -- 172.21.15.5:0/75687887 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00f660 con 0x5622938d11c0 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.802+0000 7f67db7fe700 1 -- 172.21.15.5:0/75687887 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67dc01d070 con 0x5622938d11c0 2023-10-08T13:07:09.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.802+0000 7f67db7fe700 1 -- 172.21.15.5:0/75687887 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0052a0 con 0x5622938d11c0 2023-10-08T13:07:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 -- 172.21.15.5:0/75687887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 msgr2=0x5622938b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938b9ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f67dc005e90 tx=0x7f67dc00fd50 comp rx=0 tx=0).stop 2023-10-08T13:07:09.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 -- 172.21.15.5:0/75687887 shutdown_connections 2023-10-08T13:07:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938b9ac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/75687887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.803+0000 7f67f6f8db80 1 -- 172.21.15.5:0/75687887 >> 172.21.15.5:0/75687887 conn(0x562293824260 msgr2=0x5622938c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.804+0000 7f67f6f8db80 1 -- 172.21.15.5:0/75687887 shutdown_connections 2023-10-08T13:07:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.804+0000 7f67f6f8db80 1 -- 172.21.15.5:0/75687887 wait complete. 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 -- start start 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 Processor -- start 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229391e070 con 0x5622938aee80 2023-10-08T13:07:09.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229391e1b0 con 0x5622938d11c0 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.805+0000 7f67f6f8db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229391e370 con 0x5622938ba650 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67f6f8db80 10 client.0 _ll_register_callbacks cb 0x7f67cc09a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58584/0 (socket says 172.21.15.5:58584) 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 -- 172.21.15.5:0/3193932985 learned_addr learned my addr 172.21.15.5:0/3193932985 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 -- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 msgr2=0x5622938bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 -- 172.21.15.5:0/3193932985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 msgr2=0x5622938bfa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938bfa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 -- 172.21.15.5:0/3193932985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc00fb10 con 0x5622938d11c0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67e9341700 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938c0490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00c010 tx=0x7f67dc00fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c57c20499a6a4cce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.806+0000 7f67c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67c3fff700 1 -- 172.21.15.5:0/3193932985 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc005040 con 0x5622938d11c0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67c3fff700 1 -- 172.21.15.5:0/3193932985 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f67dc0051a0 con 0x5622938d11c0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67d400c920 con 0x5622938d11c0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67c3fff700 1 -- 172.21.15.5:0/3193932985 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67dc005360 con 0x5622938d11c0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 10 client.25610 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562293616c60 con 0x5622938d11c0 2023-10-08T13:07:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67c3fff700 1 -- 172.21.15.5:0/3193932985 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67d400c920 con 0x5622938d11c0 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67c3fff700 1 -- 172.21.15.5:0/3193932985 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f67dc035070 con 0x5622938d11c0 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 10 client.25610 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 10 client.25610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 20 client.25610 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56229391f790 0x562293921bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 4 client.25610 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.807+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5622937fbb30 con 0x56229391f790 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.808+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56229391f790 0x562293921bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.808+0000 7f67c3fff700 10 client.25610 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.808+0000 7f67e8b40700 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56229391f790 0x562293921bb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa3621ee071f4b8 server_cookie=9a2155811c666594 in_seq=0 out_seq=0 2023-10-08T13:07:09.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67c3fff700 1 -- 172.21.15.5:0/3193932985 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5622937fbb30 con 0x56229391f790 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67c3fff700 10 client.25610 handle_command_reply: tid=0 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 client.25610 shutdown 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 msgr2=0x5622938c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938c0490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00c010 tx=0x7f67dc00fef0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 shutdown_connections 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56229391f790 0x562293921bb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622938d11c0 0x5622938c0490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5622938aee80 0x5622938bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67c3fff700 0 client.25610 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 --2- 172.21.15.5:0/3193932985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5622938ba650 0x5622938bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.809+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 >> 172.21.15.5:0/3193932985 conn(0x562293824260 msgr2=0x5622938aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.810+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 shutdown_connections 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.810+0000 7f67f6f8db80 1 -- 172.21.15.5:0/3193932985 wait complete. 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.810+0000 7f67f6f8db80 20 client.25610 trim_cache size 0 max 16384 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:07:09.814 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:07:09.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:07:09.815 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:07:09.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:07:09.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:07:09.815 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67d00b2700 msgr2=0x7f67d00b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67d00b2700 0x7f67d00b4bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f67d400dfd0 tx=0x7f67d400f040 comp rx=0 tx=0).stop 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 msgr2=0x7f67e419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 0x7f67e419abd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00e5f0 tx=0x7f67cc00e900 comp rx=0 tx=0).stop 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 shutdown_connections 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67d00b2700 0x7f67d00b4bc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e4106750 0x7f67e41947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67e4100630 0x7f67e419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 --2- 172.21.15.5:0/3505880141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67e4100ff0 0x7f67e419abd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 >> 172.21.15.5:0/3505880141 conn(0x7f67e40fc100 msgr2=0x7f67e40fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 shutdown_connections 2023-10-08T13:07:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:09.811+0000 7f67eada4700 1 -- 172.21.15.5:0/3505880141 wait complete. 2023-10-08T13:07:09.829 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:07:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:10 smithi060 ceph-mon[103190]: pgmap v335: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 MiB/s wr, 1.89k op/s 2023-10-08T13:07:10.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:10 smithi005 ceph-mon[99496]: pgmap v335: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 MiB/s wr, 1.89k op/s 2023-10-08T13:07:10.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:10 smithi118 ceph-mon[104234]: pgmap v335: 129 pgs: 129 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 MiB/s wr, 1.89k op/s 2023-10-08T13:07:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 50.0 s, 2611.3 tps, lat 38.447 ms stddev 45.889 2023-10-08T13:07:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:12 smithi060 ceph-mon[103190]: pgmap v336: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 MiB/s wr, 1.89k op/s 2023-10-08T13:07:12.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:12 smithi005 ceph-mon[99496]: pgmap v336: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 MiB/s wr, 1.89k op/s 2023-10-08T13:07:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:12 smithi118 ceph-mon[104234]: pgmap v336: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 MiB/s wr, 1.89k op/s 2023-10-08T13:07:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 -- 172.21.15.5:0/916724650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b80108410 msgr2=0x7f3b8010bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 --2- 172.21.15.5:0/916724650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b80108410 0x7f3b8010bd20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009990 tx=0x7f3b78009ca0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 -- 172.21.15.5:0/916724650 shutdown_connections 2023-10-08T13:07:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 --2- 172.21.15.5:0/916724650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 0x7f3b80113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 --2- 172.21.15.5:0/916724650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 0x7f3b80107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 --2- 172.21.15.5:0/916724650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b80108410 0x7f3b8010bd20 secure :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009990 tx=0x7f3b78009ca0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.567+0000 7f3b8574a700 1 -- 172.21.15.5:0/916724650 >> 172.21.15.5:0/916724650 conn(0x7f3b8006bc20 msgr2=0x7f3b8006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.569+0000 7f3b8574a700 1 -- 172.21.15.5:0/916724650 shutdown_connections 2023-10-08T13:07:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.569+0000 7f3b8574a700 1 -- 172.21.15.5:0/916724650 wait complete. 2023-10-08T13:07:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.570+0000 7f3b8574a700 1 Processor -- start 2023-10-08T13:07:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 -- start start 2023-10-08T13:07:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 0x7f3b801a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 0x7f3b801a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b801a17c0 0x7f3b801a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801a2240 con 0x7f3b801a17c0 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801a2380 con 0x7f3b8010c400 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.571+0000 7f3b8574a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801a2540 con 0x7f3b80107a60 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 0x7f3b801a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 0x7f3b801a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 0x7f3b801a7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48618/0 (socket says 172.21.15.5:48618) 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7effd700 1 -- 172.21.15.5:0/392137525 learned_addr learned my addr 172.21.15.5:0/392137525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b801a17c0 0x7f3b801a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/392137525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 msgr2=0x7f3b801a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 0x7f3b801a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/392137525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 msgr2=0x7f3b801a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 0x7f3b801a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/392137525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780095f0 con 0x7f3b801a17c0 2023-10-08T13:07:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 0x7f3b801a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.572+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b801a17c0 0x7f3b801a1c70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b3f0 tx=0x7f3b6800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.573+0000 7f3b77fff700 1 -- 172.21.15.5:0/392137525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68011630 con 0x7f3b801a17c0 2023-10-08T13:07:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.573+0000 7f3b77fff700 1 -- 172.21.15.5:0/392137525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b68011c50 con 0x7f3b801a17c0 2023-10-08T13:07:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.573+0000 7f3b77fff700 1 -- 172.21.15.5:0/392137525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68010cc0 con 0x7f3b801a17c0 2023-10-08T13:07:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.573+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b801ae500 con 0x7f3b801a17c0 2023-10-08T13:07:13.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.573+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b801ae990 con 0x7f3b801a17c0 2023-10-08T13:07:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.577+0000 7f3b77fff700 1 -- 172.21.15.5:0/392137525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3b68010380 con 0x7f3b801a17c0 2023-10-08T13:07:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.577+0000 7f3b77fff700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3b6c0a1660 0x7f3b6c0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.578+0000 7f3b77fff700 1 -- 172.21.15.5:0/392137525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3b680ccc20 con 0x7f3b801a17c0 2023-10-08T13:07:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.578+0000 7f3b91933b80 1 Processor -- start 2023-10-08T13:07:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 -- start start 2023-10-08T13:07:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a651950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 0x56286a655cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b7effd700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3b6c0a1660 0x7f3b6c0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a656690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a5b1400 con 0x56286a651570 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a5a2bc0 con 0x56286a656230 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b91933b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a5a04e0 con 0x56286a651e90 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 0x56286a655cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 0x56286a655cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48626/0 (socket says 172.21.15.5:48626) 2023-10-08T13:07:13.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.579+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/3837097971 learned_addr learned my addr 172.21.15.5:0/3837097971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/3837097971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 msgr2=0x56286a656690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a656690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/3837097971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 msgr2=0x56286a651950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a651950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/3837097971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286a3c6d80 con 0x56286a651e90 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7effd700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3b6c0a1660 0x7f3b6c0a3b20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3b70010350 tx=0x7f3b70009790 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 0x56286a655cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b800723e0 tx=0x7f3b78009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34602982590a803f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.580+0000 7f3b757fa700 1 -- 172.21.15.5:0/3837097971 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7801d070 con 0x56286a651e90 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.581+0000 7f3b757fa700 1 -- 172.21.15.5:0/3837097971 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7801e040 con 0x56286a651e90 2023-10-08T13:07:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.581+0000 7f3b757fa700 1 -- 172.21.15.5:0/3837097971 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780056d0 con 0x56286a651e90 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.581+0000 7f3b91933b80 1 -- 172.21.15.5:0/3837097971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 msgr2=0x56286a655cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.581+0000 7f3b91933b80 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 0x56286a655cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b800723e0 tx=0x7f3b78009ee0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- 172.21.15.5:0/3837097971 shutdown_connections 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a656690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a651950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 --2- 172.21.15.5:0/3837097971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651e90 0x56286a655cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- 172.21.15.5:0/3837097971 >> 172.21.15.5:0/3837097971 conn(0x56286a5bd200 msgr2=0x56286a643b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- 172.21.15.5:0/3837097971 shutdown_connections 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- 172.21.15.5:0/3837097971 wait complete. 2023-10-08T13:07:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- start start 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 Processor -- start 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a65da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 0x56286a65ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a59bdd0 con 0x56286a651570 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a5386b0 con 0x56286a651e90 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a538350 con 0x56286a656230 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.582+0000 7f3b91933b80 10 client.0 _ll_register_callbacks cb 0x56286a3957a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 0x56286a65ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 0x56286a65ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58612/0 (socket says 172.21.15.5:58612) 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/1780414697 learned_addr learned my addr 172.21.15.5:0/1780414697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7effd700 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a65da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 msgr2=0x56286a65b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/1780414697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 msgr2=0x56286a65da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a65da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.583+0000 7f3b7e7fc700 1 -- 172.21.15.5:0/1780414697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b80114810 con 0x56286a651e90 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.584+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 0x56286a65ade0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009330 tx=0x7f3b78005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=750740d50a477cdb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.584+0000 7f3b667fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.585+0000 7f3b667fc700 1 -- 172.21.15.5:0/1780414697 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7801d070 con 0x56286a651e90 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.585+0000 7f3b667fc700 1 -- 172.21.15.5:0/1780414697 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3b78003bd0 con 0x56286a651e90 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.585+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56286a563e50 con 0x56286a651e90 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.585+0000 7f3b667fc700 1 -- 172.21.15.5:0/1780414697 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b78003d90 con 0x56286a651e90 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 10 client.25616 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56286a3afc00 con 0x56286a651e90 2023-10-08T13:07:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b667fc700 1 -- 172.21.15.5:0/1780414697 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56286a563e50 con 0x56286a651e90 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b667fc700 1 -- 172.21.15.5:0/1780414697 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f3b7800f4d0 con 0x56286a651e90 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 10 client.25616 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 10 client.25616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 20 client.25616 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a673890 0x56286a675cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 4 client.25616 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56286a594db0 con 0x56286a673890 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.586+0000 7f3b7effd700 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a673890 0x56286a675cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.587+0000 7f3b667fc700 10 client.25616 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.587+0000 7f3b7effd700 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a673890 0x56286a675cb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f5ef657098418c1 server_cookie=24005abe968aa08 in_seq=0 out_seq=0 2023-10-08T13:07:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b667fc700 1 -- 172.21.15.5:0/1780414697 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56286a594db0 con 0x56286a673890 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b667fc700 10 client.25616 handle_command_reply: tid=0 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 client.25616 shutdown 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 msgr2=0x56286a65ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 0x56286a65ade0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009330 tx=0x7f3b78005790 comp rx=0 tx=0).stop 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 shutdown_connections 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651570 0x56286a65da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a673890 0x56286a675cb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 --2- 172.21.15.5:0/1780414697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651e90 0x56286a65ade0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b667fc700 0 client.25616 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 >> 172.21.15.5:0/1780414697 conn(0x56286a5bd200 msgr2=0x56286a656e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 shutdown_connections 2023-10-08T13:07:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 1 -- 172.21.15.5:0/1780414697 wait complete. 2023-10-08T13:07:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.588+0000 7f3b91933b80 20 client.25616 trim_cache size 0 max 16384 2023-10-08T13:07:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.615+0000 7f3b91933b80 1 Processor -- start 2023-10-08T13:07:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.615+0000 7f3b91933b80 1 -- start start 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651570 0x56286a64cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a655330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b91933b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a41c8c0 con 0x56286a651e90 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b91933b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a645100 con 0x56286a656230 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b91933b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a651d00 con 0x56286a651570 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a655330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651570 0x56286a64cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a655330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58620/0 (socket says 172.21.15.5:58620) 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651570 0x56286a64cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48640/0 (socket says 172.21.15.5:48640) 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/2601470794 learned_addr learned my addr 172.21.15.5:0/2601470794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/2601470794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651570 msgr2=0x56286a64cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651570 0x56286a64cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/2601470794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 msgr2=0x56286a65a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 -- 172.21.15.5:0/2601470794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286a3ed1f0 con 0x56286a656230 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:07:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.616+0000 7f3b7f7fe700 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a655330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b68096440 tx=0x7f3b680998d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca31733fc08264f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:13.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.618+0000 7f3b75ffb700 1 -- 172.21.15.5:0/2601470794 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b680999d0 con 0x56286a656230 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.618+0000 7f3b75ffb700 1 -- 172.21.15.5:0/2601470794 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b6809db20 con 0x56286a656230 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.618+0000 7f3b75ffb700 1 -- 172.21.15.5:0/2601470794 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68099c30 con 0x56286a656230 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 -- 172.21.15.5:0/2601470794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 msgr2=0x56286a655330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a655330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b68096440 tx=0x7f3b680998d0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 -- 172.21.15.5:0/2601470794 shutdown_connections 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a656230 0x56286a655330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a651570 0x56286a64cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2601470794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 -- 172.21.15.5:0/2601470794 >> 172.21.15.5:0/2601470794 conn(0x56286a5bd200 msgr2=0x56286a656610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 -- 172.21.15.5:0/2601470794 shutdown_connections 2023-10-08T13:07:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 -- 172.21.15.5:0/2601470794 wait complete. 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.619+0000 7f3b91933b80 1 -- start start 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 Processor -- start 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 0x56286a64d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a642860 con 0x56286a651e90 2023-10-08T13:07:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a6429a0 con 0x56286a651570 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286a642b60 con 0x56286a656230 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b91933b80 10 client.0 _ll_register_callbacks cb 0x7f3b7800bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 0x56286a64d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b7f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 0x56286a64d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58624/0 (socket says 172.21.15.5:58624) 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b7effd700 1 -- 172.21.15.5:0/2560018822 learned_addr learned my addr 172.21.15.5:0/2560018822 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.620+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35444/0 (socket says 172.21.15.5:35444) 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.621+0000 7f3b7effd700 1 -- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 msgr2=0x56286a65a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.621+0000 7f3b7effd700 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.621+0000 7f3b7effd700 1 -- 172.21.15.5:0/2560018822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 msgr2=0x56286a65a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:13.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.621+0000 7f3b7effd700 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.621+0000 7f3b7effd700 1 -- 172.21.15.5:0/2560018822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b801ae990 con 0x56286a651570 2023-10-08T13:07:13.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.622+0000 7f3b7effd700 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 0x56286a64d180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b70010aa0 tx=0x7f3b70004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37eaab46bf7b942e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:13.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.622+0000 7f3b667fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:13.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.622+0000 7f3b667fc700 1 -- 172.21.15.5:0/2560018822 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7004c070 con 0x56286a651570 2023-10-08T13:07:13.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.622+0000 7f3b667fc700 1 -- 172.21.15.5:0/2560018822 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3b70006e40 con 0x56286a651570 2023-10-08T13:07:13.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.622+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7801e040 con 0x56286a651570 2023-10-08T13:07:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b667fc700 1 -- 172.21.15.5:0/2560018822 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7000e040 con 0x56286a651570 2023-10-08T13:07:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 10 client.25622 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56286a3c5250 con 0x56286a651570 2023-10-08T13:07:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b667fc700 1 -- 172.21.15.5:0/2560018822 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7801e040 con 0x56286a651570 2023-10-08T13:07:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b667fc700 1 -- 172.21.15.5:0/2560018822 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f3b700504a0 con 0x56286a651570 2023-10-08T13:07:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 10 client.25622 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 10 client.25622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 20 client.25622 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a6c8290 0x56286a6ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 4 client.25622 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:07:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56286a594ad0 con 0x56286a6c8290 2023-10-08T13:07:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.625+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a6c8290 0x56286a6ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.626+0000 7f3b7e7fc700 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a6c8290 0x56286a6ca6b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f05e9075e3ddc server_cookie=bbbb9d9945e3e8a1 in_seq=0 out_seq=0 2023-10-08T13:07:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.626+0000 7f3b667fc700 10 client.25622 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:13.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.718+0000 7f3b667fc700 1 -- 172.21.15.5:0/2560018822 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56286a594ad0 con 0x56286a6c8290 2023-10-08T13:07:13.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.718+0000 7f3b667fc700 10 client.25622 handle_command_reply: tid=0 2023-10-08T13:07:13.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.718+0000 7f3b91933b80 1 client.25622 shutdown 2023-10-08T13:07:13.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 msgr2=0x56286a64d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 0x56286a64d180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b70010aa0 tx=0x7f3b70004ad0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 shutdown_connections 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56286a656230 0x56286a65a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56286a6c8290 0x56286a6ca6b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56286a651570 0x56286a64d180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 --2- 172.21.15.5:0/2560018822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56286a651e90 0x56286a65a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 >> 172.21.15.5:0/2560018822 conn(0x56286a5bd200 msgr2=0x56286a657e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b667fc700 0 client.25622 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 shutdown_connections 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 1 -- 172.21.15.5:0/2560018822 wait complete. 2023-10-08T13:07:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.719+0000 7f3b91933b80 20 client.25622 trim_cache size 0 max 16384 2023-10-08T13:07:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:07:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:07:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:07:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:07:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3b6c0a1660 msgr2=0x7f3b6c0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3b6c0a1660 0x7f3b6c0a3b20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3b70010350 tx=0x7f3b70009790 comp rx=0 tx=0).stop 2023-10-08T13:07:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b801a17c0 msgr2=0x7f3b801a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b801a17c0 0x7f3b801a1c70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b3f0 tx=0x7f3b6800b700 comp rx=0 tx=0).stop 2023-10-08T13:07:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 shutdown_connections 2023-10-08T13:07:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3b6c0a1660 0x7f3b6c0a3b20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b801a17c0 0x7f3b801a1c70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b80107a60 0x7f3b801a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 --2- 172.21.15.5:0/392137525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8010c400 0x7f3b801a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:13.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.723+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 >> 172.21.15.5:0/392137525 conn(0x7f3b8006bc20 msgr2=0x7f3b80070050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:13.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.727+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 shutdown_connections 2023-10-08T13:07:13.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:13.727+0000 7f3b8574a700 1 -- 172.21.15.5:0/392137525 wait complete. 2023-10-08T13:07:14.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:14 smithi060 ceph-mon[103190]: pgmap v337: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 36 MiB/s wr, 1.71k op/s 2023-10-08T13:07:14.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:14 smithi005 ceph-mon[99496]: pgmap v337: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 36 MiB/s wr, 1.71k op/s 2023-10-08T13:07:14.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:14 smithi118 ceph-mon[104234]: pgmap v337: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 36 MiB/s wr, 1.71k op/s 2023-10-08T13:07:16.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:16 smithi060 ceph-mon[103190]: pgmap v338: 129 pgs: 129 active+clean; 1.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 27 MiB/s wr, 1.27k op/s 2023-10-08T13:07:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:16 smithi005 ceph-mon[99496]: pgmap v338: 129 pgs: 129 active+clean; 1.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 27 MiB/s wr, 1.27k op/s 2023-10-08T13:07:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 55.0 s, 2833.6 tps, lat 35.422 ms stddev 39.875 2023-10-08T13:07:16.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:16 smithi118 ceph-mon[104234]: pgmap v338: 129 pgs: 129 active+clean; 1.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 27 MiB/s wr, 1.27k op/s 2023-10-08T13:07:18.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:18 smithi005 ceph-mon[99496]: pgmap v339: 129 pgs: 129 active+clean; 1.7 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 20 MiB/s wr, 863 op/s 2023-10-08T13:07:18.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:18 smithi118 ceph-mon[104234]: pgmap v339: 129 pgs: 129 active+clean; 1.7 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 20 MiB/s wr, 863 op/s 2023-10-08T13:07:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:18 smithi060 ceph-mon[103190]: pgmap v339: 129 pgs: 129 active+clean; 1.7 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 20 MiB/s wr, 863 op/s 2023-10-08T13:07:20.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:20 smithi005 ceph-mon[99496]: pgmap v340: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 16 MiB/s wr, 704 op/s 2023-10-08T13:07:20.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:20 smithi118 ceph-mon[104234]: pgmap v340: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 16 MiB/s wr, 704 op/s 2023-10-08T13:07:20.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:20 smithi060 ceph-mon[103190]: pgmap v340: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 16 MiB/s wr, 704 op/s 2023-10-08T13:07:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 60.0 s, 2510.1 tps, lat 39.411 ms stddev 44.341 2023-10-08T13:07:22.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:22 smithi118 ceph-mon[104234]: pgmap v341: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 15 MiB/s wr, 728 op/s 2023-10-08T13:07:22.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:22 smithi060 ceph-mon[103190]: pgmap v341: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 15 MiB/s wr, 728 op/s 2023-10-08T13:07:22.927 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:22 smithi005 ceph-mon[99496]: pgmap v341: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 15 MiB/s wr, 728 op/s 2023-10-08T13:07:23.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:23 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:07:23.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:23 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:07:23.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:23 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:07:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:24 smithi060 ceph-mon[103190]: pgmap v342: 129 pgs: 129 active+clean; 1.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 16 MiB/s wr, 798 op/s 2023-10-08T13:07:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:24 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:25.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:24 smithi005 ceph-mon[99496]: pgmap v342: 129 pgs: 129 active+clean; 1.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 16 MiB/s wr, 798 op/s 2023-10-08T13:07:25.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:25.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:24 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:25.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:24 smithi118 ceph-mon[104234]: pgmap v342: 129 pgs: 129 active+clean; 1.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 16 MiB/s wr, 798 op/s 2023-10-08T13:07:25.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:25.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:24 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:26.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:07:26.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:07:26.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:26.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:07:26.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:07:26.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:26.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:07:26.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:07:26.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:07:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 65.0 s, 1354.3 tps, lat 74.683 ms stddev 93.040 2023-10-08T13:07:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 -- 172.21.15.5:0/290131856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6480ff8c0 msgr2=0x7fc64810bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/290131856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6480ff8c0 0x7fc64810bbe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc64000b0a0 tx=0x7fc64000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 -- 172.21.15.5:0/290131856 shutdown_connections 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/290131856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6480ff8c0 0x7fc64810bbe0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/290131856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648103d00 0x7fc6481040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/290131856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc6480ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.925+0000 7fc64f7e9700 1 -- 172.21.15.5:0/290131856 >> 172.21.15.5:0/290131856 conn(0x7fc6480748d0 msgr2=0x7fc648074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.926+0000 7fc64f7e9700 1 -- 172.21.15.5:0/290131856 shutdown_connections 2023-10-08T13:07:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.926+0000 7fc64f7e9700 1 -- 172.21.15.5:0/290131856 wait complete. 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 Processor -- start 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 -- start start 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc64819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6480ff8c0 0x7fc64819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc648103d00 0x7fc648196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc648197100 con 0x7fc648103d00 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc648197270 con 0x7fc6480fef20 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64f7e9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc648197430 con 0x7fc6480ff8c0 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64d585700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc64819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc648103d00 0x7fc648196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64d585700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc64819c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58636/0 (socket says 172.21.15.5:58636) 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64d585700 1 -- 172.21.15.5:0/4243148006 learned_addr learned my addr 172.21.15.5:0/4243148006 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.927+0000 7fc64cd84700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6480ff8c0 0x7fc64819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.928+0000 7fc64d585700 1 -- 172.21.15.5:0/4243148006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6480ff8c0 msgr2=0x7fc64819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.928+0000 7fc64d585700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6480ff8c0 0x7fc64819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.928+0000 7fc64d585700 1 -- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc648103d00 msgr2=0x7fc648196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.928+0000 7fc64d585700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc648103d00 0x7fc648196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.928+0000 7fc64d585700 1 -- 172.21.15.5:0/4243148006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009d00 con 0x7fc6480fef20 2023-10-08T13:07:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.929+0000 7fc64d585700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc64819c910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc63800e970 tx=0x7fc63800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.930+0000 7fc63e7fc700 1 -- 172.21.15.5:0/4243148006 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638009790 con 0x7fc6480fef20 2023-10-08T13:07:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.930+0000 7fc63e7fc700 1 -- 172.21.15.5:0/4243148006 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc63800c7e0 con 0x7fc6480fef20 2023-10-08T13:07:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.930+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc648197710 con 0x7fc6480fef20 2023-10-08T13:07:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.930+0000 7fc63e7fc700 1 -- 172.21.15.5:0/4243148006 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638003c70 con 0x7fc6480fef20 2023-10-08T13:07:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.930+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc648105d90 con 0x7fc6480fef20 2023-10-08T13:07:26.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.934+0000 7fc63e7fc700 1 -- 172.21.15.5:0/4243148006 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc63800cc50 con 0x7fc6480fef20 2023-10-08T13:07:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.934+0000 7fc63e7fc700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc6340a15e0 0x7fc6340a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.935+0000 7fc65b9d2b80 1 Processor -- start 2023-10-08T13:07:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.935+0000 7fc63e7fc700 1 -- 172.21.15.5:0/4243148006 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc638014070 con 0x7fc6480fef20 2023-10-08T13:07:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.936+0000 7fc64cd84700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc6340a15e0 0x7fc6340a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 -- start start 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0741c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff073bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64cd84700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc6340a15e0 0x7fc6340a3aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc6480fc930 tx=0x7fc644009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff073c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff06a4400 con 0x55cff073c0b0 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff0695bc0 con 0x55cff0741880 2023-10-08T13:07:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff06934e0 con 0x55cff07421a0 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff073c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64d585700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0741c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff073c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35466/0 (socket says 172.21.15.5:35466) 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 -- 172.21.15.5:0/3792535570 learned_addr learned my addr 172.21.15.5:0/3792535570 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64cd84700 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff073bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 -- 172.21.15.5:0/3792535570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 msgr2=0x55cff073bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff073bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 -- 172.21.15.5:0/3792535570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 msgr2=0x55cff0741c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0741c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.937+0000 7fc64dd86700 1 -- 172.21.15.5:0/3792535570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cff04b9d80 con 0x55cff073c0b0 2023-10-08T13:07:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.938+0000 7fc64dd86700 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff073c510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc64000b0a0 tx=0x7fc640009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63523437c680408 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.938+0000 7fc6337fe700 1 -- 172.21.15.5:0/3792535570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000e040 con 0x55cff073c0b0 2023-10-08T13:07:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.938+0000 7fc6337fe700 1 -- 172.21.15.5:0/3792535570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc640007d30 con 0x55cff073c0b0 2023-10-08T13:07:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.938+0000 7fc6337fe700 1 -- 172.21.15.5:0/3792535570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640007700 con 0x55cff073c0b0 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/3792535570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 msgr2=0x55cff073c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff073c510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc64000b0a0 tx=0x7fc640009c60 comp rx=0 tx=0).stop 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/3792535570 shutdown_connections 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff073c510 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0741c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/3792535570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff073bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/3792535570 >> 172.21.15.5:0/3792535570 conn(0x55cff06b0200 msgr2=0x55cff0736b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/3792535570 shutdown_connections 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/3792535570 wait complete. 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 -- start start 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.939+0000 7fc65b9d2b80 1 Processor -- start 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff073c0b0 0x55cff07481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff07454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 0x55cff0745c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff068edd0 con 0x55cff07421a0 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff062b6b0 con 0x55cff0741880 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff062b350 con 0x55cff073c0b0 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc65b9d2b80 10 client.0 _ll_register_callbacks cb 0x55cff04887a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 0x55cff0745c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 0x55cff0745c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35472/0 (socket says 172.21.15.5:35472) 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64cd84700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff07454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 -- 172.21.15.5:0/2231574876 learned_addr learned my addr 172.21.15.5:0/2231574876 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64d585700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff073c0b0 0x55cff07481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 -- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff073c0b0 msgr2=0x55cff07481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff073c0b0 0x55cff07481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 -- 172.21.15.5:0/2231574876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 msgr2=0x55cff07454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff07454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 -- 172.21.15.5:0/2231574876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64810c4e0 con 0x55cff07421a0 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64cd84700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff07454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc64dd86700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 0x55cff0745c00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc640009cd0 tx=0x7fc6400094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241212292c84e326 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.940+0000 7fc630ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc630ff9700 1 -- 172.21.15.5:0/2231574876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000e040 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc630ff9700 1 -- 172.21.15.5:0/2231574876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc6400074a0 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cff0656e50 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc630ff9700 1 -- 172.21.15.5:0/2231574876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc640007680 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 10 client.16110 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55cff04a2c00 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc630ff9700 1 -- 172.21.15.5:0/2231574876 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cff0656e50 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc630ff9700 1 -- 172.21.15.5:0/2231574876 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fc640019030 con 0x55cff07421a0 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 10 client.16110 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 20 client.16110 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff0766840 0x55cff0768c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 4 client.16110 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.941+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cff0687db0 con 0x55cff0766840 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.942+0000 7fc64d585700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff0766840 0x55cff0768c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.942+0000 7fc64d585700 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff0766840 0x55cff0768c60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87d43205d8f19cf5 server_cookie=f95f066eb5c67b04 in_seq=0 out_seq=0 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.942+0000 7fc630ff9700 10 client.16110 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.943+0000 7fc630ff9700 1 -- 172.21.15.5:0/2231574876 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cff0687db0 con 0x55cff0766840 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.943+0000 7fc630ff9700 10 client.16110 handle_command_reply: tid=0 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.943+0000 7fc65b9d2b80 1 client.16110 shutdown 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 msgr2=0x55cff0745c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 0x55cff0745c00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc640009cd0 tx=0x7fc6400094e0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 shutdown_connections 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff07421a0 0x55cff0745c00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff073c0b0 0x55cff07481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff0766840 0x55cff0768c60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/2231574876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff07454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc630ff9700 0 client.16110 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 >> 172.21.15.5:0/2231574876 conn(0x55cff06b0200 msgr2=0x55cff0736010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 shutdown_connections 2023-10-08T13:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.944+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/2231574876 wait complete. 2023-10-08T13:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.945+0000 7fc65b9d2b80 20 client.16110 trim_cache size 0 max 16384 2023-10-08T13:07:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.982+0000 7fc65b9d2b80 1 Processor -- start 2023-10-08T13:07:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 -- start start 2023-10-08T13:07:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0747d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff0736790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff050f8c0 con 0x55cff073c0b0 2023-10-08T13:07:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff0733830 con 0x55cff0741880 2023-10-08T13:07:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.993+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff0746b10 con 0x55cff07421a0 2023-10-08T13:07:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.996+0000 7fc64cd84700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0747d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.997+0000 7fc64d585700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.997+0000 7fc64d585700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35480/0 (socket says 172.21.15.5:35480) 2023-10-08T13:07:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.997+0000 7fc64d585700 1 -- 172.21.15.5:0/167114364 learned_addr learned my addr 172.21.15.5:0/167114364 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.997+0000 7fc64dd86700 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff0736790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64dd86700 1 -- 172.21.15.5:0/167114364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 msgr2=0x55cff0747d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64dd86700 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0747d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64dd86700 1 -- 172.21.15.5:0/167114364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 msgr2=0x55cff075dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64dd86700 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64dd86700 1 -- 172.21.15.5:0/167114364 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cff04e01f0 con 0x55cff07421a0 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64cd84700 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0747d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc64dd86700 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff0736790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc640009a20 tx=0x7fc640003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de77d74221ceb569 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:26.999+0000 7fc633fff700 1 -- 172.21.15.5:0/167114364 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000e040 con 0x55cff07421a0 2023-10-08T13:07:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.001+0000 7fc633fff700 1 -- 172.21.15.5:0/167114364 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc640028070 con 0x55cff07421a0 2023-10-08T13:07:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.001+0000 7fc633fff700 1 -- 172.21.15.5:0/167114364 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64001ca30 con 0x55cff07421a0 2023-10-08T13:07:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/167114364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 msgr2=0x55cff0736790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff0736790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc640009a20 tx=0x7fc640003a00 comp rx=0 tx=0).stop 2023-10-08T13:07:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/167114364 shutdown_connections 2023-10-08T13:07:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff07421a0 0x55cff0736790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/167114364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff0741880 0x55cff0747d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/167114364 >> 172.21.15.5:0/167114364 conn(0x55cff06b0200 msgr2=0x55cff073c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/167114364 shutdown_connections 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.002+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/167114364 wait complete. 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.003+0000 7fc65b9d2b80 1 -- start start 2023-10-08T13:07:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.003+0000 7fc65b9d2b80 1 Processor -- start 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.003+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.003+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff0741880 0x55cff075bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc65b9d2b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 0x55cff075c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff075c7c0 con 0x55cff073c0b0 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff075c930 con 0x55cff07421a0 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc65b9d2b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff07b9670 con 0x55cff0741880 2023-10-08T13:07:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc65b9d2b80 10 client.0 _ll_register_callbacks cb 0x7fc638095f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 0x55cff075c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc64dd86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 0x55cff075c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58664/0 (socket says 172.21.15.5:58664) 2023-10-08T13:07:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc64dd86700 1 -- 172.21.15.5:0/162374360 learned_addr learned my addr 172.21.15.5:0/162374360 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc64cd84700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff0741880 0x55cff075bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.004+0000 7fc64d585700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc64dd86700 1 -- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff0741880 msgr2=0x55cff075bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc64dd86700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff0741880 0x55cff075bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc64dd86700 1 -- 172.21.15.5:0/162374360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 msgr2=0x55cff075ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc64dd86700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc64dd86700 1 -- 172.21.15.5:0/162374360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cff04a2c00 con 0x55cff07421a0 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc64dd86700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 0x55cff075c0f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc640002230 tx=0x7fc640009410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695633ce8f6f597c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.005+0000 7fc630ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.006+0000 7fc630ff9700 1 -- 172.21.15.5:0/162374360 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000e040 con 0x55cff07421a0 2023-10-08T13:07:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.006+0000 7fc630ff9700 1 -- 172.21.15.5:0/162374360 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc6400076b0 con 0x55cff07421a0 2023-10-08T13:07:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.006+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc640007d30 con 0x55cff07421a0 2023-10-08T13:07:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.007+0000 7fc630ff9700 1 -- 172.21.15.5:0/162374360 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc640007890 con 0x55cff07421a0 2023-10-08T13:07:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.008+0000 7fc65b9d2b80 10 client.25637 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.008+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55cff04b8250 con 0x55cff07421a0 2023-10-08T13:07:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.008+0000 7fc630ff9700 1 -- 172.21.15.5:0/162374360 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc640007d30 con 0x55cff07421a0 2023-10-08T13:07:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc630ff9700 1 -- 172.21.15.5:0/162374360 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fc64000b0d0 con 0x55cff07421a0 2023-10-08T13:07:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc65b9d2b80 10 client.25637 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc65b9d2b80 10 client.25637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc65b9d2b80 20 client.25637 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff07ba930 0x55cff07bcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc65b9d2b80 4 client.25637 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:07:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.010+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cff0687ad0 con 0x55cff07ba930 2023-10-08T13:07:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.011+0000 7fc64d585700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff07ba930 0x55cff07bcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.011+0000 7fc630ff9700 10 client.25637 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.011+0000 7fc64d585700 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff07ba930 0x55cff07bcd50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8d83ebc96dbe7d server_cookie=43975a307ce82f73 in_seq=0 out_seq=0 2023-10-08T13:07:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc630ff9700 1 -- 172.21.15.5:0/162374360 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cff0687ad0 con 0x55cff07ba930 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc630ff9700 10 client.25637 handle_command_reply: tid=0 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 client.25637 shutdown 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 msgr2=0x55cff075c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 0x55cff075c0f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc640002230 tx=0x7fc640009410 comp rx=0 tx=0).stop 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 shutdown_connections 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55cff07ba930 0x55cff07bcd50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cff07421a0 0x55cff075c0f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cff073c0b0 0x55cff075ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc630ff9700 0 client.25637 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 --2- 172.21.15.5:0/162374360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cff0741880 0x55cff075bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 >> 172.21.15.5:0/162374360 conn(0x55cff06b0200 msgr2=0x55cff0743d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 shutdown_connections 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 1 -- 172.21.15.5:0/162374360 wait complete. 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.041+0000 7fc65b9d2b80 20 client.25637 trim_cache size 0 max 16384 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:07:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:07:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc6340a15e0 msgr2=0x7fc6340a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc6340a15e0 0x7fc6340a3aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc6480fc930 tx=0x7fc644009260 comp rx=0 tx=0).stop 2023-10-08T13:07:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 msgr2=0x7fc64819c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc64819c910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc63800e970 tx=0x7fc63800ec80 comp rx=0 tx=0).stop 2023-10-08T13:07:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 shutdown_connections 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc6340a15e0 0x7fc6340a3aa0 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc6480fc930 tx=0x7fc644009260 comp rx=0 tx=0).stop 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc648103d00 0x7fc648196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6480fef20 0x7fc64819c910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 --2- 172.21.15.5:0/4243148006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6480ff8c0 0x7fc64819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 >> 172.21.15.5:0/4243148006 conn(0x7fc6480748d0 msgr2=0x7fc6480fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 shutdown_connections 2023-10-08T13:07:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:27.043+0000 7fc64f7e9700 1 -- 172.21.15.5:0/4243148006 wait complete. 2023-10-08T13:07:27.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:26 smithi060 ceph-mon[103190]: pgmap v343: 129 pgs: 129 active+clean; 1.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 16 MiB/s wr, 871 op/s 2023-10-08T13:07:27.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:26 smithi005 ceph-mon[99496]: pgmap v343: 129 pgs: 129 active+clean; 1.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 16 MiB/s wr, 871 op/s 2023-10-08T13:07:27.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:26 smithi118 ceph-mon[104234]: pgmap v343: 129 pgs: 129 active+clean; 1.8 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 16 MiB/s wr, 871 op/s 2023-10-08T13:07:29.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:28 smithi060 ceph-mon[103190]: pgmap v344: 129 pgs: 129 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 19 MiB/s wr, 930 op/s 2023-10-08T13:07:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:28 smithi005 ceph-mon[99496]: pgmap v344: 129 pgs: 129 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 19 MiB/s wr, 930 op/s 2023-10-08T13:07:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:28 smithi118 ceph-mon[104234]: pgmap v344: 129 pgs: 129 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 19 MiB/s wr, 930 op/s 2023-10-08T13:07:31.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:30 smithi060 ceph-mon[103190]: pgmap v345: 129 pgs: 129 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 19 MiB/s wr, 942 op/s 2023-10-08T13:07:31.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:30 smithi005 ceph-mon[99496]: pgmap v345: 129 pgs: 129 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 19 MiB/s wr, 942 op/s 2023-10-08T13:07:31.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:30 smithi118 ceph-mon[104234]: pgmap v345: 129 pgs: 129 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 19 MiB/s wr, 942 op/s 2023-10-08T13:07:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 70.0 s, 2137.2 tps, lat 46.568 ms stddev 54.824 2023-10-08T13:07:33.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:32 smithi060 ceph-mon[103190]: pgmap v346: 129 pgs: 129 active+clean; 1.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 990 op/s 2023-10-08T13:07:33.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:32 smithi005 ceph-mon[99496]: pgmap v346: 129 pgs: 129 active+clean; 1.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 990 op/s 2023-10-08T13:07:33.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:32 smithi118 ceph-mon[104234]: pgmap v346: 129 pgs: 129 active+clean; 1.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 990 op/s 2023-10-08T13:07:35.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:34 smithi060 ceph-mon[103190]: pgmap v347: 129 pgs: 129 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 21 MiB/s wr, 1.03k op/s 2023-10-08T13:07:35.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:34 smithi005 ceph-mon[99496]: pgmap v347: 129 pgs: 129 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 21 MiB/s wr, 1.03k op/s 2023-10-08T13:07:35.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:34 smithi118 ceph-mon[104234]: pgmap v347: 129 pgs: 129 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 21 MiB/s wr, 1.03k op/s 2023-10-08T13:07:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 75.0 s, 1831.7 tps, lat 54.507 ms stddev 61.532 2023-10-08T13:07:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:36 smithi118 ceph-mon[104234]: pgmap v348: 129 pgs: 129 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 21 MiB/s wr, 984 op/s 2023-10-08T13:07:37.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:36 smithi060 ceph-mon[103190]: pgmap v348: 129 pgs: 129 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 21 MiB/s wr, 984 op/s 2023-10-08T13:07:37.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:36 smithi005 ceph-mon[99496]: pgmap v348: 129 pgs: 129 active+clean; 2.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 21 MiB/s wr, 984 op/s 2023-10-08T13:07:39.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:38 smithi118 ceph-mon[104234]: pgmap v349: 129 pgs: 129 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 21 MiB/s wr, 911 op/s 2023-10-08T13:07:39.411 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:38 smithi060 ceph-mon[103190]: pgmap v349: 129 pgs: 129 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 21 MiB/s wr, 911 op/s 2023-10-08T13:07:39.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:38 smithi005 ceph-mon[99496]: pgmap v349: 129 pgs: 129 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 21 MiB/s wr, 911 op/s 2023-10-08T13:07:39.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:07:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 -- 172.21.15.5:0/785964239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 msgr2=0x7f0ee8101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 --2- 172.21.15.5:0/785964239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee8101c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009990 tx=0x7f0ee4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 -- 172.21.15.5:0/785964239 shutdown_connections 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 --2- 172.21.15.5:0/785964239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 0x7f0ee810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 --2- 172.21.15.5:0/785964239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee8101c90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 --2- 172.21.15.5:0/785964239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 0x7f0ee810a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 -- 172.21.15.5:0/785964239 >> 172.21.15.5:0/785964239 conn(0x7f0ee80fafb0 msgr2=0x7f0ee80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 -- 172.21.15.5:0/785964239 shutdown_connections 2023-10-08T13:07:40.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.081+0000 7f0eef838700 1 -- 172.21.15.5:0/785964239 wait complete. 2023-10-08T13:07:40.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 Processor -- start 2023-10-08T13:07:40.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 -- start start 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 0x7f0ee819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 0x7f0ee8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8196fe0 con 0x7f0ee81018b0 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8197150 con 0x7f0ee81021d0 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eef838700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8197310 con 0x7f0ee810ac80 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35496/0 (socket says 172.21.15.5:35496) 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.082+0000 7f0eed5d4700 1 -- 172.21.15.5:0/2621003613 learned_addr learned my addr 172.21.15.5:0/2621003613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 0x7f0ee8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 0x7f0ee819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eeddd5700 1 -- 172.21.15.5:0/2621003613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 msgr2=0x7f0ee819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 0x7f0ee819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eeddd5700 1 -- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 msgr2=0x7f0ee819c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee819c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eeddd5700 1 -- 172.21.15.5:0/2621003613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40095f0 con 0x7f0ee810ac80 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.083+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 0x7f0ee819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:40.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.084+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 0x7f0ee8196980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800e970 tx=0x7f0ed800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.084+0000 7f0ede7fc700 1 -- 172.21.15.5:0/2621003613 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8004220 con 0x7f0ee810ac80 2023-10-08T13:07:40.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.084+0000 7f0ede7fc700 1 -- 172.21.15.5:0/2621003613 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed8004cf0 con 0x7f0ee810ac80 2023-10-08T13:07:40.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.084+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee81975f0 con 0x7f0ee810ac80 2023-10-08T13:07:40.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.084+0000 7f0ede7fc700 1 -- 172.21.15.5:0/2621003613 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8005660 con 0x7f0ee810ac80 2023-10-08T13:07:40.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.084+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee81a3840 con 0x7f0ee810ac80 2023-10-08T13:07:40.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.087+0000 7f0ede7fc700 1 -- 172.21.15.5:0/2621003613 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0ed8004750 con 0x7f0ee810ac80 2023-10-08T13:07:40.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.088+0000 7f0ede7fc700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0ed40a15f0 0x7f0ed40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.088+0000 7f0ede7fc700 1 -- 172.21.15.5:0/2621003613 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0ed8014070 con 0x7f0ee810ac80 2023-10-08T13:07:40.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.088+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0ed40a15f0 0x7f0ed40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0ed40a15f0 0x7f0ed40a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4006010 tx=0x7f0ee400b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 Processor -- start 2023-10-08T13:07:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 -- start start 2023-10-08T13:07:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cf1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9cfc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9cfea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9c5a460 con 0x564db9cfc650 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9c4bc20 con 0x564db9cf17a0 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0efba21b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9c49540 con 0x564db9cf0e80 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.089+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cf1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cf1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48708/0 (socket says 172.21.15.5:48708) 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eed5d4700 1 -- 172.21.15.5:0/187654642 learned_addr learned my addr 172.21.15.5:0/187654642 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9cfc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9cfea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 -- 172.21.15.5:0/187654642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 msgr2=0x564db9cf1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cf1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 -- 172.21.15.5:0/187654642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 msgr2=0x564db9cfea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9cfea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 -- 172.21.15.5:0/187654642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db9a6fde0 con 0x564db9cf17a0 2023-10-08T13:07:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9cfc110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00093d0 tx=0x7f0ee0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4956e834ac25500 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0ed37fe700 1 -- 172.21.15.5:0/187654642 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000e9c0 con 0x564db9cf17a0 2023-10-08T13:07:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0ed37fe700 1 -- 172.21.15.5:0/187654642 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ee000f040 con 0x564db9cf17a0 2023-10-08T13:07:40.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.090+0000 7f0ed37fe700 1 -- 172.21.15.5:0/187654642 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0015ea0 con 0x564db9cf17a0 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 -- 172.21.15.5:0/187654642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 msgr2=0x564db9cfc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9cfc110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00093d0 tx=0x7f0ee0009920 comp rx=0 tx=0).stop 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 -- 172.21.15.5:0/187654642 shutdown_connections 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9cfea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cf1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 --2- 172.21.15.5:0/187654642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9cfc110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 -- 172.21.15.5:0/187654642 >> 172.21.15.5:0/187654642 conn(0x564db9c66260 msgr2=0x564db9ced2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 -- 172.21.15.5:0/187654642 shutdown_connections 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.091+0000 7f0efba21b80 1 -- 172.21.15.5:0/187654642 wait complete. 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.092+0000 7f0efba21b80 1 -- start start 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.092+0000 7f0efba21b80 1 Processor -- start 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cfbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf17a0 0x564db9cf93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cfc650 0x564db9cf9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9c44e30 con 0x564db9cf17a0 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9be1710 con 0x564db9cfc650 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9be13b0 con 0x564db9cf0e80 2023-10-08T13:07:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0efba21b80 10 client.0 _ll_register_callbacks cb 0x564db9a3e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eecdd3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf17a0 0x564db9cf93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cfbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cfbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48714/0 (socket says 172.21.15.5:48714) 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eecdd3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf17a0 0x564db9cf93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35512/0 (socket says 172.21.15.5:35512) 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cfc650 0x564db9cf9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eed5d4700 1 -- 172.21.15.5:0/4033483790 learned_addr learned my addr 172.21.15.5:0/4033483790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 -- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 msgr2=0x564db9cfbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cfbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 -- 172.21.15.5:0/4033483790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf17a0 msgr2=0x564db9cf93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf17a0 0x564db9cf93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 -- 172.21.15.5:0/4033483790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee00090b0 con 0x564db9cfc650 2023-10-08T13:07:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cfbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cfc650 0x564db9cf9940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80ca560 tx=0x7f0ed809a4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f704c27956e83323 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0ed0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.093+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/4033483790 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed809a250 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/4033483790 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0ed8099df0 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564db9c0ceb0 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/4033483790 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed809df40 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 10 client.25649 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564db9a58c60 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/4033483790 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564db9c0ceb0 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/4033483790 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f0ed80adcf0 con 0x564db9cfc650 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 10 client.25649 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 10 client.25649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 20 client.25649 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d14a20 0x564db9d16e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 4 client.25649 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564db9c3de10 con 0x564db9d14a20 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.094+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d14a20 0x564db9d16e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.095+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d14a20 0x564db9d16e40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9186dda61494b4d server_cookie=1911641ca54222c0 in_seq=0 out_seq=0 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.095+0000 7f0ed0ff9700 10 client.25649 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.095+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/4033483790 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564db9c3de10 con 0x564db9d14a20 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.095+0000 7f0ed0ff9700 10 client.25649 handle_command_reply: tid=0 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 client.25649 shutdown 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cfc650 msgr2=0x564db9cf9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cfc650 0x564db9cf9940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80ca560 tx=0x7f0ed809a4f0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 shutdown_connections 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d14a20 0x564db9d16e40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cfc650 0x564db9cf9940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf0e80 0x564db9cfbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 --2- 172.21.15.5:0/4033483790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf17a0 0x564db9cf93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0ed0ff9700 0 client.25649 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 >> 172.21.15.5:0/4033483790 conn(0x564db9c66260 msgr2=0x564db9cecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 shutdown_connections 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 1 -- 172.21.15.5:0/4033483790 wait complete. 2023-10-08T13:07:40.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.096+0000 7f0efba21b80 20 client.25649 trim_cache size 0 max 16384 2023-10-08T13:07:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 Processor -- start 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 -- start start 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf0e80 0x564db9cf98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9d0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 0x564db9cf7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9ac5920 con 0x564db9cf0e80 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9d0bfb0 con 0x564db9cf17a0 2023-10-08T13:07:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0efba21b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9cf78f0 con 0x564db9cfc650 2023-10-08T13:07:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0eeddd5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 0x564db9cf7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf0e80 0x564db9cf98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0eeddd5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 0x564db9cf7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48722/0 (socket says 172.21.15.5:48722) 2023-10-08T13:07:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0eeddd5700 1 -- 172.21.15.5:0/3482592675 learned_addr learned my addr 172.21.15.5:0/3482592675 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.121+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9d0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eeddd5700 1 -- 172.21.15.5:0/3482592675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 msgr2=0x564db9d0ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9d0ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eeddd5700 1 -- 172.21.15.5:0/3482592675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf0e80 msgr2=0x564db9cf98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf0e80 0x564db9cf98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eeddd5700 1 -- 172.21.15.5:0/3482592675 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db9a96250 con 0x564db9cfc650 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf0e80 0x564db9cf98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0eeddd5700 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 0x564db9cf7c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80962f0 tx=0x7f0ed8004380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72685e2ffa5f8779 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0ed3fff700 1 -- 172.21.15.5:0/3482592675 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8065030 con 0x564db9cfc650 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0ed3fff700 1 -- 172.21.15.5:0/3482592675 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed8099df0 con 0x564db9cfc650 2023-10-08T13:07:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.122+0000 7f0ed3fff700 1 -- 172.21.15.5:0/3482592675 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed809a050 con 0x564db9cfc650 2023-10-08T13:07:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.123+0000 7f0efba21b80 1 -- 172.21.15.5:0/3482592675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 msgr2=0x564db9cf7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.123+0000 7f0efba21b80 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 0x564db9cf7c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80962f0 tx=0x7f0ed8004380 comp rx=0 tx=0).stop 2023-10-08T13:07:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 -- 172.21.15.5:0/3482592675 shutdown_connections 2023-10-08T13:07:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cfc650 0x564db9cf7c70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cf0e80 0x564db9cf98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 --2- 172.21.15.5:0/3482592675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf17a0 0x564db9d0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 -- 172.21.15.5:0/3482592675 >> 172.21.15.5:0/3482592675 conn(0x564db9c66260 msgr2=0x564db9cf47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 -- 172.21.15.5:0/3482592675 shutdown_connections 2023-10-08T13:07:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.128+0000 7f0efba21b80 1 -- 172.21.15.5:0/3482592675 wait complete. 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.129+0000 7f0efba21b80 1 -- start start 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.129+0000 7f0efba21b80 1 Processor -- start 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.129+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 0x564db9d0b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf17a0 0x564db9d09a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0efba21b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9d09f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0efba21b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9d0be50 con 0x564db9cfc650 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0efba21b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9d0a4d0 con 0x564db9cf0e80 2023-10-08T13:07:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0efba21b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9d0a640 con 0x564db9cf17a0 2023-10-08T13:07:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0efba21b80 10 client.0 _ll_register_callbacks cb 0x7f0ed8004e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 0x564db9d0b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eeddd5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9d09f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 0x564db9d0b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58706/0 (socket says 172.21.15.5:58706) 2023-10-08T13:07:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 -- 172.21.15.5:0/2625502903 learned_addr learned my addr 172.21.15.5:0/2625502903 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 -- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf17a0 msgr2=0x564db9d09a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:07:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf17a0 0x564db9d09a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 -- 172.21.15.5:0/2625502903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 msgr2=0x564db9d09f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9d09f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.130+0000 7f0eed5d4700 1 -- 172.21.15.5:0/2625502903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee810dd90 con 0x564db9cf0e80 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.131+0000 7f0eed5d4700 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 0x564db9d0b580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4000c00 tx=0x7f0ee4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a1c75871c8b4af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.131+0000 7f0ed0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.131+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/2625502903 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400be90 con 0x564db9cf0e80 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.131+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/2625502903 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0ee40362c0 con 0x564db9cf0e80 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.131+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ee000f040 con 0x564db9cf0e80 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.131+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/2625502903 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ee4036480 con 0x564db9cf0e80 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 10 client.25655 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564db9a58c60 con 0x564db9cf0e80 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/2625502903 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ee000f040 con 0x564db9cf0e80 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/2625502903 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f0ee400f4f0 con 0x564db9cf0e80 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 10 client.25655 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 10 client.25655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 20 client.25655 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d63c60 0x564db9d64070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 4 client.25655 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:07:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.132+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564db9c3db30 con 0x564db9d63c60 2023-10-08T13:07:40.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.154+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d63c60 0x564db9d64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.156+0000 7f0ed0ff9700 10 client.25655 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.156+0000 7f0eecdd3700 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d63c60 0x564db9d64070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7719616d6a32f490 server_cookie=630932cbd5a87f27 in_seq=0 out_seq=0 2023-10-08T13:07:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.156+0000 7f0ed0ff9700 1 -- 172.21.15.5:0/2625502903 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564db9c3db30 con 0x564db9d63c60 2023-10-08T13:07:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.156+0000 7f0ed0ff9700 10 client.25655 handle_command_reply: tid=0 2023-10-08T13:07:40.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.156+0000 7f0efba21b80 1 client.25655 shutdown 2023-10-08T13:07:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.173+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 msgr2=0x564db9d0b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.173+0000 7f0efba21b80 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 0x564db9d0b580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4000c00 tx=0x7f0ee4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.182+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 shutdown_connections 2023-10-08T13:07:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.182+0000 7f0efba21b80 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564db9cfc650 0x564db9d09f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.182+0000 7f0efba21b80 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564db9d63c60 0x564db9d64070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.182+0000 7f0efba21b80 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564db9cf0e80 0x564db9d0b580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.182+0000 7f0efba21b80 1 --2- 172.21.15.5:0/2625502903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564db9cf17a0 0x564db9d09a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.182+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 >> 172.21.15.5:0/2625502903 conn(0x564db9c66260 msgr2=0x564db9cf7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.183+0000 7f0ed0ff9700 0 client.25655 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.196+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 shutdown_connections 2023-10-08T13:07:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.196+0000 7f0efba21b80 1 -- 172.21.15.5:0/2625502903 wait complete. 2023-10-08T13:07:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.197+0000 7f0efba21b80 20 client.25655 trim_cache size 0 max 16384 2023-10-08T13:07:40.201 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:07:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:07:40.203 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:07:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.198+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0ed40a15f0 msgr2=0x7f0ed40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.198+0000 7f0eef838700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0ed40a15f0 0x7f0ed40a3ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4006010 tx=0x7f0ee400b260 comp rx=0 tx=0).stop 2023-10-08T13:07:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.198+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 msgr2=0x7f0ee8196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.198+0000 7f0eef838700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 0x7f0ee8196980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800e970 tx=0x7f0ed800ec80 comp rx=0 tx=0).stop 2023-10-08T13:07:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.201+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 shutdown_connections 2023-10-08T13:07:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.201+0000 7f0eef838700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f0ed40a15f0 0x7f0ed40a3ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.201+0000 7f0eef838700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee810ac80 0x7f0ee8196980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.201+0000 7f0eef838700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ee81018b0 0x7f0ee819c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.201+0000 7f0eef838700 1 --2- 172.21.15.5:0/2621003613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee81021d0 0x7f0ee819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.201+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 >> 172.21.15.5:0/2621003613 conn(0x7f0ee80fafb0 msgr2=0x7f0ee80fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.208+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 shutdown_connections 2023-10-08T13:07:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:07:40.214+0000 7f0eef838700 1 -- 172.21.15.5:0/2621003613 wait complete. 2023-10-08T13:07:40.259 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.263+0000 7fcb341bc700 1 -- 172.21.15.5:0/3517740065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c10eea0 msgr2=0x7fcb2c1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.263+0000 7fcb341bc700 1 --2- 172.21.15.5:0/3517740065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c10eea0 0x7fcb2c1077f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb280099f0 tx=0x7fcb28009d00 comp rx=0 tx=0).stop 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.264+0000 7fcb341bc700 1 -- 172.21.15.5:0/3517740065 shutdown_connections 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.264+0000 7fcb341bc700 1 --2- 172.21.15.5:0/3517740065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 0x7fcb2c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.264+0000 7fcb341bc700 1 --2- 172.21.15.5:0/3517740065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c10eea0 0x7fcb2c1077f0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb280099f0 tx=0x7fcb28009d00 comp rx=0 tx=0).stop 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.264+0000 7fcb341bc700 1 --2- 172.21.15.5:0/3517740065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb2c10f310 0x7fcb2c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.264+0000 7fcb341bc700 1 -- 172.21.15.5:0/3517740065 >> 172.21.15.5:0/3517740065 conn(0x7fcb2c06b7c0 msgr2=0x7fcb2c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.265+0000 7fcb341bc700 1 -- 172.21.15.5:0/3517740065 shutdown_connections 2023-10-08T13:07:40.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.265+0000 7fcb341bc700 1 -- 172.21.15.5:0/3517740065 wait complete. 2023-10-08T13:07:40.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 Processor -- start 2023-10-08T13:07:40.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 -- start start 2023-10-08T13:07:40.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 0x7fcb2c1a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c1a6250 0x7fcb2c1a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb2c1a9a80 0x7fcb2c1a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a6930 con 0x7fcb2c1a9a80 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1b28d0 con 0x7fcb2c1a6250 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.266+0000 7fcb341bc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1b2a10 con 0x7fcb2c119fd0 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.267+0000 7fcb31757700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c1a6250 0x7fcb2c1a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.267+0000 7fcb31757700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c1a6250 0x7fcb2c1a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58716/0 (socket says 172.21.15.5:58716) 2023-10-08T13:07:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.267+0000 7fcb31757700 1 -- 172.21.15.5:0/4034310662 learned_addr learned my addr 172.21.15.5:0/4034310662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.267+0000 7fcb31f58700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 0x7fcb2c1a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.268+0000 7fcb31f58700 1 -- 172.21.15.5:0/4034310662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c1a6250 msgr2=0x7fcb2c1a9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.268+0000 7fcb31f58700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c1a6250 0x7fcb2c1a9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.268+0000 7fcb31f58700 1 -- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb2c1a9a80 msgr2=0x7fcb2c1a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.268+0000 7fcb31f58700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb2c1a9a80 0x7fcb2c1a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.268+0000 7fcb31f58700 1 -- 172.21.15.5:0/4034310662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280095f0 con 0x7fcb2c119fd0 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.268+0000 7fcb31f58700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 0x7fcb2c1a5d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb28008000 tx=0x7fcb280057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.269+0000 7fcb22ffd700 1 -- 172.21.15.5:0/4034310662 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2801d070 con 0x7fcb2c119fd0 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.269+0000 7fcb22ffd700 1 -- 172.21.15.5:0/4034310662 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb28003f30 con 0x7fcb2c119fd0 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.269+0000 7fcb22ffd700 1 -- 172.21.15.5:0/4034310662 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800fb40 con 0x7fcb2c119fd0 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.269+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c1b2c90 con 0x7fcb2c119fd0 2023-10-08T13:07:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.269+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c10f990 con 0x7fcb2c119fd0 2023-10-08T13:07:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.275+0000 7fcb403a5b80 1 Processor -- start 2023-10-08T13:07:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 -- start start 2023-10-08T13:07:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3056c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f3050b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3051510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2fb9400 con 0x5632f30510b0 2023-10-08T13:07:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2faabc0 con 0x5632f30571a0 2023-10-08T13:07:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2fa84e0 con 0x5632f3056880 2023-10-08T13:07:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb32759700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3056c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb32759700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3056c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48744/0 (socket says 172.21.15.5:48744) 2023-10-08T13:07:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.276+0000 7fcb32759700 1 -- 172.21.15.5:0/3974665946 learned_addr learned my addr 172.21.15.5:0/3974665946 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb32759700 1 -- 172.21.15.5:0/3974665946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 msgr2=0x5632f3050b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:07:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb32759700 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f3050b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb32759700 1 -- 172.21.15.5:0/3974665946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 msgr2=0x5632f3051510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb32759700 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3051510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb32759700 1 -- 172.21.15.5:0/3974665946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632f2dced80 con 0x5632f3056880 2023-10-08T13:07:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb32759700 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3056c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005c50 tx=0x7fcb1c007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714f935879689d8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.277+0000 7fcb22ffd700 1 -- 172.21.15.5:0/4034310662 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcb2800fca0 con 0x7fcb2c119fd0 2023-10-08T13:07:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.278+0000 7fcb22ffd700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb180a1660 0x7fcb180a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.278+0000 7fcb22ffd700 1 -- 172.21.15.5:0/4034310662 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcb280cdf80 con 0x7fcb2c119fd0 2023-10-08T13:07:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.281+0000 7fcb17fff700 1 -- 172.21.15.5:0/3974665946 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c004020 con 0x5632f3056880 2023-10-08T13:07:40.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.281+0000 7fcb17fff700 1 -- 172.21.15.5:0/3974665946 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb1c00d890 con 0x5632f3056880 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.281+0000 7fcb17fff700 1 -- 172.21.15.5:0/3974665946 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c004ca0 con 0x5632f3056880 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3974665946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 msgr2=0x5632f3056c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3056c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005c50 tx=0x7fcb1c007e40 comp rx=0 tx=0).stop 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3974665946 shutdown_connections 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3051510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3056c60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3974665946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f3050b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.282+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3974665946 >> 172.21.15.5:0/3974665946 conn(0x5632f2fc5200 msgr2=0x5632f304bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.284+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3974665946 shutdown_connections 2023-10-08T13:07:40.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.286+0000 7fcb31f58700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb180a1660 0x7fcb180a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.287+0000 7fcb31f58700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb180a1660 0x7fcb180a3b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5632f3057600 tx=0x7fcb2800ff50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.288+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3974665946 wait complete. 2023-10-08T13:07:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.289+0000 7fcb403a5b80 1 -- start start 2023-10-08T13:07:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.289+0000 7fcb403a5b80 1 Processor -- start 2023-10-08T13:07:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.289+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f305d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.289+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f305a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f305ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2fa3dd0 con 0x5632f30510b0 2023-10-08T13:07:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2f406b0 con 0x5632f30571a0 2023-10-08T13:07:40.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2f40350 con 0x5632f3056880 2023-10-08T13:07:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb403a5b80 10 client.0 _ll_register_callbacks cb 0x5632f2d9d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb31757700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f305a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb32759700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f305d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb32759700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f305d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35546/0 (socket says 172.21.15.5:35546) 2023-10-08T13:07:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb32759700 1 -- 172.21.15.5:0/3126133362 learned_addr learned my addr 172.21.15.5:0/3126133362 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.290+0000 7fcb32759700 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f305ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb32759700 1 -- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 msgr2=0x5632f305a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb32759700 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f305a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb32759700 1 -- 172.21.15.5:0/3126133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 msgr2=0x5632f305d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb32759700 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f305d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb32759700 1 -- 172.21.15.5:0/3126133362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c0077c0 con 0x5632f30571a0 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb32759700 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f305ac50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005c20 tx=0x7fcb1c007460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23b03b4d7f7c765 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb157fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb157fa700 1 -- 172.21.15.5:0/3126133362 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c010cc0 con 0x5632f30571a0 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb157fa700 1 -- 172.21.15.5:0/3126133362 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcb1c010e20 con 0x5632f30571a0 2023-10-08T13:07:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.291+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632f2f6be50 con 0x5632f30571a0 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb157fa700 1 -- 172.21.15.5:0/3126133362 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb1c028460 con 0x5632f30571a0 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 10 client.25664 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5632f2db7c00 con 0x5632f30571a0 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb157fa700 1 -- 172.21.15.5:0/3126133362 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5632f2f6be50 con 0x5632f30571a0 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb157fa700 1 -- 172.21.15.5:0/3126133362 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fcb1c0185d0 con 0x5632f30571a0 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 10 client.25664 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 20 client.25664 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f306ada0 0x5632f306d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 4 client.25664 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.292+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632f2f9cdb0 con 0x5632f306ada0 2023-10-08T13:07:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.293+0000 7fcb31757700 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f306ada0 0x5632f306d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.293+0000 7fcb157fa700 10 client.25664 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.293+0000 7fcb31757700 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f306ada0 0x5632f306d1c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da299e90dc2f792f server_cookie=c42e691475333726 in_seq=0 out_seq=0 2023-10-08T13:07:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.294+0000 7fcb157fa700 1 -- 172.21.15.5:0/3126133362 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5632f2f9cdb0 con 0x5632f306ada0 2023-10-08T13:07:40.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.294+0000 7fcb157fa700 10 client.25664 handle_command_reply: tid=0 2023-10-08T13:07:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.294+0000 7fcb403a5b80 1 client.25664 shutdown 2023-10-08T13:07:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.294+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 msgr2=0x5632f305ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.294+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f305ac50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005c20 tx=0x7fcb1c007460 comp rx=0 tx=0).stop 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 shutdown_connections 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f306ada0 0x5632f306d1c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f305ac50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f305d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3126133362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f305a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 >> 172.21.15.5:0/3126133362 conn(0x5632f2fc5200 msgr2=0x5632f304b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.296+0000 7fcb157fa700 0 client.25664 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.298+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 shutdown_connections 2023-10-08T13:07:40.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.298+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3126133362 wait complete. 2023-10-08T13:07:40.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.299+0000 7fcb403a5b80 20 client.25664 trim_cache size 0 max 16384 2023-10-08T13:07:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 Processor -- start 2023-10-08T13:07:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 -- start start 2023-10-08T13:07:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3047c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3059a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f304b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f2e248c0 con 0x5632f30510b0 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f30462e0 con 0x5632f30571a0 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3067820 con 0x5632f3056880 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb32759700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3047c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb32759700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3047c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35554/0 (socket says 172.21.15.5:35554) 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb31757700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3059a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb32759700 1 -- 172.21.15.5:0/4143387577 learned_addr learned my addr 172.21.15.5:0/4143387577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.323+0000 7fcb32759700 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f304b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.324+0000 7fcb32759700 1 -- 172.21.15.5:0/4143387577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 msgr2=0x5632f3059a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.324+0000 7fcb32759700 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3059a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.324+0000 7fcb32759700 1 -- 172.21.15.5:0/4143387577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 msgr2=0x5632f304b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.324+0000 7fcb32759700 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f304b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.324+0000 7fcb32759700 1 -- 172.21.15.5:0/4143387577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632f2df51f0 con 0x5632f30510b0 2023-10-08T13:07:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.326+0000 7fcb32759700 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3047c80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c018b40 tx=0x7fcb1c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7379eac94464b971 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb20ff9700 1 -- 172.21.15.5:0/4143387577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c010460 con 0x5632f30510b0 2023-10-08T13:07:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb20ff9700 1 -- 172.21.15.5:0/4143387577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb1c01f070 con 0x5632f30510b0 2023-10-08T13:07:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb20ff9700 1 -- 172.21.15.5:0/4143387577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c004360 con 0x5632f30510b0 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 -- 172.21.15.5:0/4143387577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 msgr2=0x5632f3047c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3047c80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c018b40 tx=0x7fcb1c001e50 comp rx=0 tx=0).stop 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 -- 172.21.15.5:0/4143387577 shutdown_connections 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f30571a0 0x5632f304b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3047c80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/4143387577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f3056880 0x5632f3059a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 -- 172.21.15.5:0/4143387577 >> 172.21.15.5:0/4143387577 conn(0x5632f2fc5200 msgr2=0x5632f3071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.327+0000 7fcb403a5b80 1 -- 172.21.15.5:0/4143387577 shutdown_connections 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.328+0000 7fcb403a5b80 1 -- 172.21.15.5:0/4143387577 wait complete. 2023-10-08T13:07:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.328+0000 7fcb403a5b80 1 -- start start 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.328+0000 7fcb403a5b80 1 Processor -- start 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3053480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f3056880 0x5632f30539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f30571a0 0x5632f3052390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f30540c0 con 0x5632f30510b0 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f30528d0 con 0x5632f3056880 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3052a90 con 0x5632f30571a0 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb403a5b80 10 client.0 _ll_register_callbacks cb 0x7fcb1c010600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3053480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3053480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35560/0 (socket says 172.21.15.5:35560) 2023-10-08T13:07:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 -- 172.21.15.5:0/3787953305 learned_addr learned my addr 172.21.15.5:0/3787953305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f30571a0 0x5632f3052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 -- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f30571a0 msgr2=0x5632f3052390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f30571a0 0x5632f3052390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 -- 172.21.15.5:0/3787953305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f3056880 msgr2=0x5632f30539c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f3056880 0x5632f30539c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 -- 172.21.15.5:0/3787953305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c02d040 con 0x5632f30510b0 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb32759700 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3053480 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0074e0 tx=0x7fcb1c0107f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599d979e0c251031 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.329+0000 7fcb157fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb157fa700 1 -- 172.21.15.5:0/3787953305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0041e0 con 0x5632f30510b0 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb157fa700 1 -- 172.21.15.5:0/3787953305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcb1c004340 con 0x5632f30510b0 2023-10-08T13:07:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb1c00d890 con 0x5632f30510b0 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb157fa700 1 -- 172.21.15.5:0/3787953305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb1c004500 con 0x5632f30510b0 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb403a5b80 10 client.16143 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5632f2dcd250 con 0x5632f30510b0 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.330+0000 7fcb157fa700 1 -- 172.21.15.5:0/3787953305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb1c00d890 con 0x5632f30510b0 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb157fa700 1 -- 172.21.15.5:0/3787953305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fcb1c03f060 con 0x5632f30510b0 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb403a5b80 10 client.16143 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb403a5b80 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb403a5b80 20 client.16143 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f30bf4a0 0x5632f30c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb403a5b80 4 client.16143 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:07:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5632f2f9cad0 con 0x5632f30bf4a0 2023-10-08T13:07:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb31757700 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f30bf4a0 0x5632f30c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb157fa700 10 client.16143 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.331+0000 7fcb31757700 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f30bf4a0 0x5632f30c18c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d86ab0dd2b3359 server_cookie=3f6b0ab51b6cbd51 in_seq=0 out_seq=0 2023-10-08T13:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.359+0000 7fcb157fa700 1 -- 172.21.15.5:0/3787953305 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5632f2f9cad0 con 0x5632f30bf4a0 2023-10-08T13:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.359+0000 7fcb157fa700 10 client.16143 handle_command_reply: tid=0 2023-10-08T13:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.359+0000 7fcb403a5b80 1 client.16143 shutdown 2023-10-08T13:07:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 msgr2=0x5632f3053480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3053480 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0074e0 tx=0x7fcb1c0107f0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 shutdown_connections 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5632f30571a0 0x5632f3052390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f30510b0 0x5632f3053480 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5632f30bf4a0 0x5632f30c18c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 --2- 172.21.15.5:0/3787953305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5632f3056880 0x5632f30539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 >> 172.21.15.5:0/3787953305 conn(0x5632f2fc5200 msgr2=0x5632f3047c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb157fa700 0 client.16143 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 shutdown_connections 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 1 -- 172.21.15.5:0/3787953305 wait complete. 2023-10-08T13:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.360+0000 7fcb403a5b80 20 client.16143 trim_cache size 0 max 16384 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.361+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb180a1660 msgr2=0x7fcb180a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.361+0000 7fcb341bc700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb180a1660 0x7fcb180a3b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5632f3057600 tx=0x7fcb2800ff50 comp rx=0 tx=0).stop 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.361+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 msgr2=0x7fcb2c1a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.361+0000 7fcb341bc700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 0x7fcb2c1a5d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb28008000 tx=0x7fcb280057f0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.362+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 shutdown_connections 2023-10-08T13:07:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.362+0000 7fcb341bc700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcb180a1660 0x7fcb180a3b20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.362+0000 7fcb341bc700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb2c1a9a80 0x7fcb2c1a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.362+0000 7fcb341bc700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb2c119fd0 0x7fcb2c1a5d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.362+0000 7fcb341bc700 1 --2- 172.21.15.5:0/4034310662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb2c1a6250 0x7fcb2c1a9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.362+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 >> 172.21.15.5:0/4034310662 conn(0x7fcb2c06b7c0 msgr2=0x7fcb2c117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.368+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 shutdown_connections 2023-10-08T13:07:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:40.376+0000 7fcb341bc700 1 -- 172.21.15.5:0/4034310662 wait complete. 2023-10-08T13:07:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:40 smithi118 ceph-mon[104234]: pgmap v350: 129 pgs: 129 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 20 MiB/s wr, 960 op/s 2023-10-08T13:07:41.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:40 smithi060 ceph-mon[103190]: pgmap v350: 129 pgs: 129 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 20 MiB/s wr, 960 op/s 2023-10-08T13:07:41.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:40 smithi005 ceph-mon[99496]: pgmap v350: 129 pgs: 129 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 20 MiB/s wr, 960 op/s 2023-10-08T13:07:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 80.0 s, 776.4 tps, lat 129.140 ms stddev 336.693 2023-10-08T13:07:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:42 smithi118 ceph-mon[104234]: pgmap v351: 129 pgs: 129 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 1.40k op/s 2023-10-08T13:07:43.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:42 smithi060 ceph-mon[103190]: pgmap v351: 129 pgs: 129 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 1.40k op/s 2023-10-08T13:07:43.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:42 smithi005 ceph-mon[99496]: pgmap v351: 129 pgs: 129 active+clean; 2.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 1.40k op/s 2023-10-08T13:07:45.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:44 smithi118 ceph-mon[104234]: pgmap v352: 129 pgs: 129 active+clean; 2.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 MiB/s wr, 1.92k op/s 2023-10-08T13:07:45.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:44 smithi060 ceph-mon[103190]: pgmap v352: 129 pgs: 129 active+clean; 2.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 MiB/s wr, 1.92k op/s 2023-10-08T13:07:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:44 smithi005 ceph-mon[99496]: pgmap v352: 129 pgs: 129 active+clean; 2.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 MiB/s wr, 1.92k op/s 2023-10-08T13:07:46.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 85.0 s, 2321.8 tps, lat 42.713 ms stddev 49.072 2023-10-08T13:07:47.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:46 smithi118 ceph-mon[104234]: pgmap v353: 129 pgs: 129 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 1.93k op/s 2023-10-08T13:07:47.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:46 smithi060 ceph-mon[103190]: pgmap v353: 129 pgs: 129 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 1.93k op/s 2023-10-08T13:07:47.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:46 smithi005 ceph-mon[99496]: pgmap v353: 129 pgs: 129 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 MiB/s wr, 1.93k op/s 2023-10-08T13:07:49.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:48 smithi118 ceph-mon[104234]: pgmap v354: 129 pgs: 129 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 34 MiB/s wr, 1.90k op/s 2023-10-08T13:07:49.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:48 smithi060 ceph-mon[103190]: pgmap v354: 129 pgs: 129 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 34 MiB/s wr, 1.90k op/s 2023-10-08T13:07:49.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:48 smithi005 ceph-mon[99496]: pgmap v354: 129 pgs: 129 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 34 MiB/s wr, 1.90k op/s 2023-10-08T13:07:51.411 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:51 smithi060 ceph-mon[103190]: pgmap v355: 129 pgs: 129 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-08T13:07:51.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:51 smithi005 ceph-mon[99496]: pgmap v355: 129 pgs: 129 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-08T13:07:51.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:51 smithi118 ceph-mon[104234]: pgmap v355: 129 pgs: 129 active+clean; 2.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-08T13:07:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 90.0 s, 1950.0 tps, lat 51.749 ms stddev 57.112 2023-10-08T13:07:53.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:53 smithi060 ceph-mon[103190]: pgmap v356: 129 pgs: 129 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 1.74k op/s 2023-10-08T13:07:53.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:53 smithi005 ceph-mon[99496]: pgmap v356: 129 pgs: 129 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 1.74k op/s 2023-10-08T13:07:53.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:53 smithi118 ceph-mon[104234]: pgmap v356: 129 pgs: 129 active+clean; 2.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 31 MiB/s wr, 1.74k op/s 2023-10-08T13:07:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 -- 172.21.15.5:0/2170039230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c0ffd50 msgr2=0x7f369c108880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2170039230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c0ffd50 0x7f369c108880 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f368c009990 tx=0x7f368c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 -- 172.21.15.5:0/2170039230 shutdown_connections 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2170039230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369c108f60 0x7f369c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2170039230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c0ff3a0 0x7f369c0ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2170039230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c0ffd50 0x7f369c108880 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 -- 172.21.15.5:0/2170039230 >> 172.21.15.5:0/2170039230 conn(0x7f369c0748a0 msgr2=0x7f369c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 -- 172.21.15.5:0/2170039230 shutdown_connections 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.545+0000 7f36a0caa700 1 -- 172.21.15.5:0/2170039230 wait complete. 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 Processor -- start 2023-10-08T13:07:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 -- start start 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c0ff3a0 0x7f369c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 0x7f369c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369c19d710 0x7f369c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c19e190 con 0x7f369c108f60 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c19e300 con 0x7f369c0ff3a0 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f36a0caa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c19e4c0 con 0x7f369c19d710 2023-10-08T13:07:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 0x7f369c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 0x7f369c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35572/0 (socket says 172.21.15.5:35572) 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 -- 172.21.15.5:0/2155984666 learned_addr learned my addr 172.21.15.5:0/2155984666 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f369ad9d700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369c19d710 0x7f369c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f369a59c700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c0ff3a0 0x7f369c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 -- 172.21.15.5:0/2155984666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369c19d710 msgr2=0x7f369c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369c19d710 0x7f369c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 -- 172.21.15.5:0/2155984666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c0ff3a0 msgr2=0x7f369c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c0ff3a0 0x7f369c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 -- 172.21.15.5:0/2155984666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0095f0 con 0x7f369c108f60 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f3699d9b700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 0x7f369c199370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f368c000c00 tx=0x7f368c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.546+0000 7f368b7fe700 1 -- 172.21.15.5:0/2155984666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c01d070 con 0x7f369c108f60 2023-10-08T13:07:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.547+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c1a59c0 con 0x7f369c108f60 2023-10-08T13:07:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.547+0000 7f368b7fe700 1 -- 172.21.15.5:0/2155984666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f368c021410 con 0x7f369c108f60 2023-10-08T13:07:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.547+0000 7f368b7fe700 1 -- 172.21.15.5:0/2155984666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c017650 con 0x7f369c108f60 2023-10-08T13:07:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.547+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c1a5de0 con 0x7f369c108f60 2023-10-08T13:07:53.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.549+0000 7f368b7fe700 1 -- 172.21.15.5:0/2155984666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f368c021580 con 0x7f369c108f60 2023-10-08T13:07:53.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.549+0000 7f368b7fe700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36840a15e0 0x7f36840a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.549+0000 7f369a59c700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36840a15e0 0x7f36840a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.549+0000 7f368b7fe700 1 -- 172.21.15.5:0/2155984666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f368c0ce5f0 con 0x7f369c108f60 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.550+0000 7f369a59c700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36840a15e0 0x7f36840a3aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3690009c60 tx=0x7f3690009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.550+0000 7f36ace93b80 1 Processor -- start 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.550+0000 7f36ace93b80 1 -- start start 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c1191c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c118bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 0x55e2c118c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f36ace93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c10f4400 con 0x55e2c118c0b0 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f36ace93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c10e5bc0 con 0x55e2c11921a0 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f36ace93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c10e34e0 con 0x55e2c1191880 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 0x55e2c118c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c1191c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 0x55e2c118c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35582/0 (socket says 172.21.15.5:35582) 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c118bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 -- 172.21.15.5:0/2109415506 learned_addr learned my addr 172.21.15.5:0/2109415506 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 -- 172.21.15.5:0/2109415506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 msgr2=0x55e2c1191c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c1191c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 -- 172.21.15.5:0/2109415506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 msgr2=0x55e2c118bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c118bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 -- 172.21.15.5:0/2109415506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2c0f09d80 con 0x55e2c118c0b0 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f3699d9b700 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c118bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f369ad9d700 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 0x55e2c118c510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3694011680 tx=0x7f3694009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc52681c9b1b3a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f3688ff9700 1 -- 172.21.15.5:0/2109415506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400e040 con 0x55e2c118c0b0 2023-10-08T13:07:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f3688ff9700 1 -- 172.21.15.5:0/2109415506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f369400f040 con 0x55e2c118c0b0 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.551+0000 7f3688ff9700 1 -- 172.21.15.5:0/2109415506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694004860 con 0x55e2c118c0b0 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 -- 172.21.15.5:0/2109415506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 msgr2=0x55e2c118c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 0x55e2c118c510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3694011680 tx=0x7f3694009920 comp rx=0 tx=0).stop 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 -- 172.21.15.5:0/2109415506 shutdown_connections 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c118c0b0 0x55e2c118c510 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c1191c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 --2- 172.21.15.5:0/2109415506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c118bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 -- 172.21.15.5:0/2109415506 >> 172.21.15.5:0/2109415506 conn(0x55e2c1100200 msgr2=0x55e2c1186b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 -- 172.21.15.5:0/2109415506 shutdown_connections 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 -- 172.21.15.5:0/2109415506 wait complete. 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.552+0000 7f36ace93b80 1 -- start start 2023-10-08T13:07:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 Processor -- start 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c118c0b0 0x55e2c11955c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1195b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c1196040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c10dedd0 con 0x55e2c1191880 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c107b6b0 con 0x55e2c11921a0 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c107b350 con 0x55e2c118c0b0 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f36ace93b80 10 client.0 _ll_register_callbacks cb 0x55e2c0ed87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35586/0 (socket says 172.21.15.5:35586) 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 -- 172.21.15.5:0/3265672184 learned_addr learned my addr 172.21.15.5:0/3265672184 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f369a59c700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c118c0b0 0x55e2c11955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f369ad9d700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c1196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 -- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c118c0b0 msgr2=0x55e2c11955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c118c0b0 0x55e2c11955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 -- 172.21.15.5:0/3265672184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 msgr2=0x55e2c1196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c1196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 -- 172.21.15.5:0/3265672184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c1a5de0 con 0x55e2c1191880 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1195b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b2e0 tx=0x7f368c09b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a70a7b7ea645205 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.553+0000 7f3681ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f3681ffb700 1 -- 172.21.15.5:0/3265672184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c09b320 con 0x55e2c1191880 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f3681ffb700 1 -- 172.21.15.5:0/3265672184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f368c09f470 con 0x55e2c1191880 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2c10a6e50 con 0x55e2c1191880 2023-10-08T13:07:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f3681ffb700 1 -- 172.21.15.5:0/3265672184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368c0a3620 con 0x55e2c1191880 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 10 client.16155 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f3694011330 con 0x55e2c1191880 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f3681ffb700 1 -- 172.21.15.5:0/3265672184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e2c10a6e50 con 0x55e2c1191880 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f3681ffb700 1 -- 172.21.15.5:0/3265672184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f368c09a810 con 0x55e2c1191880 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 10 client.16155 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 20 client.16155 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11a5aa0 0x55e2c11a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 4 client.16155 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2c10d7db0 con 0x55e2c11a5aa0 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.554+0000 7f369a59c700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11a5aa0 0x55e2c11a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.555+0000 7f369a59c700 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11a5aa0 0x55e2c11a7ec0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c54d9f2fc31c97 server_cookie=754f7b6515201ac5 in_seq=0 out_seq=0 2023-10-08T13:07:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.556+0000 7f3681ffb700 10 client.16155 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.556+0000 7f3681ffb700 1 -- 172.21.15.5:0/3265672184 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2c10d7db0 con 0x55e2c11a5aa0 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.556+0000 7f3681ffb700 10 client.16155 handle_command_reply: tid=0 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 client.16155 shutdown 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 msgr2=0x55e2c1195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1195b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b2e0 tx=0x7f368c09b1f0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 shutdown_connections 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11a5aa0 0x55e2c11a7ec0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c11921a0 0x55e2c1196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c118c0b0 0x55e2c11955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f3681ffb700 0 client.16155 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3265672184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1195b00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.557+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 >> 172.21.15.5:0/3265672184 conn(0x55e2c1100200 msgr2=0x55e2c1186010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.558+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 shutdown_connections 2023-10-08T13:07:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.560+0000 7f36ace93b80 1 -- 172.21.15.5:0/3265672184 wait complete. 2023-10-08T13:07:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.560+0000 7f36ace93b80 20 client.16155 trim_cache size 0 max 16384 2023-10-08T13:07:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.582+0000 7f36ace93b80 1 Processor -- start 2023-10-08T13:07:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 -- start start 2023-10-08T13:07:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c118bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c11921a0 0x55e2c119cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c0f5f8c0 con 0x55e2c1191880 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c1195400 con 0x55e2c118c0b0 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f36ace93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c10d7db0 con 0x55e2c11921a0 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c118bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369ad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c11921a0 0x55e2c119cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1194ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35594/0 (socket says 172.21.15.5:35594) 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f3699d9b700 1 -- 172.21.15.5:0/3238108708 learned_addr learned my addr 172.21.15.5:0/3238108708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c118bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58774/0 (socket says 172.21.15.5:58774) 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 -- 172.21.15.5:0/3238108708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c11921a0 msgr2=0x55e2c119cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c11921a0 0x55e2c119cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 -- 172.21.15.5:0/3238108708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 msgr2=0x55e2c1194ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1194ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f369a59c700 1 -- 172.21.15.5:0/3238108708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2c0ef2c00 con 0x55e2c118c0b0 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.583+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.584+0000 7f369a59c700 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c118bb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55e2c11a5e80 tx=0x7f3690014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d44538e84824d6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.584+0000 7f36897fa700 1 -- 172.21.15.5:0/3238108708 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690022030 con 0x55e2c118c0b0 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.584+0000 7f36897fa700 1 -- 172.21.15.5:0/3238108708 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3690023040 con 0x55e2c118c0b0 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.584+0000 7f36897fa700 1 -- 172.21.15.5:0/3238108708 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690003d80 con 0x55e2c118c0b0 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.585+0000 7f36ace93b80 1 -- 172.21.15.5:0/3238108708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 msgr2=0x55e2c118bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.585+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c118bb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55e2c11a5e80 tx=0x7f3690014000 comp rx=0 tx=0).stop 2023-10-08T13:07:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.586+0000 7f36ace93b80 1 -- 172.21.15.5:0/3238108708 shutdown_connections 2023-10-08T13:07:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.586+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c11921a0 0x55e2c119cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.586+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c118bb70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.586+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3238108708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c1191880 0x55e2c1194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.586+0000 7f36ace93b80 1 -- 172.21.15.5:0/3238108708 >> 172.21.15.5:0/3238108708 conn(0x55e2c1100200 msgr2=0x55e2c11906b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.587+0000 7f36ace93b80 1 -- 172.21.15.5:0/3238108708 shutdown_connections 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.587+0000 7f36ace93b80 1 -- 172.21.15.5:0/3238108708 wait complete. 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.587+0000 7f36ace93b80 1 -- start start 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.587+0000 7f36ace93b80 1 Processor -- start 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c119c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c119c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c11921a0 0x55e2c119abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c119b1a0 con 0x55e2c11921a0 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c119b310 con 0x55e2c118c0b0 2023-10-08T13:07:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c119b4d0 con 0x55e2c1191880 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f36ace93b80 10 client.0 _ll_register_callbacks cb 0x7f368c097710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c119c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c119c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48804/0 (socket says 172.21.15.5:48804) 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 -- 172.21.15.5:0/3363045706 learned_addr learned my addr 172.21.15.5:0/3363045706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f369ad9d700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c11921a0 0x55e2c119abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f369a59c700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c119c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 -- 172.21.15.5:0/3363045706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 msgr2=0x55e2c119c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c119c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 -- 172.21.15.5:0/3363045706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c11921a0 msgr2=0x55e2c119abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c11921a0 0x55e2c119abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.588+0000 7f3699d9b700 1 -- 172.21.15.5:0/3363045706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3694011330 con 0x55e2c1191880 2023-10-08T13:07:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3699d9b700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c119c890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f368c09b020 tx=0x7f368c021a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81b62ea138882e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3681ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3681ffb700 1 -- 172.21.15.5:0/3363045706 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00fd40 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3681ffb700 1 -- 172.21.15.5:0/3363045706 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f368c09f470 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f369400f040 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3681ffb700 1 -- 172.21.15.5:0/3363045706 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368c00fea0 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f36ace93b80 10 client.25726 fetch_fsmap learned FSMap version 33 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f3690017070 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3681ffb700 1 -- 172.21.15.5:0/3363045706 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f369400f040 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f3681ffb700 1 -- 172.21.15.5:0/3363045706 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f368c097110 con 0x55e2c1191880 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.589+0000 7f36ace93b80 10 client.25726 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:07:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f36ace93b80 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f36ace93b80 20 client.25726 populate_metadata read hostname 'smithi005' 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11fa870 0x55e2c11fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f36ace93b80 4 client.25726 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e2c10d7ad0 con 0x55e2c11fa870 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f369a59c700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11fa870 0x55e2c11fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f3681ffb700 10 client.25726 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.590+0000 7f369a59c700 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11fa870 0x55e2c11fcc90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c4302bd15ed2cf server_cookie=b6e9975067f6b795 in_seq=0 out_seq=0 2023-10-08T13:07:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.613+0000 7f3681ffb700 1 -- 172.21.15.5:0/3363045706 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e2c10d7ad0 con 0x55e2c11fa870 2023-10-08T13:07:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.613+0000 7f3681ffb700 10 client.25726 handle_command_reply: tid=0 2023-10-08T13:07:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.613+0000 7f36ace93b80 1 client.25726 shutdown 2023-10-08T13:07:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 msgr2=0x55e2c119c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c119c890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f368c09b020 tx=0x7f368c021a70 comp rx=0 tx=0).stop 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 shutdown_connections 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2c11921a0 0x55e2c119abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e2c11fa870 0x55e2c11fcc90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e2c118c0b0 0x55e2c119c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 --2- 172.21.15.5:0/3363045706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c1191880 0x55e2c119c890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f3681ffb700 0 client.25726 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 >> 172.21.15.5:0/3363045706 conn(0x55e2c1100200 msgr2=0x55e2c1190f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.614+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 shutdown_connections 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.615+0000 7f36ace93b80 1 -- 172.21.15.5:0/3363045706 wait complete. 2023-10-08T13:07:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.615+0000 7f36ace93b80 20 client.25726 trim_cache size 0 max 16384 2023-10-08T13:07:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:07:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:07:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:07:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.615+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36840a15e0 msgr2=0x7f36840a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.615+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36840a15e0 0x7f36840a3aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3690009c60 tx=0x7f3690009260 comp rx=0 tx=0).stop 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.615+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 msgr2=0x7f369c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.615+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 0x7f369c199370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f368c000c00 tx=0x7f368c004730 comp rx=0 tx=0).stop 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 shutdown_connections 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f36840a15e0 0x7f36840a3aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f369c19d710 0x7f369c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c0ff3a0 0x7f369c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 --2- 172.21.15.5:0/2155984666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f369c108f60 0x7f369c199370 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:07:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 >> 172.21.15.5:0/2155984666 conn(0x7f369c0748a0 msgr2=0x7f369c106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:07:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.616+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 shutdown_connections 2023-10-08T13:07:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:07:53.618+0000 7f36a0caa700 1 -- 172.21.15.5:0/2155984666 wait complete. 2023-10-08T13:07:55.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:55 smithi060 ceph-mon[103190]: pgmap v357: 129 pgs: 129 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 1.32k op/s 2023-10-08T13:07:55.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:55 smithi005 ceph-mon[99496]: pgmap v357: 129 pgs: 129 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 1.32k op/s 2023-10-08T13:07:55.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:55 smithi118 ceph-mon[104234]: pgmap v357: 129 pgs: 129 active+clean; 2.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 24 MiB/s wr, 1.32k op/s 2023-10-08T13:07:56.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:56 smithi118 ceph-mon[104234]: pgmap v358: 129 pgs: 129 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 816 op/s 2023-10-08T13:07:56.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:56 smithi060 ceph-mon[103190]: pgmap v358: 129 pgs: 129 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 816 op/s 2023-10-08T13:07:56.677 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:56 smithi005 ceph-mon[99496]: pgmap v358: 129 pgs: 129 active+clean; 2.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 816 op/s 2023-10-08T13:07:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 95.0 s, 2136.0 tps, lat 46.556 ms stddev 56.122 2023-10-08T13:07:58.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:07:58 smithi118 ceph-mon[104234]: pgmap v359: 129 pgs: 129 active+clean; 2.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 14 MiB/s wr, 796 op/s 2023-10-08T13:07:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:07:58 smithi060 ceph-mon[103190]: pgmap v359: 129 pgs: 129 active+clean; 2.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 14 MiB/s wr, 796 op/s 2023-10-08T13:07:58.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:07:58 smithi005 ceph-mon[99496]: pgmap v359: 129 pgs: 129 active+clean; 2.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 14 MiB/s wr, 796 op/s 2023-10-08T13:08:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:00 smithi118 ceph-mon[104234]: scrub summary: active paths [/] 2023-10-08T13:08:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:00 smithi118 ceph-mon[104234]: scrub summary: idle+waiting paths [/] 2023-10-08T13:08:00.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:00 smithi118 ceph-mon[104234]: pgmap v360: 129 pgs: 129 active+clean; 2.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 803 op/s 2023-10-08T13:08:00.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:00 smithi060 ceph-mon[103190]: scrub summary: active paths [/] 2023-10-08T13:08:00.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:00 smithi060 ceph-mon[103190]: scrub summary: idle+waiting paths [/] 2023-10-08T13:08:00.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:00 smithi060 ceph-mon[103190]: pgmap v360: 129 pgs: 129 active+clean; 2.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 803 op/s 2023-10-08T13:08:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:00 smithi005 ceph-mon[99496]: scrub summary: active paths [/] 2023-10-08T13:08:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:00 smithi005 ceph-mon[99496]: scrub summary: idle+waiting paths [/] 2023-10-08T13:08:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:00 smithi005 ceph-mon[99496]: pgmap v360: 129 pgs: 129 active+clean; 2.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 803 op/s 2023-10-08T13:08:01.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 100.0 s, 1351.9 tps, lat 50.916 ms stddev 61.303 2023-10-08T13:08:02.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:02 smithi118 ceph-mon[104234]: pgmap v361: 129 pgs: 129 active+clean; 2.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 929 op/s 2023-10-08T13:08:02.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:02 smithi060 ceph-mon[103190]: pgmap v361: 129 pgs: 129 active+clean; 2.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 929 op/s 2023-10-08T13:08:02.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:02 smithi005 ceph-mon[99496]: pgmap v361: 129 pgs: 129 active+clean; 2.4 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 929 op/s 2023-10-08T13:08:04.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:04 smithi118 ceph-mon[104234]: pgmap v362: 129 pgs: 129 active+clean; 2.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2023-10-08T13:08:04.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:04 smithi060 ceph-mon[103190]: pgmap v362: 129 pgs: 129 active+clean; 2.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2023-10-08T13:08:04.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:04 smithi005 ceph-mon[99496]: pgmap v362: 129 pgs: 129 active+clean; 2.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2023-10-08T13:08:06.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:06 smithi060 ceph-mon[103190]: pgmap v363: 129 pgs: 129 active+clean; 2.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 1.75k op/s 2023-10-08T13:08:06.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:06 smithi005 ceph-mon[99496]: pgmap v363: 129 pgs: 129 active+clean; 2.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 1.75k op/s 2023-10-08T13:08:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 105.0 s, 1868.5 tps, lat 69.932 ms stddev 220.310 2023-10-08T13:08:06.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:06 smithi118 ceph-mon[104234]: pgmap v363: 129 pgs: 129 active+clean; 2.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 1.75k op/s 2023-10-08T13:08:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 -- 172.21.15.5:0/1465389268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe710107a60 msgr2=0x7fe710107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 --2- 172.21.15.5:0/1465389268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe710107a60 0x7fe710107e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe700009990 tx=0x7fe700009ca0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 -- 172.21.15.5:0/1465389268 shutdown_connections 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 --2- 172.21.15.5:0/1465389268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe71010c260 0x7fe71010c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 --2- 172.21.15.5:0/1465389268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe710107a60 0x7fe710107e40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 --2- 172.21.15.5:0/1465389268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710108380 0x7fe71010bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 -- 172.21.15.5:0/1465389268 >> 172.21.15.5:0/1465389268 conn(0x7fe71006bc20 msgr2=0x7fe71006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.804+0000 7fe718648700 1 -- 172.21.15.5:0/1465389268 shutdown_connections 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 -- 172.21.15.5:0/1465389268 wait complete. 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 Processor -- start 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 -- start start 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710107a60 0x7fe71019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe710108380 0x7fe71019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe71010c260 0x7fe7101a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101a43b0 con 0x7fe710108380 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101a4520 con 0x7fe710107a60 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.805+0000 7fe718648700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101a46e0 con 0x7fe71010c260 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe715be3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe710108380 0x7fe71019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710107a60 0x7fe71019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe715be3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe710108380 0x7fe71019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35614/0 (socket says 172.21.15.5:35614) 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe715be3700 1 -- 172.21.15.5:0/1549340589 learned_addr learned my addr 172.21.15.5:0/1549340589 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe716be5700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe71010c260 0x7fe7101a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 -- 172.21.15.5:0/1549340589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe71010c260 msgr2=0x7fe7101a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe71010c260 0x7fe7101a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 -- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe710108380 msgr2=0x7fe71019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe710108380 0x7fe71019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 -- 172.21.15.5:0/1549340589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c009520 con 0x7fe710107a60 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7163e4700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710107a60 0x7fe71019f490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7000098e0 tx=0x7fe700005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7077fe700 1 -- 172.21.15.5:0/1549340589 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70001d070 con 0x7fe710107a60 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7077fe700 1 -- 172.21.15.5:0/1549340589 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe700022470 con 0x7fe710107a60 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe7077fe700 1 -- 172.21.15.5:0/1549340589 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700017650 con 0x7fe710107a60 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000095f0 con 0x7fe710107a60 2023-10-08T13:08:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.806+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101a4ba0 con 0x7fe710107a60 2023-10-08T13:08:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.809+0000 7fe7077fe700 1 -- 172.21.15.5:0/1549340589 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fe7000225e0 con 0x7fe710107a60 2023-10-08T13:08:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.810+0000 7fe7077fe700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6fc0a15e0 0x7fe6fc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.810+0000 7fe715be3700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6fc0a15e0 0x7fe6fc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.810+0000 7fe7077fe700 1 -- 172.21.15.5:0/1549340589 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe7000ce6a0 con 0x7fe710107a60 2023-10-08T13:08:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.810+0000 7fe715be3700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6fc0a15e0 0x7fe6fc0a3aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe7101a09e0 tx=0x7fe70c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 Processor -- start 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 -- start start 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cddc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cd7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cd8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0c40400 con 0x560ad0cd80b0 2023-10-08T13:08:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0c31bc0 con 0x560ad0cdd880 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe724831b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0c2f4e0 con 0x560ad0cde1a0 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cddc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cddc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58802/0 (socket says 172.21.15.5:58802) 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe716be5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cd8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe7163e4700 1 -- 172.21.15.5:0/182890671 learned_addr learned my addr 172.21.15.5:0/182890671 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.811+0000 7fe715be3700 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cd7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe7163e4700 1 -- 172.21.15.5:0/182890671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 msgr2=0x560ad0cd7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe7163e4700 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cd7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe7163e4700 1 -- 172.21.15.5:0/182890671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 msgr2=0x560ad0cd8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe7163e4700 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cd8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe7163e4700 1 -- 172.21.15.5:0/182890671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ad0a55d80 con 0x560ad0cdd880 2023-10-08T13:08:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe7163e4700 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cddc60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe700097e40 tx=0x7fe700022c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65187746be48d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe704ff9700 1 -- 172.21.15.5:0/182890671 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70009bad0 con 0x560ad0cdd880 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe704ff9700 1 -- 172.21.15.5:0/182890671 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70009b3d0 con 0x560ad0cdd880 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.812+0000 7fe704ff9700 1 -- 172.21.15.5:0/182890671 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70009f2d0 con 0x560ad0cdd880 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 -- 172.21.15.5:0/182890671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 msgr2=0x560ad0cddc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cddc60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe700097e40 tx=0x7fe700022c60 comp rx=0 tx=0).stop 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 -- 172.21.15.5:0/182890671 shutdown_connections 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cd8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cddc60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 --2- 172.21.15.5:0/182890671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cd7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 -- 172.21.15.5:0/182890671 >> 172.21.15.5:0/182890671 conn(0x560ad0c4c200 msgr2=0x560ad0cd2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 -- 172.21.15.5:0/182890671 shutdown_connections 2023-10-08T13:08:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.814+0000 7fe724831b80 1 -- 172.21.15.5:0/182890671 wait complete. 2023-10-08T13:08:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 -- start start 2023-10-08T13:08:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 Processor -- start 2023-10-08T13:08:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0ce2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cde710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0c2add0 con 0x560ad0cd80b0 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.815+0000 7fe724831b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0bc76b0 con 0x560ad0cdd880 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe724831b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0bc7350 con 0x560ad0cde1a0 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe724831b80 10 client.0 _ll_register_callbacks cb 0x560ad0a247a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cde710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cde710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58810/0 (socket says 172.21.15.5:58810) 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 -- 172.21.15.5:0/4022863404 learned_addr learned my addr 172.21.15.5:0/4022863404 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe7163e4700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0ce2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe716be5700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 -- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 msgr2=0x560ad0cded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 -- 172.21.15.5:0/4022863404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 msgr2=0x560ad0ce2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0ce2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 -- 172.21.15.5:0/4022863404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101a4ba0 con 0x560ad0cdd880 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe715be3700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cde710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00ed30 tx=0x7fe70c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc42b3710d1e868e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe6f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.816+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/4022863404 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c022070 con 0x560ad0cdd880 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/4022863404 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe70c00ee20 con 0x560ad0cdd880 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ad0bf2e50 con 0x560ad0cdd880 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/4022863404 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe70c01ddc0 con 0x560ad0cdd880 2023-10-08T13:08:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 10 client.25697 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x560ad0a3ec00 con 0x560ad0cdd880 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/4022863404 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560ad0bf2e50 con 0x560ad0cdd880 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/4022863404 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe70c01c530 con 0x560ad0cdd880 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 10 client.25697 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 10 client.25697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 20 client.25697 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0ce99a0 0x560ad0cebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 4 client.25697 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ad0c23db0 con 0x560ad0ce99a0 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.817+0000 7fe7163e4700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0ce99a0 0x560ad0cebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.818+0000 7fe6f9ffb700 10 client.25697 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.818+0000 7fe7163e4700 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0ce99a0 0x560ad0cebdc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68372929da03d5a3 server_cookie=e86be46ee51895a1 in_seq=0 out_seq=0 2023-10-08T13:08:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/4022863404 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560ad0c23db0 con 0x560ad0ce99a0 2023-10-08T13:08:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe6f9ffb700 10 client.25697 handle_command_reply: tid=0 2023-10-08T13:08:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 client.25697 shutdown 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 msgr2=0x560ad0cde710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cde710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00ed30 tx=0x7fe70c0047c0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 shutdown_connections 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0ce2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0ce99a0 0x560ad0cebdc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 --2- 172.21.15.5:0/4022863404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cdd880 0x560ad0cde710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe6f9ffb700 0 client.25697 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 >> 172.21.15.5:0/4022863404 conn(0x560ad0c4c200 msgr2=0x560ad0cd2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 shutdown_connections 2023-10-08T13:08:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 1 -- 172.21.15.5:0/4022863404 wait complete. 2023-10-08T13:08:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.819+0000 7fe724831b80 20 client.25697 trim_cache size 0 max 16384 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.844+0000 7fe724831b80 1 Processor -- start 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.844+0000 7fe724831b80 1 -- start start 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.844+0000 7fe724831b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.844+0000 7fe724831b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cdd880 0x560ad0cd2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.844+0000 7fe724831b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cde1a0 0x560ad0cd2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.845+0000 7fe724831b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0aab8c0 con 0x560ad0cd80b0 2023-10-08T13:08:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.845+0000 7fe724831b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0cdfd80 con 0x560ad0cde1a0 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.845+0000 7fe724831b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0ce4610 con 0x560ad0cdd880 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.845+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.845+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35634/0 (socket says 172.21.15.5:35634) 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.845+0000 7fe7163e4700 1 -- 172.21.15.5:0/2559689465 learned_addr learned my addr 172.21.15.5:0/2559689465 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe7163e4700 1 -- 172.21.15.5:0/2559689465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cdd880 msgr2=0x560ad0cd2790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe7163e4700 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cdd880 0x560ad0cd2790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe7163e4700 1 -- 172.21.15.5:0/2559689465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cde1a0 msgr2=0x560ad0cd2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe716be5700 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cde1a0 0x560ad0cd2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe7163e4700 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cde1a0 0x560ad0cd2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe7163e4700 1 -- 172.21.15.5:0/2559689465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ad0a7c1f0 con 0x560ad0cd80b0 2023-10-08T13:08:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.846+0000 7fe7163e4700 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cebd90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe7000cbb60 tx=0x7fe700022c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820148143c4362ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.847+0000 7fe7057fa700 1 -- 172.21.15.5:0/2559689465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000a36d0 con 0x560ad0cd80b0 2023-10-08T13:08:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.847+0000 7fe7057fa700 1 -- 172.21.15.5:0/2559689465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70009f520 con 0x560ad0cd80b0 2023-10-08T13:08:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.847+0000 7fe7057fa700 1 -- 172.21.15.5:0/2559689465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000228c0 con 0x560ad0cd80b0 2023-10-08T13:08:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.848+0000 7fe724831b80 1 -- 172.21.15.5:0/2559689465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 msgr2=0x560ad0cebd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.848+0000 7fe724831b80 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cebd90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe7000cbb60 tx=0x7fe700022c60 comp rx=0 tx=0).stop 2023-10-08T13:08:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.851+0000 7fe724831b80 1 -- 172.21.15.5:0/2559689465 shutdown_connections 2023-10-08T13:08:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.851+0000 7fe724831b80 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0cde1a0 0x560ad0cd2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.851+0000 7fe724831b80 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cebd90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.851+0000 7fe724831b80 1 --2- 172.21.15.5:0/2559689465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cdd880 0x560ad0cd2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.851+0000 7fe724831b80 1 -- 172.21.15.5:0/2559689465 >> 172.21.15.5:0/2559689465 conn(0x560ad0c4c200 msgr2=0x560ad0d0b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.869+0000 7fe724831b80 1 -- 172.21.15.5:0/2559689465 shutdown_connections 2023-10-08T13:08:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.869+0000 7fe724831b80 1 -- 172.21.15.5:0/2559689465 wait complete. 2023-10-08T13:08:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.869+0000 7fe724831b80 1 -- start start 2023-10-08T13:08:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 Processor -- start 2023-10-08T13:08:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cf06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0ceebe0 0x560ad0cef060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0cf0c00 con 0x560ad0cd80b0 2023-10-08T13:08:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0cfdea0 con 0x560ad0ceebe0 2023-10-08T13:08:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ad0cfe060 con 0x560ad0cde1a0 2023-10-08T13:08:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.870+0000 7fe724831b80 10 client.0 _ll_register_callbacks cb 0x7fe70c00e8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.871+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cf06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.871+0000 7fe7163e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cf06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35638/0 (socket says 172.21.15.5:35638) 2023-10-08T13:08:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.871+0000 7fe7163e4700 1 -- 172.21.15.5:0/2930250039 learned_addr learned my addr 172.21.15.5:0/2930250039 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe7163e4700 1 -- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 msgr2=0x560ad0cee6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:08:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe7163e4700 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cee6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe7163e4700 1 -- 172.21.15.5:0/2930250039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0ceebe0 msgr2=0x560ad0cef060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:08:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe7163e4700 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0ceebe0 0x560ad0cef060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe7163e4700 1 -- 172.21.15.5:0/2930250039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ad0a55d80 con 0x560ad0cd80b0 2023-10-08T13:08:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe7163e4700 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cf06c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe700099720 tx=0x7fe70000bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831557ae500bb44c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe6f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:08:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.872+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/2930250039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70009f350 con 0x560ad0cd80b0 2023-10-08T13:08:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.873+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/2930250039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe7000b1040 con 0x560ad0cd80b0 2023-10-08T13:08:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.873+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe70009b3d0 con 0x560ad0cd80b0 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.873+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/2930250039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7000ce340 con 0x560ad0cd80b0 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 10 client.16179 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x560ad0a54250 con 0x560ad0cd80b0 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/2930250039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70009b3d0 con 0x560ad0cd80b0 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/2930250039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe70009a8c0 con 0x560ad0cd80b0 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 10 client.16179 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 10 client.16179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 20 client.16179 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0cff3b0 0x560ad0d01870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 4 client.16179 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:08:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.874+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ad0c23ad0 con 0x560ad0cff3b0 2023-10-08T13:08:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.875+0000 7fe715be3700 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0cff3b0 0x560ad0d01870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.876+0000 7fe6f9ffb700 10 client.16179 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.876+0000 7fe715be3700 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0cff3b0 0x560ad0d01870 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d6f4009eff00dec server_cookie=afd8dc2f4d5eb5cc in_seq=0 out_seq=0 2023-10-08T13:08:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe6f9ffb700 1 -- 172.21.15.5:0/2930250039 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ad0c23ad0 con 0x560ad0cff3b0 2023-10-08T13:08:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe6f9ffb700 10 client.16179 handle_command_reply: tid=0 2023-10-08T13:08:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 client.16179 shutdown 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 msgr2=0x560ad0cf06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cf06c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe700099720 tx=0x7fe70000bfb0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 shutdown_connections 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560ad0cff3b0 0x560ad0d01870 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560ad0ceebe0 0x560ad0cef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560ad0cd80b0 0x560ad0cf06c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 --2- 172.21.15.5:0/2930250039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560ad0cde1a0 0x560ad0cee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 >> 172.21.15.5:0/2930250039 conn(0x560ad0c4c200 msgr2=0x560ad0cde6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe6f9ffb700 0 client.16179 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 shutdown_connections 2023-10-08T13:08:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.894+0000 7fe724831b80 1 -- 172.21.15.5:0/2930250039 wait complete. 2023-10-08T13:08:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe724831b80 20 client.16179 trim_cache size 0 max 16384 2023-10-08T13:08:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:08:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:08:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:08:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:08:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6fc0a15e0 msgr2=0x7fe6fc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6fc0a15e0 0x7fe6fc0a3aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe7101a09e0 tx=0x7fe70c009260 comp rx=0 tx=0).stop 2023-10-08T13:08:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710107a60 msgr2=0x7fe71019f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710107a60 0x7fe71019f490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7000098e0 tx=0x7fe700005740 comp rx=0 tx=0).stop 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 shutdown_connections 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fe6fc0a15e0 0x7fe6fc0a3aa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe71010c260 0x7fe7101a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe710107a60 0x7fe71019f490 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 --2- 172.21.15.5:0/1549340589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe710108380 0x7fe71019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 >> 172.21.15.5:0/1549340589 conn(0x7fe71006bc20 msgr2=0x7fe7101158b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 shutdown_connections 2023-10-08T13:08:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:06.895+0000 7fe718648700 1 -- 172.21.15.5:0/1549340589 wait complete. 2023-10-08T13:08:08.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:08 smithi060 ceph-mon[103190]: pgmap v364: 129 pgs: 129 active+clean; 2.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 24 MiB/s wr, 1.72k op/s 2023-10-08T13:08:08.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:08 smithi005 ceph-mon[99496]: pgmap v364: 129 pgs: 129 active+clean; 2.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 24 MiB/s wr, 1.72k op/s 2023-10-08T13:08:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:08 smithi118 ceph-mon[104234]: pgmap v364: 129 pgs: 129 active+clean; 2.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 24 MiB/s wr, 1.72k op/s 2023-10-08T13:08:10.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.555+0000 7fda2d8e4700 1 -- 172.21.15.5:0/2933689484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda2810edf0 msgr2=0x7fda2810f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.555+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/2933689484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda2810edf0 0x7fda2810f1d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fda2000b0a0 tx=0x7fda2000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 -- 172.21.15.5:0/2933689484 shutdown_connections 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/2933689484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda281083a0 0x7fda2811bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/2933689484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda2810edf0 0x7fda2810f1d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/2933689484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda281077f0 0x7fda28107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 -- 172.21.15.5:0/2933689484 >> 172.21.15.5:0/2933689484 conn(0x7fda2806b770 msgr2=0x7fda2806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 -- 172.21.15.5:0/2933689484 shutdown_connections 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.556+0000 7fda2d8e4700 1 -- 172.21.15.5:0/2933689484 wait complete. 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.557+0000 7fda2d8e4700 1 Processor -- start 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.557+0000 7fda2d8e4700 1 -- start start 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.557+0000 7fda2d8e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda281077f0 0x7fda281ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda2d8e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda281083a0 0x7fda281abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda2d8e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 0x7fda281a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda2d8e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281a5ee0 con 0x7fda281083a0 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda2d8e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281a6050 con 0x7fda2810edf0 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda2d8e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281a6210 con 0x7fda281077f0 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 0x7fda281a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 0x7fda281a5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58830/0 (socket says 172.21.15.5:58830) 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 -- 172.21.15.5:0/3100796616 learned_addr learned my addr 172.21.15.5:0/3100796616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 -- 172.21.15.5:0/3100796616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda281077f0 msgr2=0x7fda281ab6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda281077f0 0x7fda281ab6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 -- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda281083a0 msgr2=0x7fda281abc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda281083a0 0x7fda281abc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.558+0000 7fda277fe700 1 -- 172.21.15.5:0/3100796616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009d00 con 0x7fda2810edf0 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.559+0000 7fda277fe700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 0x7fda281a5880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00b450 tx=0x7fda1c00b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.559+0000 7fda2c8e2700 1 -- 172.21.15.5:0/3100796616 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011830 con 0x7fda2810edf0 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.559+0000 7fda2c8e2700 1 -- 172.21.15.5:0/3100796616 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda1c011e50 con 0x7fda2810edf0 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.559+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda281a64f0 con 0x7fda2810edf0 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.559+0000 7fda2c8e2700 1 -- 172.21.15.5:0/3100796616 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00f2e0 con 0x7fda2810edf0 2023-10-08T13:08:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.559+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda281b2810 con 0x7fda2810edf0 2023-10-08T13:08:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.565+0000 7fda2c8e2700 1 -- 172.21.15.5:0/3100796616 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fda1c00f440 con 0x7fda2810edf0 2023-10-08T13:08:10.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 Processor -- start 2023-10-08T13:08:10.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 -- start start 2023-10-08T13:08:10.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a669260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a674110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a676a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a5d2460 con 0x558e1a674650 2023-10-08T13:08:10.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a5c3c20 con 0x558e1a668e80 2023-10-08T13:08:10.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda39acdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a5c1540 con 0x558e1a6697a0 2023-10-08T13:08:10.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda267fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a669260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda267fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a669260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58832/0 (socket says 172.21.15.5:58832) 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda267fc700 1 -- 172.21.15.5:0/4099965175 learned_addr learned my addr 172.21.15.5:0/4099965175 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda2c8e2700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda100a1670 0x7fda100a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.566+0000 7fda267fc700 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a676a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda267fc700 1 -- 172.21.15.5:0/4099965175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 msgr2=0x558e1a674110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda267fc700 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a674110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda2c8e2700 1 -- 172.21.15.5:0/3100796616 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fda1c0cdd10 con 0x7fda2810edf0 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda267fc700 1 -- 172.21.15.5:0/4099965175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 msgr2=0x558e1a676a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda267fc700 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a676a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda267fc700 1 -- 172.21.15.5:0/4099965175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e1a3e7de0 con 0x558e1a668e80 2023-10-08T13:08:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.567+0000 7fda277fe700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda100a1670 0x7fda100a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.568+0000 7fda267fc700 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a669260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda18015430 tx=0x7fda18009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f370ef5f292f940 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:10.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.568+0000 7fda277fe700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda100a1670 0x7fda100a3b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00bc10 tx=0x7fda1c010000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:10.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.568+0000 7fda0dffb700 1 -- 172.21.15.5:0/4099965175 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18015c50 con 0x558e1a668e80 2023-10-08T13:08:10.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.568+0000 7fda0dffb700 1 -- 172.21.15.5:0/4099965175 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda18015db0 con 0x558e1a668e80 2023-10-08T13:08:10.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.568+0000 7fda0dffb700 1 -- 172.21.15.5:0/4099965175 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18004ac0 con 0x558e1a668e80 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 -- 172.21.15.5:0/4099965175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 msgr2=0x558e1a669260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a669260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda18015430 tx=0x7fda18009ec0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 -- 172.21.15.5:0/4099965175 shutdown_connections 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a676a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a669260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 --2- 172.21.15.5:0/4099965175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a674110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 -- 172.21.15.5:0/4099965175 >> 172.21.15.5:0/4099965175 conn(0x558e1a5de260 msgr2=0x558e1a6652d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 -- 172.21.15.5:0/4099965175 shutdown_connections 2023-10-08T13:08:10.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.569+0000 7fda39acdb80 1 -- 172.21.15.5:0/4099965175 wait complete. 2023-10-08T13:08:10.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.570+0000 7fda39acdb80 1 -- start start 2023-10-08T13:08:10.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.570+0000 7fda39acdb80 1 Processor -- start 2023-10-08T13:08:10.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a673f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a6697a0 0x558e1a671280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a674650 0x558e1a671800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a5bce30 con 0x558e1a668e80 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a559710 con 0x558e1a6697a0 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a5593b0 con 0x558e1a674650 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda39acdb80 10 client.0 _ll_register_callbacks cb 0x558e1a3b6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a673f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a673f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35656/0 (socket says 172.21.15.5:35656) 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda267fc700 1 -- 172.21.15.5:0/810984493 learned_addr learned my addr 172.21.15.5:0/810984493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.571+0000 7fda26ffd700 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a6697a0 0x558e1a671280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda26ffd700 1 -- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a674650 msgr2=0x558e1a671800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda26ffd700 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a674650 0x558e1a671800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda26ffd700 1 -- 172.21.15.5:0/810984493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 msgr2=0x558e1a673f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda26ffd700 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a673f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda26ffd700 1 -- 172.21.15.5:0/810984493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda18001d50 con 0x558e1a6697a0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda26ffd700 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a6697a0 0x558e1a671280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda280707f0 tx=0x7fda200094d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14be52e36370c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda06ffd700 1 -- 172.21.15.5:0/810984493 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000e040 con 0x558e1a6697a0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda06ffd700 1 -- 172.21.15.5:0/810984493 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fda200074a0 con 0x558e1a6697a0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.572+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e1a584eb0 con 0x558e1a6697a0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda06ffd700 1 -- 172.21.15.5:0/810984493 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda20007660 con 0x558e1a6697a0 2023-10-08T13:08:10.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 10 client.25706 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x558e1a3d0c60 con 0x558e1a6697a0 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda06ffd700 1 -- 172.21.15.5:0/810984493 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda2002a030 con 0x558e1a6697a0 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda06ffd700 1 -- 172.21.15.5:0/810984493 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fda20019040 con 0x558e1a6697a0 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 10 client.25706 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 20 client.25706 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a695260 0x558e1a697720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 4 client.25706 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:10.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.573+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e1a5b5e10 con 0x558e1a695260 2023-10-08T13:08:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.575+0000 7fda267fc700 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a695260 0x558e1a697720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.575+0000 7fda06ffd700 10 client.25706 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.575+0000 7fda267fc700 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a695260 0x558e1a697720 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=909cf811a0530970 server_cookie=4074bc4d5e1b1df8 in_seq=0 out_seq=0 2023-10-08T13:08:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda06ffd700 1 -- 172.21.15.5:0/810984493 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558e1a5b5e10 con 0x558e1a695260 2023-10-08T13:08:10.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda06ffd700 10 client.25706 handle_command_reply: tid=0 2023-10-08T13:08:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda39acdb80 1 client.25706 shutdown 2023-10-08T13:08:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a6697a0 msgr2=0x558e1a671280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda39acdb80 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a6697a0 0x558e1a671280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda280707f0 tx=0x7fda200094d0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 shutdown_connections 2023-10-08T13:08:10.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.576+0000 7fda39acdb80 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a674650 0x558e1a671800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a673f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a695260 0x558e1a697720 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 1 --2- 172.21.15.5:0/810984493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a6697a0 0x558e1a671280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 >> 172.21.15.5:0/810984493 conn(0x558e1a5de260 msgr2=0x558e1a664ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda06ffd700 0 client.25706 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 shutdown_connections 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 1 -- 172.21.15.5:0/810984493 wait complete. 2023-10-08T13:08:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.577+0000 7fda39acdb80 20 client.25706 trim_cache size 0 max 16384 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.601+0000 7fda39acdb80 1 Processor -- start 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.601+0000 7fda39acdb80 1 -- start start 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a6717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a674650 0x558e1a66c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda39acdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a43d920 con 0x558e1a668e80 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda39acdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a66a0d0 con 0x558e1a674650 2023-10-08T13:08:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda39acdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a661ae0 con 0x558e1a6697a0 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a6717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48870/0 (socket says 172.21.15.5:48870) 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a6717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35664/0 (socket says 172.21.15.5:35664) 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 -- 172.21.15.5:0/1181043334 learned_addr learned my addr 172.21.15.5:0/1181043334 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda267fc700 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a674650 0x558e1a66c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 -- 172.21.15.5:0/1181043334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a674650 msgr2=0x558e1a66c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a674650 0x558e1a66c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 -- 172.21.15.5:0/1181043334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 msgr2=0x558e1a6717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a6717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda26ffd700 1 -- 172.21.15.5:0/1181043334 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e1a40e250 con 0x558e1a6697a0 2023-10-08T13:08:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.602+0000 7fda267fc700 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a6717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:08:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.603+0000 7fda26ffd700 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c1f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda20009850 tx=0x7fda20004a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d451371cf149e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.603+0000 7fda0e7fc700 1 -- 172.21.15.5:0/1181043334 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20004f20 con 0x558e1a6697a0 2023-10-08T13:08:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.603+0000 7fda0e7fc700 1 -- 172.21.15.5:0/1181043334 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda2002a070 con 0x558e1a6697a0 2023-10-08T13:08:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.603+0000 7fda0e7fc700 1 -- 172.21.15.5:0/1181043334 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2001d940 con 0x558e1a6697a0 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.604+0000 7fda39acdb80 1 -- 172.21.15.5:0/1181043334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 msgr2=0x558e1a68c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.604+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c1f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda20009850 tx=0x7fda20004a10 comp rx=0 tx=0).stop 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 -- 172.21.15.5:0/1181043334 shutdown_connections 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a674650 0x558e1a66c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a668e80 0x558e1a6717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1181043334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c1f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 -- 172.21.15.5:0/1181043334 >> 172.21.15.5:0/1181043334 conn(0x558e1a5de260 msgr2=0x558e1a697270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 -- 172.21.15.5:0/1181043334 shutdown_connections 2023-10-08T13:08:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 -- 172.21.15.5:0/1181043334 wait complete. 2023-10-08T13:08:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.605+0000 7fda39acdb80 1 -- start start 2023-10-08T13:08:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 Processor -- start 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a68bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a689f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a68a670 con 0x558e1a674650 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a68a7e0 con 0x558e1a668e80 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1a68a9a0 con 0x558e1a6697a0 2023-10-08T13:08:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.606+0000 7fda39acdb80 10 client.0 _ll_register_callbacks cb 0x7fda20009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48874/0 (socket says 172.21.15.5:48874) 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 -- 172.21.15.5:0/1388456146 learned_addr learned my addr 172.21.15.5:0/1388456146 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda267fc700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a68bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda267fc700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a689f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 -- 172.21.15.5:0/1388456146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 msgr2=0x558e1a68bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a68bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 -- 172.21.15.5:0/1388456146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 msgr2=0x558e1a689f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a689f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.607+0000 7fda26ffd700 1 -- 172.21.15.5:0/1388456146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1802d040 con 0x558e1a6697a0 2023-10-08T13:08:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.608+0000 7fda26ffd700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda20009ac0 tx=0x7fda20006020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f81c62b73ebc402e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:08:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda06ffd700 1 -- 172.21.15.5:0/1388456146 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2001d990 con 0x558e1a6697a0 2023-10-08T13:08:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda06ffd700 1 -- 172.21.15.5:0/1388456146 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fda2001daf0 con 0x558e1a6697a0 2023-10-08T13:08:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda18015db0 con 0x558e1a6697a0 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda06ffd700 1 -- 172.21.15.5:0/1388456146 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda2002f440 con 0x558e1a6697a0 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 10 client.25744 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x558e1a3d0c60 con 0x558e1a6697a0 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda06ffd700 1 -- 172.21.15.5:0/1388456146 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda18015db0 con 0x558e1a6697a0 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda06ffd700 1 -- 172.21.15.5:0/1388456146 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fda20019040 con 0x558e1a6697a0 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 10 client.25744 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 10 client.25744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 20 client.25744 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a6e9f10 0x558e1a6ec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 4 client.25744 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.609+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558e1a5b5b30 con 0x558e1a6e9f10 2023-10-08T13:08:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda267fc700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a6e9f10 0x558e1a6ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda06ffd700 10 client.25744 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda267fc700 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a6e9f10 0x558e1a6ec330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab32cceafb8e39ba server_cookie=3ea5be206c345a74 in_seq=0 out_seq=0 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda06ffd700 1 -- 172.21.15.5:0/1388456146 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558e1a5b5b30 con 0x558e1a6e9f10 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda06ffd700 10 client.25744 handle_command_reply: tid=0 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda39acdb80 1 client.25744 shutdown 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 msgr2=0x558e1a68c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda20009ac0 tx=0x7fda20006020 comp rx=0 tx=0).stop 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 shutdown_connections 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558e1a674650 0x558e1a689f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.610+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x558e1a6e9f10 0x558e1a6ec330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.611+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e1a668e80 0x558e1a68bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.611+0000 7fda39acdb80 1 --2- 172.21.15.5:0/1388456146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e1a6697a0 0x558e1a68c050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.611+0000 7fda06ffd700 0 client.25744 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.611+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 >> 172.21.15.5:0/1388456146 conn(0x558e1a5de260 msgr2=0x558e1a66c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 shutdown_connections 2023-10-08T13:08:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda39acdb80 1 -- 172.21.15.5:0/1388456146 wait complete. 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda39acdb80 20 client.25744 trim_cache size 0 max 16384 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:08:10.616 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:08:10.617 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:08:10.617 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:08:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda100a1670 msgr2=0x7fda100a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda100a1670 0x7fda100a3b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00bc10 tx=0x7fda1c010000 comp rx=0 tx=0).stop 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 msgr2=0x7fda281a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 0x7fda281a5880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00b450 tx=0x7fda1c00b810 comp rx=0 tx=0).stop 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 shutdown_connections 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fda100a1670 0x7fda100a3b30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda2810edf0 0x7fda281a5880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda281077f0 0x7fda281ab6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 --2- 172.21.15.5:0/3100796616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda281083a0 0x7fda281abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.613+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 >> 172.21.15.5:0/3100796616 conn(0x7fda2806b770 msgr2=0x7fda28070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.616+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 shutdown_connections 2023-10-08T13:08:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:10.616+0000 7fda2d8e4700 1 -- 172.21.15.5:0/3100796616 wait complete. 2023-10-08T13:08:10.636 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:10 smithi005 ceph-mon[99496]: pgmap v365: 129 pgs: 129 active+clean; 2.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 1.65k op/s 2023-10-08T13:08:10.637 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:08:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:10 smithi060 ceph-mon[103190]: pgmap v365: 129 pgs: 129 active+clean; 2.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 1.65k op/s 2023-10-08T13:08:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:10 smithi118 ceph-mon[104234]: pgmap v365: 129 pgs: 129 active+clean; 2.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 1.65k op/s 2023-10-08T13:08:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 110.0 s, 2007.4 tps, lat 49.651 ms stddev 56.770 2023-10-08T13:08:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:12 smithi060 ceph-mon[103190]: pgmap v366: 129 pgs: 129 active+clean; 2.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 23 MiB/s wr, 1.66k op/s 2023-10-08T13:08:12.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:12 smithi005 ceph-mon[99496]: pgmap v366: 129 pgs: 129 active+clean; 2.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 23 MiB/s wr, 1.66k op/s 2023-10-08T13:08:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:12 smithi118 ceph-mon[104234]: pgmap v366: 129 pgs: 129 active+clean; 2.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 23 MiB/s wr, 1.66k op/s 2023-10-08T13:08:14.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:14 smithi060 ceph-mon[103190]: pgmap v367: 129 pgs: 129 active+clean; 2.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 1.58k op/s 2023-10-08T13:08:14.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:14 smithi005 ceph-mon[99496]: pgmap v367: 129 pgs: 129 active+clean; 2.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 1.58k op/s 2023-10-08T13:08:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:14 smithi118 ceph-mon[104234]: pgmap v367: 129 pgs: 129 active+clean; 2.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 1.58k op/s 2023-10-08T13:08:16.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:16 smithi005 ceph-mon[99496]: pgmap v368: 129 pgs: 129 active+clean; 2.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2023-10-08T13:08:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 115.0 s, 1394.0 tps, lat 72.515 ms stddev 88.909 2023-10-08T13:08:16.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:16 smithi118 ceph-mon[104234]: pgmap v368: 129 pgs: 129 active+clean; 2.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2023-10-08T13:08:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:16 smithi060 ceph-mon[103190]: pgmap v368: 129 pgs: 129 active+clean; 2.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2023-10-08T13:08:18.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:18 smithi118 ceph-mon[104234]: pgmap v369: 129 pgs: 129 active+clean; 2.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 710 op/s 2023-10-08T13:08:18.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:18 smithi060 ceph-mon[103190]: pgmap v369: 129 pgs: 129 active+clean; 2.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 710 op/s 2023-10-08T13:08:18.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:18 smithi005 ceph-mon[99496]: pgmap v369: 129 pgs: 129 active+clean; 2.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 710 op/s 2023-10-08T13:08:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 -- 172.21.15.5:0/723951275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410eea0 msgr2=0x7f84041077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 --2- 172.21.15.5:0/723951275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410eea0 0x7f84041077f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84000099c0 tx=0x7f8400009cd0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 -- 172.21.15.5:0/723951275 shutdown_connections 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 --2- 172.21.15.5:0/723951275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8404119fd0 0x7f840411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 --2- 172.21.15.5:0/723951275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410eea0 0x7f84041077f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 --2- 172.21.15.5:0/723951275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f840410f310 0x7f8404107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 -- 172.21.15.5:0/723951275 >> 172.21.15.5:0/723951275 conn(0x7f840406b7c0 msgr2=0x7f840406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 -- 172.21.15.5:0/723951275 shutdown_connections 2023-10-08T13:08:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.085+0000 7f840c052700 1 -- 172.21.15.5:0/723951275 wait complete. 2023-10-08T13:08:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 Processor -- start 2023-10-08T13:08:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 -- start start 2023-10-08T13:08:20.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 0x7f84041ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410f310 0x7f84041abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8404119fd0 0x7f84041a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84041a5e70 con 0x7f840410eea0 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84041a5fe0 con 0x7f8404119fd0 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f840c052700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84041a61a0 con 0x7f840410f310 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.086+0000 7f8409dee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 0x7f84041ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f8409dee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 0x7f84041ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35684/0 (socket says 172.21.15.5:35684) 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f8409dee700 1 -- 172.21.15.5:0/1020259252 learned_addr learned my addr 172.21.15.5:0/1020259252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8404119fd0 0x7f84041a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f84095ed700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410f310 0x7f84041abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 -- 172.21.15.5:0/1020259252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410f310 msgr2=0x7f84041abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410f310 0x7f84041abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 -- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 msgr2=0x7f84041ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 0x7f84041ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 -- 172.21.15.5:0/1020259252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000095f0 con 0x7f8404119fd0 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f8409dee700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 0x7f84041ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8404119fd0 0x7f84041a5800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00efc0 tx=0x7f83fc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.087+0000 7f83faffd700 1 -- 172.21.15.5:0/1020259252 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc018070 con 0x7f8404119fd0 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.088+0000 7f83faffd700 1 -- 172.21.15.5:0/1020259252 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83fc00f040 con 0x7f8404119fd0 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.088+0000 7f83faffd700 1 -- 172.21.15.5:0/1020259252 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00cca0 con 0x7f8404119fd0 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.088+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84041a6420 con 0x7f8404119fd0 2023-10-08T13:08:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.088+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84041b2670 con 0x7f8404119fd0 2023-10-08T13:08:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 Processor -- start 2023-10-08T13:08:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 -- start start 2023-10-08T13:08:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebdcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebd6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebd7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2eb3f400 con 0x564a2ebd70b0 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2eb30bc0 con 0x564a2ebdd1a0 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.093+0000 7f841823bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2eb2e4e0 con 0x564a2ebdc880 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebdcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebdcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48894/0 (socket says 172.21.15.5:48894) 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 -- 172.21.15.5:0/2887200717 learned_addr learned my addr 172.21.15.5:0/2887200717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f8409dee700 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebd6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebd7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 -- 172.21.15.5:0/2887200717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 msgr2=0x564a2ebd6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebd6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 -- 172.21.15.5:0/2887200717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 msgr2=0x564a2ebd7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebd7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 -- 172.21.15.5:0/2887200717 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2e954d80 con 0x564a2ebdc880 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f84095ed700 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebdcc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83f4017780 tx=0x7f83f4009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c429e64da4f9949b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f83effff700 1 -- 172.21.15.5:0/2887200717 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4018450 con 0x564a2ebdc880 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f83effff700 1 -- 172.21.15.5:0/2887200717 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83f4018a70 con 0x564a2ebdc880 2023-10-08T13:08:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.094+0000 7f83effff700 1 -- 172.21.15.5:0/2887200717 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40168d0 con 0x564a2ebdc880 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.095+0000 7f83faffd700 1 -- 172.21.15.5:0/1020259252 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f83fc003a00 con 0x7f8404119fd0 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.095+0000 7f841823bb80 1 -- 172.21.15.5:0/2887200717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 msgr2=0x564a2ebdcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.095+0000 7f841823bb80 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebdcc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83f4017780 tx=0x7f83f4009550 comp rx=0 tx=0).stop 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 -- 172.21.15.5:0/2887200717 shutdown_connections 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebd7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebdcc60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 --2- 172.21.15.5:0/2887200717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebd6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 -- 172.21.15.5:0/2887200717 >> 172.21.15.5:0/2887200717 conn(0x564a2eb4b200 msgr2=0x564a2ebd1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 -- 172.21.15.5:0/2887200717 shutdown_connections 2023-10-08T13:08:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 -- 172.21.15.5:0/2887200717 wait complete. 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f83faffd700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f83f00a1640 0x7f83f00a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 -- start start 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f841823bb80 1 Processor -- start 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.096+0000 7f83faffd700 1 -- 172.21.15.5:0/1020259252 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f83fc0cc7d0 con 0x7f8404119fd0 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f84095ed700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f83f00a1640 0x7f83f00a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebd70b0 0x564a2ebe0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 0x564a2ebe1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2eb29dd0 con 0x564a2ebdc880 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2eac66b0 con 0x564a2ebd70b0 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2eac6350 con 0x564a2ebdd1a0 2023-10-08T13:08:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f841823bb80 10 client.0 _ll_register_callbacks cb 0x564a2e9237a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f840a5ef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 0x564a2ebe1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f8409dee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebd70b0 0x564a2ebe0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f840a5ef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 0x564a2ebe1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48902/0 (socket says 172.21.15.5:48902) 2023-10-08T13:08:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.097+0000 7f840a5ef700 1 -- 172.21.15.5:0/1404284182 learned_addr learned my addr 172.21.15.5:0/1404284182 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f84095ed700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f840a5ef700 1 -- 172.21.15.5:0/1404284182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebd70b0 msgr2=0x564a2ebe0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebd70b0 0x564a2ebe0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f840a5ef700 1 -- 172.21.15.5:0/1404284182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 msgr2=0x564a2ebe0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f840a5ef700 1 -- 172.21.15.5:0/1404284182 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f4017460 con 0x564a2ebdd1a0 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f8409dee700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebd70b0 0x564a2ebe0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f840a5ef700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 0x564a2ebe1080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009fd0 tx=0x7f83fc098ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b354be8cb40400e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.098+0000 7f83ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f83ed7fa700 1 -- 172.21.15.5:0/1404284182 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0a17a0 con 0x564a2ebdd1a0 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f83ed7fa700 1 -- 172.21.15.5:0/1404284182 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f83fc0cc3b0 con 0x564a2ebdd1a0 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a2eaf1e50 con 0x564a2ebdd1a0 2023-10-08T13:08:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f84095ed700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f83f00a1640 0x7f83f00a3b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009270 tx=0x7f83f4004860 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f83ed7fa700 1 -- 172.21.15.5:0/1404284182 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83fc0cc590 con 0x564a2ebdd1a0 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f841823bb80 10 client.25756 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564a2e93dc00 con 0x564a2ebdd1a0 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.099+0000 7f83ed7fa700 1 -- 172.21.15.5:0/1404284182 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564a2eaf1e50 con 0x564a2ebdd1a0 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f83ed7fa700 1 -- 172.21.15.5:0/1404284182 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f83fc099790 con 0x564a2ebdd1a0 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f841823bb80 10 client.25756 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f841823bb80 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f841823bb80 20 client.25756 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f841823bb80 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ebf0d70 0x564a2ebf3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f841823bb80 4 client.25756 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a2eb22db0 con 0x564a2ebf0d70 2023-10-08T13:08:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f8409dee700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ebf0d70 0x564a2ebf3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f83ed7fa700 10 client.25756 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.100+0000 7f8409dee700 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ebf0d70 0x564a2ebf3190 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce4acc29e848851 server_cookie=5f85608adcf671c2 in_seq=0 out_seq=0 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.101+0000 7f83ed7fa700 1 -- 172.21.15.5:0/1404284182 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a2eb22db0 con 0x564a2ebf0d70 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.101+0000 7f83ed7fa700 10 client.25756 handle_command_reply: tid=0 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.101+0000 7f841823bb80 1 client.25756 shutdown 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 msgr2=0x564a2ebe1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 0x564a2ebe1080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009fd0 tx=0x7f83fc098ea0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 shutdown_connections 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdd1a0 0x564a2ebe1080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ebf0d70 0x564a2ebf3190 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebd70b0 0x564a2ebe0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f83ed7fa700 0 client.25756 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 --2- 172.21.15.5:0/1404284182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 >> 172.21.15.5:0/1404284182 conn(0x564a2eb4b200 msgr2=0x564a2ebd1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 shutdown_connections 2023-10-08T13:08:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 1 -- 172.21.15.5:0/1404284182 wait complete. 2023-10-08T13:08:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.102+0000 7f841823bb80 20 client.25756 trim_cache size 0 max 16384 2023-10-08T13:08:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.123+0000 7f841823bb80 1 Processor -- start 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.123+0000 7f841823bb80 1 -- start start 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f841823bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebd70b0 0x564a2ebdfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f841823bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f841823bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebdbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f841823bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e9aa8c0 con 0x564a2ebdc880 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f841823bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2ebe3600 con 0x564a2ebdd1a0 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f841823bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2ebd2610 con 0x564a2ebd70b0 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f840a5ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebdbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35708/0 (socket says 172.21.15.5:35708) 2023-10-08T13:08:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 -- 172.21.15.5:0/2609244537 learned_addr learned my addr 172.21.15.5:0/2609244537 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f840a5ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebdbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58892/0 (socket says 172.21.15.5:58892) 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f8409dee700 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebd70b0 0x564a2ebdfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 -- 172.21.15.5:0/2609244537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebd70b0 msgr2=0x564a2ebdfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebd70b0 0x564a2ebdfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 -- 172.21.15.5:0/2609244537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 msgr2=0x564a2ebdbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebdbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 -- 172.21.15.5:0/2609244537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2e97b1f0 con 0x564a2ebdc880 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f840a5ef700 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebdbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:08:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.124+0000 7f84095ed700 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe7c10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f83f401a000 tx=0x7f83f4028070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e7e134dd474b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.125+0000 7f83f8ff9700 1 -- 172.21.15.5:0/2609244537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4016720 con 0x564a2ebdc880 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.125+0000 7f83f8ff9700 1 -- 172.21.15.5:0/2609244537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83f4016d40 con 0x564a2ebdc880 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.125+0000 7f83f8ff9700 1 -- 172.21.15.5:0/2609244537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4032c70 con 0x564a2ebdc880 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 -- 172.21.15.5:0/2609244537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 msgr2=0x564a2ebe7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe7c10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f83f401a000 tx=0x7f83f4028070 comp rx=0 tx=0).stop 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 -- 172.21.15.5:0/2609244537 shutdown_connections 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ebdbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebd70b0 0x564a2ebdfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 --2- 172.21.15.5:0/2609244537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebdc880 0x564a2ebe7c10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 -- 172.21.15.5:0/2609244537 >> 172.21.15.5:0/2609244537 conn(0x564a2eb4b200 msgr2=0x564a2ebdb660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 -- 172.21.15.5:0/2609244537 shutdown_connections 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.126+0000 7f841823bb80 1 -- 172.21.15.5:0/2609244537 wait complete. 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.127+0000 7f841823bb80 1 -- start start 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.127+0000 7f841823bb80 1 Processor -- start 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.127+0000 7f841823bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebe3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.127+0000 7f841823bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebe4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f841823bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ec43b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f841823bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2ebe4a90 con 0x564a2ebd70b0 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f841823bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2ec44090 con 0x564a2ebdd1a0 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f841823bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2ec44250 con 0x564a2ebdc880 2023-10-08T13:08:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f841823bb80 10 client.0 _ll_register_callbacks cb 0x7f83fc099270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebe3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebe3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35712/0 (socket says 172.21.15.5:35712) 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 -- 172.21.15.5:0/3862677401 learned_addr learned my addr 172.21.15.5:0/3862677401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f840a5ef700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ec43b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f84095ed700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebe4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 -- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 msgr2=0x564a2ebe4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebe4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 -- 172.21.15.5:0/3862677401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 msgr2=0x564a2ec43b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ec43b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 -- 172.21.15.5:0/3862677401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a2e93dc00 con 0x564a2ebd70b0 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f8409dee700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebe3de0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8400006010 tx=0x7f8400005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e7a0c9463c004e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.128+0000 7f83ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:08:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f83ed7fa700 1 -- 172.21.15.5:0/3862677401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840001d040 con 0x564a2ebd70b0 2023-10-08T13:08:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f83ed7fa700 1 -- 172.21.15.5:0/3862677401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8400026c00 con 0x564a2ebd70b0 2023-10-08T13:08:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83f4018a70 con 0x564a2ebd70b0 2023-10-08T13:08:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f83ed7fa700 1 -- 172.21.15.5:0/3862677401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8400026dc0 con 0x564a2ebd70b0 2023-10-08T13:08:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 10 client.16212 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564a2e954d80 con 0x564a2ebd70b0 2023-10-08T13:08:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f83ed7fa700 1 -- 172.21.15.5:0/3862677401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83f4018a70 con 0x564a2ebd70b0 2023-10-08T13:08:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f83ed7fa700 1 -- 172.21.15.5:0/3862677401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f840000f460 con 0x564a2ebd70b0 2023-10-08T13:08:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 10 client.16212 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 20 client.16212 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ec45b60 0x564a2ec47f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 4 client.16212 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.129+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a2eb22ad0 con 0x564a2ec45b60 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.130+0000 7f84095ed700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ec45b60 0x564a2ec47f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.130+0000 7f83ed7fa700 10 client.16212 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.130+0000 7f84095ed700 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ec45b60 0x564a2ec47f80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=179388c24fa1698f server_cookie=7ba0c7e282c47607 in_seq=0 out_seq=0 2023-10-08T13:08:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.144+0000 7f83ed7fa700 1 -- 172.21.15.5:0/3862677401 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a2eb22ad0 con 0x564a2ec45b60 2023-10-08T13:08:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.144+0000 7f83ed7fa700 10 client.16212 handle_command_reply: tid=0 2023-10-08T13:08:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.144+0000 7f841823bb80 1 client.16212 shutdown 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 msgr2=0x564a2ebe3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebe3de0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8400006010 tx=0x7f8400005cb0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 shutdown_connections 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564a2ec45b60 0x564a2ec47f80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a2ebdd1a0 0x564a2ec43b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a2ebd70b0 0x564a2ebe3de0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f83ed7fa700 0 client.16212 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 --2- 172.21.15.5:0/3862677401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a2ebdc880 0x564a2ebe4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.145+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 >> 172.21.15.5:0/3862677401 conn(0x564a2eb4b200 msgr2=0x564a2ebe1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.146+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 shutdown_connections 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.146+0000 7f841823bb80 1 -- 172.21.15.5:0/3862677401 wait complete. 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.146+0000 7f841823bb80 20 client.16212 trim_cache size 0 max 16384 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:08:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:08:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f83f00a1640 msgr2=0x7f83f00a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f83f00a1640 0x7f83f00a3b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009270 tx=0x7f83f4004860 comp rx=0 tx=0).stop 2023-10-08T13:08:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8404119fd0 msgr2=0x7f84041a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8404119fd0 0x7f84041a5800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00efc0 tx=0x7f83fc00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 shutdown_connections 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f83f00a1640 0x7f83f00a3b00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8404119fd0 0x7f84041a5800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f840410eea0 0x7f84041ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 --2- 172.21.15.5:0/1020259252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f840410f310 0x7f84041abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 >> 172.21.15.5:0/1020259252 conn(0x7f840406b7c0 msgr2=0x7f8404117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 shutdown_connections 2023-10-08T13:08:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:20.147+0000 7f840c052700 1 -- 172.21.15.5:0/1020259252 wait complete. 2023-10-08T13:08:20.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:20 smithi118 ceph-mon[104234]: pgmap v370: 129 pgs: 129 active+clean; 2.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 704 op/s 2023-10-08T13:08:20.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:20 smithi060 ceph-mon[103190]: pgmap v370: 129 pgs: 129 active+clean; 2.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 704 op/s 2023-10-08T13:08:20.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:20 smithi005 ceph-mon[99496]: pgmap v370: 129 pgs: 129 active+clean; 2.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 704 op/s 2023-10-08T13:08:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 120.0 s, 1355.2 tps, lat 73.107 ms stddev 81.051 2023-10-08T13:08:22.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:22 smithi118 ceph-mon[104234]: pgmap v371: 129 pgs: 129 active+clean; 2.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 793 op/s 2023-10-08T13:08:22.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:22 smithi060 ceph-mon[103190]: pgmap v371: 129 pgs: 129 active+clean; 2.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 793 op/s 2023-10-08T13:08:22.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:22 smithi005 ceph-mon[99496]: pgmap v371: 129 pgs: 129 active+clean; 2.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 793 op/s 2023-10-08T13:08:24.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:24 smithi118 ceph-mon[104234]: pgmap v372: 129 pgs: 129 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 835 op/s 2023-10-08T13:08:24.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:24 smithi060 ceph-mon[103190]: pgmap v372: 129 pgs: 129 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 835 op/s 2023-10-08T13:08:24.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:24 smithi005 ceph-mon[99496]: pgmap v372: 129 pgs: 129 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 835 op/s 2023-10-08T13:08:25.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:25 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:08:25.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:25 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:08:25.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:25 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:08:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 125.0 s, 1474.8 tps, lat 68.089 ms stddev 82.355 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: pgmap v373: 129 pgs: 129 active+clean; 2.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 773 op/s 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:08:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:08:27.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:26 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: pgmap v373: 129 pgs: 129 active+clean; 2.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 773 op/s 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:08:27.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:26 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: pgmap v373: 129 pgs: 129 active+clean; 2.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 773 op/s 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:08:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:26 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:08:29.028 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:28 smithi118 ceph-mon[104234]: pgmap v374: 129 pgs: 129 active+clean; 2.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 856 op/s 2023-10-08T13:08:29.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:28 smithi060 ceph-mon[103190]: pgmap v374: 129 pgs: 129 active+clean; 2.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 856 op/s 2023-10-08T13:08:29.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:28 smithi005 ceph-mon[99496]: pgmap v374: 129 pgs: 129 active+clean; 2.7 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 856 op/s 2023-10-08T13:08:31.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:30 smithi118 ceph-mon[104234]: pgmap v375: 129 pgs: 129 active+clean; 2.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 836 op/s 2023-10-08T13:08:31.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:30 smithi060 ceph-mon[103190]: pgmap v375: 129 pgs: 129 active+clean; 2.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 836 op/s 2023-10-08T13:08:31.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:30 smithi005 ceph-mon[99496]: pgmap v375: 129 pgs: 129 active+clean; 2.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 836 op/s 2023-10-08T13:08:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 130.0 s, 1652.8 tps, lat 60.605 ms stddev 71.057 2023-10-08T13:08:33.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:32 smithi118 ceph-mon[104234]: pgmap v376: 129 pgs: 129 active+clean; 2.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 844 op/s 2023-10-08T13:08:33.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:32 smithi060 ceph-mon[103190]: pgmap v376: 129 pgs: 129 active+clean; 2.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 844 op/s 2023-10-08T13:08:33.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:32 smithi005 ceph-mon[99496]: pgmap v376: 129 pgs: 129 active+clean; 2.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 MiB/s wr, 844 op/s 2023-10-08T13:08:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 -- 172.21.15.5:0/1217814982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 msgr2=0x7f2878078b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 --2- 172.21.15.5:0/1217814982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 0x7f2878078b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f28680098f0 tx=0x7f2868009c00 comp rx=0 tx=0).stop 2023-10-08T13:08:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 -- 172.21.15.5:0/1217814982 shutdown_connections 2023-10-08T13:08:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 --2- 172.21.15.5:0/1217814982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 0x7f2878078b00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 --2- 172.21.15.5:0/1217814982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878107a60 0x7f2878107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 --2- 172.21.15.5:0/1217814982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2878108380 0x7f287810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.328+0000 7f287ebae700 1 -- 172.21.15.5:0/1217814982 >> 172.21.15.5:0/1217814982 conn(0x7f287806b7c0 msgr2=0x7f287806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:33.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.339+0000 7f287ebae700 1 -- 172.21.15.5:0/1217814982 shutdown_connections 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.340+0000 7f287ebae700 1 -- 172.21.15.5:0/1217814982 wait complete. 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 Processor -- start 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 -- start start 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 0x7f28780832e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 0x7f287807d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287807d8c0 0x7f287807dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781c3170 con 0x7f2878108380 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287812fb40 con 0x7f287807d8c0 2023-10-08T13:08:33.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287ebae700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287812fd00 con 0x7f287810c000 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287c94a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 0x7f28780832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287c94a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 0x7f28780832e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35724/0 (socket says 172.21.15.5:35724) 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.341+0000 7f287c94a700 1 -- 172.21.15.5:0/2726389581 learned_addr learned my addr 172.21.15.5:0/2726389581 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f2877fff700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 0x7f287807d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f287c94a700 1 -- 172.21.15.5:0/2726389581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 msgr2=0x7f287807d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f287c94a700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 0x7f287807d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f287c94a700 1 -- 172.21.15.5:0/2726389581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287807d8c0 msgr2=0x7f287807dd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f287c94a700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287807d8c0 0x7f287807dd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f287c94a700 1 -- 172.21.15.5:0/2726389581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009520 con 0x7f2878108380 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.342+0000 7f287c94a700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 0x7f28780832e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f287000b9b0 tx=0x7f287000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:33.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.343+0000 7f2875ffb700 1 -- 172.21.15.5:0/2726389581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000ca30 con 0x7f2878108380 2023-10-08T13:08:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.343+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287812ffe0 con 0x7f2878108380 2023-10-08T13:08:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.343+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28781304f0 con 0x7f2878108380 2023-10-08T13:08:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.343+0000 7f2875ffb700 1 -- 172.21.15.5:0/2726389581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f287000cb90 con 0x7f2878108380 2023-10-08T13:08:33.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.343+0000 7f2875ffb700 1 -- 172.21.15.5:0/2726389581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28700125a0 con 0x7f2878108380 2023-10-08T13:08:33.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.350+0000 7f2875ffb700 1 -- 172.21.15.5:0/2726389581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2870002020 con 0x7f2878108380 2023-10-08T13:08:33.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.352+0000 7f288ad97b80 1 Processor -- start 2023-10-08T13:08:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.353+0000 7f2875ffb700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28600a1800 0x7f28600a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.353+0000 7f2875ffb700 1 -- 172.21.15.5:0/2726389581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f28700cc780 con 0x7f2878108380 2023-10-08T13:08:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.358+0000 7f287d14b700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28600a1800 0x7f28600a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.358+0000 7f288ad97b80 1 -- start start 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.358+0000 7f287d14b700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28600a1800 0x7f28600a3cc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2868009810 tx=0x7f28680058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f288ad97b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17e1b400 con 0x55ab17eb30b0 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f288ad97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17e0cbc0 con 0x55ab17eb8880 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f288ad97b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17e0a4e0 con 0x55ab17eb91a0 2023-10-08T13:08:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35732/0 (socket says 172.21.15.5:35732) 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 -- 172.21.15.5:0/1353856054 learned_addr learned my addr 172.21.15.5:0/1353856054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287c94a700 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 -- 172.21.15.5:0/1353856054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 msgr2=0x55ab17eb2b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb2b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 -- 172.21.15.5:0/1353856054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 msgr2=0x55ab17eb8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.359+0000 7f287d14b700 1 -- 172.21.15.5:0/1353856054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab17c30d80 con 0x55ab17eb30b0 2023-10-08T13:08:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.363+0000 7f287d14b700 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb3510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f286800f5d0 tx=0x7f286801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01b1538a3b3c3d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.365+0000 7f285effd700 1 -- 172.21.15.5:0/1353856054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286801c070 con 0x55ab17eb30b0 2023-10-08T13:08:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.365+0000 7f285effd700 1 -- 172.21.15.5:0/1353856054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f286800fa90 con 0x55ab17eb30b0 2023-10-08T13:08:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.368+0000 7f285effd700 1 -- 172.21.15.5:0/1353856054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868022bb0 con 0x55ab17eb30b0 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.369+0000 7f288ad97b80 1 -- 172.21.15.5:0/1353856054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 msgr2=0x55ab17eb3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.369+0000 7f288ad97b80 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb3510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f286800f5d0 tx=0x7f286801c000 comp rx=0 tx=0).stop 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.374+0000 7f288ad97b80 1 -- 172.21.15.5:0/1353856054 shutdown_connections 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.374+0000 7f288ad97b80 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb3510 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.374+0000 7f288ad97b80 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.374+0000 7f288ad97b80 1 --2- 172.21.15.5:0/1353856054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.374+0000 7f288ad97b80 1 -- 172.21.15.5:0/1353856054 >> 172.21.15.5:0/1353856054 conn(0x55ab17e27200 msgr2=0x55ab17eadb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.389+0000 7f288ad97b80 1 -- 172.21.15.5:0/1353856054 shutdown_connections 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.390+0000 7f288ad97b80 1 -- 172.21.15.5:0/1353856054 wait complete. 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 -- start start 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 Processor -- start 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 0x55ab17ebf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb8880 0x55ab17ebc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb91a0 0x55ab17ebcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17e05dd0 con 0x55ab17eb8880 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17da26b0 con 0x55ab17eb91a0 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17da2350 con 0x55ab17eb30b0 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.391+0000 7f288ad97b80 10 client.0 _ll_register_callbacks cb 0x55ab17bff7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 0x55ab17ebf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 0x55ab17ebf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48938/0 (socket says 172.21.15.5:48938) 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 -- 172.21.15.5:0/2861120558 learned_addr learned my addr 172.21.15.5:0/2861120558 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287d14b700 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb91a0 0x55ab17ebcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 -- 172.21.15.5:0/2861120558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb91a0 msgr2=0x55ab17ebcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb91a0 0x55ab17ebcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 -- 172.21.15.5:0/2861120558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb8880 msgr2=0x55ab17ebc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb8880 0x55ab17ebc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.392+0000 7f287c94a700 1 -- 172.21.15.5:0/2861120558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28780793c0 con 0x55ab17eb30b0 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.393+0000 7f287c94a700 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 0x55ab17ebf1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28700c9ca0 tx=0x7f28700ca090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845b5121fcec2d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.393+0000 7f2857fff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:08:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.394+0000 7f2857fff700 1 -- 172.21.15.5:0/2861120558 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287009d3b0 con 0x55ab17eb30b0 2023-10-08T13:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.394+0000 7f2857fff700 1 -- 172.21.15.5:0/2861120558 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f28700a1860 con 0x55ab17eb30b0 2023-10-08T13:08:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.395+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab17dcde50 con 0x55ab17eb30b0 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.396+0000 7f2857fff700 1 -- 172.21.15.5:0/2861120558 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2870099730 con 0x55ab17eb30b0 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.396+0000 7f288ad97b80 10 client.25768 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.396+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ab17c19c00 con 0x55ab17eb30b0 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.396+0000 7f2857fff700 1 -- 172.21.15.5:0/2861120558 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab17dcde50 con 0x55ab17eb30b0 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.396+0000 7f2857fff700 1 -- 172.21.15.5:0/2861120558 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f28700ae030 con 0x55ab17eb30b0 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.398+0000 7f288ad97b80 10 client.25768 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.398+0000 7f288ad97b80 10 client.25768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.398+0000 7f288ad97b80 20 client.25768 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.398+0000 7f288ad97b80 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17ecf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.398+0000 7f288ad97b80 4 client.25768 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.398+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab17dfedb0 con 0x55ab17ecce20 2023-10-08T13:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.399+0000 7f2877fff700 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17ecf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.399+0000 7f2877fff700 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17ecf240 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca280eecef3af75c server_cookie=33b449d733e75721 in_seq=0 out_seq=0 2023-10-08T13:08:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.399+0000 7f2857fff700 10 client.25768 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f2857fff700 1 -- 172.21.15.5:0/2861120558 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ab17dfedb0 con 0x55ab17ecce20 2023-10-08T13:08:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f2857fff700 10 client.25768 handle_command_reply: tid=0 2023-10-08T13:08:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 client.25768 shutdown 2023-10-08T13:08:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 msgr2=0x55ab17ebf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 0x55ab17ebf1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28700c9ca0 tx=0x7f28700ca090 comp rx=0 tx=0).stop 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 shutdown_connections 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17ecf240 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb91a0 0x55ab17ebcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f2857fff700 0 client.25768 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb30b0 0x55ab17ebf1c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 --2- 172.21.15.5:0/2861120558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb8880 0x55ab17ebc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.400+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 >> 172.21.15.5:0/2861120558 conn(0x55ab17e27200 msgr2=0x55ab17ead010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.401+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 shutdown_connections 2023-10-08T13:08:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.401+0000 7f288ad97b80 1 -- 172.21.15.5:0/2861120558 wait complete. 2023-10-08T13:08:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.403+0000 7f288ad97b80 20 client.25768 trim_cache size 0 max 16384 2023-10-08T13:08:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.418+0000 7f288ad97b80 1 Processor -- start 2023-10-08T13:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 -- start start 2023-10-08T13:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17ec3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17ead790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17c868c0 con 0x55ab17eb30b0 2023-10-08T13:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17dcde80 con 0x55ab17eb8880 2023-10-08T13:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f288ad97b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17ebd1f0 con 0x55ab17eb91a0 2023-10-08T13:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f287d14b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17ead790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f287d14b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17ead790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48944/0 (socket says 172.21.15.5:48944) 2023-10-08T13:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f2877fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17ec3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.419+0000 7f287d14b700 1 -- 172.21.15.5:0/3864627224 learned_addr learned my addr 172.21.15.5:0/3864627224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f2877fff700 1 -- 172.21.15.5:0/3864627224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 msgr2=0x55ab17ead790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f2877fff700 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17ead790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f2877fff700 1 -- 172.21.15.5:0/3864627224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 msgr2=0x55ab17eb2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f2877fff700 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f2877fff700 1 -- 172.21.15.5:0/3864627224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab17c571f0 con 0x55ab17eb8880 2023-10-08T13:08:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f2877fff700 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17ec3c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55ab17eaa950 tx=0x7f286c005ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89f557b96cd1a12d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f285f7fe700 1 -- 172.21.15.5:0/3864627224 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c017530 con 0x55ab17eb8880 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f285f7fe700 1 -- 172.21.15.5:0/3864627224 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f286c017040 con 0x55ab17eb8880 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.420+0000 7f285f7fe700 1 -- 172.21.15.5:0/3864627224 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c01f400 con 0x55ab17eb8880 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 -- 172.21.15.5:0/3864627224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 msgr2=0x55ab17ec3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17ec3c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55ab17eaa950 tx=0x7f286c005ab0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 -- 172.21.15.5:0/3864627224 shutdown_connections 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17ead790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3864627224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17ec3c10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 -- 172.21.15.5:0/3864627224 >> 172.21.15.5:0/3864627224 conn(0x55ab17e27200 msgr2=0x55ab17ed3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 -- 172.21.15.5:0/3864627224 shutdown_connections 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 -- 172.21.15.5:0/3864627224 wait complete. 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 -- start start 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.421+0000 7f288ad97b80 1 Processor -- start 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17eb4aa0 con 0x55ab17eb30b0 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17eb4c10 con 0x55ab17eb8880 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab17eb4dd0 con 0x55ab17eb91a0 2023-10-08T13:08:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f288ad97b80 10 client.0 _ll_register_callbacks cb 0x55ab17bff7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35746/0 (socket says 172.21.15.5:35746) 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 -- 172.21.15.5:0/3670853302 learned_addr learned my addr 172.21.15.5:0/3670853302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f2877fff700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287d14b700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 -- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 msgr2=0x55ab17eb4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 -- 172.21.15.5:0/3670853302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 msgr2=0x55ab17eb5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 -- 172.21.15.5:0/3670853302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c009970 con 0x55ab17eb30b0 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.422+0000 7f287c94a700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb58a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2870097820 tx=0x7f28700a1600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d648e00d40537 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2857fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2857fff700 1 -- 172.21.15.5:0/3670853302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870099010 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2857fff700 1 -- 172.21.15.5:0/3670853302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f28700a1860 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f286800fa90 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2857fff700 1 -- 172.21.15.5:0/3670853302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f287009d3c0 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 10 client.16221 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ab17c2f250 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2857fff700 1 -- 172.21.15.5:0/3670853302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f287007c080 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2857fff700 1 -- 172.21.15.5:0/3670853302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f28700ae040 con 0x55ab17eb30b0 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 20 client.16221 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17f238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 4 client.16221 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:08:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ab17dfead0 con 0x55ab17ecce20 2023-10-08T13:08:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.423+0000 7f2877fff700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17f238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.424+0000 7f2857fff700 10 client.16221 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.424+0000 7f2877fff700 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17f238b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d93b6526aff1a197 server_cookie=5644f777ba934fc7 in_seq=0 out_seq=0 2023-10-08T13:08:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f2857fff700 1 -- 172.21.15.5:0/3670853302 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ab17dfead0 con 0x55ab17ecce20 2023-10-08T13:08:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f2857fff700 10 client.16221 handle_command_reply: tid=0 2023-10-08T13:08:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 client.16221 shutdown 2023-10-08T13:08:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 msgr2=0x55ab17eb58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb58a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2870097820 tx=0x7f28700a1600 comp rx=0 tx=0).stop 2023-10-08T13:08:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 shutdown_connections 2023-10-08T13:08:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ab17eb91a0 0x55ab17eb4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab17eb30b0 0x55ab17eb58a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ab17ecce20 0x55ab17f238b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 --2- 172.21.15.5:0/3670853302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab17eb8880 0x55ab17eb5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f2857fff700 0 client.16221 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.444+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 >> 172.21.15.5:0/3670853302 conn(0x55ab17e27200 msgr2=0x55ab17eb6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 shutdown_connections 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f288ad97b80 1 -- 172.21.15.5:0/3670853302 wait complete. 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f288ad97b80 20 client.16221 trim_cache size 0 max 16384 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:08:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:08:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:08:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28600a1800 msgr2=0x7f28600a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28600a1800 0x7f28600a3cc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2868009810 tx=0x7f28680058e0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 msgr2=0x7f28780832e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 0x7f28780832e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f287000b9b0 tx=0x7f287000bd70 comp rx=0 tx=0).stop 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 shutdown_connections 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28600a1800 0x7f28600a3cc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287807d8c0 0x7f287807dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2878108380 0x7f28780832e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 --2- 172.21.15.5:0/2726389581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f287810c000 0x7f287807d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.445+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 >> 172.21.15.5:0/2726389581 conn(0x7f287806b7c0 msgr2=0x7f28780705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.447+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 shutdown_connections 2023-10-08T13:08:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:33.447+0000 7f287ebae700 1 -- 172.21.15.5:0/2726389581 wait complete. 2023-10-08T13:08:35.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:34 smithi118 ceph-mon[104234]: pgmap v377: 129 pgs: 129 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 815 op/s 2023-10-08T13:08:35.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:34 smithi060 ceph-mon[103190]: pgmap v377: 129 pgs: 129 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 815 op/s 2023-10-08T13:08:35.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:34 smithi005 ceph-mon[99496]: pgmap v377: 129 pgs: 129 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 815 op/s 2023-10-08T13:08:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 135.0 s, 778.0 tps, lat 129.398 ms stddev 313.273 2023-10-08T13:08:37.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:36 smithi118 ceph-mon[104234]: pgmap v378: 129 pgs: 129 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 707 op/s 2023-10-08T13:08:37.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:36 smithi060 ceph-mon[103190]: pgmap v378: 129 pgs: 129 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 707 op/s 2023-10-08T13:08:37.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:36 smithi005 ceph-mon[99496]: pgmap v378: 129 pgs: 129 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 707 op/s 2023-10-08T13:08:39.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:38 smithi118 ceph-mon[104234]: pgmap v379: 129 pgs: 129 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2023-10-08T13:08:39.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:38 smithi060 ceph-mon[103190]: pgmap v379: 129 pgs: 129 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2023-10-08T13:08:39.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:38 smithi005 ceph-mon[99496]: pgmap v379: 129 pgs: 129 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2023-10-08T13:08:40.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:08:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 -- 172.21.15.5:0/2669232490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 msgr2=0x7f10d00ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 --2- 172.21.15.5:0/2669232490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d00ff9c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0099c0 tx=0x7f10bc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 -- 172.21.15.5:0/2669232490 shutdown_connections 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 --2- 172.21.15.5:0/2669232490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 --2- 172.21.15.5:0/2669232490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0105600 0x7f10d01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 --2- 172.21.15.5:0/2669232490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d00ff9c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 -- 172.21.15.5:0/2669232490 >> 172.21.15.5:0/2669232490 conn(0x7f10d00fafb0 msgr2=0x7f10d00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 -- 172.21.15.5:0/2669232490 shutdown_connections 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.887+0000 7f10d7234700 1 -- 172.21.15.5:0/2669232490 wait complete. 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 Processor -- start 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 -- start start 2023-10-08T13:08:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d0197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0105600 0x7f10d01a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01986b0 con 0x7f10d00ff540 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01a2ee0 con 0x7f10d00fff00 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10d7234700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01a3020 con 0x7f10d0105600 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.888+0000 7f10cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0105600 0x7f10d01a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d0197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58944/0 (socket says 172.21.15.5:58944) 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 -- 172.21.15.5:0/2857578228 learned_addr learned my addr 172.21.15.5:0/2857578228 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d0197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 -- 172.21.15.5:0/2857578228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0105600 msgr2=0x7f10d01a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0105600 0x7f10d01a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 -- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 msgr2=0x7f10d0197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d0197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 -- 172.21.15.5:0/2857578228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8009c40 con 0x7f10d00fff00 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d0197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cffff700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d0197e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00f6c0 tx=0x7f10bc00bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cdffb700 1 -- 172.21.15.5:0/2857578228 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc01c070 con 0x7f10d00fff00 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cdffb700 1 -- 172.21.15.5:0/2857578228 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10bc00fe40 con 0x7f10d00fff00 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc0095f0 con 0x7f10d00fff00 2023-10-08T13:08:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.889+0000 7f10cdffb700 1 -- 172.21.15.5:0/2857578228 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc022cf0 con 0x7f10d00fff00 2023-10-08T13:08:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.890+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d01a34b0 con 0x7f10d00fff00 2023-10-08T13:08:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.895+0000 7f10e341db80 1 Processor -- start 2023-10-08T13:08:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.896+0000 7f10cdffb700 1 -- 172.21.15.5:0/2857578228 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f10bc020070 con 0x7f10d00fff00 2023-10-08T13:08:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.897+0000 7f10cdffb700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f10c00a15f0 0x7f10c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.897+0000 7f10cdffb700 1 -- 172.21.15.5:0/2857578228 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f10bc0ce2b0 con 0x7f10d00fff00 2023-10-08T13:08:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.901+0000 7f10e341db80 1 -- start start 2023-10-08T13:08:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10e341db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x56406534bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10e341db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406533d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10e341db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 0x564065352490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10e341db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640652a5460 con 0x56406533ce90 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10e341db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564065296c20 con 0x56406534b6e0 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10e341db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564065294540 con 0x56406533d850 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.902+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 0x564065352490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 0x564065352490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48972/0 (socket says 172.21.15.5:48972) 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 -- 172.21.15.5:0/1866553170 learned_addr learned my addr 172.21.15.5:0/1866553170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f10c00a15f0 0x7f10c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x56406534bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 -- 172.21.15.5:0/1866553170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 msgr2=0x56406534bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x56406534bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 -- 172.21.15.5:0/1866553170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 msgr2=0x56406533d310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406533d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 -- 172.21.15.5:0/1866553170 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640650bade0 con 0x56406533d850 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x56406534bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.903+0000 7f10d57d1700 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 0x564065352490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10c801a510 tx=0x7f10c801a820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c4bc854556d8161 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.904+0000 7f10d57d1700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f10c00a15f0 0x7f10c00a3ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f10c801ac20 tx=0x7f10c800e000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.904+0000 7f10baffd700 1 -- 172.21.15.5:0/1866553170 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800e070 con 0x56406533d850 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.904+0000 7f10baffd700 1 -- 172.21.15.5:0/1866553170 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10c801f070 con 0x56406533d850 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.904+0000 7f10baffd700 1 -- 172.21.15.5:0/1866553170 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8023b20 con 0x56406533d850 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 -- 172.21.15.5:0/1866553170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 msgr2=0x564065352490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 0x564065352490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10c801a510 tx=0x7f10c801a820 comp rx=0 tx=0).stop 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 -- 172.21.15.5:0/1866553170 shutdown_connections 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533d850 0x564065352490 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x56406534bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 --2- 172.21.15.5:0/1866553170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406533d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 -- 172.21.15.5:0/1866553170 >> 172.21.15.5:0/1866553170 conn(0x5640652b1260 msgr2=0x564065338180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 -- 172.21.15.5:0/1866553170 shutdown_connections 2023-10-08T13:08:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.905+0000 7f10e341db80 1 -- 172.21.15.5:0/1866553170 wait complete. 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 -- start start 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 Processor -- start 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406534f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533d850 0x56406534fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x5640653502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56406528fe30 con 0x56406533ce90 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56406522c710 con 0x56406533d850 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56406522c3b0 con 0x56406534b6e0 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.906+0000 7f10e341db80 10 client.0 _ll_register_callbacks cb 0x564065089800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406534f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406534f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35772/0 (socket says 172.21.15.5:35772) 2023-10-08T13:08:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 -- 172.21.15.5:0/3937488841 learned_addr learned my addr 172.21.15.5:0/3937488841 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 -- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 msgr2=0x5640653502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x5640653502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 -- 172.21.15.5:0/3937488841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533d850 msgr2=0x56406534fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533d850 0x56406534fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 -- 172.21.15.5:0/3937488841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c8008ca0 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.907+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406534f840 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10c4010680 tx=0x7f10c4010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882f44a30dcb975a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10affff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10affff700 1 -- 172.21.15.5:0/3937488841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004220 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10affff700 1 -- 172.21.15.5:0/3937488841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f10c4017070 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564065257eb0 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10affff700 1 -- 172.21.15.5:0/3937488841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c4004380 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10e341db80 10 client.16227 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.910+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5640650a3c60 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10affff700 1 -- 172.21.15.5:0/3937488841 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564065257eb0 con 0x56406533ce90 2023-10-08T13:08:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10affff700 1 -- 172.21.15.5:0/3937488841 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f10c4003a40 con 0x56406533ce90 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10e341db80 10 client.16227 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10e341db80 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10e341db80 20 client.16227 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10e341db80 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653408a0 0x564065342cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10e341db80 4 client.16227 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564065288e10 con 0x5640653408a0 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10cffff700 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653408a0 0x564065342cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10affff700 10 client.16227 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.911+0000 7f10cffff700 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653408a0 0x564065342cc0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e24ce502c52748 server_cookie=a0214319cef62350 in_seq=0 out_seq=0 2023-10-08T13:08:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10affff700 1 -- 172.21.15.5:0/3937488841 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564065288e10 con 0x5640653408a0 2023-10-08T13:08:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10affff700 10 client.16227 handle_command_reply: tid=0 2023-10-08T13:08:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 client.16227 shutdown 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 msgr2=0x56406534f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406534f840 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f10c4010680 tx=0x7f10c4010a40 comp rx=0 tx=0).stop 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 shutdown_connections 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x5640653502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533ce90 0x56406534f840 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653408a0 0x564065342cc0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 --2- 172.21.15.5:0/3937488841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533d850 0x56406534fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10affff700 0 client.16227 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 >> 172.21.15.5:0/3937488841 conn(0x5640652b1260 msgr2=0x564065337d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 shutdown_connections 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 1 -- 172.21.15.5:0/3937488841 wait complete. 2023-10-08T13:08:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.919+0000 7f10e341db80 20 client.16227 trim_cache size 0 max 16384 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.951+0000 7f10e341db80 1 Processor -- start 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 -- start start 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533ce90 0x56406535bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406534d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x564065351ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564065110920 con 0x56406533d850 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56406535d200 con 0x56406533ce90 2023-10-08T13:08:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10e341db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56406534b370 con 0x56406534b6e0 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x564065351ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x564065351ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:48986/0 (socket says 172.21.15.5:48986) 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.952+0000 7f10d57d1700 1 -- 172.21.15.5:0/592467314 learned_addr learned my addr 172.21.15.5:0/592467314 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10cffff700 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406534d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10d57d1700 1 -- 172.21.15.5:0/592467314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533ce90 msgr2=0x56406535bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10d57d1700 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533ce90 0x56406535bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10d57d1700 1 -- 172.21.15.5:0/592467314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 msgr2=0x56406534d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10d57d1700 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406534d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10d57d1700 1 -- 172.21.15.5:0/592467314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640650e1250 con 0x56406534b6e0 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.953+0000 7f10d57d1700 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x564065351ec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009400 tx=0x7f10c8006040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4978be68068ceaf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.954+0000 7f10bb7fe700 1 -- 172.21.15.5:0/592467314 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c80098a0 con 0x56406534b6e0 2023-10-08T13:08:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.954+0000 7f10bb7fe700 1 -- 172.21.15.5:0/592467314 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10c800f040 con 0x56406534b6e0 2023-10-08T13:08:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.954+0000 7f10bb7fe700 1 -- 172.21.15.5:0/592467314 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c80054f0 con 0x56406534b6e0 2023-10-08T13:08:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.955+0000 7f10e341db80 1 -- 172.21.15.5:0/592467314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 msgr2=0x564065351ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.955+0000 7f10e341db80 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x564065351ec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009400 tx=0x7f10c8006040 comp rx=0 tx=0).stop 2023-10-08T13:08:40.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 -- 172.21.15.5:0/592467314 shutdown_connections 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406534b6e0 0x564065351ec0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406533ce90 0x56406535bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 --2- 172.21.15.5:0/592467314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406534d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 -- 172.21.15.5:0/592467314 >> 172.21.15.5:0/592467314 conn(0x5640652b1260 msgr2=0x56406533be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 -- 172.21.15.5:0/592467314 shutdown_connections 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.957+0000 7f10e341db80 1 -- 172.21.15.5:0/592467314 wait complete. 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 -- start start 2023-10-08T13:08:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 Processor -- start 2023-10-08T13:08:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533ce90 0x56406535e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406535e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x5640653a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640653a4a80 con 0x56406533d850 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640653a4bf0 con 0x56406534b6e0 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640653a4db0 con 0x56406533ce90 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10e341db80 10 client.0 _ll_register_callbacks cb 0x7f10c4009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.958+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x5640653a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x5640653a4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58970/0 (socket says 172.21.15.5:58970) 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 -- 172.21.15.5:0/373201048 learned_addr learned my addr 172.21.15.5:0/373201048 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10cffff700 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406535e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 -- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533ce90 msgr2=0x56406535e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533ce90 0x56406535e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 -- 172.21.15.5:0/373201048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 msgr2=0x56406535e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406535e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 -- 172.21.15.5:0/373201048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640650bade0 con 0x56406534b6e0 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.959+0000 7f10d57d1700 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x5640653a4540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000f80 tx=0x7f10c8009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b9d640e05b37a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10affff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10affff700 1 -- 172.21.15.5:0/373201048 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8008020 con 0x56406534b6e0 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10affff700 1 -- 172.21.15.5:0/373201048 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f10c8008180 con 0x56406534b6e0 2023-10-08T13:08:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10c801f070 con 0x56406534b6e0 2023-10-08T13:08:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10affff700 1 -- 172.21.15.5:0/373201048 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c8008340 con 0x56406534b6e0 2023-10-08T13:08:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 10 client.25751 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5640650b92b0 con 0x56406534b6e0 2023-10-08T13:08:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10affff700 1 -- 172.21.15.5:0/373201048 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10c801f070 con 0x56406534b6e0 2023-10-08T13:08:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10affff700 1 -- 172.21.15.5:0/373201048 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f10c80051c0 con 0x56406534b6e0 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 10 client.25751 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 10 client.25751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 20 client.25751 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653ac290 0x5640653ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 4 client.25751 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.960+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564065288b30 con 0x5640653ac290 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.961+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653ac290 0x5640653ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.961+0000 7f10affff700 10 client.25751 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.961+0000 7f10d4fd0700 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653ac290 0x5640653ae6b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c1d6e19afd98002 server_cookie=585ef01fa0532a7f in_seq=0 out_seq=0 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.962+0000 7f10affff700 1 -- 172.21.15.5:0/373201048 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564065288b30 con 0x5640653ac290 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.962+0000 7f10affff700 10 client.25751 handle_command_reply: tid=0 2023-10-08T13:08:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.962+0000 7f10e341db80 1 client.25751 shutdown 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.965+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 msgr2=0x5640653a4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.965+0000 7f10e341db80 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x5640653a4540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000f80 tx=0x7f10c8009990 comp rx=0 tx=0).stop 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 shutdown_connections 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5640653ac290 0x5640653ae6b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56406534b6e0 0x5640653a4540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56406533ce90 0x56406535e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10affff700 0 client.25751 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 --2- 172.21.15.5:0/373201048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56406533d850 0x56406535e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 >> 172.21.15.5:0/373201048 conn(0x5640652b1260 msgr2=0x56406533c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 shutdown_connections 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 1 -- 172.21.15.5:0/373201048 wait complete. 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10e341db80 20 client.25751 trim_cache size 0 max 16384 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:08:40.968 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:08:40.969 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f10c00a15f0 msgr2=0x7f10c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.966+0000 7f10d7234700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f10c00a15f0 0x7f10c00a3ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f10c801ac20 tx=0x7f10c800e000 comp rx=0 tx=0).stop 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 msgr2=0x7f10d0197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d0197e60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00f6c0 tx=0x7f10bc00bfd0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 shutdown_connections 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f10c00a15f0 0x7f10c00a3ab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0105600 0x7f10d01a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10d00ff540 0x7f10d0197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 --2- 172.21.15.5:0/2857578228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10d00fff00 0x7f10d0197e60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 >> 172.21.15.5:0/2857578228 conn(0x7f10d00fafb0 msgr2=0x7f10d00fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 shutdown_connections 2023-10-08T13:08:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:08:40.967+0000 7f10d7234700 1 -- 172.21.15.5:0/2857578228 wait complete. 2023-10-08T13:08:40.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:40 smithi005 ceph-mon[99496]: pgmap v380: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 1.59k op/s 2023-10-08T13:08:40.985 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:08:41.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:40 smithi118 ceph-mon[104234]: pgmap v380: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 1.59k op/s 2023-10-08T13:08:41.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:40 smithi060 ceph-mon[103190]: pgmap v380: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 1.59k op/s 2023-10-08T13:08:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 140.0 s, 1689.6 tps, lat 58.635 ms stddev 80.934 2023-10-08T13:08:43.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:42 smithi118 ceph-mon[104234]: pgmap v381: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 1.67k op/s 2023-10-08T13:08:43.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:42 smithi060 ceph-mon[103190]: pgmap v381: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 1.67k op/s 2023-10-08T13:08:43.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:42 smithi005 ceph-mon[99496]: pgmap v381: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 1.67k op/s 2023-10-08T13:08:45.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:44 smithi060 ceph-mon[103190]: pgmap v382: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 25 MiB/s wr, 1.65k op/s 2023-10-08T13:08:45.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:44 smithi005 ceph-mon[99496]: pgmap v382: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 25 MiB/s wr, 1.65k op/s 2023-10-08T13:08:45.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:44 smithi118 ceph-mon[104234]: pgmap v382: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 25 MiB/s wr, 1.65k op/s 2023-10-08T13:08:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.615+0000 7f6ee77a4700 1 -- 172.21.15.5:0/1648448888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee0105630 msgr2=0x7f6ee0105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.615+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/1648448888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee0105630 0x7f6ee0105a10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0099c0 tx=0x7f6edc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 -- 172.21.15.5:0/1648448888 shutdown_connections 2023-10-08T13:08:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/1648448888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee00fff30 0x7f6ee010c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/1648448888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee0105630 0x7f6ee0105a10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/1648448888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00ff570 0x7f6ee00ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 -- 172.21.15.5:0/1648448888 >> 172.21.15.5:0/1648448888 conn(0x7f6ee00fb080 msgr2=0x7f6ee00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 -- 172.21.15.5:0/1648448888 shutdown_connections 2023-10-08T13:08:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.616+0000 7f6ee77a4700 1 -- 172.21.15.5:0/1648448888 wait complete. 2023-10-08T13:08:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 Processor -- start 2023-10-08T13:08:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 -- start start 2023-10-08T13:08:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00ff570 0x7f6ee0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 0x7f6ee0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee0105630 0x7f6ee01a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0198620 con 0x7f6ee00ff570 2023-10-08T13:08:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01a2e30 con 0x7f6ee0105630 2023-10-08T13:08:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.617+0000 7f6ee77a4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01a2f70 con 0x7f6ee00fff30 2023-10-08T13:08:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 0x7f6ee0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 0x7f6ee0197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49004/0 (socket says 172.21.15.5:49004) 2023-10-08T13:08:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 -- 172.21.15.5:0/3924796312 learned_addr learned my addr 172.21.15.5:0/3924796312 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee0105630 0x7f6ee01a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 -- 172.21.15.5:0/3924796312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee0105630 msgr2=0x7f6ee01a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee0105630 0x7f6ee01a28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 -- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00ff570 msgr2=0x7f6ee0197870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:08:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00ff570 0x7f6ee0197870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 -- 172.21.15.5:0/3924796312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0095f0 con 0x7f6ee00fff30 2023-10-08T13:08:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.618+0000 7f6ee4d3f700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 0x7f6ee0197db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000e9a0 tx=0x7f6ed000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.619+0000 7f6ed67fc700 1 -- 172.21.15.5:0/3924796312 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0009790 con 0x7f6ee00fff30 2023-10-08T13:08:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.619+0000 7f6ed67fc700 1 -- 172.21.15.5:0/3924796312 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed000cbd0 con 0x7f6ee00fff30 2023-10-08T13:08:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.619+0000 7f6ed67fc700 1 -- 172.21.15.5:0/3924796312 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0018680 con 0x7f6ee00fff30 2023-10-08T13:08:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.619+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee01a3200 con 0x7f6ee00fff30 2023-10-08T13:08:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.619+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee01a36c0 con 0x7f6ee00fff30 2023-10-08T13:08:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.622+0000 7f6ed67fc700 1 -- 172.21.15.5:0/3924796312 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6ed00187e0 con 0x7f6ee00fff30 2023-10-08T13:08:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.623+0000 7f6ed67fc700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ecc0a1660 0x7f6ecc0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.623+0000 7f6ed67fc700 1 -- 172.21.15.5:0/3924796312 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6ed0014070 con 0x7f6ee00fff30 2023-10-08T13:08:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.623+0000 7f6ee5540700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ecc0a1660 0x7f6ecc0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.623+0000 7f6ef398db80 1 Processor -- start 2023-10-08T13:08:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 -- start start 2023-10-08T13:08:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd269d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26aa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd2605400 con 0x559dd269cd60 2023-10-08T13:08:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd25f6bc0 con 0x559dd269d680 2023-10-08T13:08:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ef398db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd25f44e0 con 0x559dd26aa2b0 2023-10-08T13:08:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ee5d41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ee5d41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49010/0 (socket says 172.21.15.5:49010) 2023-10-08T13:08:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.624+0000 7f6ee5d41700 1 -- 172.21.15.5:0/2524405557 learned_addr learned my addr 172.21.15.5:0/2524405557 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5d41700 1 -- 172.21.15.5:0/2524405557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 msgr2=0x559dd26a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5d41700 1 -- 172.21.15.5:0/2524405557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 msgr2=0x559dd269d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd269d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5d41700 1 -- 172.21.15.5:0/2524405557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd241ad80 con 0x559dd26aa2b0 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26aa710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8003f90 tx=0x7f6ed8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47a5ca9b8c9b738a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.625+0000 7f6ee5540700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ecc0a1660 0x7f6ecc0a3b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0058e0 tx=0x7f6edc000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.626+0000 7f6ecb7fe700 1 -- 172.21.15.5:0/2524405557 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8009e60 con 0x559dd26aa2b0 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.626+0000 7f6ecb7fe700 1 -- 172.21.15.5:0/2524405557 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed800f040 con 0x559dd26aa2b0 2023-10-08T13:08:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.626+0000 7f6ecb7fe700 1 -- 172.21.15.5:0/2524405557 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8015770 con 0x559dd26aa2b0 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 -- 172.21.15.5:0/2524405557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 msgr2=0x559dd26aa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26aa710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8003f90 tx=0x7f6ed8009c20 comp rx=0 tx=0).stop 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 -- 172.21.15.5:0/2524405557 shutdown_connections 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26aa710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd269d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 --2- 172.21.15.5:0/2524405557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 -- 172.21.15.5:0/2524405557 >> 172.21.15.5:0/2524405557 conn(0x559dd2611200 msgr2=0x559dd2697d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.627+0000 7f6ef398db80 1 -- 172.21.15.5:0/2524405557 shutdown_connections 2023-10-08T13:08:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.628+0000 7f6ef398db80 1 -- 172.21.15.5:0/2524405557 wait complete. 2023-10-08T13:08:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.629+0000 7f6ef398db80 1 -- start start 2023-10-08T13:08:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.629+0000 7f6ef398db80 1 Processor -- start 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.629+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd269cd60 0x559dd26b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269d680 0x559dd26aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 0x559dd26af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ef398db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd25efdd0 con 0x559dd269d680 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ef398db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd258c6b0 con 0x559dd26aa2b0 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ef398db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd258c350 con 0x559dd269cd60 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ef398db80 10 client.0 _ll_register_callbacks cb 0x559dd23e97a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 0x559dd26af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 0x559dd26af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:58996/0 (socket says 172.21.15.5:58996) 2023-10-08T13:08:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 -- 172.21.15.5:0/3585101132 learned_addr learned my addr 172.21.15.5:0/3585101132 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 -- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd269cd60 msgr2=0x559dd26b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd269cd60 0x559dd26b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 -- 172.21.15.5:0/3585101132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269d680 msgr2=0x559dd26aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269d680 0x559dd26aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 -- 172.21.15.5:0/3585101132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed8003bf0 con 0x559dd26aa2b0 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 0x559dd26af510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007ed0 tx=0x7f6ed80077c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1718492e1ab554a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.630+0000 7f6ec8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/3585101132 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8015890 con 0x559dd26aa2b0 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/3585101132 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6ed8022070 con 0x559dd26aa2b0 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559dd25b7e50 con 0x559dd26aa2b0 2023-10-08T13:08:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/3585101132 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ed8007c50 con 0x559dd26aa2b0 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ef398db80 10 client.25760 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x559dd2403c00 con 0x559dd26aa2b0 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.631+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/3585101132 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559dd25b7e50 con 0x559dd26aa2b0 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/3585101132 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f6ed8026ac0 con 0x559dd26aa2b0 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ef398db80 10 client.25760 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ef398db80 10 client.25760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ef398db80 20 client.25760 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ef398db80 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd26d0440 0x559dd26d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ef398db80 4 client.25760 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559dd25e8db0 con 0x559dd26d0440 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ee5540700 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd26d0440 0x559dd26d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ec8ff9700 10 client.25760 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.632+0000 7f6ee5540700 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd26d0440 0x559dd26d28c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd74641292ee83b server_cookie=9ce467f7bb3c622a in_seq=0 out_seq=0 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.633+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/3585101132 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559dd25e8db0 con 0x559dd26d0440 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.633+0000 7f6ec8ff9700 10 client.25760 handle_command_reply: tid=0 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.633+0000 7f6ef398db80 1 client.25760 shutdown 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 msgr2=0x559dd26af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 0x559dd26af510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007ed0 tx=0x7f6ed80077c0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 shutdown_connections 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd26d0440 0x559dd26d28c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd26aa2b0 0x559dd26af510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd269cd60 0x559dd26b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 --2- 172.21.15.5:0/3585101132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269d680 0x559dd26aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ec8ff9700 0 client.25760 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 >> 172.21.15.5:0/3585101132 conn(0x559dd2611200 msgr2=0x559dd26ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 shutdown_connections 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 1 -- 172.21.15.5:0/3585101132 wait complete. 2023-10-08T13:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.634+0000 7f6ef398db80 20 client.25760 trim_cache size 0 max 16384 2023-10-08T13:08:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.656+0000 7f6ef398db80 1 Processor -- start 2023-10-08T13:08:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.656+0000 7f6ef398db80 1 -- start start 2023-10-08T13:08:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ef398db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd24708c0 con 0x559dd269cd60 2023-10-08T13:08:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ef398db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd269dd60 con 0x559dd269d680 2023-10-08T13:08:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ef398db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd268f750 con 0x559dd26aa2b0 2023-10-08T13:08:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee4d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee4d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59002/0 (socket says 172.21.15.5:59002) 2023-10-08T13:08:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee4d3f700 1 -- 172.21.15.5:0/1411758105 learned_addr learned my addr 172.21.15.5:0/1411758105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26a9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35820/0 (socket says 172.21.15.5:35820) 2023-10-08T13:08:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 -- 172.21.15.5:0/1411758105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 msgr2=0x559dd26ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 -- 172.21.15.5:0/1411758105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 msgr2=0x559dd26b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.657+0000 7f6ee5540700 1 -- 172.21.15.5:0/1411758105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd24411f0 con 0x559dd269cd60 2023-10-08T13:08:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.658+0000 7f6ee5540700 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26a9b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009fd0 tx=0x7f6edc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca134d6e4a502d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.659+0000 7f6ecbfff700 1 -- 172.21.15.5:0/1411758105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc02a040 con 0x559dd269cd60 2023-10-08T13:08:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.659+0000 7f6ecbfff700 1 -- 172.21.15.5:0/1411758105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6edc02c370 con 0x559dd269cd60 2023-10-08T13:08:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.659+0000 7f6ecbfff700 1 -- 172.21.15.5:0/1411758105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc01d070 con 0x559dd269cd60 2023-10-08T13:08:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 -- 172.21.15.5:0/1411758105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 msgr2=0x559dd26a9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26a9b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009fd0 tx=0x7f6edc009310 comp rx=0 tx=0).stop 2023-10-08T13:08:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 -- 172.21.15.5:0/1411758105 shutdown_connections 2023-10-08T13:08:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd26ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26a9b20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 --2- 172.21.15.5:0/1411758105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 -- 172.21.15.5:0/1411758105 >> 172.21.15.5:0/1411758105 conn(0x559dd2611200 msgr2=0x559dd26a9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 -- 172.21.15.5:0/1411758105 shutdown_connections 2023-10-08T13:08:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.660+0000 7f6ef398db80 1 -- 172.21.15.5:0/1411758105 wait complete. 2023-10-08T13:08:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 -- start start 2023-10-08T13:08:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 Processor -- start 2023-10-08T13:08:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd271d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd271d820 con 0x559dd269cd60 2023-10-08T13:08:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd271d990 con 0x559dd269d680 2023-10-08T13:08:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd271db50 con 0x559dd26aa2b0 2023-10-08T13:08:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.661+0000 7f6ef398db80 10 client.0 _ll_register_callbacks cb 0x7f6ed8003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee4d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee4d3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59006/0 (socket says 172.21.15.5:59006) 2023-10-08T13:08:46.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee4d3f700 1 -- 172.21.15.5:0/502342234 learned_addr learned my addr 172.21.15.5:0/502342234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:46.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5d41700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd271d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 -- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 msgr2=0x559dd271d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd271d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 -- 172.21.15.5:0/502342234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 msgr2=0x559dd26c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:46.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 -- 172.21.15.5:0/502342234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc005050 con 0x559dd269cd60 2023-10-08T13:08:46.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ee5540700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26c55f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6edc02cbc0 tx=0x7f6edc02de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d495b6640fae30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:46.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.662+0000 7f6ec8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:08:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/502342234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc01d040 con 0x559dd269cd60 2023-10-08T13:08:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/502342234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6edc00bdf0 con 0x559dd269cd60 2023-10-08T13:08:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ed800f040 con 0x559dd269cd60 2023-10-08T13:08:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/502342234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6edc02c4e0 con 0x559dd269cd60 2023-10-08T13:08:46.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 10 client.16242 fetch_fsmap learned FSMap version 33 2023-10-08T13:08:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x559dd2419250 con 0x559dd269cd60 2023-10-08T13:08:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/502342234 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ed800f040 con 0x559dd269cd60 2023-10-08T13:08:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/502342234 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f6edc03e470 con 0x559dd269cd60 2023-10-08T13:08:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 10 client.16242 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:08:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:46.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 20 client.16242 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd2724fc0 0x559dd27273e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.663+0000 7f6ef398db80 4 client.16242 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:08:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.664+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559dd25e8ad0 con 0x559dd2724fc0 2023-10-08T13:08:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.664+0000 7f6ee4d3f700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd2724fc0 0x559dd27273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.664+0000 7f6ec8ff9700 10 client.16242 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.664+0000 7f6ee4d3f700 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd2724fc0 0x559dd27273e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8016503d7184b78f server_cookie=cece0e9039074a3e in_seq=0 out_seq=0 2023-10-08T13:08:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 145.0 s, 1584.2 tps, lat 62.608 ms stddev 67.994 2023-10-08T13:08:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.774+0000 7f6ec8ff9700 1 -- 172.21.15.5:0/502342234 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559dd25e8ad0 con 0x559dd2724fc0 2023-10-08T13:08:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.774+0000 7f6ec8ff9700 10 client.16242 handle_command_reply: tid=0 2023-10-08T13:08:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.775+0000 7f6ef398db80 1 client.16242 shutdown 2023-10-08T13:08:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.778+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 msgr2=0x559dd26c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.778+0000 7f6ef398db80 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26c55f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6edc02cbc0 tx=0x7f6edc02de40 comp rx=0 tx=0).stop 2023-10-08T13:08:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 shutdown_connections 2023-10-08T13:08:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ef398db80 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559dd26aa2b0 0x559dd271d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ef398db80 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559dd269cd60 0x559dd26c55f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ef398db80 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559dd2724fc0 0x559dd27273e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ef398db80 1 --2- 172.21.15.5:0/502342234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559dd269d680 0x559dd26c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 >> 172.21.15.5:0/502342234 conn(0x559dd2611200 msgr2=0x559dd269bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.780+0000 7f6ec8ff9700 0 client.16242 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.787+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 shutdown_connections 2023-10-08T13:08:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.787+0000 7f6ef398db80 1 -- 172.21.15.5:0/502342234 wait complete. 2023-10-08T13:08:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.788+0000 7f6ef398db80 20 client.16242 trim_cache size 0 max 16384 2023-10-08T13:08:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:08:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:08:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:08:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:08:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ecc0a1660 msgr2=0x7f6ecc0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ecc0a1660 0x7f6ecc0a3b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0058e0 tx=0x7f6edc000bc0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 msgr2=0x7f6ee0197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 0x7f6ee0197db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000e9a0 tx=0x7f6ed000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 shutdown_connections 2023-10-08T13:08:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6ecc0a1660 0x7f6ecc0a3b20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee0105630 0x7f6ee01a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ee00ff570 0x7f6ee0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 --2- 172.21.15.5:0/3924796312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00fff30 0x7f6ee0197db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 >> 172.21.15.5:0/3924796312 conn(0x7f6ee00fb080 msgr2=0x7f6ee00fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 shutdown_connections 2023-10-08T13:08:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:46.789+0000 7f6ee77a4700 1 -- 172.21.15.5:0/3924796312 wait complete. 2023-10-08T13:08:47.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:46 smithi060 ceph-mon[103190]: pgmap v383: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 23 MiB/s wr, 1.57k op/s 2023-10-08T13:08:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:46 smithi005 ceph-mon[99496]: pgmap v383: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 23 MiB/s wr, 1.57k op/s 2023-10-08T13:08:47.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:46 smithi118 ceph-mon[104234]: pgmap v383: 129 pgs: 129 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 23 MiB/s wr, 1.57k op/s 2023-10-08T13:08:49.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:48 smithi060 ceph-mon[103190]: pgmap v384: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 MiB/s wr, 1.62k op/s 2023-10-08T13:08:49.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:48 smithi005 ceph-mon[99496]: pgmap v384: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 MiB/s wr, 1.62k op/s 2023-10-08T13:08:49.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:48 smithi118 ceph-mon[104234]: pgmap v384: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 MiB/s wr, 1.62k op/s 2023-10-08T13:08:51.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:50 smithi060 ceph-mon[103190]: pgmap v385: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-10-08T13:08:51.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:50 smithi005 ceph-mon[99496]: pgmap v385: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-10-08T13:08:51.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:50 smithi118 ceph-mon[104234]: pgmap v385: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-10-08T13:08:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 150.0 s, 1367.1 tps, lat 74.216 ms stddev 86.667 2023-10-08T13:08:52.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:52 smithi118 ceph-mon[104234]: pgmap v386: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 692 op/s 2023-10-08T13:08:52.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:52 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:08:52.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:52 smithi060 ceph-mon[103190]: pgmap v386: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 692 op/s 2023-10-08T13:08:52.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:52 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:08:52.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:52 smithi005 ceph-mon[99496]: pgmap v386: 129 pgs: 129 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 13 MiB/s wr, 692 op/s 2023-10-08T13:08:52.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:52 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:08:54.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:54 smithi118 ceph-mon[104234]: pgmap v387: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 663 op/s 2023-10-08T13:08:54.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:54 smithi060 ceph-mon[103190]: pgmap v387: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 663 op/s 2023-10-08T13:08:54.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:54 smithi005 ceph-mon[99496]: pgmap v387: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 663 op/s 2023-10-08T13:08:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:56 smithi118 ceph-mon[104234]: pgmap v388: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 590 op/s 2023-10-08T13:08:56.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:56 smithi060 ceph-mon[103190]: pgmap v388: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 590 op/s 2023-10-08T13:08:56.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:56 smithi005 ceph-mon[99496]: pgmap v388: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 590 op/s 2023-10-08T13:08:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 155.0 s, 1535.1 tps, lat 65.239 ms stddev 74.765 2023-10-08T13:08:57.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:57 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:08:57.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:57 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:08:57.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:57 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:08:58.663 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:08:58 smithi060 ceph-mon[103190]: pgmap v389: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 714 op/s 2023-10-08T13:08:58.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:08:58 smithi005 ceph-mon[99496]: pgmap v389: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 714 op/s 2023-10-08T13:08:58.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:08:58 smithi118 ceph-mon[104234]: pgmap v389: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 714 op/s 2023-10-08T13:08:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 -- 172.21.15.5:0/292212785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280fef20 msgr2=0x7f45280ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 --2- 172.21.15.5:0/292212785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280fef20 0x7f45280ff380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4518009f90 tx=0x7f451800b330 comp rx=0 tx=0).stop 2023-10-08T13:08:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 -- 172.21.15.5:0/292212785 shutdown_connections 2023-10-08T13:08:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 --2- 172.21.15.5:0/292212785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45280ff8c0 0x7f452810bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 --2- 172.21.15.5:0/292212785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4528103d00 0x7f45281040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 --2- 172.21.15.5:0/292212785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280fef20 0x7f45280ff380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 -- 172.21.15.5:0/292212785 >> 172.21.15.5:0/292212785 conn(0x7f45280748d0 msgr2=0x7f4528074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 -- 172.21.15.5:0/292212785 shutdown_connections 2023-10-08T13:08:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.966+0000 7f452dbed700 1 -- 172.21.15.5:0/292212785 wait complete. 2023-10-08T13:08:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.967+0000 7f452dbed700 1 Processor -- start 2023-10-08T13:08:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 -- start start 2023-10-08T13:08:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45280fef20 0x7f452810d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 0x7f452810d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528103d00 0x7f452810dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4528071230 con 0x7f4528103d00 2023-10-08T13:08:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280713a0 con 0x7f45280ff8c0 2023-10-08T13:08:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f452dbed700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4528071560 con 0x7f45280fef20 2023-10-08T13:08:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.969+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 0x7f452810d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.970+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 0x7f452810d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59020/0 (socket says 172.21.15.5:59020) 2023-10-08T13:08:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.970+0000 7f4526ffd700 1 -- 172.21.15.5:0/2154741613 learned_addr learned my addr 172.21.15.5:0/2154741613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4527fff700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528103d00 0x7f452810dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4526ffd700 1 -- 172.21.15.5:0/2154741613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45280fef20 msgr2=0x7f452810d230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45280fef20 0x7f452810d230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4526ffd700 1 -- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528103d00 msgr2=0x7f452810dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528103d00 0x7f452810dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4526ffd700 1 -- 172.21.15.5:0/2154741613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518009c40 con 0x7f45280ff8c0 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4527fff700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528103d00 0x7f452810dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:08:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.971+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 0x7f452810d770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4518007a50 tx=0x7f4518009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.972+0000 7f4524ff9700 1 -- 172.21.15.5:0/2154741613 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800e040 con 0x7f45280ff8c0 2023-10-08T13:08:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.972+0000 7f4524ff9700 1 -- 172.21.15.5:0/2154741613 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4518006060 con 0x7f45280ff8c0 2023-10-08T13:08:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.972+0000 7f4524ff9700 1 -- 172.21.15.5:0/2154741613 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518005040 con 0x7f45280ff8c0 2023-10-08T13:08:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.972+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45280717e0 con 0x7f45280ff8c0 2023-10-08T13:08:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.972+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4528071ca0 con 0x7f45280ff8c0 2023-10-08T13:08:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.974+0000 7f4524ff9700 1 -- 172.21.15.5:0/2154741613 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f45180051e0 con 0x7f45280ff8c0 2023-10-08T13:08:59.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.975+0000 7f4524ff9700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45140a1730 0x7f45140a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.975+0000 7f4524ff9700 1 -- 172.21.15.5:0/2154741613 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f45180ce810 con 0x7f45280ff8c0 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.976+0000 7f4539dd6b80 1 Processor -- start 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.976+0000 7f4539dd6b80 1 -- start start 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461ce880 0x5560461cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461cf1a0 0x5560461c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556046131400 con 0x5560461ce880 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556046122bc0 con 0x5560461cf1a0 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560461204e0 con 0x5560461c90b0 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f45277fe700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45140a1730 0x7f45140a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f45277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461ce880 0x5560461cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f45277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461ce880 0x5560461cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35844/0 (socket says 172.21.15.5:35844) 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f45277fe700 1 -- 172.21.15.5:0/2829982843 learned_addr learned my addr 172.21.15.5:0/2829982843 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4527fff700 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4527fff700 1 -- 172.21.15.5:0/2829982843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461cf1a0 msgr2=0x5560461c8b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4527fff700 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461cf1a0 0x5560461c8b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4527fff700 1 -- 172.21.15.5:0/2829982843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461ce880 msgr2=0x5560461cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4527fff700 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461ce880 0x5560461cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.977+0000 7f4527fff700 1 -- 172.21.15.5:0/2829982843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556045f46d80 con 0x5560461c90b0 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.978+0000 7f4527fff700 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461c9510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4520009c40 tx=0x7f4520009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab54e011f54c4fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.978+0000 7f451dffb700 1 -- 172.21.15.5:0/2829982843 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520010b80 con 0x5560461c90b0 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.978+0000 7f451dffb700 1 -- 172.21.15.5:0/2829982843 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45200044f0 con 0x5560461c90b0 2023-10-08T13:08:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.978+0000 7f451dffb700 1 -- 172.21.15.5:0/2829982843 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520003e10 con 0x5560461c90b0 2023-10-08T13:08:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.979+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2829982843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 msgr2=0x5560461c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.979+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461c9510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4520009c40 tx=0x7f4520009f50 comp rx=0 tx=0).stop 2023-10-08T13:08:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.979+0000 7f45277fe700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45140a1730 0x7f45140a3bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4510009fd0 tx=0x7f4510009ae0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2829982843 shutdown_connections 2023-10-08T13:08:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461c9510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461ce880 0x5560461cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2829982843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461cf1a0 0x5560461c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2829982843 >> 172.21.15.5:0/2829982843 conn(0x55604613d200 msgr2=0x5560461c3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2829982843 shutdown_connections 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2829982843 wait complete. 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.981+0000 7f4539dd6b80 1 -- start start 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 Processor -- start 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461c90b0 0x5560461d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461cf1a0 0x5560461d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604611bdd0 con 0x5560461c90b0 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560460b86b0 con 0x5560461ce880 2023-10-08T13:08:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560460b8350 con 0x5560461cf1a0 2023-10-08T13:08:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4539dd6b80 10 client.0 _ll_register_callbacks cb 0x556045f157a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:08:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f45277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461c90b0 0x5560461d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f45277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461c90b0 0x5560461d51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35850/0 (socket says 172.21.15.5:35850) 2023-10-08T13:08:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f45277fe700 1 -- 172.21.15.5:0/2819552886 learned_addr learned my addr 172.21.15.5:0/2819552886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:08:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.982+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4526ffd700 1 -- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461cf1a0 msgr2=0x5560461d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461cf1a0 0x5560461d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4526ffd700 1 -- 172.21.15.5:0/2819552886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461c90b0 msgr2=0x5560461d51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461c90b0 0x5560461d51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4526ffd700 1 -- 172.21.15.5:0/2819552886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4520009920 con 0x5560461ce880 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4526ffd700 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461d2450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45180cbbc0 tx=0x7f4518009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=850187f13b03f2a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4506ffd700 1 -- 172.21.15.5:0/2819552886 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180ce610 con 0x5560461ce880 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.983+0000 7f4506ffd700 1 -- 172.21.15.5:0/2819552886 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f451809c310 con 0x5560461ce880 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.984+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560460e3e50 con 0x5560461ce880 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.984+0000 7f4506ffd700 1 -- 172.21.15.5:0/2819552886 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45180a0460 con 0x5560461ce880 2023-10-08T13:08:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.984+0000 7f4539dd6b80 10 client.25775 fetch_fsmap learned FSMap version 35 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.984+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x556045f2fc00 con 0x5560461ce880 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4506ffd700 1 -- 172.21.15.5:0/2819552886 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5560460e3e50 con 0x5560461ce880 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4506ffd700 1 -- 172.21.15.5:0/2819552886 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f451800bbf0 con 0x5560461ce880 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4539dd6b80 10 client.25775 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4539dd6b80 10 client.25775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4539dd6b80 20 client.25775 populate_metadata read hostname 'smithi005' 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5560461e2b80 0x5560461e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4539dd6b80 4 client.25775 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556046114db0 con 0x5560461e2b80 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.985+0000 7f45277fe700 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5560461e2b80 0x5560461e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.986+0000 7f4506ffd700 10 client.25775 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.986+0000 7f45277fe700 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5560461e2b80 0x5560461e4fa0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ba1b8ec3e7e557 server_cookie=1dc2b5c73d4e0259 in_seq=0 out_seq=0 2023-10-08T13:08:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.986+0000 7f4506ffd700 1 -- 172.21.15.5:0/2819552886 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556046114db0 con 0x5560461e2b80 2023-10-08T13:08:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.986+0000 7f4506ffd700 10 client.25775 handle_command_reply: tid=0 2023-10-08T13:08:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.987+0000 7f4539dd6b80 1 client.25775 shutdown 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.988+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 msgr2=0x5560461d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461d2450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45180cbbc0 tx=0x7f4518009bd0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 shutdown_connections 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461cf1a0 0x5560461d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461c90b0 0x5560461d51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5560461e2b80 0x5560461e4fa0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2819552886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461d2450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4506ffd700 0 client.25775 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 >> 172.21.15.5:0/2819552886 conn(0x55604613d200 msgr2=0x5560461c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:08:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 shutdown_connections 2023-10-08T13:08:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2819552886 wait complete. 2023-10-08T13:08:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:08:59.989+0000 7f4539dd6b80 20 client.25775 trim_cache size 0 max 16384 2023-10-08T13:09:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.015+0000 7f4539dd6b80 1 Processor -- start 2023-10-08T13:09:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 -- start start 2023-10-08T13:09:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461c90b0 0x5560461cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 0x5560461d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556045f9c8c0 con 0x5560461cf1a0 2023-10-08T13:09:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560461c4610 con 0x5560461c90b0 2023-10-08T13:09:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.027+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560461d3080 con 0x5560461ce880 2023-10-08T13:09:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 0x5560461d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 0x5560461d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49064/0 (socket says 172.21.15.5:49064) 2023-10-08T13:09:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 -- 172.21.15.5:0/1934509056 learned_addr learned my addr 172.21.15.5:0/1934509056 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 -- 172.21.15.5:0/1934509056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461c90b0 msgr2=0x5560461cdc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:09:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461c90b0 0x5560461cdc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 -- 172.21.15.5:0/1934509056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 msgr2=0x5560461c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.035+0000 7f4526ffd700 1 -- 172.21.15.5:0/1934509056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560461e9b90 con 0x5560461ce880 2023-10-08T13:09:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.041+0000 7f4526ffd700 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 0x5560461d4d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4518009f60 tx=0x7f4518009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d2e126702dd7b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.052+0000 7f451e7fc700 1 -- 172.21.15.5:0/1934509056 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518011390 con 0x5560461ce880 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.052+0000 7f451e7fc700 1 -- 172.21.15.5:0/1934509056 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f451809c310 con 0x5560461ce880 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.052+0000 7f451e7fc700 1 -- 172.21.15.5:0/1934509056 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180a2220 con 0x5560461ce880 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 -- 172.21.15.5:0/1934509056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 msgr2=0x5560461d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 0x5560461d4d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4518009f60 tx=0x7f4518009920 comp rx=0 tx=0).stop 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 -- 172.21.15.5:0/1934509056 shutdown_connections 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461c90b0 0x5560461cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/1934509056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461ce880 0x5560461d4d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 -- 172.21.15.5:0/1934509056 >> 172.21.15.5:0/1934509056 conn(0x55604613d200 msgr2=0x5560461cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 -- 172.21.15.5:0/1934509056 shutdown_connections 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.053+0000 7f4539dd6b80 1 -- 172.21.15.5:0/1934509056 wait complete. 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 -- start start 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 Processor -- start 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560461cb3c0 con 0x5560461cf1a0 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560461cb530 con 0x5560461ce880 2023-10-08T13:09:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560461cb6f0 con 0x5560461c90b0 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.054+0000 7f4539dd6b80 10 client.0 _ll_register_callbacks cb 0x7f451809c0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.055+0000 7f4526ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.055+0000 7f4527fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.055+0000 7f4527fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35864/0 (socket says 172.21.15.5:35864) 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.055+0000 7f4527fff700 1 -- 172.21.15.5:0/2130381862 learned_addr learned my addr 172.21.15.5:0/2130381862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.056+0000 7f4527fff700 1 -- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 msgr2=0x5560461ca400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.056+0000 7f4527fff700 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461ca400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.056+0000 7f4527fff700 1 -- 172.21.15.5:0/2130381862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 msgr2=0x5560461ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.056+0000 7f4527fff700 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.056+0000 7f4527fff700 1 -- 172.21.15.5:0/2130381862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556045f2fc00 con 0x5560461cf1a0 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.056+0000 7f4527fff700 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461cae80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4520010c20 tx=0x7f4520010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f864dabb69394d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.061+0000 7f4506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:09:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.061+0000 7f4506ffd700 1 -- 172.21.15.5:0/2130381862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520021070 con 0x5560461cf1a0 2023-10-08T13:09:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.061+0000 7f4506ffd700 1 -- 172.21.15.5:0/2130381862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4520016030 con 0x5560461cf1a0 2023-10-08T13:09:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.061+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45200044f0 con 0x5560461cf1a0 2023-10-08T13:09:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.069+0000 7f4506ffd700 1 -- 172.21.15.5:0/2130381862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4520010ed0 con 0x5560461cf1a0 2023-10-08T13:09:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.070+0000 7f4539dd6b80 10 client.16254 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.070+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x556045f6d1f0 con 0x5560461cf1a0 2023-10-08T13:09:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4506ffd700 1 -- 172.21.15.5:0/2130381862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45200044f0 con 0x5560461cf1a0 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4506ffd700 1 -- 172.21.15.5:0/2130381862 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4520012450 con 0x5560461cf1a0 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4539dd6b80 10 client.16254 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4539dd6b80 10 client.16254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4539dd6b80 20 client.16254 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556046259450 0x55604625b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4539dd6b80 4 client.16254 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:09:00.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.073+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556046114ad0 con 0x556046259450 2023-10-08T13:09:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.074+0000 7f45277fe700 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556046259450 0x55604625b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.076+0000 7f45277fe700 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556046259450 0x55604625b870 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f33e24091c6ad13e server_cookie=94a333697a7e3d01 in_seq=0 out_seq=0 2023-10-08T13:09:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.076+0000 7f4506ffd700 10 client.16254 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.121+0000 7f4506ffd700 1 -- 172.21.15.5:0/2130381862 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556046114ad0 con 0x556046259450 2023-10-08T13:09:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.121+0000 7f4506ffd700 10 client.16254 handle_command_reply: tid=0 2023-10-08T13:09:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.121+0000 7f4539dd6b80 1 client.16254 shutdown 2023-10-08T13:09:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 msgr2=0x5560461cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461cae80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4520010c20 tx=0x7f4520010d00 comp rx=0 tx=0).stop 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 shutdown_connections 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560461cf1a0 0x5560461cae80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5560461c90b0 0x5560461ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556046259450 0x55604625b870 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 --2- 172.21.15.5:0/2130381862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560461ce880 0x5560461ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4506ffd700 0 client.16254 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.122+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 >> 172.21.15.5:0/2130381862 conn(0x55604613d200 msgr2=0x5560461d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.123+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 shutdown_connections 2023-10-08T13:09:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.123+0000 7f4539dd6b80 1 -- 172.21.15.5:0/2130381862 wait complete. 2023-10-08T13:09:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.126+0000 7f4539dd6b80 20 client.16254 trim_cache size 0 max 16384 2023-10-08T13:09:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:09:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:09:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:09:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:09:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.127+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45140a1730 msgr2=0x7f45140a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.127+0000 7f452dbed700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45140a1730 0x7f45140a3bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4510009fd0 tx=0x7f4510009ae0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.127+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 msgr2=0x7f452810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.127+0000 7f452dbed700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 0x7f452810d770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4518007a50 tx=0x7f4518009510 comp rx=0 tx=0).stop 2023-10-08T13:09:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 shutdown_connections 2023-10-08T13:09:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45140a1730 0x7f45140a3bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528103d00 0x7f452810dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45280fef20 0x7f452810d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 --2- 172.21.15.5:0/2154741613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45280ff8c0 0x7f452810d770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 >> 172.21.15.5:0/2154741613 conn(0x7f45280748d0 msgr2=0x7f45280fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 shutdown_connections 2023-10-08T13:09:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:00.129+0000 7f452dbed700 1 -- 172.21.15.5:0/2154741613 wait complete. 2023-10-08T13:09:00.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:00 smithi060 ceph-mon[103190]: pgmap v390: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 717 op/s 2023-10-08T13:09:00.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:00 smithi005 ceph-mon[99496]: pgmap v390: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 717 op/s 2023-10-08T13:09:00.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:00 smithi118 ceph-mon[104234]: pgmap v390: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 717 op/s 2023-10-08T13:09:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 160.0 s, 901.2 tps, lat 88.591 ms stddev 97.280 2023-10-08T13:09:02.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:02 smithi060 ceph-mon[103190]: pgmap v391: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 718 op/s 2023-10-08T13:09:02.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:02 smithi005 ceph-mon[99496]: pgmap v391: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 718 op/s 2023-10-08T13:09:02.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:02 smithi118 ceph-mon[104234]: pgmap v391: 129 pgs: 129 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 718 op/s 2023-10-08T13:09:04.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:04 smithi060 ceph-mon[103190]: pgmap v392: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T13:09:04.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:04 smithi005 ceph-mon[99496]: pgmap v392: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T13:09:04.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:04 smithi118 ceph-mon[104234]: pgmap v392: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T13:09:06.663 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:06 smithi060 ceph-mon[103190]: pgmap v393: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T13:09:06.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:06 smithi005 ceph-mon[99496]: pgmap v393: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T13:09:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 165.0 s, 909.8 tps, lat 130.706 ms stddev 318.869 2023-10-08T13:09:06.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:06 smithi118 ceph-mon[104234]: pgmap v393: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T13:09:08.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:08 smithi060 ceph-mon[103190]: pgmap v394: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 19 MiB/s wr, 1.52k op/s 2023-10-08T13:09:08.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:08 smithi005 ceph-mon[99496]: pgmap v394: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 19 MiB/s wr, 1.52k op/s 2023-10-08T13:09:08.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:08 smithi118 ceph-mon[104234]: pgmap v394: 129 pgs: 129 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 19 MiB/s wr, 1.52k op/s 2023-10-08T13:09:10.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:10 smithi060 ceph-mon[103190]: pgmap v395: 129 pgs: 129 active+clean; 3.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 1.47k op/s 2023-10-08T13:09:10.680 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:10 smithi005 ceph-mon[99496]: pgmap v395: 129 pgs: 129 active+clean; 3.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 1.47k op/s 2023-10-08T13:09:10.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:10 smithi118 ceph-mon[104234]: pgmap v395: 129 pgs: 129 active+clean; 3.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 1.47k op/s 2023-10-08T13:09:10.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:09:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 -- 172.21.15.5:0/2582841855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 msgr2=0x7fbed0101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 --2- 172.21.15.5:0/2582841855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed0101bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbec00098f0 tx=0x7fbec0009c00 comp rx=0 tx=0).stop 2023-10-08T13:09:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 -- 172.21.15.5:0/2582841855 shutdown_connections 2023-10-08T13:09:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 --2- 172.21.15.5:0/2582841855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed010ac10 0x7fbed010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 --2- 172.21.15.5:0/2582841855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed0101bd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 --2- 172.21.15.5:0/2582841855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbed0102110 0x7fbed010a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 -- 172.21.15.5:0/2582841855 >> 172.21.15.5:0/2582841855 conn(0x7fbed00fafb0 msgr2=0x7fbed00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 -- 172.21.15.5:0/2582841855 shutdown_connections 2023-10-08T13:09:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.186+0000 7fbed5493700 1 -- 172.21.15.5:0/2582841855 wait complete. 2023-10-08T13:09:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.187+0000 7fbed5493700 1 Processor -- start 2023-10-08T13:09:11.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.187+0000 7fbed5493700 1 -- start start 2023-10-08T13:09:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbed5493700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed00ff460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbed5493700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 0x7fbed00ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbed5493700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbed010ac10 0x7fbed00ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbed5493700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0101430 con 0x7fbed0102110 2023-10-08T13:09:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbed5493700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed019aca0 con 0x7fbed01017f0 2023-10-08T13:09:11.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbed5493700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed019ae60 con 0x7fbed010ac10 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbece7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 0x7fbed00ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed00ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbece7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 0x7fbed00ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35878/0 (socket says 172.21.15.5:35878) 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed00ff460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59058/0 (socket says 172.21.15.5:59058) 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbece7fc700 1 -- 172.21.15.5:0/1630533495 learned_addr learned my addr 172.21.15.5:0/1630533495 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbed010ac10 0x7fbed00ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 -- 172.21.15.5:0/1630533495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbed010ac10 msgr2=0x7fbed00ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbed010ac10 0x7fbed00ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 -- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 msgr2=0x7fbed00ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 0x7fbed00ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 -- 172.21.15.5:0/1630533495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009520 con 0x7fbed01017f0 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbece7fc700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 0x7fbed00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.188+0000 7fbeceffd700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed00ff460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009230 tx=0x7fbec000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.189+0000 7fbeb7fff700 1 -- 172.21.15.5:0/1630533495 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec001c070 con 0x7fbed01017f0 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.189+0000 7fbeb7fff700 1 -- 172.21.15.5:0/1630533495 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec000ba20 con 0x7fbed01017f0 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.189+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed019b0e0 con 0x7fbed01017f0 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.189+0000 7fbeb7fff700 1 -- 172.21.15.5:0/1630533495 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00038e0 con 0x7fbed01017f0 2023-10-08T13:09:11.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.189+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed019b5e0 con 0x7fbed01017f0 2023-10-08T13:09:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.192+0000 7fbeb7fff700 1 -- 172.21.15.5:0/1630533495 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fbec0020030 con 0x7fbed01017f0 2023-10-08T13:09:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.193+0000 7fbeb7fff700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbeb80a16f0 0x7fbeb80a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.193+0000 7fbeb7fff700 1 -- 172.21.15.5:0/1630533495 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbec00ce130 con 0x7fbed01017f0 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 Processor -- start 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 -- start start 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbece7fc700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbeb80a16f0 0x7fbeb80a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 0x559b7eb1d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb1d7a0 0x559b7eb28110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb28650 0x559b7eb2aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7ea86460 con 0x559b7eb1ce80 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7ea77c20 con 0x559b7eb1d7a0 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbee167cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7ea75540 con 0x559b7eb28650 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 0x559b7eb1d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 0x559b7eb1d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35884/0 (socket says 172.21.15.5:35884) 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 -- 172.21.15.5:0/2208728888 learned_addr learned my addr 172.21.15.5:0/2208728888 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbece7fc700 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb1d7a0 0x559b7eb28110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 -- 172.21.15.5:0/2208728888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb28650 msgr2=0x559b7eb2aa40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb28650 0x559b7eb2aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 -- 172.21.15.5:0/2208728888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb1d7a0 msgr2=0x559b7eb28110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:11.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb1d7a0 0x559b7eb28110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.194+0000 7fbeceffd700 1 -- 172.21.15.5:0/2208728888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b7e89bde0 con 0x559b7eb1ce80 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.195+0000 7fbece7fc700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbeb80a16f0 0x7fbeb80a3bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbed0100b90 tx=0x7fbec40134e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.195+0000 7fbeceffd700 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 0x559b7eb1d260 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbec00a2bd0 tx=0x7fbec0005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196398b5cdefa24e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.195+0000 7fbeb57fa700 1 -- 172.21.15.5:0/2208728888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec009d050 con 0x559b7eb1ce80 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.195+0000 7fbeb57fa700 1 -- 172.21.15.5:0/2208728888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec009ae00 con 0x559b7eb1ce80 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.195+0000 7fbeb57fa700 1 -- 172.21.15.5:0/2208728888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00051f0 con 0x559b7eb1ce80 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.196+0000 7fbee167cb80 1 -- 172.21.15.5:0/2208728888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 msgr2=0x559b7eb1d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.196+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 0x559b7eb1d260 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbec00a2bd0 tx=0x7fbec0005470 comp rx=0 tx=0).stop 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 -- 172.21.15.5:0/2208728888 shutdown_connections 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb28650 0x559b7eb2aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1ce80 0x559b7eb1d260 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2208728888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb1d7a0 0x559b7eb28110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 -- 172.21.15.5:0/2208728888 >> 172.21.15.5:0/2208728888 conn(0x559b7ea92260 msgr2=0x559b7eb192d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 -- 172.21.15.5:0/2208728888 shutdown_connections 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 -- 172.21.15.5:0/2208728888 wait complete. 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.197+0000 7fbee167cb80 1 -- start start 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 Processor -- start 2023-10-08T13:09:11.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb27f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb25290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb25810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7ea70e30 con 0x559b7eb1d7a0 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7ea0d710 con 0x559b7eb28650 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7ea0d3b0 con 0x559b7eb1ce80 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.198+0000 7fbee167cb80 10 client.0 _ll_register_callbacks cb 0x559b7e86a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb25810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbece7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb25290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb25810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59074/0 (socket says 172.21.15.5:59074) 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 -- 172.21.15.5:0/1175761933 learned_addr learned my addr 172.21.15.5:0/1175761933 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:11.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 -- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 msgr2=0x559b7eb27f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb27f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 -- 172.21.15.5:0/1175761933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 msgr2=0x559b7eb25290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb25290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.199+0000 7fbecf7fe700 1 -- 172.21.15.5:0/1175761933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed019b5e0 con 0x559b7eb28650 2023-10-08T13:09:11.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.201+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb25810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007be0 tx=0x7fbec8007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7436e007af39cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.201+0000 7fbeb2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.201+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/1175761933 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003a00 con 0x559b7eb28650 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.202+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/1175761933 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbec8003b60 con 0x559b7eb28650 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.202+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b7ea38eb0 con 0x559b7eb28650 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.202+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/1175761933 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec8003d20 con 0x559b7eb28650 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.203+0000 7fbee167cb80 10 client.25787 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:11.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.203+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559b7e884c60 con 0x559b7eb28650 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.204+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/1175761933 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559b7ea38eb0 con 0x559b7eb28650 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/1175761933 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fbec8035040 con 0x559b7eb28650 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbee167cb80 10 client.25787 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbee167cb80 10 client.25787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbee167cb80 20 client.25787 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbee167cb80 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb48fe0 0x559b7eb4b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbee167cb80 4 client.25787 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:09:11.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b7ea69e10 con 0x559b7eb48fe0 2023-10-08T13:09:11.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.205+0000 7fbeceffd700 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb48fe0 0x559b7eb4b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbeb2ff5700 10 client.25787 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbeceffd700 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb48fe0 0x559b7eb4b400 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dabb1e7efab8526 server_cookie=381e8400d65f6827 in_seq=0 out_seq=0 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/1175761933 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559b7ea69e10 con 0x559b7eb48fe0 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbeb2ff5700 10 client.25787 handle_command_reply: tid=0 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 client.25787 shutdown 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 msgr2=0x559b7eb25810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb25810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007be0 tx=0x7fbec8007ef0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 shutdown_connections 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb48fe0 0x559b7eb4b400 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb25810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb27f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbeb2ff5700 0 client.25787 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 --2- 172.21.15.5:0/1175761933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb25290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.206+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 >> 172.21.15.5:0/1175761933 conn(0x559b7ea92260 msgr2=0x559b7eb18ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.207+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 shutdown_connections 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.207+0000 7fbee167cb80 1 -- 172.21.15.5:0/1175761933 wait complete. 2023-10-08T13:09:11.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.207+0000 7fbee167cb80 20 client.25787 trim_cache size 0 max 16384 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.235+0000 7fbee167cb80 1 Processor -- start 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.235+0000 7fbee167cb80 1 -- start start 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb1fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb257e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb2f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbee167cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7e8f1920 con 0x559b7eb1d7a0 2023-10-08T13:09:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbee167cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7eb459b0 con 0x559b7eb28650 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbee167cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7eb1db80 con 0x559b7eb1ce80 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb1fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb1fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49100/0 (socket says 172.21.15.5:49100) 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbeceffd700 1 -- 172.21.15.5:0/3872982730 learned_addr learned my addr 172.21.15.5:0/3872982730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb2f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbecf7fe700 1 -- 172.21.15.5:0/3872982730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 msgr2=0x559b7eb1fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb1fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbecf7fe700 1 -- 172.21.15.5:0/3872982730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 msgr2=0x559b7eb257e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb257e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbecf7fe700 1 -- 172.21.15.5:0/3872982730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b7e8c2250 con 0x559b7eb28650 2023-10-08T13:09:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.236+0000 7fbeceffd700 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb1fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.237+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb2f030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007bb0 tx=0x7fbec80096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59955a63d26eaf65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.237+0000 7fbeb5ffb700 1 -- 172.21.15.5:0/3872982730 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec80394c0 con 0x559b7eb28650 2023-10-08T13:09:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.237+0000 7fbeb5ffb700 1 -- 172.21.15.5:0/3872982730 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec8003a00 con 0x559b7eb28650 2023-10-08T13:09:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.237+0000 7fbeb5ffb700 1 -- 172.21.15.5:0/3872982730 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8039be0 con 0x559b7eb28650 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 -- 172.21.15.5:0/3872982730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 msgr2=0x559b7eb2f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb2f030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007bb0 tx=0x7fbec80096a0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 -- 172.21.15.5:0/3872982730 shutdown_connections 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb2f030 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb1fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 --2- 172.21.15.5:0/3872982730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 -- 172.21.15.5:0/3872982730 >> 172.21.15.5:0/3872982730 conn(0x559b7ea92260 msgr2=0x559b7eb205b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 -- 172.21.15.5:0/3872982730 shutdown_connections 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 -- 172.21.15.5:0/3872982730 wait complete. 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 -- start start 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.238+0000 7fbee167cb80 1 Processor -- start 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb21c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb22140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb22680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7eb9ce10 con 0x559b7eb1d7a0 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7eb9cf50 con 0x559b7eb28650 2023-10-08T13:09:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7eb9d0c0 con 0x559b7eb1ce80 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbee167cb80 10 client.0 _ll_register_callbacks cb 0x7fbec8009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb22680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb21c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb22680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59084/0 (socket says 172.21.15.5:59084) 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 -- 172.21.15.5:0/2627166109 learned_addr learned my addr 172.21.15.5:0/2627166109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbeceffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb21c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49104/0 (socket says 172.21.15.5:49104) 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbece7fc700 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb22140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 -- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 msgr2=0x559b7eb21c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb21c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 -- 172.21.15.5:0/2627166109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 msgr2=0x559b7eb22140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb22140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.239+0000 7fbecf7fe700 1 -- 172.21.15.5:0/2627166109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b7e89bde0 con 0x559b7eb28650 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbecf7fe700 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb22680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbec8039770 tx=0x7fbec8003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45aaf3929e0fade8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbeb2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/2627166109 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8033d60 con 0x559b7eb28650 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/2627166109 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbec80398d0 con 0x559b7eb28650 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbec009ae00 con 0x559b7eb28650 2023-10-08T13:09:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/2627166109 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec8039a90 con 0x559b7eb28650 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 10 client.25793 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559b7e884c60 con 0x559b7eb28650 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/2627166109 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbec009ae00 con 0x559b7eb28650 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/2627166109 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fbec8052020 con 0x559b7eb28650 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 10 client.25793 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 10 client.25793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 20 client.25793 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb9e560 0x559b7eba0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 4 client.25793 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:09:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.240+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559b7ea69b30 con 0x559b7eb9e560 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbeceffd700 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb9e560 0x559b7eba0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbeb2ff5700 10 client.25793 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbeceffd700 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb9e560 0x559b7eba0980 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=587279c72569ab7e server_cookie=3a247946f89b2276 in_seq=0 out_seq=0 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbeb2ff5700 1 -- 172.21.15.5:0/2627166109 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559b7ea69b30 con 0x559b7eb9e560 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbeb2ff5700 10 client.25793 handle_command_reply: tid=0 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbee167cb80 1 client.25793 shutdown 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 msgr2=0x559b7eb22680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb22680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbec8039770 tx=0x7fbec8003da0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.241+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 shutdown_connections 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559b7eb9e560 0x559b7eba0980 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559b7eb28650 0x559b7eb22680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbeb2ff5700 0 client.25793 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b7eb1ce80 0x559b7eb21c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 --2- 172.21.15.5:0/2627166109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b7eb1d7a0 0x559b7eb22140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 >> 172.21.15.5:0/2627166109 conn(0x559b7ea92260 msgr2=0x559b7eb184d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 shutdown_connections 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 1 -- 172.21.15.5:0/2627166109 wait complete. 2023-10-08T13:09:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.242+0000 7fbee167cb80 20 client.25793 trim_cache size 0 max 16384 2023-10-08T13:09:11.252 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:09:11.252 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:09:11.252 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:09:11.252 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:09:11.252 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:09:11.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:09:11.253 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:09:11.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:09:11.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:09:11.253 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbeb80a16f0 msgr2=0x7fbeb80a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbeb80a16f0 0x7fbeb80a3bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbed0100b90 tx=0x7fbec40134e0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 msgr2=0x7fbed00ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed00ff460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009230 tx=0x7fbec000fa00 comp rx=0 tx=0).stop 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 shutdown_connections 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbeb80a16f0 0x7fbeb80a3bb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbed010ac10 0x7fbed00ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed01017f0 0x7fbed00ff460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 --2- 172.21.15.5:0/1630533495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed0102110 0x7fbed00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:11.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 >> 172.21.15.5:0/1630533495 conn(0x7fbed00fafb0 msgr2=0x7fbed00fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:11.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 shutdown_connections 2023-10-08T13:09:11.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:11.246+0000 7fbed5493700 1 -- 172.21.15.5:0/1630533495 wait complete. 2023-10-08T13:09:11.287 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:09:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 170.0 s, 1172.8 tps, lat 84.998 ms stddev 94.508 2023-10-08T13:09:12.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:12 smithi060 ceph-mon[103190]: pgmap v396: 129 pgs: 129 active+clean; 3.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.43k op/s 2023-10-08T13:09:12.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:12 smithi005 ceph-mon[99496]: pgmap v396: 129 pgs: 129 active+clean; 3.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.43k op/s 2023-10-08T13:09:12.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:12 smithi118 ceph-mon[104234]: pgmap v396: 129 pgs: 129 active+clean; 3.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.43k op/s 2023-10-08T13:09:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.325+0000 7ff157252700 1 -- 172.21.15.5:0/2681624504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 msgr2=0x7ff15010f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.325+0000 7ff157252700 1 --2- 172.21.15.5:0/2681624504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff15010f780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff144009990 tx=0x7ff144009ca0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.326+0000 7ff157252700 1 -- 172.21.15.5:0/2681624504 shutdown_connections 2023-10-08T13:09:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.326+0000 7ff157252700 1 --2- 172.21.15.5:0/2681624504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff15010f780 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.326+0000 7ff157252700 1 --2- 172.21.15.5:0/2681624504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1501088c0 0x7ff150108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.326+0000 7ff157252700 1 --2- 172.21.15.5:0/2681624504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1501028b0 0x7ff150102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.326+0000 7ff157252700 1 -- 172.21.15.5:0/2681624504 >> 172.21.15.5:0/2681624504 conn(0x7ff1500fe3a0 msgr2=0x7ff1501007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.335+0000 7ff157252700 1 -- 172.21.15.5:0/2681624504 shutdown_connections 2023-10-08T13:09:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.336+0000 7ff157252700 1 -- 172.21.15.5:0/2681624504 wait complete. 2023-10-08T13:09:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.336+0000 7ff157252700 1 Processor -- start 2023-10-08T13:09:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 -- start start 2023-10-08T13:09:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1501028b0 0x7ff15010ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff150119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1501088c0 0x7ff15010e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15010ea50 con 0x7ff150103270 2023-10-08T13:09:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15010ebc0 con 0x7ff1501088c0 2023-10-08T13:09:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff157252700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15006a210 con 0x7ff1501028b0 2023-10-08T13:09:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff14ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff150119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff14ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff150119a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35912/0 (socket says 172.21.15.5:35912) 2023-10-08T13:09:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff14ffff700 1 -- 172.21.15.5:0/180818567 learned_addr learned my addr 172.21.15.5:0/180818567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.337+0000 7ff154fee700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1501028b0 0x7ff15010ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.338+0000 7ff14ffff700 1 -- 172.21.15.5:0/180818567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1501028b0 msgr2=0x7ff15010ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.338+0000 7ff14ffff700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1501028b0 0x7ff15010ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.338+0000 7ff14ffff700 1 -- 172.21.15.5:0/180818567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1501088c0 msgr2=0x7ff15010e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.338+0000 7ff14ffff700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1501088c0 0x7ff15010e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.338+0000 7ff14ffff700 1 -- 172.21.15.5:0/180818567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440095f0 con 0x7ff150103270 2023-10-08T13:09:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.338+0000 7ff14ffff700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff150119a50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff14000b550 tx=0x7ff14000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.341+0000 7ff14dffb700 1 -- 172.21.15.5:0/180818567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140011830 con 0x7ff150103270 2023-10-08T13:09:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.342+0000 7ff14dffb700 1 -- 172.21.15.5:0/180818567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff140011e50 con 0x7ff150103270 2023-10-08T13:09:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.342+0000 7ff14dffb700 1 -- 172.21.15.5:0/180818567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000f2e0 con 0x7ff150103270 2023-10-08T13:09:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.343+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15006a490 con 0x7ff150103270 2023-10-08T13:09:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.343+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15006a920 con 0x7ff150103270 2023-10-08T13:09:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.347+0000 7ff14dffb700 1 -- 172.21.15.5:0/180818567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff140011990 con 0x7ff150103270 2023-10-08T13:09:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 Processor -- start 2023-10-08T13:09:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff14dffb700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1380a1730 0x7ff1380a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 -- start start 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff14dffb700 1 -- 172.21.15.5:0/180818567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff1400cce10 con 0x7ff150103270 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ff7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860ff1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860f5a400 con 0x55d860ff81a0 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860f4bbc0 con 0x55d860ff20b0 2023-10-08T13:09:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.348+0000 7ff16343bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860f494e0 con 0x55d860ff7880 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ff7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ff7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49124/0 (socket says 172.21.15.5:49124) 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 -- 172.21.15.5:0/3339637862 learned_addr learned my addr 172.21.15.5:0/3339637862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 -- 172.21.15.5:0/3339637862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 msgr2=0x55d860ff2510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff2510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 -- 172.21.15.5:0/3339637862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 msgr2=0x55d860ff1b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860ff1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff154fee700 1 -- 172.21.15.5:0/3339637862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d860d6fd80 con 0x55d860ff7880 2023-10-08T13:09:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.349+0000 7ff1557ef700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1380a1730 0x7ff1380a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.350+0000 7ff154fee700 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ff7c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff148009fd0 tx=0x7ff14800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf185040ae2d3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.350+0000 7ff136ffd700 1 -- 172.21.15.5:0/3339637862 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148011070 con 0x55d860ff7880 2023-10-08T13:09:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.350+0000 7ff136ffd700 1 -- 172.21.15.5:0/3339637862 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff14800ce10 con 0x55d860ff7880 2023-10-08T13:09:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.350+0000 7ff136ffd700 1 -- 172.21.15.5:0/3339637862 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1480159f0 con 0x55d860ff7880 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.351+0000 7ff16343bb80 1 -- 172.21.15.5:0/3339637862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 msgr2=0x55d860ff7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.351+0000 7ff16343bb80 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ff7c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff148009fd0 tx=0x7ff14800c6e0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 -- 172.21.15.5:0/3339637862 shutdown_connections 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ff7c60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 --2- 172.21.15.5:0/3339637862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860ff1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 -- 172.21.15.5:0/3339637862 >> 172.21.15.5:0/3339637862 conn(0x55d860f66200 msgr2=0x55d860fecb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 -- 172.21.15.5:0/3339637862 shutdown_connections 2023-10-08T13:09:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.352+0000 7ff16343bb80 1 -- 172.21.15.5:0/3339637862 wait complete. 2023-10-08T13:09:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.353+0000 7ff16343bb80 1 -- start start 2023-10-08T13:09:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.353+0000 7ff16343bb80 1 Processor -- start 2023-10-08T13:09:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff20b0 0x55d860ffb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d860ffc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860f44dd0 con 0x55d860ff20b0 2023-10-08T13:09:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860ee16b0 con 0x55d860ff81a0 2023-10-08T13:09:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860ee1350 con 0x55d860ff7880 2023-10-08T13:09:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.354+0000 7ff16343bb80 10 client.0 _ll_register_callbacks cb 0x55d860d3e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.355+0000 7ff1557ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d860ffc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.355+0000 7ff1557ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d860ffc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59106/0 (socket says 172.21.15.5:59106) 2023-10-08T13:09:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.355+0000 7ff1557ef700 1 -- 172.21.15.5:0/1425882002 learned_addr learned my addr 172.21.15.5:0/1425882002 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.355+0000 7ff154fee700 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff20b0 0x55d860ffb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1557ef700 1 -- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 msgr2=0x55d860ffbc40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1557ef700 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1557ef700 1 -- 172.21.15.5:0/1425882002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff20b0 msgr2=0x55d860ffb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1557ef700 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff20b0 0x55d860ffb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1557ef700 1 -- 172.21.15.5:0/1425882002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff148009c80 con 0x55d860ff81a0 2023-10-08T13:09:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1557ef700 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d860ffc180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b9c0 tx=0x7ff14400b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e74ab97a189d9d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.356+0000 7ff1347f8700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.357+0000 7ff1347f8700 1 -- 172.21.15.5:0/1425882002 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144005a00 con 0x55d860ff81a0 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.357+0000 7ff1347f8700 1 -- 172.21.15.5:0/1425882002 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff1440186e0 con 0x55d860ff81a0 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.357+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d860f0ce50 con 0x55d860ff81a0 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.357+0000 7ff1557ef700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1380a1730 0x7ff1380a3bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff144005f50 tx=0x7ff14401c000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.357+0000 7ff1347f8700 1 -- 172.21.15.5:0/1425882002 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1440188a0 con 0x55d860ff81a0 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 10 client.25796 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d860d58c00 con 0x55d860ff81a0 2023-10-08T13:09:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff1347f8700 1 -- 172.21.15.5:0/1425882002 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d860f0ce50 con 0x55d860ff81a0 2023-10-08T13:09:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff1347f8700 1 -- 172.21.15.5:0/1425882002 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7ff14400fa40 con 0x55d860ff81a0 2023-10-08T13:09:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 10 client.25796 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 20 client.25796 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d86100bf40 0x55d86100e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 4 client.25796 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:09:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.358+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d860f3ddb0 con 0x55d86100bf40 2023-10-08T13:09:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.359+0000 7ff154fee700 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d86100bf40 0x55d86100e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.359+0000 7ff1347f8700 10 client.25796 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.359+0000 7ff154fee700 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d86100bf40 0x55d86100e360 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6bbeee2bd94a35f server_cookie=e8cdf7a03144352f in_seq=0 out_seq=0 2023-10-08T13:09:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff1347f8700 1 -- 172.21.15.5:0/1425882002 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d860f3ddb0 con 0x55d86100bf40 2023-10-08T13:09:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff1347f8700 10 client.25796 handle_command_reply: tid=0 2023-10-08T13:09:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 client.25796 shutdown 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 msgr2=0x55d860ffc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d860ffc180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b9c0 tx=0x7ff14400b9f0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 shutdown_connections 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d86100bf40 0x55d86100e360 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d860ffc180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff20b0 0x55d860ffb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1425882002 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 >> 172.21.15.5:0/1425882002 conn(0x55d860f66200 msgr2=0x55d860fec010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff1347f8700 0 client.25796 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 shutdown_connections 2023-10-08T13:09:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 1 -- 172.21.15.5:0/1425882002 wait complete. 2023-10-08T13:09:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.360+0000 7ff16343bb80 20 client.25796 trim_cache size 0 max 16384 2023-10-08T13:09:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 Processor -- start 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 -- start start 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860fec790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860dc58c0 con 0x55d860ff81a0 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860ffcc60 con 0x55d860ff20b0 2023-10-08T13:09:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.383+0000 7ff16343bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d860fee100 con 0x55d860ff7880 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860fec790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860fec790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35930/0 (socket says 172.21.15.5:35930) 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 -- 172.21.15.5:0/572289472 learned_addr learned my addr 172.21.15.5:0/572289472 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff14ffff700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff154fee700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 -- 172.21.15.5:0/572289472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 msgr2=0x55d860ffbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 -- 172.21.15.5:0/572289472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 msgr2=0x55d860ff1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 -- 172.21.15.5:0/572289472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d860d961f0 con 0x55d860ff81a0 2023-10-08T13:09:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff154fee700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:09:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff14ffff700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.384+0000 7ff1557ef700 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860fec790 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff14400fdf0 tx=0x7ff14400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b988b56d165e0402 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.385+0000 7ff1377fe700 1 -- 172.21.15.5:0/572289472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144005960 con 0x55d860ff81a0 2023-10-08T13:09:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.385+0000 7ff1377fe700 1 -- 172.21.15.5:0/572289472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff144005d00 con 0x55d860ff81a0 2023-10-08T13:09:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.385+0000 7ff1377fe700 1 -- 172.21.15.5:0/572289472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144039ad0 con 0x55d860ff81a0 2023-10-08T13:09:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 -- 172.21.15.5:0/572289472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 msgr2=0x55d860fec790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860fec790 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff14400fdf0 tx=0x7ff14400b540 comp rx=0 tx=0).stop 2023-10-08T13:09:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 -- 172.21.15.5:0/572289472 shutdown_connections 2023-10-08T13:09:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff81a0 0x55d860fec790 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff20b0 0x55d860ff1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 --2- 172.21.15.5:0/572289472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff7880 0x55d860ffbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 -- 172.21.15.5:0/572289472 >> 172.21.15.5:0/572289472 conn(0x55d860f66200 msgr2=0x55d860ff9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 -- 172.21.15.5:0/572289472 shutdown_connections 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.386+0000 7ff16343bb80 1 -- 172.21.15.5:0/572289472 wait complete. 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 -- start start 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 Processor -- start 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 0x55d861002de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff7880 0x55d861000bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d861001110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d861001800 con 0x55d860ff7880 2023-10-08T13:09:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d861001970 con 0x55d860ff81a0 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86105ed70 con 0x55d860ff20b0 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff16343bb80 10 client.0 _ll_register_callbacks cb 0x7ff144009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff154fee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 0x55d861002de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff154fee700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 0x55d861002de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49138/0 (socket says 172.21.15.5:49138) 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.387+0000 7ff154fee700 1 -- 172.21.15.5:0/1156994719 learned_addr learned my addr 172.21.15.5:0/1156994719 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff1557ef700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d861001110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff14ffff700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff7880 0x55d861000bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff154fee700 1 -- 172.21.15.5:0/1156994719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 msgr2=0x55d861001110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff154fee700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d861001110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff154fee700 1 -- 172.21.15.5:0/1156994719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff7880 msgr2=0x55d861000bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff154fee700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff7880 0x55d861000bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff154fee700 1 -- 172.21.15.5:0/1156994719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15006a920 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff154fee700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 0x55d861002de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f80 tx=0x7ff148003ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b8d152508d8682 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff1347f8700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff1347f8700 1 -- 172.21.15.5:0/1156994719 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148011040 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff1347f8700 1 -- 172.21.15.5:0/1156994719 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff148024ce0 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.388+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff14800ce10 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff1347f8700 1 -- 172.21.15.5:0/1156994719 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1480241d0 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 10 client.25834 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d860d58c00 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff1347f8700 1 -- 172.21.15.5:0/1156994719 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff14800ce10 con 0x55d860ff20b0 2023-10-08T13:09:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff1347f8700 1 -- 172.21.15.5:0/1156994719 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7ff14800a5f0 con 0x55d860ff20b0 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 10 client.25834 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 10 client.25834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 20 client.25834 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d861060490 0x55d8610628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 4 client.25834 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d860f3dad0 con 0x55d861060490 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.389+0000 7ff14ffff700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d861060490 0x55d8610628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.390+0000 7ff1347f8700 10 client.25834 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.390+0000 7ff14ffff700 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d861060490 0x55d8610628b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ce36fa57be0b818 server_cookie=403127dc359c6209 in_seq=0 out_seq=0 2023-10-08T13:09:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff1347f8700 1 -- 172.21.15.5:0/1156994719 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d860f3dad0 con 0x55d861060490 2023-10-08T13:09:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff1347f8700 10 client.25834 handle_command_reply: tid=0 2023-10-08T13:09:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 client.25834 shutdown 2023-10-08T13:09:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 msgr2=0x55d861002de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 0x55d861002de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f80 tx=0x7ff148003ac0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 shutdown_connections 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d861060490 0x55d8610628b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d860ff81a0 0x55d861001110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d860ff20b0 0x55d861002de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff1347f8700 0 client.25834 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 --2- 172.21.15.5:0/1156994719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d860ff7880 0x55d861000bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 >> 172.21.15.5:0/1156994719 conn(0x55d860f66200 msgr2=0x55d860ff67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 shutdown_connections 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 1 -- 172.21.15.5:0/1156994719 wait complete. 2023-10-08T13:09:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.403+0000 7ff16343bb80 20 client.25834 trim_cache size 0 max 16384 2023-10-08T13:09:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:09:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:09:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:09:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1380a1730 msgr2=0x7ff1380a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1380a1730 0x7ff1380a3bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff144005f50 tx=0x7ff14401c000 comp rx=0 tx=0).stop 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 msgr2=0x7ff150119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff150119a50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff14000b550 tx=0x7ff14000b910 comp rx=0 tx=0).stop 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 shutdown_connections 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1380a1730 0x7ff1380a3bf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1501088c0 0x7ff15010e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1501028b0 0x7ff15010ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 --2- 172.21.15.5:0/180818567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff150103270 0x7ff150119a50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 >> 172.21.15.5:0/180818567 conn(0x7ff1500fe3a0 msgr2=0x7ff150100550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 shutdown_connections 2023-10-08T13:09:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:13.404+0000 7ff157252700 1 -- 172.21.15.5:0/180818567 wait complete. 2023-10-08T13:09:14.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:14 smithi060 ceph-mon[103190]: pgmap v397: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.45k op/s 2023-10-08T13:09:14.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:14 smithi005 ceph-mon[99496]: pgmap v397: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.45k op/s 2023-10-08T13:09:14.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:14 smithi118 ceph-mon[104234]: pgmap v397: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.45k op/s 2023-10-08T13:09:16.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:16 smithi060 ceph-mon[103190]: pgmap v398: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 992 op/s 2023-10-08T13:09:16.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:16 smithi005 ceph-mon[99496]: pgmap v398: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 992 op/s 2023-10-08T13:09:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 175.0 s, 996.1 tps, lat 99.921 ms stddev 116.151 2023-10-08T13:09:16.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:16 smithi118 ceph-mon[104234]: pgmap v398: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 992 op/s 2023-10-08T13:09:18.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:18 smithi118 ceph-mon[104234]: pgmap v399: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 964 op/s 2023-10-08T13:09:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:18 smithi060 ceph-mon[103190]: pgmap v399: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 964 op/s 2023-10-08T13:09:18.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:18 smithi005 ceph-mon[99496]: pgmap v399: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 964 op/s 2023-10-08T13:09:20.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:20 smithi118 ceph-mon[104234]: pgmap v400: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 594 op/s 2023-10-08T13:09:20.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:20 smithi060 ceph-mon[103190]: pgmap v400: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 594 op/s 2023-10-08T13:09:20.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:20 smithi005 ceph-mon[99496]: pgmap v400: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 594 op/s 2023-10-08T13:09:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 180.0 s, 1232.8 tps, lat 82.441 ms stddev 102.037 2023-10-08T13:09:22.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:22 smithi118 ceph-mon[104234]: pgmap v401: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 591 op/s 2023-10-08T13:09:22.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:22 smithi060 ceph-mon[103190]: pgmap v401: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 591 op/s 2023-10-08T13:09:22.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:22 smithi005 ceph-mon[99496]: pgmap v401: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 591 op/s 2023-10-08T13:09:24.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:24 smithi118 ceph-mon[104234]: pgmap v402: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 636 op/s 2023-10-08T13:09:24.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:24 smithi060 ceph-mon[103190]: pgmap v402: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 636 op/s 2023-10-08T13:09:24.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:24 smithi005 ceph-mon[99496]: pgmap v402: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.0 MiB/s wr, 636 op/s 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/2053416736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b140ff640 msgr2=0x7f4b140ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/2053416736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b140ff640 0x7f4b140ffa20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b040098f0 tx=0x7f4b04009c00 comp rx=0 tx=0).stop 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/2053416736 shutdown_connections 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/2053416736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b14104a40 0x7f4b14104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/2053416736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b140ff640 0x7f4b140ffa20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/2053416736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140fff60 0x7f4b14104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/2053416736 >> 172.21.15.5:0/2053416736 conn(0x7f4b140fb090 msgr2=0x7f4b140fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/2053416736 shutdown_connections 2023-10-08T13:09:26.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.591+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/2053416736 wait complete. 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.592+0000 7f4b1a0cd700 1 Processor -- start 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.592+0000 7f4b1a0cd700 1 -- start start 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b1a0cd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 0x7f4b1419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b1a0cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b140fff60 0x7f4b1419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b1a0cd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b14104a40 0x7f4b141a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b1a0cd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b141a20e0 con 0x7f4b140ff640 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b1a0cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b141a2250 con 0x7f4b140fff60 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b1a0cd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b141a2410 con 0x7f4b14104a40 2023-10-08T13:09:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 0x7f4b1419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 0x7f4b1419d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35948/0 (socket says 172.21.15.5:35948) 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b137fe700 1 -- 172.21.15.5:0/4220370054 learned_addr learned my addr 172.21.15.5:0/4220370054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.593+0000 7f4b13fff700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b14104a40 0x7f4b141a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b13fff700 1 -- 172.21.15.5:0/4220370054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b140fff60 msgr2=0x7f4b1419d700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b13fff700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b140fff60 0x7f4b1419d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b13fff700 1 -- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 msgr2=0x7f4b1419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b13fff700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 0x7f4b1419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b13fff700 1 -- 172.21.15.5:0/4220370054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009520 con 0x7f4b14104a40 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b137fe700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 0x7f4b1419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b13fff700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b14104a40 0x7f4b141a1aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800b3c0 tx=0x7f4b0800b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b10ff9700 1 -- 172.21.15.5:0/4220370054 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08011830 con 0x7f4b14104a40 2023-10-08T13:09:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b10ff9700 1 -- 172.21.15.5:0/4220370054 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b0800be80 con 0x7f4b14104a40 2023-10-08T13:09:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b141a26f0 con 0x7f4b14104a40 2023-10-08T13:09:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b10ff9700 1 -- 172.21.15.5:0/4220370054 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08010d70 con 0x7f4b14104a40 2023-10-08T13:09:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.594+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b141a9f30 con 0x7f4b14104a40 2023-10-08T13:09:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.597+0000 7f4b10ff9700 1 -- 172.21.15.5:0/4220370054 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4b08010410 con 0x7f4b14104a40 2023-10-08T13:09:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.598+0000 7f4b262b6b80 1 Processor -- start 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.599+0000 7f4b262b6b80 1 -- start start 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.599+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb5880 0x556817bb5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.599+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bafb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817b18400 con 0x556817bb61a0 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817b09bc0 con 0x556817bb00b0 2023-10-08T13:09:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817b074e0 con 0x556817bb5880 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b10ff9700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4afc0a1660 0x7f4afc0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bafb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bafb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35954/0 (socket says 172.21.15.5:35954) 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 -- 172.21.15.5:0/3088232245 learned_addr learned my addr 172.21.15.5:0/3088232245 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb5880 0x556817bb5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b13fff700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4afc0a1660 0x7f4afc0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 -- 172.21.15.5:0/3088232245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb5880 msgr2=0x556817bb5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb5880 0x556817bb5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 -- 172.21.15.5:0/3088232245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 msgr2=0x556817bb0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 -- 172.21.15.5:0/3088232245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55681792dd80 con 0x556817bb61a0 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b10ff9700 1 -- 172.21.15.5:0/4220370054 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4b080ccc90 con 0x7f4b14104a40 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b137fe700 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bafb70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400f5d0 tx=0x7f4b0400f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c850d6114508aa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4b13fff700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4afc0a1660 0x7f4afc0a3b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4b080996e0 tx=0x7f4b080b9040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4af9ffb700 1 -- 172.21.15.5:0/3088232245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0401c050 con 0x556817bb61a0 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4af9ffb700 1 -- 172.21.15.5:0/3088232245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b0401d040 con 0x556817bb61a0 2023-10-08T13:09:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.600+0000 7f4af9ffb700 1 -- 172.21.15.5:0/3088232245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04005540 con 0x556817bb61a0 2023-10-08T13:09:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 -- 172.21.15.5:0/3088232245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 msgr2=0x556817bafb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bafb70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400f5d0 tx=0x7f4b0400f600 comp rx=0 tx=0).stop 2023-10-08T13:09:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 -- 172.21.15.5:0/3088232245 shutdown_connections 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb5880 0x556817bb5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/3088232245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bafb70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 -- 172.21.15.5:0/3088232245 >> 172.21.15.5:0/3088232245 conn(0x556817b24200 msgr2=0x556817baab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 -- 172.21.15.5:0/3088232245 shutdown_connections 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.601+0000 7f4b262b6b80 1 -- 172.21.15.5:0/3088232245 wait complete. 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 -- start start 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 Processor -- start 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bbc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bb9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bb9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817b02dd0 con 0x556817bb5880 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817a9f6b0 con 0x556817bb00b0 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817a9f350 con 0x556817bb61a0 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b262b6b80 10 client.0 _ll_register_callbacks cb 0x5568178fc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bb9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bb9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35962/0 (socket says 172.21.15.5:35962) 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.602+0000 7f4b137fe700 1 -- 172.21.15.5:0/969531348 learned_addr learned my addr 172.21.15.5:0/969531348 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.603+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bb9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.603+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bbc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b137fe700 1 -- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 msgr2=0x556817bb9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b137fe700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bb9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b137fe700 1 -- 172.21.15.5:0/969531348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 msgr2=0x556817bbc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b137fe700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bbc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b137fe700 1 -- 172.21.15.5:0/969531348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b141143f0 con 0x556817bb5880 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b137fe700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bb9470 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009810 tx=0x7f4b0400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccadd8299fe11aef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4af2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4af2ffd700 1 -- 172.21.15.5:0/969531348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04005180 con 0x556817bb5880 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4af2ffd700 1 -- 172.21.15.5:0/969531348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4b040052e0 con 0x556817bb5880 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556817acae50 con 0x556817bb5880 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4af2ffd700 1 -- 172.21.15.5:0/969531348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b0401c020 con 0x556817bb5880 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b262b6b80 10 client.16296 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x556817916c00 con 0x556817bb5880 2023-10-08T13:09:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.604+0000 7f4af2ffd700 1 -- 172.21.15.5:0/969531348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556817acae50 con 0x556817bb5880 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4af2ffd700 1 -- 172.21.15.5:0/969531348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4b0402a070 con 0x556817bb5880 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b262b6b80 10 client.16296 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b262b6b80 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b262b6b80 20 client.16296 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bc9830 0x556817bcbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b262b6b80 4 client.16296 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556817afbdb0 con 0x556817bc9830 2023-10-08T13:09:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bc9830 0x556817bcbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bc9830 0x556817bcbc50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e613d92aa9e143ec server_cookie=60a6ee07dc10500d in_seq=0 out_seq=0 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.605+0000 7f4af2ffd700 10 client.16296 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4af2ffd700 1 -- 172.21.15.5:0/969531348 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556817afbdb0 con 0x556817bc9830 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4af2ffd700 10 client.16296 handle_command_reply: tid=0 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 client.16296 shutdown 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 msgr2=0x556817bb9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bb9470 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009810 tx=0x7f4b0400b840 comp rx=0 tx=0).stop 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 shutdown_connections 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bb9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bc9830 0x556817bcbc50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bbc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/969531348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bb9470 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4af2ffd700 0 client.16296 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 >> 172.21.15.5:0/969531348 conn(0x556817b24200 msgr2=0x556817baa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.606+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 shutdown_connections 2023-10-08T13:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.607+0000 7f4b262b6b80 1 -- 172.21.15.5:0/969531348 wait complete. 2023-10-08T13:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.607+0000 7f4b262b6b80 20 client.16296 trim_cache size 0 max 16384 2023-10-08T13:09:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.643+0000 7f4b262b6b80 1 Processor -- start 2023-10-08T13:09:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 -- start start 2023-10-08T13:09:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bc5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bc0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568179838c0 con 0x556817bb5880 2023-10-08T13:09:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817acae50 con 0x556817bb00b0 2023-10-08T13:09:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.653+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817ba52b0 con 0x556817bb61a0 2023-10-08T13:09:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59150/0 (socket says 172.21.15.5:59150) 2023-10-08T13:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 -- 172.21.15.5:0/1730223871 learned_addr learned my addr 172.21.15.5:0/1730223871 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bc0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 -- 172.21.15.5:0/1730223871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 msgr2=0x556817bc0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bc0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 -- 172.21.15.5:0/1730223871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 msgr2=0x556817bc5b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bc5b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 -- 172.21.15.5:0/1730223871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568179541f0 con 0x556817bb00b0 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.655+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb5c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009cb0 tx=0x7f4b0c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5719ab54501923de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.656+0000 7f4afa7fc700 1 -- 172.21.15.5:0/1730223871 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c012ec0 con 0x556817bb00b0 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.656+0000 7f4afa7fc700 1 -- 172.21.15.5:0/1730223871 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b0c00f040 con 0x556817bb00b0 2023-10-08T13:09:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.656+0000 7f4afa7fc700 1 -- 172.21.15.5:0/1730223871 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c01b6b0 con 0x556817bb00b0 2023-10-08T13:09:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.658+0000 7f4b262b6b80 1 -- 172.21.15.5:0/1730223871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 msgr2=0x556817bb5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.658+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb5c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009cb0 tx=0x7f4b0c004ad0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.659+0000 7f4b262b6b80 1 -- 172.21.15.5:0/1730223871 shutdown_connections 2023-10-08T13:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.659+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817bb61a0 0x556817bc0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.659+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb5c60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.659+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/1730223871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb5880 0x556817bc5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.659+0000 7f4b262b6b80 1 -- 172.21.15.5:0/1730223871 >> 172.21.15.5:0/1730223871 conn(0x556817b24200 msgr2=0x556817bb4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.662+0000 7f4b262b6b80 1 -- 172.21.15.5:0/1730223871 shutdown_connections 2023-10-08T13:09:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.662+0000 7f4b262b6b80 1 -- 172.21.15.5:0/1730223871 wait complete. 2023-10-08T13:09:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.662+0000 7f4b262b6b80 1 -- start start 2023-10-08T13:09:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.664+0000 7f4b262b6b80 1 Processor -- start 2023-10-08T13:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bb2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817c185f0 0x556817c18a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817bc1010 con 0x556817bb61a0 2023-10-08T13:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817c18fb0 con 0x556817bb00b0 2023-10-08T13:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556817c19170 con 0x556817c185f0 2023-10-08T13:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b262b6b80 10 client.0 _ll_register_callbacks cb 0x7f4b0c0124e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.674+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59154/0 (socket says 172.21.15.5:59154) 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 -- 172.21.15.5:0/2110677235 learned_addr learned my addr 172.21.15.5:0/2110677235 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817c185f0 0x556817c18a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 -- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817c185f0 msgr2=0x556817c18a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817c185f0 0x556817c18a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 -- 172.21.15.5:0/2110677235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 msgr2=0x556817bb2b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bb2b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 -- 172.21.15.5:0/2110677235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c028040 con 0x556817bb00b0 2023-10-08T13:09:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.675+0000 7f4b12ffd700 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb2640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0122c0 tx=0x7f4b0c025040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4f4b2dd666b33a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.681+0000 7f4af2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:09:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.681+0000 7f4af2ffd700 1 -- 172.21.15.5:0/2110677235 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c008b70 con 0x556817bb00b0 2023-10-08T13:09:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.681+0000 7f4af2ffd700 1 -- 172.21.15.5:0/2110677235 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4b0c008cd0 con 0x556817bb00b0 2023-10-08T13:09:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.681+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b0401d040 con 0x556817bb00b0 2023-10-08T13:09:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.681+0000 7f4af2ffd700 1 -- 172.21.15.5:0/2110677235 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b0c008e90 con 0x556817bb00b0 2023-10-08T13:09:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 10 client.25814 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55681792c250 con 0x556817bb00b0 2023-10-08T13:09:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4af2ffd700 1 -- 172.21.15.5:0/2110677235 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b0401d040 con 0x556817bb00b0 2023-10-08T13:09:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4af2ffd700 1 -- 172.21.15.5:0/2110677235 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4b0c02e440 con 0x556817bb00b0 2023-10-08T13:09:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 10 client.25814 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 10 client.25814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 20 client.25814 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bbfd00 0x556817bc0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 4 client.25814 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:09:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.682+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556817afbad0 con 0x556817bbfd00 2023-10-08T13:09:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.684+0000 7f4b137fe700 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bbfd00 0x556817bc0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.684+0000 7f4b137fe700 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bbfd00 0x556817bc0110 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2081147d72cc87c5 server_cookie=d4563ffb03af59d9 in_seq=0 out_seq=0 2023-10-08T13:09:26.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.684+0000 7f4af2ffd700 10 client.25814 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.710+0000 7f4af2ffd700 1 -- 172.21.15.5:0/2110677235 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556817afbad0 con 0x556817bbfd00 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.710+0000 7f4af2ffd700 10 client.25814 handle_command_reply: tid=0 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.710+0000 7f4b262b6b80 1 client.25814 shutdown 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.710+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 msgr2=0x556817bb2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.710+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb2640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0122c0 tx=0x7f4b0c025040 comp rx=0 tx=0).stop 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 shutdown_connections 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556817c185f0 0x556817c18a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556817bbfd00 0x556817bc0110 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556817bb00b0 0x556817bb2640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4b262b6b80 1 --2- 172.21.15.5:0/2110677235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556817bb61a0 0x556817bb2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 >> 172.21.15.5:0/2110677235 conn(0x556817b24200 msgr2=0x556817bc59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.711+0000 7f4af2ffd700 0 client.25814 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.713+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 shutdown_connections 2023-10-08T13:09:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.713+0000 7f4b262b6b80 1 -- 172.21.15.5:0/2110677235 wait complete. 2023-10-08T13:09:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b262b6b80 20 client.25814 trim_cache size 0 max 16384 2023-10-08T13:09:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:09:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:09:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:09:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4afc0a1660 msgr2=0x7f4afc0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4afc0a1660 0x7f4afc0a3b20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4b080996e0 tx=0x7f4b080b9040 comp rx=0 tx=0).stop 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b14104a40 msgr2=0x7f4b141a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b14104a40 0x7f4b141a1aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800b3c0 tx=0x7f4b0800b6d0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 shutdown_connections 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4afc0a1660 0x7f4afc0a3b20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b14104a40 0x7f4b141a1aa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b140ff640 0x7f4b1419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 --2- 172.21.15.5:0/4220370054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b140fff60 0x7f4b1419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.716+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 >> 172.21.15.5:0/4220370054 conn(0x7f4b140fb090 msgr2=0x7f4b141023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.717+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 shutdown_connections 2023-10-08T13:09:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:26.717+0000 7f4b1a0cd700 1 -- 172.21.15.5:0/4220370054 wait complete. 2023-10-08T13:09:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 185.0 s, 1255.2 tps, lat 79.776 ms stddev 95.658 2023-10-08T13:09:26.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:26 smithi118 ceph-mon[104234]: pgmap v403: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 543 op/s 2023-10-08T13:09:26.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:26 smithi060 ceph-mon[103190]: pgmap v403: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 543 op/s 2023-10-08T13:09:26.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:26 smithi005 ceph-mon[99496]: pgmap v403: 129 pgs: 129 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 543 op/s 2023-10-08T13:09:27.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:27 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:09:27.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:27 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:09:28.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:27 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:09:28.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:28 smithi060 ceph-mon[103190]: pgmap v404: 129 pgs: 129 active+clean; 3.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.9 MiB/s wr, 662 op/s 2023-10-08T13:09:28.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:09:28.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:09:28.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:28 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:09:28.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:28 smithi005 ceph-mon[99496]: pgmap v404: 129 pgs: 129 active+clean; 3.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.9 MiB/s wr, 662 op/s 2023-10-08T13:09:28.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:09:28.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:09:28.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:28 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:09:29.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:28 smithi118 ceph-mon[104234]: pgmap v404: 129 pgs: 129 active+clean; 3.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.9 MiB/s wr, 662 op/s 2023-10-08T13:09:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:09:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:09:29.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:28 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:09:30.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:30 smithi060 ceph-mon[103190]: pgmap v405: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 673 op/s 2023-10-08T13:09:30.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:30 smithi005 ceph-mon[99496]: pgmap v405: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 673 op/s 2023-10-08T13:09:31.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:30 smithi118 ceph-mon[104234]: pgmap v405: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 673 op/s 2023-10-08T13:09:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 190.0 s, 631.3 tps, lat 151.180 ms stddev 181.288 2023-10-08T13:09:32.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:32 smithi060 ceph-mon[103190]: pgmap v406: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.9 MiB/s wr, 723 op/s 2023-10-08T13:09:32.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:32 smithi005 ceph-mon[99496]: pgmap v406: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.9 MiB/s wr, 723 op/s 2023-10-08T13:09:33.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:32 smithi118 ceph-mon[104234]: pgmap v406: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.9 MiB/s wr, 723 op/s 2023-10-08T13:09:34.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:34 smithi060 ceph-mon[103190]: pgmap v407: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 769 op/s 2023-10-08T13:09:34.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:34 smithi005 ceph-mon[99496]: pgmap v407: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 769 op/s 2023-10-08T13:09:35.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:34 smithi118 ceph-mon[104234]: pgmap v407: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 769 op/s 2023-10-08T13:09:36.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 195.0 s, 388.0 tps, lat 220.626 ms stddev 357.596 2023-10-08T13:09:36.916 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:36 smithi060 ceph-mon[103190]: pgmap v408: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 681 op/s 2023-10-08T13:09:36.929 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:36 smithi005 ceph-mon[99496]: pgmap v408: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 681 op/s 2023-10-08T13:09:37.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:36 smithi118 ceph-mon[104234]: pgmap v408: 129 pgs: 129 active+clean; 3.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 681 op/s 2023-10-08T13:09:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:38 smithi005 ceph-mon[99496]: pgmap v409: 129 pgs: 129 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 885 op/s 2023-10-08T13:09:39.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:38 smithi118 ceph-mon[104234]: pgmap v409: 129 pgs: 129 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 885 op/s 2023-10-08T13:09:39.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:38 smithi060 ceph-mon[103190]: pgmap v409: 129 pgs: 129 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 885 op/s 2023-10-08T13:09:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.891+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/2680344219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a28108380 msgr2=0x7f7a2810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.891+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/2680344219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a28108380 0x7f7a2810b8d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7a10008580 tx=0x7f7a10008890 comp rx=0 tx=0).stop 2023-10-08T13:09:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.899+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/2680344219 shutdown_connections 2023-10-08T13:09:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.899+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/2680344219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a2810c000 0x7f7a28078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.899+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/2680344219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a28107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.899+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/2680344219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a28108380 0x7f7a2810b8d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.899+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/2680344219 >> 172.21.15.5:0/2680344219 conn(0x7f7a2806b7c0 msgr2=0x7f7a2806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.910+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/2680344219 shutdown_connections 2023-10-08T13:09:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.914+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/2680344219 wait complete. 2023-10-08T13:09:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 Processor -- start 2023-10-08T13:09:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 -- start start 2023-10-08T13:09:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a281bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a28108380 0x7f7a281bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2810c000 0x7f7a281b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281b7160 con 0x7f7a2810c000 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281b72d0 con 0x7f7a28107a60 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a2dfc2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281b7490 con 0x7f7a28108380 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2810c000 0x7f7a281b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a281bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2810c000 0x7f7a281b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35986/0 (socket says 172.21.15.5:35986) 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a281bc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59166/0 (socket says 172.21.15.5:59166) 2023-10-08T13:09:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a27fff700 1 -- 172.21.15.5:0/1984862736 learned_addr learned my addr 172.21.15.5:0/1984862736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.915+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a28108380 0x7f7a281bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.916+0000 7f7a277fe700 1 -- 172.21.15.5:0/1984862736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a28108380 msgr2=0x7f7a281bcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.916+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a28108380 0x7f7a281bcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.916+0000 7f7a277fe700 1 -- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2810c000 msgr2=0x7f7a281b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.916+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2810c000 0x7f7a281b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.916+0000 7f7a277fe700 1 -- 172.21.15.5:0/1984862736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10008230 con 0x7f7a28107a60 2023-10-08T13:09:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.922+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a281bc9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800b450 tx=0x7f7a1800b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.923+0000 7f7a257fa700 1 -- 172.21.15.5:0/1984862736 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18011830 con 0x7f7a28107a60 2023-10-08T13:09:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.923+0000 7f7a257fa700 1 -- 172.21.15.5:0/1984862736 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a18011e50 con 0x7f7a28107a60 2023-10-08T13:09:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.923+0000 7f7a257fa700 1 -- 172.21.15.5:0/1984862736 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18010de0 con 0x7f7a28107a60 2023-10-08T13:09:39.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.924+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a281b7770 con 0x7f7a28107a60 2023-10-08T13:09:39.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.924+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a281c39c0 con 0x7f7a28107a60 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.928+0000 7f7a3a1abb80 1 Processor -- start 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 -- start start 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560efc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560ea510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d656052400 con 0x55d6560ea0b0 2023-10-08T13:09:39.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d656043bc0 con 0x55d6560ef880 2023-10-08T13:09:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6560414e0 con 0x55d6560f01a0 2023-10-08T13:09:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.929+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560ea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35992/0 (socket says 172.21.15.5:35992) 2023-10-08T13:09:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 -- 172.21.15.5:0/3219774445 learned_addr learned my addr 172.21.15.5:0/3219774445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 -- 172.21.15.5:0/3219774445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 msgr2=0x55d6560e9b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:09:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560e9b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 -- 172.21.15.5:0/3219774445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 msgr2=0x55d6560efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 -- 172.21.15.5:0/3219774445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d655e67d80 con 0x55d6560ea0b0 2023-10-08T13:09:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.930+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560ea510 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009d40 tx=0x7f7a10009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96e652a57b1af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.933+0000 7f7a257fa700 1 -- 172.21.15.5:0/1984862736 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7a18010480 con 0x7f7a28107a60 2023-10-08T13:09:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.934+0000 7f7a1dffb700 1 -- 172.21.15.5:0/3219774445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000b7b0 con 0x55d6560ea0b0 2023-10-08T13:09:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.934+0000 7f7a1dffb700 1 -- 172.21.15.5:0/3219774445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a100050c0 con 0x55d6560ea0b0 2023-10-08T13:09:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.934+0000 7f7a1dffb700 1 -- 172.21.15.5:0/3219774445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100039e0 con 0x55d6560ea0b0 2023-10-08T13:09:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.935+0000 7f7a257fa700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7a140a17f0 0x7f7a140a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.935+0000 7f7a257fa700 1 -- 172.21.15.5:0/1984862736 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7a180ccc60 con 0x7f7a28107a60 2023-10-08T13:09:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.935+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/3219774445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 msgr2=0x55d6560ea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.935+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560ea510 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009d40 tx=0x7f7a10009d70 comp rx=0 tx=0).stop 2023-10-08T13:09:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.936+0000 7f7a27fff700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7a140a17f0 0x7f7a140a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.936+0000 7f7a27fff700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7a140a17f0 0x7f7a140a3cb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009fd0 tx=0x7f7a2000b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:39.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.938+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/3219774445 shutdown_connections 2023-10-08T13:09:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.938+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560ea510 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.938+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.938+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/3219774445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.938+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/3219774445 >> 172.21.15.5:0/3219774445 conn(0x55d65605e200 msgr2=0x55d6560e4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.941+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/3219774445 shutdown_connections 2023-10-08T13:09:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.944+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/3219774445 wait complete. 2023-10-08T13:09:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.944+0000 7f7a3a1abb80 1 -- start start 2023-10-08T13:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 Processor -- start 2023-10-08T13:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d65603cdd0 con 0x55d6560ef880 2023-10-08T13:09:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d655fd96b0 con 0x55d6560ea0b0 2023-10-08T13:09:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d655fd9350 con 0x55d6560f01a0 2023-10-08T13:09:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.945+0000 7f7a3a1abb80 10 client.0 _ll_register_callbacks cb 0x55d655e367a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.946+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.946+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49202/0 (socket says 172.21.15.5:49202) 2023-10-08T13:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.946+0000 7f7a27fff700 1 -- 172.21.15.5:0/2858482810 learned_addr learned my addr 172.21.15.5:0/2858482810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.947+0000 7f7a27fff700 1 -- 172.21.15.5:0/2858482810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 msgr2=0x55d6560f6220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.947+0000 7f7a27fff700 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f6220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.947+0000 7f7a27fff700 1 -- 172.21.15.5:0/2858482810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 msgr2=0x55d6560f3510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.947+0000 7f7a27fff700 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f3510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.947+0000 7f7a27fff700 1 -- 172.21.15.5:0/2858482810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a280793c0 con 0x55d6560f01a0 2023-10-08T13:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.947+0000 7f7a27fff700 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f3c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a20004c20 tx=0x7f7a20004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4018ae57288f062 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a0effd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:09:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a0effd700 1 -- 172.21.15.5:0/2858482810 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20013850 con 0x55d6560f01a0 2023-10-08T13:09:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a0effd700 1 -- 172.21.15.5:0/2858482810 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7a20006e40 con 0x55d6560f01a0 2023-10-08T13:09:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d656004e50 con 0x55d6560f01a0 2023-10-08T13:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a0effd700 1 -- 172.21.15.5:0/2858482810 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a200139b0 con 0x55d6560f01a0 2023-10-08T13:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a3a1abb80 10 client.25858 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.950+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d655e50c00 con 0x55d6560f01a0 2023-10-08T13:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.951+0000 7f7a0effd700 1 -- 172.21.15.5:0/2858482810 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d656004e50 con 0x55d6560f01a0 2023-10-08T13:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.951+0000 7f7a0effd700 1 -- 172.21.15.5:0/2858482810 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f7a20028ba0 con 0x55d6560f01a0 2023-10-08T13:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.952+0000 7f7a3a1abb80 10 client.25858 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.952+0000 7f7a3a1abb80 10 client.25858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.952+0000 7f7a3a1abb80 20 client.25858 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.952+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d656103ca0 0x55d6561060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.952+0000 7f7a3a1abb80 4 client.25858 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.952+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d656035db0 con 0x55d656103ca0 2023-10-08T13:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.953+0000 7f7a277fe700 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d656103ca0 0x55d6561060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.954+0000 7f7a277fe700 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d656103ca0 0x55d6561060c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ce836964f3b14a server_cookie=108da20bc2dd4e1a in_seq=0 out_seq=0 2023-10-08T13:09:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.954+0000 7f7a0effd700 10 client.25858 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.955+0000 7f7a0effd700 1 -- 172.21.15.5:0/2858482810 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d656035db0 con 0x55d656103ca0 2023-10-08T13:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.955+0000 7f7a0effd700 10 client.25858 handle_command_reply: tid=0 2023-10-08T13:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.955+0000 7f7a3a1abb80 1 client.25858 shutdown 2023-10-08T13:09:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.957+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 msgr2=0x55d6560f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.957+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f3c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a20004c20 tx=0x7f7a20004ad0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 shutdown_connections 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f3c50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d656103ca0 0x55d6561060c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/2858482810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 >> 172.21.15.5:0/2858482810 conn(0x55d65605e200 msgr2=0x55d6560e4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a0effd700 0 client.25858 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 shutdown_connections 2023-10-08T13:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.959+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/2858482810 wait complete. 2023-10-08T13:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.960+0000 7f7a3a1abb80 20 client.25858 trim_cache size 0 max 16384 2023-10-08T13:09:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.986+0000 7f7a3a1abb80 1 Processor -- start 2023-10-08T13:09:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.986+0000 7f7a3a1abb80 1 -- start start 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560ea490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560faad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d655ebd8c0 con 0x55d6560ea0b0 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d656004e50 con 0x55d6560ef880 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6560f4510 con 0x55d6560f01a0 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560ea490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59186/0 (socket says 172.21.15.5:59186) 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 -- 172.21.15.5:0/1227823963 learned_addr learned my addr 172.21.15.5:0/1227823963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a27fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 -- 172.21.15.5:0/1227823963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 msgr2=0x55d6560faad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560faad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 -- 172.21.15.5:0/1227823963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 msgr2=0x55d6560e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a1ffff700 1 -- 172.21.15.5:0/1227823963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d655e8e1f0 con 0x55d6560ef880 2023-10-08T13:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.987+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.988+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560ea490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a10000c00 tx=0x7f7a10005990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60dc46e137f34ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.988+0000 7f7a1e7fc700 1 -- 172.21.15.5:0/1227823963 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000b7b0 con 0x55d6560ef880 2023-10-08T13:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.988+0000 7f7a1e7fc700 1 -- 172.21.15.5:0/1227823963 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a10005230 con 0x55d6560ef880 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.988+0000 7f7a1e7fc700 1 -- 172.21.15.5:0/1227823963 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10003a00 con 0x55d6560ef880 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1227823963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 msgr2=0x55d6560ea490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560ea490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7a10000c00 tx=0x7f7a10005990 comp rx=0 tx=0).stop 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1227823963 shutdown_connections 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560faad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ea0b0 0x55d6560e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1227823963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ef880 0x55d6560ea490 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1227823963 >> 172.21.15.5:0/1227823963 conn(0x55d65605e200 msgr2=0x55d6560ed600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1227823963 shutdown_connections 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.989+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1227823963 wait complete. 2023-10-08T13:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 -- start start 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 Processor -- start 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d656156af0 con 0x55d6560ef880 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d656156c30 con 0x55d6560ea0b0 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d656156df0 con 0x55d6560f01a0 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.990+0000 7f7a3a1abb80 10 client.0 _ll_register_callbacks cb 0x7f7a2000ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59190/0 (socket says 172.21.15.5:59190) 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 -- 172.21.15.5:0/1251817721 learned_addr learned my addr 172.21.15.5:0/1251817721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a27fff700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 -- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 msgr2=0x55d6560f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 -- 172.21.15.5:0/1251817721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 msgr2=0x55d6560f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 -- 172.21.15.5:0/1251817721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a281c39c0 con 0x55d6560ea0b0 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a27fff700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.991+0000 7f7a277fe700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f8ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a180ca180 tx=0x7f7a1800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6daa18ffbf4c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.992+0000 7f7a0effd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:09:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.992+0000 7f7a0effd700 1 -- 172.21.15.5:0/1251817721 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180a1dc0 con 0x55d6560ea0b0 2023-10-08T13:09:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.992+0000 7f7a0effd700 1 -- 172.21.15.5:0/1251817721 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7a18099c90 con 0x55d6560ea0b0 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.992+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a100050c0 con 0x55d6560ea0b0 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.992+0000 7f7a0effd700 1 -- 172.21.15.5:0/1251817721 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a180b92b0 con 0x55d6560ea0b0 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 10 client.25823 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d655e67d80 con 0x55d6560ea0b0 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a0effd700 1 -- 172.21.15.5:0/1251817721 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a180a8020 con 0x55d6560ea0b0 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a0effd700 1 -- 172.21.15.5:0/1251817721 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f7a180a1930 con 0x55d6560ea0b0 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 10 client.25823 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 10 client.25823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 20 client.25823 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d6561586b0 0x55d65615aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 4 client.25823 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:09:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d656035ad0 con 0x55d6561586b0 2023-10-08T13:09:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.993+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d6561586b0 0x55d65615aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.994+0000 7f7a0effd700 10 client.25823 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:39.994+0000 7f7a1ffff700 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d6561586b0 0x55d65615aad0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0ff7c1ac65e217e server_cookie=c4603cf3830592cf in_seq=0 out_seq=0 2023-10-08T13:09:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.008+0000 7f7a0effd700 1 -- 172.21.15.5:0/1251817721 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d656035ad0 con 0x55d6561586b0 2023-10-08T13:09:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.008+0000 7f7a0effd700 10 client.25823 handle_command_reply: tid=0 2023-10-08T13:09:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.008+0000 7f7a3a1abb80 1 client.25823 shutdown 2023-10-08T13:09:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.008+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 msgr2=0x55d6560f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.008+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f8ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a180ca180 tx=0x7f7a1800bf10 comp rx=0 tx=0).stop 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 shutdown_connections 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d6560f01a0 0x55d6560f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d6561586b0 0x55d65615aad0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6560ea0b0 0x55d6560f8ab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 --2- 172.21.15.5:0/1251817721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6560ef880 0x55d6560f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 >> 172.21.15.5:0/1251817721 conn(0x55d65605e200 msgr2=0x55d6560f2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a0effd700 0 client.25823 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.009+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 shutdown_connections 2023-10-08T13:09:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.010+0000 7f7a3a1abb80 1 -- 172.21.15.5:0/1251817721 wait complete. 2023-10-08T13:09:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.010+0000 7f7a3a1abb80 20 client.25823 trim_cache size 0 max 16384 2023-10-08T13:09:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:09:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:09:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:09:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7a140a17f0 msgr2=0x7f7a140a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7a140a17f0 0x7f7a140a3cb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009fd0 tx=0x7f7a2000b040 comp rx=0 tx=0).stop 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 msgr2=0x7f7a281bc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a281bc9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800b450 tx=0x7f7a1800b760 comp rx=0 tx=0).stop 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 shutdown_connections 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7a140a17f0 0x7f7a140a3cb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2810c000 0x7f7a281b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a28107a60 0x7f7a281bc9d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 --2- 172.21.15.5:0/1984862736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a28108380 0x7f7a281bcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.014+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 >> 172.21.15.5:0/1984862736 conn(0x7f7a2806b7c0 msgr2=0x7f7a28070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.015+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 shutdown_connections 2023-10-08T13:09:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:40.015+0000 7f7a2dfc2700 1 -- 172.21.15.5:0/1984862736 wait complete. 2023-10-08T13:09:41.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:40 smithi118 ceph-mon[104234]: pgmap v410: 129 pgs: 129 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-10-08T13:09:41.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:40 smithi060 ceph-mon[103190]: pgmap v410: 129 pgs: 129 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-10-08T13:09:41.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:40 smithi005 ceph-mon[99496]: pgmap v410: 129 pgs: 129 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-10-08T13:09:41.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:09:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 -- 172.21.15.5:0/1595461922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 msgr2=0x7f2d700ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 --2- 172.21.15.5:0/1595461922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d700ffa10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0099c0 tx=0x7f2d5c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 -- 172.21.15.5:0/1595461922 shutdown_connections 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 --2- 172.21.15.5:0/1595461922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700fff50 0x7f2d7010c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 --2- 172.21.15.5:0/1595461922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d70105650 0x7f2d70105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 --2- 172.21.15.5:0/1595461922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d700ffa10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 -- 172.21.15.5:0/1595461922 >> 172.21.15.5:0/1595461922 conn(0x7f2d700fb060 msgr2=0x7f2d700fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 -- 172.21.15.5:0/1595461922 shutdown_connections 2023-10-08T13:09:41.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.579+0000 7f2d771a4700 1 -- 172.21.15.5:0/1595461922 wait complete. 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 Processor -- start 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 -- start start 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d70071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff50 0x7f2d700722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 0x7f2d70068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70068f10 con 0x7f2d700ff590 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70069080 con 0x7f2d70105650 2023-10-08T13:09:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.580+0000 7f2d771a4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70069240 con 0x7f2d700fff50 2023-10-08T13:09:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 0x7f2d70068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 0x7f2d70068830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59206/0 (socket says 172.21.15.5:59206) 2023-10-08T13:09:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 -- 172.21.15.5:0/191308673 learned_addr learned my addr 172.21.15.5:0/191308673 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d74f40700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d70071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 -- 172.21.15.5:0/191308673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff50 msgr2=0x7f2d700722d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:09:41.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff50 0x7f2d700722d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 -- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 msgr2=0x7f2d70071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d70071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 -- 172.21.15.5:0/191308673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009c40 con 0x7f2d70105650 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d74f40700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d70071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d75741700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 0x7f2d70068830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c370 tx=0x7f2d6800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.581+0000 7f2d6dffb700 1 -- 172.21.15.5:0/191308673 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68017070 con 0x7f2d70105650 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.582+0000 7f2d6dffb700 1 -- 172.21.15.5:0/191308673 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d6800f040 con 0x7f2d70105650 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.582+0000 7f2d6dffb700 1 -- 172.21.15.5:0/191308673 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800e050 con 0x7f2d70105650 2023-10-08T13:09:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.583+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c0095f0 con 0x7f2d70105650 2023-10-08T13:09:41.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.583+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a5b10 con 0x7f2d70105650 2023-10-08T13:09:41.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.586+0000 7f2d6dffb700 1 -- 172.21.15.5:0/191308673 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2d68004540 con 0x7f2d70105650 2023-10-08T13:09:41.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.587+0000 7f2d6dffb700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d600a1670 0x7f2d600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.587+0000 7f2d6dffb700 1 -- 172.21.15.5:0/191308673 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2d680ccdd0 con 0x7f2d70105650 2023-10-08T13:09:41.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.587+0000 7f2d74f40700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d600a1670 0x7f2d600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.587+0000 7f2d8338db80 1 Processor -- start 2023-10-08T13:09:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.587+0000 7f2d8338db80 1 -- start start 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d74f40700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d600a1670 0x7f2d600a3b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009cb0 tx=0x7f2d64009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54e8650 0x560fb54eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d8338db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5446460 con 0x560fb54e8650 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d8338db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5437c20 con 0x560fb54dce80 2023-10-08T13:09:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d8338db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5435540 con 0x560fb54dd7a0 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54e8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49236/0 (socket says 172.21.15.5:49236) 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 -- 172.21.15.5:0/1054098540 learned_addr learned my addr 172.21.15.5:0/1054098540 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d75741700 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54e8650 0x560fb54eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 -- 172.21.15.5:0/1054098540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 msgr2=0x560fb54dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54dd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 -- 172.21.15.5:0/1054098540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54e8650 msgr2=0x560fb54eaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54e8650 0x560fb54eaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.588+0000 7f2d6ffff700 1 -- 172.21.15.5:0/1054098540 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fb525bde0 con 0x560fb54dd7a0 2023-10-08T13:09:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.589+0000 7f2d75741700 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54e8650 0x560fb54eaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.589+0000 7f2d6ffff700 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54e8110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00b580 tx=0x7f2d5c005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4962b4e5b91b0cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.589+0000 7f2d5affd700 1 -- 172.21.15.5:0/1054098540 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c01d070 con 0x560fb54dd7a0 2023-10-08T13:09:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.589+0000 7f2d5affd700 1 -- 172.21.15.5:0/1054098540 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d5c004500 con 0x560fb54dd7a0 2023-10-08T13:09:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.589+0000 7f2d5affd700 1 -- 172.21.15.5:0/1054098540 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c003680 con 0x560fb54dd7a0 2023-10-08T13:09:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 -- 172.21.15.5:0/1054098540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 msgr2=0x560fb54e8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54e8110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00b580 tx=0x7f2d5c005a90 comp rx=0 tx=0).stop 2023-10-08T13:09:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 -- 172.21.15.5:0/1054098540 shutdown_connections 2023-10-08T13:09:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54e8650 0x560fb54eaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1054098540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54e8110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 -- 172.21.15.5:0/1054098540 >> 172.21.15.5:0/1054098540 conn(0x560fb5452260 msgr2=0x560fb54d92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.590+0000 7f2d8338db80 1 -- 172.21.15.5:0/1054098540 shutdown_connections 2023-10-08T13:09:41.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 -- 172.21.15.5:0/1054098540 wait complete. 2023-10-08T13:09:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 -- start start 2023-10-08T13:09:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 Processor -- start 2023-10-08T13:09:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 0x560fb54e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5430e30 con 0x560fb54dd7a0 2023-10-08T13:09:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb53cd710 con 0x560fb54e8650 2023-10-08T13:09:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.591+0000 7f2d8338db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb53cd3b0 con 0x560fb54dce80 2023-10-08T13:09:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d8338db80 10 client.0 _ll_register_callbacks cb 0x560fb522a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 0x560fb54e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 0x560fb54e80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49238/0 (socket says 172.21.15.5:49238) 2023-10-08T13:09:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 -- 172.21.15.5:0/1692922736 learned_addr learned my addr 172.21.15.5:0/1692922736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d75741700 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 -- 172.21.15.5:0/1692922736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 msgr2=0x560fb54e5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 -- 172.21.15.5:0/1692922736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 msgr2=0x560fb54e53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54e53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 -- 172.21.15.5:0/1692922736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a5b10 con 0x560fb54dce80 2023-10-08T13:09:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 0x560fb54e80a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009690 tx=0x7f2d640047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39e3add93dc74c0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:09:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d4ffff700 1 -- 172.21.15.5:0/1692922736 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64012450 con 0x560fb54dce80 2023-10-08T13:09:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fb53f8eb0 con 0x560fb54dce80 2023-10-08T13:09:41.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.592+0000 7f2d4ffff700 1 -- 172.21.15.5:0/1692922736 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2d64018070 con 0x560fb54dce80 2023-10-08T13:09:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d4ffff700 1 -- 172.21.15.5:0/1692922736 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d640125b0 con 0x560fb54dce80 2023-10-08T13:09:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 10 client.25873 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f2d7010cd10 con 0x560fb54dce80 2023-10-08T13:09:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d4ffff700 1 -- 172.21.15.5:0/1692922736 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560fb53f8eb0 con 0x560fb54dce80 2023-10-08T13:09:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d4ffff700 1 -- 172.21.15.5:0/1692922736 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f2d64021790 con 0x560fb54dce80 2023-10-08T13:09:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 10 client.25873 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 10 client.25873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 20 client.25873 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb54f8250 0x560fb54fa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 4 client.25873 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:09:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.593+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fb5429e10 con 0x560fb54f8250 2023-10-08T13:09:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.594+0000 7f2d6ffff700 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb54f8250 0x560fb54fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.594+0000 7f2d6ffff700 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb54f8250 0x560fb54fa670 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a8fd7bbe90c32c server_cookie=38901d24189295b9 in_seq=0 out_seq=0 2023-10-08T13:09:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.594+0000 7f2d4ffff700 10 client.25873 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.595+0000 7f2d4ffff700 1 -- 172.21.15.5:0/1692922736 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560fb5429e10 con 0x560fb54f8250 2023-10-08T13:09:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.595+0000 7f2d4ffff700 10 client.25873 handle_command_reply: tid=0 2023-10-08T13:09:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.595+0000 7f2d8338db80 1 client.25873 shutdown 2023-10-08T13:09:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 msgr2=0x560fb54e80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 0x560fb54e80a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009690 tx=0x7f2d640047c0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 shutdown_connections 2023-10-08T13:09:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb54f8250 0x560fb54fa670 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dce80 0x560fb54e80a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1692922736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54e53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d4ffff700 0 client.25873 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 >> 172.21.15.5:0/1692922736 conn(0x560fb5452260 msgr2=0x560fb54d8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 shutdown_connections 2023-10-08T13:09:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 1 -- 172.21.15.5:0/1692922736 wait complete. 2023-10-08T13:09:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.596+0000 7f2d8338db80 20 client.25873 trim_cache size 0 max 16384 2023-10-08T13:09:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.621+0000 7f2d8338db80 1 Processor -- start 2023-10-08T13:09:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.621+0000 7f2d8338db80 1 -- start start 2023-10-08T13:09:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.621+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 0x560fb54dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.621+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d8338db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb52b1920 con 0x560fb54dce80 2023-10-08T13:09:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d8338db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb54dd4b0 con 0x560fb54e8650 2023-10-08T13:09:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d8338db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb54da060 con 0x560fb54dd7a0 2023-10-08T13:09:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 0x560fb54dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d75741700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 0x560fb54dfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36042/0 (socket says 172.21.15.5:36042) 2023-10-08T13:09:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 -- 172.21.15.5:0/1315697452 learned_addr learned my addr 172.21.15.5:0/1315697452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 -- 172.21.15.5:0/1315697452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 msgr2=0x560fb54ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 -- 172.21.15.5:0/1315697452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 msgr2=0x560fb54e0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 -- 172.21.15.5:0/1315697452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fb5244c60 con 0x560fb54dce80 2023-10-08T13:09:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d75741700 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d74f40700 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 0x560fb54dfd50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2d64021af0 tx=0x7f2d64009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b7cb574c2ff8a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.622+0000 7f2d5b7fe700 1 -- 172.21.15.5:0/1315697452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64003cf0 con 0x560fb54dce80 2023-10-08T13:09:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d5b7fe700 1 -- 172.21.15.5:0/1315697452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d64003e50 con 0x560fb54dce80 2023-10-08T13:09:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d5b7fe700 1 -- 172.21.15.5:0/1315697452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64012be0 con 0x560fb54dce80 2023-10-08T13:09:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 -- 172.21.15.5:0/1315697452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 msgr2=0x560fb54dfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 0x560fb54dfd50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2d64021af0 tx=0x7f2d64009830 comp rx=0 tx=0).stop 2023-10-08T13:09:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 -- 172.21.15.5:0/1315697452 shutdown_connections 2023-10-08T13:09:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54e8650 0x560fb54e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dce80 0x560fb54dfd50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 --2- 172.21.15.5:0/1315697452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54dd7a0 0x560fb54ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.623+0000 7f2d8338db80 1 -- 172.21.15.5:0/1315697452 >> 172.21.15.5:0/1315697452 conn(0x560fb5452260 msgr2=0x560fb54f3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.626+0000 7f2d8338db80 1 -- 172.21.15.5:0/1315697452 shutdown_connections 2023-10-08T13:09:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.627+0000 7f2d8338db80 1 -- 172.21.15.5:0/1315697452 wait complete. 2023-10-08T13:09:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 -- start start 2023-10-08T13:09:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 Processor -- start 2023-10-08T13:09:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54ed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54ed660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 0x560fb554b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb54edf70 con 0x560fb54dd7a0 2023-10-08T13:09:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb554b5c0 con 0x560fb54dce80 2023-10-08T13:09:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb554b700 con 0x560fb54e8650 2023-10-08T13:09:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.628+0000 7f2d8338db80 10 client.0 _ll_register_callbacks cb 0x7f2d640043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 0x560fb554b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 0x560fb554b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49252/0 (socket says 172.21.15.5:49252) 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 -- 172.21.15.5:0/3904094612 learned_addr learned my addr 172.21.15.5:0/3904094612 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 -- 172.21.15.5:0/3904094612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 msgr2=0x560fb54ed120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54ed120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 -- 172.21.15.5:0/3904094612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 msgr2=0x560fb54ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.629+0000 7f2d75741700 1 -- 172.21.15.5:0/3904094612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c0095f0 con 0x560fb54e8650 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.630+0000 7f2d75741700 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 0x560fb554b080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c340 tx=0x7f2d680ca6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b29622547304f53 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.630+0000 7f2d4ffff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:09:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.630+0000 7f2d4ffff700 1 -- 172.21.15.5:0/3904094612 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d680a1da0 con 0x560fb54e8650 2023-10-08T13:09:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.630+0000 7f2d4ffff700 1 -- 172.21.15.5:0/3904094612 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2d68098f90 con 0x560fb54e8650 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.633+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d5c004500 con 0x560fb54e8650 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.633+0000 7f2d4ffff700 1 -- 172.21.15.5:0/3904094612 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d68099150 con 0x560fb54e8650 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.633+0000 7f2d8338db80 10 client.25879 fetch_fsmap learned FSMap version 35 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.633+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f2d7010cd10 con 0x560fb54e8650 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.633+0000 7f2d4ffff700 1 -- 172.21.15.5:0/3904094612 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d680b6070 con 0x560fb54e8650 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d4ffff700 1 -- 172.21.15.5:0/3904094612 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f2d680a1910 con 0x560fb54e8650 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d8338db80 10 client.25879 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d8338db80 10 client.25879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d8338db80 20 client.25879 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d8338db80 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb554ceb0 0x560fb554f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d8338db80 4 client.25879 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:09:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.635+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560fb5429b30 con 0x560fb554ceb0 2023-10-08T13:09:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.636+0000 7f2d74f40700 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb554ceb0 0x560fb554f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.636+0000 7f2d4ffff700 10 client.25879 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.636+0000 7f2d74f40700 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb554ceb0 0x560fb554f2d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83c121a1ea0d39d server_cookie=a5edd09f2882625a in_seq=0 out_seq=0 2023-10-08T13:09:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.636+0000 7f2d4ffff700 1 -- 172.21.15.5:0/3904094612 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560fb5429b30 con 0x560fb554ceb0 2023-10-08T13:09:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.636+0000 7f2d4ffff700 10 client.25879 handle_command_reply: tid=0 2023-10-08T13:09:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.636+0000 7f2d8338db80 1 client.25879 shutdown 2023-10-08T13:09:41.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 msgr2=0x560fb554b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 0x560fb554b080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c340 tx=0x7f2d680ca6e0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 shutdown_connections 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb54e8650 0x560fb554b080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x560fb554ceb0 0x560fb554f2d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560fb54dce80 0x560fb54ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 --2- 172.21.15.5:0/3904094612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560fb54dd7a0 0x560fb54ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 >> 172.21.15.5:0/3904094612 conn(0x560fb5452260 msgr2=0x560fb54e0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d4ffff700 0 client.25879 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 shutdown_connections 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 1 -- 172.21.15.5:0/3904094612 wait complete. 2023-10-08T13:09:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.637+0000 7f2d8338db80 20 client.25879 trim_cache size 0 max 16384 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:09:41.641 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:09:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d600a1670 msgr2=0x7f2d600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d600a1670 0x7f2d600a3b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009cb0 tx=0x7f2d64009260 comp rx=0 tx=0).stop 2023-10-08T13:09:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 msgr2=0x7f2d70068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 0x7f2d70068830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c370 tx=0x7f2d6800c730 comp rx=0 tx=0).stop 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 shutdown_connections 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2d600a1670 0x7f2d600a3b30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d70105650 0x7f2d70068830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d700ff590 0x7f2d70071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 --2- 172.21.15.5:0/191308673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d700fff50 0x7f2d700722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 >> 172.21.15.5:0/191308673 conn(0x7f2d700fb060 msgr2=0x7f2d700fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 shutdown_connections 2023-10-08T13:09:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:09:41.638+0000 7f2d771a4700 1 -- 172.21.15.5:0/191308673 wait complete. 2023-10-08T13:09:41.673 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:09:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 200.0 s, 808.0 tps, lat 144.657 ms stddev 268.793 2023-10-08T13:09:43.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:42 smithi118 ceph-mon[104234]: pgmap v411: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T13:09:43.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:42 smithi060 ceph-mon[103190]: pgmap v411: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T13:09:43.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:42 smithi005 ceph-mon[99496]: pgmap v411: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T13:09:45.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:44 smithi118 ceph-mon[104234]: pgmap v412: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T13:09:45.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:44 smithi060 ceph-mon[103190]: pgmap v412: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T13:09:45.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:44 smithi005 ceph-mon[99496]: pgmap v412: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T13:09:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 205.0 s, 938.8 tps, lat 108.590 ms stddev 129.274 2023-10-08T13:09:47.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:46 smithi118 ceph-mon[104234]: pgmap v413: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 MiB/s wr, 1.32k op/s 2023-10-08T13:09:47.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:46 smithi060 ceph-mon[103190]: pgmap v413: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 MiB/s wr, 1.32k op/s 2023-10-08T13:09:47.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:46 smithi005 ceph-mon[99496]: pgmap v413: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 MiB/s wr, 1.32k op/s 2023-10-08T13:09:49.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:48 smithi118 ceph-mon[104234]: pgmap v414: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 22 MiB/s wr, 1.49k op/s 2023-10-08T13:09:49.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:48 smithi060 ceph-mon[103190]: pgmap v414: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 22 MiB/s wr, 1.49k op/s 2023-10-08T13:09:49.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:48 smithi005 ceph-mon[99496]: pgmap v414: 129 pgs: 129 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 22 MiB/s wr, 1.49k op/s 2023-10-08T13:09:51.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:50 smithi118 ceph-mon[104234]: pgmap v415: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 MiB/s wr, 1.38k op/s 2023-10-08T13:09:51.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:50 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:09:51.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:50 smithi060 ceph-mon[103190]: pgmap v415: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 MiB/s wr, 1.38k op/s 2023-10-08T13:09:51.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:50 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:09:51.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:50 smithi005 ceph-mon[99496]: pgmap v415: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 MiB/s wr, 1.38k op/s 2023-10-08T13:09:51.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:50 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:09:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 210.0 s, 734.6 tps, lat 135.325 ms stddev 251.095 2023-10-08T13:09:53.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:52 smithi060 ceph-mon[103190]: pgmap v416: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2023-10-08T13:09:53.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:52 smithi005 ceph-mon[99496]: pgmap v416: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2023-10-08T13:09:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.179+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1884451555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4100640 msgr2=0x7f3ff4100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.179+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1884451555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4100640 0x7f3ff4100ac0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009990 tx=0x7f3fe8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1884451555 shutdown_connections 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1884451555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 0x7f3ff410d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1884451555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff4106650 0x7f3ff4106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1884451555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4100640 0x7f3ff4100ac0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1884451555 >> 172.21.15.5:0/1884451555 conn(0x7f3ff40fc190 msgr2=0x7f3ff40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1884451555 shutdown_connections 2023-10-08T13:09:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.181+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1884451555 wait complete. 2023-10-08T13:09:53.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 Processor -- start 2023-10-08T13:09:53.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 -- start start 2023-10-08T13:09:53.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff4100640 0x7f3ff419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 0x7f3ff419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4106650 0x7f3ff41968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4196f50 con 0x7f3ff4106650 2023-10-08T13:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41970c0 con 0x7f3ff4101000 2023-10-08T13:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.182+0000 7f3ffa78e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4197280 con 0x7f3ff4100640 2023-10-08T13:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff8d2b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4106650 0x7f3ff41968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff8d2b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4106650 0x7f3ff41968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36060/0 (socket says 172.21.15.5:36060) 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff8d2b700 1 -- 172.21.15.5:0/1810488587 learned_addr learned my addr 172.21.15.5:0/1810488587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 0x7f3ff419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 -- 172.21.15.5:0/1810488587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff4100640 msgr2=0x7f3ff419c7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff4100640 0x7f3ff419c7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 -- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4106650 msgr2=0x7f3ff41968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4106650 0x7f3ff41968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 -- 172.21.15.5:0/1810488587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80095f0 con 0x7f3ff4101000 2023-10-08T13:09:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.183+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 0x7f3ff419cd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000c00 tx=0x7f3fe8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.184+0000 7f3ff17fa700 1 -- 172.21.15.5:0/1810488587 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe801d070 con 0x7f3ff4101000 2023-10-08T13:09:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.184+0000 7f3ff17fa700 1 -- 172.21.15.5:0/1810488587 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fe800bdb0 con 0x7f3ff4101000 2023-10-08T13:09:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.184+0000 7f3ff17fa700 1 -- 172.21.15.5:0/1810488587 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8022e40 con 0x7f3ff4101000 2023-10-08T13:09:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.184+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff4197500 con 0x7f3ff4101000 2023-10-08T13:09:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.184+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff4072c00 con 0x7f3ff4101000 2023-10-08T13:09:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.186+0000 7f3ff17fa700 1 -- 172.21.15.5:0/1810488587 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3fe8022570 con 0x7f3ff4101000 2023-10-08T13:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.187+0000 7f3ff17fa700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fdc0a1660 0x7f3fdc0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f3ff17fa700 1 -- 172.21.15.5:0/1810488587 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3fe80ce7c0 con 0x7f3ff4101000 2023-10-08T13:09:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fdc0a1660 0x7f3fdc0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 Processor -- start 2023-10-08T13:09:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fdc0a1660 0x7f3fdc0a3b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009a70 tx=0x7f3fe4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 -- start start 2023-10-08T13:09:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x55775404b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x55775404fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557754050230 0x557754050690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753fab400 con 0x55775404b570 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753f9cbc0 con 0x55775404be90 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.188+0000 7f4006977b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753f9a4e0 con 0x557754050230 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x55775404b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x55775404b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36066/0 (socket says 172.21.15.5:36066) 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 -- 172.21.15.5:0/2824354830 learned_addr learned my addr 172.21.15.5:0/2824354830 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557754050230 0x557754050690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 -- 172.21.15.5:0/2824354830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557754050230 msgr2=0x557754050690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557754050230 0x557754050690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 -- 172.21.15.5:0/2824354830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 msgr2=0x55775404fcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:09:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x55775404fcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 -- 172.21.15.5:0/2824354830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557753dc0d80 con 0x55775404b570 2023-10-08T13:09:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.189+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x55775404b950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400eb70 tx=0x7f3fe4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01cb3aa783fa528 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.190+0000 7f3fda7fc700 1 -- 172.21.15.5:0/2824354830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4010ac0 con 0x55775404b570 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.190+0000 7f3fda7fc700 1 -- 172.21.15.5:0/2824354830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fe40096e0 con 0x55775404b570 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.190+0000 7f3fda7fc700 1 -- 172.21.15.5:0/2824354830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40053e0 con 0x55775404b570 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 -- 172.21.15.5:0/2824354830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 msgr2=0x55775404b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x55775404b950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400eb70 tx=0x7f3fe4011000 comp rx=0 tx=0).stop 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 -- 172.21.15.5:0/2824354830 shutdown_connections 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557754050230 0x557754050690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x55775404b950 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 --2- 172.21.15.5:0/2824354830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x55775404fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 -- 172.21.15.5:0/2824354830 >> 172.21.15.5:0/2824354830 conn(0x557753fb7200 msgr2=0x55775403db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 -- 172.21.15.5:0/2824354830 shutdown_connections 2023-10-08T13:09:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 -- 172.21.15.5:0/2824354830 wait complete. 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.191+0000 7f4006977b80 1 -- start start 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 Processor -- start 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x557754054dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404be90 0x557754055300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754055840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753f95dd0 con 0x55775404b570 2023-10-08T13:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753f326b0 con 0x557754050230 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753f32350 con 0x55775404be90 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f4006977b80 10 client.0 _ll_register_callbacks cb 0x557753d8f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x557754054dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f3ff37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404be90 0x557754055300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x557754054dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36070/0 (socket says 172.21.15.5:36070) 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1678508371 learned_addr learned my addr 172.21.15.5:0/1678508371 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.192+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754055840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404be90 msgr2=0x557754055300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404be90 0x557754055300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1678508371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 msgr2=0x557754055840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754055840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1678508371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe400e820 con 0x55775404b570 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754055840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x557754054dc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400eb40 tx=0x7f3fe4005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609f1bcf593aa230 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3fd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1678508371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4005700 con 0x55775404b570 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1678508371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3fe400ee80 con 0x55775404b570 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557753f5de50 con 0x55775404b570 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.193+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1678508371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fe4005860 con 0x55775404b570 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 10 client.16338 fetch_fsmap learned FSMap version 36 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557753da9c00 con 0x55775404b570 2023-10-08T13:09:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1678508371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557753f5de50 con 0x55775404b570 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1678508371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3fe4018070 con 0x55775404b570 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 10 client.16338 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 10 client.16338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 20 client.16338 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557754046af0 0x557754048f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 4 client.16338 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557753f8edb0 con 0x557754046af0 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.194+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557754046af0 0x557754048f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.195+0000 7f3fd37fe700 10 client.16338 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.195+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557754046af0 0x557754048f10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c0981c37828f89c server_cookie=30a8d4b5f5a753d2 in_seq=0 out_seq=0 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.195+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1678508371 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557753f8edb0 con 0x557754046af0 2023-10-08T13:09:53.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.195+0000 7f3fd37fe700 10 client.16338 handle_command_reply: tid=0 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.195+0000 7f4006977b80 1 client.16338 shutdown 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 msgr2=0x557754054dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x557754054dc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400eb40 tx=0x7f3fe4005250 comp rx=0 tx=0).stop 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 shutdown_connections 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557754046af0 0x557754048f10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754055840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f3fd37fe700 0 client.16338 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404b570 0x557754054dc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 --2- 172.21.15.5:0/1678508371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404be90 0x557754055300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 >> 172.21.15.5:0/1678508371 conn(0x557753fb7200 msgr2=0x557754041b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 shutdown_connections 2023-10-08T13:09:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 1 -- 172.21.15.5:0/1678508371 wait complete. 2023-10-08T13:09:53.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.196+0000 7f4006977b80 20 client.16338 trim_cache size 0 max 16384 2023-10-08T13:09:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.232+0000 7f4006977b80 1 Processor -- start 2023-10-08T13:09:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 -- start start 2023-10-08T13:09:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x557754048ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557754050230 0x55775403f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775405c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557753e168c0 con 0x557754050230 2023-10-08T13:09:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775403a830 con 0x55775404be90 2023-10-08T13:09:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.234+0000 7f4006977b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775405c980 con 0x55775404dc60 2023-10-08T13:09:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.235+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x557754048ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.235+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x557754048ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59260/0 (socket says 172.21.15.5:59260) 2023-10-08T13:09:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.235+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1998084948 learned_addr learned my addr 172.21.15.5:0/1998084948 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.238+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1998084948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 msgr2=0x55775405c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.238+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775405c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.238+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1998084948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557754050230 msgr2=0x55775403f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.238+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557754050230 0x55775403f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.238+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1998084948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557753de71f0 con 0x55775404be90 2023-10-08T13:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.257+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x557754048ee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40094f0 tx=0x7f3fe40107c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ad7423f29206483 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.257+0000 7f3fdaffd700 1 -- 172.21.15.5:0/1998084948 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4005700 con 0x55775404be90 2023-10-08T13:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.257+0000 7f3fdaffd700 1 -- 172.21.15.5:0/1998084948 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fe4005860 con 0x55775404be90 2023-10-08T13:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.257+0000 7f3fdaffd700 1 -- 172.21.15.5:0/1998084948 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004b80 con 0x55775404be90 2023-10-08T13:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.258+0000 7f4006977b80 1 -- 172.21.15.5:0/1998084948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 msgr2=0x557754048ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.258+0000 7f4006977b80 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x557754048ee0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40094f0 tx=0x7f3fe40107c0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.260+0000 7f4006977b80 1 -- 172.21.15.5:0/1998084948 shutdown_connections 2023-10-08T13:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.260+0000 7f4006977b80 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775405c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.260+0000 7f4006977b80 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55775404be90 0x557754048ee0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.260+0000 7f4006977b80 1 --2- 172.21.15.5:0/1998084948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557754050230 0x55775403f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.260+0000 7f4006977b80 1 -- 172.21.15.5:0/1998084948 >> 172.21.15.5:0/1998084948 conn(0x557753fb7200 msgr2=0x557754041b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:53.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:52 smithi118 ceph-mon[104234]: pgmap v416: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.273+0000 7f4006977b80 1 -- 172.21.15.5:0/1998084948 shutdown_connections 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.274+0000 7f4006977b80 1 -- 172.21.15.5:0/1998084948 wait complete. 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.274+0000 7f4006977b80 1 -- start start 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.274+0000 7f4006977b80 1 Processor -- start 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 0x55775404a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775404ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754054d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775405c810 con 0x55775404be90 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577540552d0 con 0x557754050230 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557754055490 con 0x55775404dc60 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f4006977b80 10 client.0 _ll_register_callbacks cb 0x7f3fec0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 0x55775404a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 0x55775404a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36084/0 (socket says 172.21.15.5:36084) 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff3fff700 1 -- 172.21.15.5:0/1229448096 learned_addr learned my addr 172.21.15.5:0/1229448096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754054d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff37fe700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775404ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff8d2b700 1 -- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 msgr2=0x55775404ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775404ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff8d2b700 1 -- 172.21.15.5:0/1229448096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 msgr2=0x55775404a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 0x55775404a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff8d2b700 1 -- 172.21.15.5:0/1229448096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557753da9c00 con 0x557754050230 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.275+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 0x55775404a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.276+0000 7f3ff8d2b700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754054d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009550 tx=0x7f3fec007f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6e8b2d9d2d88a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.276+0000 7f3fd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.277+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1229448096 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec004db0 con 0x557754050230 2023-10-08T13:09:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.277+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1229448096 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3fec016a40 con 0x557754050230 2023-10-08T13:09:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.277+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fe40096e0 con 0x557754050230 2023-10-08T13:09:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.282+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1229448096 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fec016c00 con 0x557754050230 2023-10-08T13:09:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.286+0000 7f4006977b80 10 client.25853 fetch_fsmap learned FSMap version 36 2023-10-08T13:09:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.286+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557753dbf250 con 0x557754050230 2023-10-08T13:09:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1229448096 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fe40096e0 con 0x557754050230 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1229448096 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 36) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3fec02a420 con 0x557754050230 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f4006977b80 10 client.25853 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f4006977b80 10 client.25853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f4006977b80 20 client.25853 populate_metadata read hostname 'smithi005' 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f4006977b80 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5577540b15b0 0x5577540b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f4006977b80 4 client.25853 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557753f8ead0 con 0x5577540b15b0 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.289+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5577540b15b0 0x5577540b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.290+0000 7f3ff3fff700 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5577540b15b0 0x5577540b39d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eefbec847eddf313 server_cookie=419cb5bba84cc499 in_seq=0 out_seq=0 2023-10-08T13:09:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.290+0000 7f3fd37fe700 10 client.25853 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.350+0000 7f3fd37fe700 1 -- 172.21.15.5:0/1229448096 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557753f8ead0 con 0x5577540b15b0 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.350+0000 7f3fd37fe700 10 client.25853 handle_command_reply: tid=0 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.350+0000 7f4006977b80 1 client.25853 shutdown 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.353+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 msgr2=0x557754054d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.353+0000 7f4006977b80 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754054d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009550 tx=0x7f3fec007f00 comp rx=0 tx=0).stop 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.354+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 shutdown_connections 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.354+0000 7f4006977b80 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5577540b15b0 0x5577540b39d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.354+0000 7f4006977b80 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557754050230 0x557754054d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.354+0000 7f4006977b80 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55775404be90 0x55775404a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.354+0000 7f4006977b80 1 --2- 172.21.15.5:0/1229448096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55775404dc60 0x55775404ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.354+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 >> 172.21.15.5:0/1229448096 conn(0x557753fb7200 msgr2=0x557754041b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.357+0000 7f3fd37fe700 0 client.25853 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:09:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.357+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 shutdown_connections 2023-10-08T13:09:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.357+0000 7f4006977b80 1 -- 172.21.15.5:0/1229448096 wait complete. 2023-10-08T13:09:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.357+0000 7f4006977b80 20 client.25853 trim_cache size 0 max 16384 2023-10-08T13:09:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:09:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:09:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:09:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:09:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.358+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fdc0a1660 msgr2=0x7f3fdc0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.358+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fdc0a1660 0x7f3fdc0a3b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009a70 tx=0x7f3fe4009260 comp rx=0 tx=0).stop 2023-10-08T13:09:53.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.358+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 msgr2=0x7f3ff419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:09:53.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.358+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 0x7f3ff419cd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000c00 tx=0x7f3fe8005740 comp rx=0 tx=0).stop 2023-10-08T13:09:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 shutdown_connections 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3fdc0a1660 0x7f3fdc0a3b20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ff4106650 0x7f3ff41968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ff4100640 0x7f3ff419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 --2- 172.21.15.5:0/1810488587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff4101000 0x7f3ff419cd00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 >> 172.21.15.5:0/1810488587 conn(0x7f3ff40fc190 msgr2=0x7f3ff40fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 shutdown_connections 2023-10-08T13:09:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:09:53.360+0000 7f3ffa78e700 1 -- 172.21.15.5:0/1810488587 wait complete. 2023-10-08T13:09:55.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:54 smithi060 ceph-mon[103190]: pgmap v417: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 829 op/s 2023-10-08T13:09:55.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:54 smithi005 ceph-mon[99496]: pgmap v417: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 829 op/s 2023-10-08T13:09:55.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:54 smithi118 ceph-mon[104234]: pgmap v417: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 829 op/s 2023-10-08T13:09:56.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:55 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:09:56.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:55 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:09:56.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:55 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:09:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 215.0 s, 661.8 tps, lat 147.476 ms stddev 186.157 2023-10-08T13:09:57.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:56 smithi060 ceph-mon[103190]: pgmap v418: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 770 op/s 2023-10-08T13:09:57.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:56 smithi005 ceph-mon[99496]: pgmap v418: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 770 op/s 2023-10-08T13:09:57.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:56 smithi118 ceph-mon[104234]: pgmap v418: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 770 op/s 2023-10-08T13:09:59.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:09:58 smithi060 ceph-mon[103190]: pgmap v419: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 975 op/s 2023-10-08T13:09:59.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:09:58 smithi005 ceph-mon[99496]: pgmap v419: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 975 op/s 2023-10-08T13:09:59.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:09:58 smithi118 ceph-mon[104234]: pgmap v419: 129 pgs: 129 active+clean; 3.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 975 op/s 2023-10-08T13:10:01.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:00 smithi060 ceph-mon[103190]: pgmap v420: 129 pgs: 129 active+clean; 3.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 913 op/s 2023-10-08T13:10:01.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:00 smithi060 ceph-mon[103190]: overall HEALTH_OK 2023-10-08T13:10:01.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:00 smithi005 ceph-mon[99496]: pgmap v420: 129 pgs: 129 active+clean; 3.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 913 op/s 2023-10-08T13:10:01.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:00 smithi005 ceph-mon[99496]: overall HEALTH_OK 2023-10-08T13:10:01.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:00 smithi118 ceph-mon[104234]: pgmap v420: 129 pgs: 129 active+clean; 3.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 913 op/s 2023-10-08T13:10:01.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:00 smithi118 ceph-mon[104234]: overall HEALTH_OK 2023-10-08T13:10:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 220.0 s, 515.3 tps, lat 185.060 ms stddev 241.227 2023-10-08T13:10:03.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:02 smithi060 ceph-mon[103190]: pgmap v421: 129 pgs: 129 active+clean; 3.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 965 op/s 2023-10-08T13:10:03.179 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:02 smithi005 ceph-mon[99496]: pgmap v421: 129 pgs: 129 active+clean; 3.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 965 op/s 2023-10-08T13:10:03.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:02 smithi118 ceph-mon[104234]: pgmap v421: 129 pgs: 129 active+clean; 3.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 965 op/s 2023-10-08T13:10:05.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:04 smithi060 ceph-mon[103190]: pgmap v422: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2023-10-08T13:10:05.178 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:04 smithi005 ceph-mon[99496]: pgmap v422: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2023-10-08T13:10:05.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:04 smithi118 ceph-mon[104234]: pgmap v422: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2023-10-08T13:10:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 -- 172.21.15.5:0/4096070793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 msgr2=0x7f79e410c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/4096070793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e410c400 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b0d0 tx=0x7f79dc00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 -- 172.21.15.5:0/4096070793 shutdown_connections 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/4096070793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e410c400 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/4096070793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e4105640 0x7f79e4105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/4096070793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e40ff580 0x7f79e40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 -- 172.21.15.5:0/4096070793 >> 172.21.15.5:0/4096070793 conn(0x7f79e40fb070 msgr2=0x7f79e40fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 -- 172.21.15.5:0/4096070793 shutdown_connections 2023-10-08T13:10:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.520+0000 7f79ec6ff700 1 -- 172.21.15.5:0/4096070793 wait complete. 2023-10-08T13:10:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.521+0000 7f79ec6ff700 1 Processor -- start 2023-10-08T13:10:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.521+0000 7f79ec6ff700 1 -- start start 2023-10-08T13:10:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ec6ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 0x7f79e419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ec6ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ec6ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e4105640 0x7f79e4196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ec6ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e4196fc0 con 0x7f79e40fff40 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ec6ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e4197130 con 0x7f79e40ff580 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ec6ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41972f0 con 0x7f79e4105640 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 0x7f79e419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36100/0 (socket says 172.21.15.5:36100) 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 0x7f79e419c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59280/0 (socket says 172.21.15.5:59280) 2023-10-08T13:10:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 -- 172.21.15.5:0/2124275790 learned_addr learned my addr 172.21.15.5:0/2124275790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79eac9c700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e4105640 0x7f79e4196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 -- 172.21.15.5:0/2124275790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e4105640 msgr2=0x7f79e4196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e4105640 0x7f79e4196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 -- 172.21.15.5:0/2124275790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 msgr2=0x7f79e419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 0x7f79e419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 -- 172.21.15.5:0/2124275790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009d00 con 0x7f79e40fff40 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79ea49b700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 0x7f79e419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.522+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e419cd70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f79d400e9a0 tx=0x7f79d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.523+0000 7f79db7fe700 1 -- 172.21.15.5:0/2124275790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4009790 con 0x7f79e40fff40 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.523+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e41975d0 con 0x7f79e40fff40 2023-10-08T13:10:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.523+0000 7f79db7fe700 1 -- 172.21.15.5:0/2124275790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79d4010430 con 0x7f79e40fff40 2023-10-08T13:10:06.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.523+0000 7f79db7fe700 1 -- 172.21.15.5:0/2124275790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4018680 con 0x7f79e40fff40 2023-10-08T13:10:06.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.523+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e41a3820 con 0x7f79e40fff40 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.525+0000 7f79db7fe700 1 -- 172.21.15.5:0/2124275790 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f79d40105a0 con 0x7f79e40fff40 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.525+0000 7f79db7fe700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f79d00a15e0 0x7f79d00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.525+0000 7f79ea49b700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f79d00a15e0 0x7f79d00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.525+0000 7f79db7fe700 1 -- 172.21.15.5:0/2124275790 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f79d4014070 con 0x7f79e40fff40 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.526+0000 7f79ea49b700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f79d00a15e0 0x7f79d00a3aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f79e0011490 tx=0x7f79e0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.526+0000 7f79f88e8b80 1 Processor -- start 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.526+0000 7f79f88e8b80 1 -- start start 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085baec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085b11400 con 0x55e085ba90b0 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085b02bc0 con 0x55e085baf1a0 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085b004e0 con 0x55e085bae880 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79eac9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085baec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085baec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49310/0 (socket says 172.21.15.5:49310) 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59290/0 (socket says 172.21.15.5:59290) 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79eac9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36110/0 (socket says 172.21.15.5:36110) 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 -- 172.21.15.5:0/50613684 learned_addr learned my addr 172.21.15.5:0/50613684 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 -- 172.21.15.5:0/50613684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 msgr2=0x55e085ba8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 -- 172.21.15.5:0/50613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 msgr2=0x55e085ba9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 -- 172.21.15.5:0/50613684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e085926d80 con 0x55e085bae880 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79eac9c700 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79ea49b700 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085baec60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79e00043c0 tx=0x7f79e0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c440e093edafbeee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.527+0000 7f79d8ff9700 1 -- 172.21.15.5:0/50613684 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0003d10 con 0x55e085bae880 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79d8ff9700 1 -- 172.21.15.5:0/50613684 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e0003e70 con 0x55e085bae880 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79d8ff9700 1 -- 172.21.15.5:0/50613684 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000e6a0 con 0x55e085bae880 2023-10-08T13:10:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 -- 172.21.15.5:0/50613684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 msgr2=0x55e085baec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085baec60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79e00043c0 tx=0x7f79e0014000 comp rx=0 tx=0).stop 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 -- 172.21.15.5:0/50613684 shutdown_connections 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085baec60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/50613684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 -- 172.21.15.5:0/50613684 >> 172.21.15.5:0/50613684 conn(0x55e085b1d200 msgr2=0x55e085ba3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 -- 172.21.15.5:0/50613684 shutdown_connections 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.528+0000 7f79f88e8b80 1 -- 172.21.15.5:0/50613684 wait complete. 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 -- start start 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 Processor -- start 2023-10-08T13:10:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085bb25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085bae880 0x55e085bb2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085baf1a0 0x55e085bb3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085afbdd0 con 0x55e085ba90b0 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085a986b0 con 0x55e085bae880 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085a98350 con 0x55e085baf1a0 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79f88e8b80 10 client.0 _ll_register_callbacks cb 0x55e0858f57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085bb25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085bb25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36112/0 (socket says 172.21.15.5:36112) 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 -- 172.21.15.5:0/2541393164 learned_addr learned my addr 172.21.15.5:0/2541393164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085bae880 0x55e085bb2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79eac9c700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085baf1a0 0x55e085bb3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 -- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085baf1a0 msgr2=0x55e085bb3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085baf1a0 0x55e085bb3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 -- 172.21.15.5:0/2541393164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085bae880 msgr2=0x55e085bb2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085bae880 0x55e085bb2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79ea49b700 1 -- 172.21.15.5:0/2541393164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e4068d90 con 0x55e085ba90b0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.529+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085bae880 0x55e085bb2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79ea49b700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085bb25f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009f10 tx=0x7f79e0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7d07b9eb1c3088 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79cdffb700 1 -- 172.21.15.5:0/2541393164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e002c070 con 0x55e085ba90b0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79cdffb700 1 -- 172.21.15.5:0/2541393164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f79e0005670 con 0x55e085ba90b0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e085ac3e50 con 0x55e085ba90b0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79cdffb700 1 -- 172.21.15.5:0/2541393164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e001e3f0 con 0x55e085ba90b0 2023-10-08T13:10:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 10 client.16353 fetch_fsmap learned FSMap version 37 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f79e41a3820 con 0x55e085ba90b0 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79cdffb700 1 -- 172.21.15.5:0/2541393164 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e085ac3e50 con 0x55e085ba90b0 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79cdffb700 1 -- 172.21.15.5:0/2541393164 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 37) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f79e0024020 con 0x55e085ba90b0 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 10 client.16353 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 20 client.16353 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085bc2b50 0x55e085bc4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 4 client.16353 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.530+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e085af4db0 con 0x55e085bc2b50 2023-10-08T13:10:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.531+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085bc2b50 0x55e085bc4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.531+0000 7f79cdffb700 10 client.16353 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.531+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085bc2b50 0x55e085bc4f70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6568b751e6156252 server_cookie=53fb8e9300adcc3c in_seq=0 out_seq=0 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79cdffb700 1 -- 172.21.15.5:0/2541393164 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e085af4db0 con 0x55e085bc2b50 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79cdffb700 10 client.16353 handle_command_reply: tid=0 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 client.16353 shutdown 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 msgr2=0x55e085bb25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085bb25f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009f10 tx=0x7f79e0005270 comp rx=0 tx=0).stop 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 shutdown_connections 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085baf1a0 0x55e085bb3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085bb25f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085bc2b50 0x55e085bc4f70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/2541393164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085bae880 0x55e085bb2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79cdffb700 0 client.16353 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 >> 172.21.15.5:0/2541393164 conn(0x55e085b1d200 msgr2=0x55e085ba3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 shutdown_connections 2023-10-08T13:10:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 1 -- 172.21.15.5:0/2541393164 wait complete. 2023-10-08T13:10:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.532+0000 7f79f88e8b80 20 client.16353 trim_cache size 0 max 16384 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 Processor -- start 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 -- start start 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085ba3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08597c8c0 con 0x55e085ba90b0 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085ba5330 con 0x55e085baf1a0 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085bbf7f0 con 0x55e085bae880 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79eac9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085ba3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36120/0 (socket says 172.21.15.5:36120) 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 -- 172.21.15.5:0/1548735766 learned_addr learned my addr 172.21.15.5:0/1548735766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 -- 172.21.15.5:0/1548735766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 msgr2=0x55e085ba3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085ba3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 -- 172.21.15.5:0/1548735766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 msgr2=0x55e085ba3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79ea49b700 1 -- 172.21.15.5:0/1548735766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0017070 con 0x55e085ba90b0 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.548+0000 7f79eac9c700 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79ea49b700 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba8b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f79e0005950 tx=0x7f79e0003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efc3fc9098ff4c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79d97fa700 1 -- 172.21.15.5:0/1548735766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e002c070 con 0x55e085ba90b0 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79d97fa700 1 -- 172.21.15.5:0/1548735766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e002a070 con 0x55e085ba90b0 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79d97fa700 1 -- 172.21.15.5:0/1548735766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e001e8b0 con 0x55e085ba90b0 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79f88e8b80 1 -- 172.21.15.5:0/1548735766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 msgr2=0x55e085ba8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba8b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f79e0005950 tx=0x7f79e0003a90 comp rx=0 tx=0).stop 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79f88e8b80 1 -- 172.21.15.5:0/1548735766 shutdown_connections 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085ba3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085ba90b0 0x55e085ba8b70 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.549+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/1548735766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085bae880 0x55e085ba3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- 172.21.15.5:0/1548735766 >> 172.21.15.5:0/1548735766 conn(0x55e085b1d200 msgr2=0x55e085bb1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- 172.21.15.5:0/1548735766 shutdown_connections 2023-10-08T13:10:06.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- 172.21.15.5:0/1548735766 wait complete. 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- start start 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 Processor -- start 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085ba90b0 0x55e085bb9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 0x55e085bb7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085bb8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085bb87d0 con 0x55e085bae880 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085bb8940 con 0x55e085baf1a0 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085c159a0 con 0x55e085ba90b0 2023-10-08T13:10:06.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79f88e8b80 10 client.0 _ll_register_callbacks cb 0x7f79e0005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 0x55e085bb7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79e9c9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 0x55e085bb7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36128/0 (socket says 172.21.15.5:36128) 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79ea49b700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085ba90b0 0x55e085bb9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79e9c9a700 1 -- 172.21.15.5:0/3451576757 learned_addr learned my addr 172.21.15.5:0/3451576757 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.550+0000 7f79eac9c700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085bb8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79e9c9a700 1 -- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085ba90b0 msgr2=0x55e085bb9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085ba90b0 0x55e085bb9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79e9c9a700 1 -- 172.21.15.5:0/3451576757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 msgr2=0x55e085bb8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085bb8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79e9c9a700 1 -- 172.21.15.5:0/3451576757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc0092e0 con 0x55e085bae880 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79e9c9a700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 0x55e085bb7bd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f79d400c510 tx=0x7f79d4010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f09e846cadf6c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79cdffb700 1 -- 172.21.15.5:0/3451576757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d409e3f0 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79cdffb700 1 -- 172.21.15.5:0/3451576757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f79d40a2630 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79e0003e70 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79cdffb700 1 -- 172.21.15.5:0/3451576757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d4098640 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 10 client.16359 fetch_fsmap learned FSMap version 37 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f79e41a3820 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79cdffb700 1 -- 172.21.15.5:0/3451576757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e0003e70 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79cdffb700 1 -- 172.21.15.5:0/3451576757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 37) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f79d4099790 con 0x55e085bae880 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 10 client.16359 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 20 client.16359 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:06.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085c17180 0x55e085c195a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:06.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 4 client.16359 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:10:06.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.551+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e085af4ad0 con 0x55e085c17180 2023-10-08T13:10:06.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.552+0000 7f79ea49b700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085c17180 0x55e085c195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:06.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.552+0000 7f79ea49b700 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085c17180 0x55e085c195a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f6661ccd7ab6a4 server_cookie=8000264713a3b45d in_seq=0 out_seq=0 2023-10-08T13:10:06.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.552+0000 7f79cdffb700 10 client.16359 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.619+0000 7f79cdffb700 1 -- 172.21.15.5:0/3451576757 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e085af4ad0 con 0x55e085c17180 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.619+0000 7f79cdffb700 10 client.16359 handle_command_reply: tid=0 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.619+0000 7f79f88e8b80 1 client.16359 shutdown 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 msgr2=0x55e085bb7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 0x55e085bb7bd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f79d400c510 tx=0x7f79d4010c80 comp rx=0 tx=0).stop 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 shutdown_connections 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e085c17180 0x55e085c195a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e085baf1a0 0x55e085bb8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e085ba90b0 0x55e085bb9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 --2- 172.21.15.5:0/3451576757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e085bae880 0x55e085bb7bd0 secure :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f79d400c510 tx=0x7f79d4010c80 comp rx=0 tx=0).stop 2023-10-08T13:10:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 >> 172.21.15.5:0/3451576757 conn(0x55e085b1d200 msgr2=0x55e085bad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.623+0000 7f79cdffb700 0 client.16359 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.633+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 shutdown_connections 2023-10-08T13:10:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.636+0000 7f79f88e8b80 1 -- 172.21.15.5:0/3451576757 wait complete. 2023-10-08T13:10:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.648+0000 7f79f88e8b80 20 client.16359 trim_cache size 0 max 16384 2023-10-08T13:10:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:10:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:10:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:10:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:10:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.649+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f79d00a15e0 msgr2=0x7f79d00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.649+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f79d00a15e0 0x7f79d00a3aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f79e0011490 tx=0x7f79e0009260 comp rx=0 tx=0).stop 2023-10-08T13:10:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.649+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 msgr2=0x7f79e419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.649+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e419cd70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f79d400e9a0 tx=0x7f79d400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.650+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 shutdown_connections 2023-10-08T13:10:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.650+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f79d00a15e0 0x7f79d00a3aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.650+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79e4105640 0x7f79e4196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.650+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40ff580 0x7f79e419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.650+0000 7f79ec6ff700 1 --2- 172.21.15.5:0/2124275790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e40fff40 0x7f79e419cd70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.650+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 >> 172.21.15.5:0/2124275790 conn(0x7f79e40fb070 msgr2=0x7f79e40fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.654+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 shutdown_connections 2023-10-08T13:10:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:06.656+0000 7f79ec6ff700 1 -- 172.21.15.5:0/2124275790 wait complete. 2023-10-08T13:10:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 225.0 s, 1167.2 tps, lat 92.130 ms stddev 149.993 2023-10-08T13:10:07.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:06 smithi005 ceph-mon[99496]: pgmap v423: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 957 op/s 2023-10-08T13:10:07.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:06 smithi118 ceph-mon[104234]: pgmap v423: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 957 op/s 2023-10-08T13:10:07.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:06 smithi060 ceph-mon[103190]: pgmap v423: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 957 op/s 2023-10-08T13:10:09.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:08 smithi118 ceph-mon[104234]: pgmap v424: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2023-10-08T13:10:09.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:08 smithi060 ceph-mon[103190]: pgmap v424: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2023-10-08T13:10:09.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:08 smithi005 ceph-mon[99496]: pgmap v424: 129 pgs: 129 active+clean; 3.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2023-10-08T13:10:11.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:10 smithi118 ceph-mon[104234]: pgmap v425: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 868 op/s 2023-10-08T13:10:11.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:10 smithi060 ceph-mon[103190]: pgmap v425: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 868 op/s 2023-10-08T13:10:11.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:10 smithi005 ceph-mon[99496]: pgmap v425: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 868 op/s 2023-10-08T13:10:11.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:10:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 230.0 s, 1176.2 tps, lat 84.010 ms stddev 109.999 2023-10-08T13:10:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.933+0000 7eff2310b700 1 -- 172.21.15.5:0/3665723230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1077f0 msgr2=0x7eff1c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:11.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.933+0000 7eff2310b700 1 --2- 172.21.15.5:0/3665723230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1077f0 0x7eff1c107c70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff1001a9a0 tx=0x7eff1001acb0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.939+0000 7eff2310b700 1 -- 172.21.15.5:0/3665723230 shutdown_connections 2023-10-08T13:10:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.939+0000 7eff2310b700 1 --2- 172.21.15.5:0/3665723230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.939+0000 7eff2310b700 1 --2- 172.21.15.5:0/3665723230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c10edf0 0x7eff1c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.939+0000 7eff2310b700 1 --2- 172.21.15.5:0/3665723230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1077f0 0x7eff1c107c70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.939+0000 7eff2310b700 1 -- 172.21.15.5:0/3665723230 >> 172.21.15.5:0/3665723230 conn(0x7eff1c06b770 msgr2=0x7eff1c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.948+0000 7eff2310b700 1 -- 172.21.15.5:0/3665723230 shutdown_connections 2023-10-08T13:10:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.950+0000 7eff2310b700 1 -- 172.21.15.5:0/3665723230 wait complete. 2023-10-08T13:10:11.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.951+0000 7eff2310b700 1 Processor -- start 2023-10-08T13:10:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 -- start start 2023-10-08T13:10:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff1c1077f0 0x7eff1c11ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c10edf0 0x7eff1c117d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c118490 con 0x7eff1c10edf0 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c118600 con 0x7eff1c1077f0 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff2310b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1187c0 con 0x7eff1c1083a0 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49342/0 (socket says 172.21.15.5:49342) 2023-10-08T13:10:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.957+0000 7eff1bfff700 1 -- 172.21.15.5:0/2035574116 learned_addr learned my addr 172.21.15.5:0/2035574116 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.958+0000 7eff1bfff700 1 -- 172.21.15.5:0/2035574116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff1c1077f0 msgr2=0x7eff1c11ba60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:10:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.958+0000 7eff1bfff700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff1c1077f0 0x7eff1c11ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.958+0000 7eff1bfff700 1 -- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c10edf0 msgr2=0x7eff1c117d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:10:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.958+0000 7eff1bfff700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c10edf0 0x7eff1c117d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.958+0000 7eff1bfff700 1 -- 172.21.15.5:0/2035574116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1001a600 con 0x7eff1c1083a0 2023-10-08T13:10:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.963+0000 7eff1bfff700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff10003b00 tx=0x7eff10003be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.965+0000 7eff19ffb700 1 -- 172.21.15.5:0/2035574116 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1002d070 con 0x7eff1c1083a0 2023-10-08T13:10:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.965+0000 7eff19ffb700 1 -- 172.21.15.5:0/2035574116 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff10004040 con 0x7eff1c1083a0 2023-10-08T13:10:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.965+0000 7eff19ffb700 1 -- 172.21.15.5:0/2035574116 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10031de0 con 0x7eff1c1083a0 2023-10-08T13:10:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.965+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c1a9b40 con 0x7eff1c1083a0 2023-10-08T13:10:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.965+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1a9eb0 con 0x7eff1c1083a0 2023-10-08T13:10:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.968+0000 7eff19ffb700 1 -- 172.21.15.5:0/2035574116 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7eff100041b0 con 0x7eff1c1083a0 2023-10-08T13:10:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.971+0000 7eff2f2f4b80 1 Processor -- start 2023-10-08T13:10:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.971+0000 7eff19ffb700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff040a17c0 0x7eff040a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.971+0000 7eff19ffb700 1 -- 172.21.15.5:0/2035574116 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7eff100decd0 con 0x7eff1c1083a0 2023-10-08T13:10:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 -- start start 2023-10-08T13:10:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524312260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x56152431d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x56152431fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152427b460 con 0x561524311e80 2023-10-08T13:10:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152426cc20 con 0x5615243127a0 2023-10-08T13:10:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.978+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152426a540 con 0x56152431d650 2023-10-08T13:10:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524312260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524312260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36142/0 (socket says 172.21.15.5:36142) 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 -- 172.21.15.5:0/1126235974 learned_addr learned my addr 172.21.15.5:0/1126235974 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 -- 172.21.15.5:0/1126235974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 msgr2=0x56152431fa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x56152431fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 -- 172.21.15.5:0/1126235974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 msgr2=0x56152431d110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x56152431d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 -- 172.21.15.5:0/1126235974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561524090de0 con 0x561524311e80 2023-10-08T13:10:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.979+0000 7eff20ea7700 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524312260 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009810 tx=0x7eff0c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bf5797a923984a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:11.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.980+0000 7eff02ffd700 1 -- 172.21.15.5:0/1126235974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c011830 con 0x561524311e80 2023-10-08T13:10:11.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.980+0000 7eff02ffd700 1 -- 172.21.15.5:0/1126235974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff0c011e50 con 0x561524311e80 2023-10-08T13:10:11.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.980+0000 7eff02ffd700 1 -- 172.21.15.5:0/1126235974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c010380 con 0x561524311e80 2023-10-08T13:10:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.981+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/1126235974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 msgr2=0x561524312260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.981+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524312260 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009810 tx=0x7eff0c009b20 comp rx=0 tx=0).stop 2023-10-08T13:10:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.983+0000 7eff216a8700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff040a17c0 0x7eff040a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.983+0000 7eff216a8700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff040a17c0 0x7eff040a3c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff1c1087d0 tx=0x7eff140091f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.984+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/1126235974 shutdown_connections 2023-10-08T13:10:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.984+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x56152431fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.984+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524312260 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.984+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/1126235974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x56152431d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.984+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/1126235974 >> 172.21.15.5:0/1126235974 conn(0x561524287260 msgr2=0x56152430e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.985+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/1126235974 shutdown_connections 2023-10-08T13:10:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.987+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/1126235974 wait complete. 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.988+0000 7eff2f2f4b80 1 -- start start 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.988+0000 7eff2f2f4b80 1 Processor -- start 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x56152431d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615243127a0 0x56152431a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56152431d650 0x56152431a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524265e30 con 0x561524311e80 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524202710 con 0x56152431d650 2023-10-08T13:10:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615242023b0 con 0x5615243127a0 2023-10-08T13:10:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff2f2f4b80 10 client.0 _ll_register_callbacks cb 0x56152405f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff20ea7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x56152431d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.989+0000 7eff20ea7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x56152431d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36144/0 (socket says 172.21.15.5:36144) 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 -- 172.21.15.5:0/2026971022 learned_addr learned my addr 172.21.15.5:0/2026971022 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff1bfff700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615243127a0 0x56152431a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff216a8700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56152431d650 0x56152431a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 -- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615243127a0 msgr2=0x56152431a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615243127a0 0x56152431a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 -- 172.21.15.5:0/2026971022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56152431d650 msgr2=0x56152431a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56152431d650 0x56152431a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 -- 172.21.15.5:0/2026971022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c009440 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff20ea7700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x56152431d000 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00bbc0 tx=0x7eff0c00bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb33dd2c475a6be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff007f8700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff007f8700 1 -- 172.21.15.5:0/2026971022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00b6b0 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff007f8700 1 -- 172.21.15.5:0/2026971022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7eff0c011630 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.990+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56152422deb0 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff007f8700 1 -- 172.21.15.5:0/2026971022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff0c0117f0 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 10 client.16365 fetch_fsmap learned FSMap version 38 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x561524079c60 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff007f8700 1 -- 172.21.15.5:0/2026971022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56152422deb0 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff007f8700 1 -- 172.21.15.5:0/2026971022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 38) v1 ==== 7918+0+0 (secure 0 0 0) 0x7eff0c01aba0 con 0x561524311e80 2023-10-08T13:10:11.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 10 client.16365 fetch_fsmap finished waiting for FSMap version 38 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 20 client.16365 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56152432d070 0x56152432f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 4 client.16365 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56152425ee10 con 0x56152432d070 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.991+0000 7eff1bfff700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56152432d070 0x56152432f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.992+0000 7eff007f8700 10 client.16365 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.993+0000 7eff1bfff700 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56152432d070 0x56152432f490 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71434d502e3b1ad server_cookie=9d3cceeb917942c in_seq=0 out_seq=0 2023-10-08T13:10:11.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.997+0000 7eff007f8700 1 -- 172.21.15.5:0/2026971022 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56152425ee10 con 0x56152432d070 2023-10-08T13:10:11.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.997+0000 7eff007f8700 10 client.16365 handle_command_reply: tid=0 2023-10-08T13:10:11.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:11.997+0000 7eff2f2f4b80 1 client.16365 shutdown 2023-10-08T13:10:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.000+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 msgr2=0x56152431d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.000+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x56152431d000 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00bbc0 tx=0x7eff0c00bf70 comp rx=0 tx=0).stop 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.003+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 shutdown_connections 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.003+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56152432d070 0x56152432f490 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.003+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56152431d650 0x56152431a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.003+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x56152431d000 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.003+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/2026971022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5615243127a0 0x56152431a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.003+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 >> 172.21.15.5:0/2026971022 conn(0x561524287260 msgr2=0x56152430dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.004+0000 7eff007f8700 0 client.16365 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.004+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 shutdown_connections 2023-10-08T13:10:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.004+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/2026971022 wait complete. 2023-10-08T13:10:12.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.005+0000 7eff2f2f4b80 20 client.16365 trim_cache size 0 max 16384 2023-10-08T13:10:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 Processor -- start 2023-10-08T13:10:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 -- start start 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561524311e80 0x561524318bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615243127a0 0x561524319100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524328930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615240e6920 con 0x5615243127a0 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152422dee0 con 0x561524311e80 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615243130d0 con 0x56152431d650 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff216a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524328930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff216a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524328930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49356/0 (socket says 172.21.15.5:49356) 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.037+0000 7eff216a8700 1 -- 172.21.15.5:0/3392661827 learned_addr learned my addr 172.21.15.5:0/3392661827 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff216a8700 1 -- 172.21.15.5:0/3392661827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561524311e80 msgr2=0x561524318bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff216a8700 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561524311e80 0x561524318bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff216a8700 1 -- 172.21.15.5:0/3392661827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615243127a0 msgr2=0x561524319100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff216a8700 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615243127a0 0x561524319100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff216a8700 1 -- 172.21.15.5:0/3392661827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615240b7250 con 0x56152431d650 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff216a8700 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524328930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff1400ce30 tx=0x7eff1400f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbccee31e723e267 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff037fe700 1 -- 172.21.15.5:0/3392661827 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400ee50 con 0x56152431d650 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff037fe700 1 -- 172.21.15.5:0/3392661827 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff1403e900 con 0x56152431d650 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.038+0000 7eff037fe700 1 -- 172.21.15.5:0/3392661827 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140468c0 con 0x56152431d650 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/3392661827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 msgr2=0x561524328930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524328930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff1400ce30 tx=0x7eff1400f000 comp rx=0 tx=0).stop 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/3392661827 shutdown_connections 2023-10-08T13:10:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524328930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561524311e80 0x561524318bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/3392661827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5615243127a0 0x561524319100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/3392661827 >> 172.21.15.5:0/3392661827 conn(0x561524287260 msgr2=0x56152432f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/3392661827 shutdown_connections 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.039+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/3392661827 wait complete. 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.040+0000 7eff2f2f4b80 1 -- start start 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.040+0000 7eff2f2f4b80 1 Processor -- start 2023-10-08T13:10:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.040+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524323ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.040+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x5615243223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.040+0000 7eff2f2f4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524322920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615243247d0 con 0x561524311e80 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524322e60 con 0x5615243127a0 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff2f2f4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561524323020 con 0x56152431d650 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff2f2f4b80 10 client.0 _ll_register_callbacks cb 0x7eff0c009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524322920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524322920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49362/0 (socket says 172.21.15.5:49362) 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 -- 172.21.15.5:0/958230972 learned_addr learned my addr 172.21.15.5:0/958230972 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff20ea7700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524323ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff1bfff700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x5615243223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 -- 172.21.15.5:0/958230972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 msgr2=0x5615243223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x5615243223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 -- 172.21.15.5:0/958230972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 msgr2=0x561524323ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524323ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff216a8700 1 -- 172.21.15.5:0/958230972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1400cae0 con 0x56152431d650 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff1bfff700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x5615243223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.041+0000 7eff20ea7700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524323ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff216a8700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524322920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff14046610 tx=0x7eff1403e840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f8a5fa76d243e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff007f8700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff007f8700 1 -- 172.21.15.5:0/958230972 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1404a070 con 0x56152431d650 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff007f8700 1 -- 172.21.15.5:0/958230972 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7eff14046660 con 0x56152431d650 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff0c011e50 con 0x56152431d650 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff007f8700 1 -- 172.21.15.5:0/958230972 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff14046820 con 0x56152431d650 2023-10-08T13:10:12.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 10 client.25921 fetch_fsmap learned FSMap version 38 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x56152408f2b0 con 0x56152431d650 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff007f8700 1 -- 172.21.15.5:0/958230972 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff0c011e50 con 0x56152431d650 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff007f8700 1 -- 172.21.15.5:0/958230972 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 38) v1 ==== 7918+0+0 (secure 0 0 0) 0x7eff14044020 con 0x56152431d650 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 10 client.25921 fetch_fsmap finished waiting for FSMap version 38 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 20 client.25921 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.042+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561524382280 0x5615243846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff2f2f4b80 4 client.25921 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56152425eb30 con 0x561524382280 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff20ea7700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561524382280 0x5615243846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff007f8700 10 client.25921 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:12.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff20ea7700 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561524382280 0x5615243846a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d270ff40a74b327e server_cookie=a00840637b57f6f5 in_seq=0 out_seq=0 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff007f8700 1 -- 172.21.15.5:0/958230972 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56152425eb30 con 0x561524382280 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff007f8700 10 client.25921 handle_command_reply: tid=0 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.043+0000 7eff2f2f4b80 1 client.25921 shutdown 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 msgr2=0x561524322920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524322920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff14046610 tx=0x7eff1403e840 comp rx=0 tx=0).stop 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 shutdown_connections 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56152431d650 0x561524322920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561524311e80 0x561524323ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561524382280 0x5615243846a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 --2- 172.21.15.5:0/958230972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5615243127a0 0x5615243223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff007f8700 0 client.25921 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:12.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 >> 172.21.15.5:0/958230972 conn(0x561524287260 msgr2=0x561524318b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 shutdown_connections 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 1 -- 172.21.15.5:0/958230972 wait complete. 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2f2f4b80 20 client.25921 trim_cache size 0 max 16384 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:10:12.052 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff040a17c0 msgr2=0x7eff040a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2310b700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff040a17c0 0x7eff040a3c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff1c1087d0 tx=0x7eff140091f0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 msgr2=0x7eff1c11bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.044+0000 7eff2310b700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff10003b00 tx=0x7eff10003be0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.045+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 shutdown_connections 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.045+0000 7eff2310b700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff040a17c0 0x7eff040a3c80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.045+0000 7eff2310b700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c10edf0 0x7eff1c117d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.045+0000 7eff2310b700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff1c1077f0 0x7eff1c11ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.045+0000 7eff2310b700 1 --2- 172.21.15.5:0/2035574116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff1c1083a0 0x7eff1c11bfa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.045+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 >> 172.21.15.5:0/2035574116 conn(0x7eff1c06b770 msgr2=0x7eff1c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.047+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 shutdown_connections 2023-10-08T13:10:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:12.047+0000 7eff2310b700 1 -- 172.21.15.5:0/2035574116 wait complete. 2023-10-08T13:10:12.112 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:10:13.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:12 smithi118 ceph-mon[104234]: pgmap v426: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 13 MiB/s wr, 804 op/s 2023-10-08T13:10:13.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:12 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:13.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:12 smithi060 ceph-mon[103190]: pgmap v426: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 13 MiB/s wr, 804 op/s 2023-10-08T13:10:13.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:12 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:13.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:12 smithi005 ceph-mon[99496]: pgmap v426: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 13 MiB/s wr, 804 op/s 2023-10-08T13:10:13.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:12 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:15.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:14 smithi118 ceph-mon[104234]: pgmap v427: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 704 op/s 2023-10-08T13:10:15.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:14 smithi060 ceph-mon[103190]: pgmap v427: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 704 op/s 2023-10-08T13:10:15.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:14 smithi005 ceph-mon[99496]: pgmap v427: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 704 op/s 2023-10-08T13:10:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 235.0 s, 857.6 tps, lat 117.101 ms stddev 122.844 2023-10-08T13:10:17.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:17 smithi060 ceph-mon[103190]: pgmap v428: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 595 op/s 2023-10-08T13:10:17.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:17 smithi005 ceph-mon[99496]: pgmap v428: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 595 op/s 2023-10-08T13:10:17.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:17 smithi118 ceph-mon[104234]: pgmap v428: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 595 op/s 2023-10-08T13:10:18.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:18 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:18.430 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:18 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:18.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:18 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:19.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:19 smithi060 ceph-mon[103190]: pgmap v429: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 13 MiB/s wr, 612 op/s 2023-10-08T13:10:19.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:19 smithi005 ceph-mon[99496]: pgmap v429: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 13 MiB/s wr, 612 op/s 2023-10-08T13:10:19.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:19 smithi118 ceph-mon[104234]: pgmap v429: 129 pgs: 129 active+clean; 3.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 13 MiB/s wr, 612 op/s 2023-10-08T13:10:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.865+0000 7f71690e4700 1 -- 172.21.15.5:0/2201239563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 msgr2=0x7f7164107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.865+0000 7f71690e4700 1 --2- 172.21.15.5:0/2201239563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f7164107d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f71580099c0 tx=0x7f7158009cd0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.871+0000 7f71690e4700 1 -- 172.21.15.5:0/2201239563 shutdown_connections 2023-10-08T13:10:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.871+0000 7f71690e4700 1 --2- 172.21.15.5:0/2201239563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7164119fd0 0x7f716411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.871+0000 7f71690e4700 1 --2- 172.21.15.5:0/2201239563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f716410eea0 0x7f71641077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.871+0000 7f71690e4700 1 --2- 172.21.15.5:0/2201239563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f7164107d30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.871+0000 7f71690e4700 1 -- 172.21.15.5:0/2201239563 >> 172.21.15.5:0/2201239563 conn(0x7f716406b7c0 msgr2=0x7f716406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:19.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.874+0000 7f71690e4700 1 -- 172.21.15.5:0/2201239563 shutdown_connections 2023-10-08T13:10:19.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.875+0000 7f71690e4700 1 -- 172.21.15.5:0/2201239563 wait complete. 2023-10-08T13:10:19.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 Processor -- start 2023-10-08T13:10:19.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 -- start start 2023-10-08T13:10:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f716410eea0 0x7f71641ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f71641abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7164119fd0 0x7f71641a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641a5e30 con 0x7f716410f310 2023-10-08T13:10:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641a5fa0 con 0x7f716410eea0 2023-10-08T13:10:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.876+0000 7f71690e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641a6160 con 0x7f7164119fd0 2023-10-08T13:10:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f71641abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f71641abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36170/0 (socket says 172.21.15.5:36170) 2023-10-08T13:10:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 -- 172.21.15.5:0/2066422969 learned_addr learned my addr 172.21.15.5:0/2066422969 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716359e700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7164119fd0 0x7f71641a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 -- 172.21.15.5:0/2066422969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7164119fd0 msgr2=0x7f71641a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7164119fd0 0x7f71641a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 -- 172.21.15.5:0/2066422969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f716410eea0 msgr2=0x7f71641ab690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f716410eea0 0x7f71641ab690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 -- 172.21.15.5:0/2066422969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71580095f0 con 0x7f716410f310 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f716259c700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f71641abbd0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7158005b40 tx=0x7f71580039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f714bfff700 1 -- 172.21.15.5:0/2066422969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715801d070 con 0x7f716410f310 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.877+0000 7f714bfff700 1 -- 172.21.15.5:0/2066422969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715800bc50 con 0x7f716410f310 2023-10-08T13:10:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.878+0000 7f714bfff700 1 -- 172.21.15.5:0/2066422969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715800fc10 con 0x7f716410f310 2023-10-08T13:10:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.878+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71641a63e0 con 0x7f716410f310 2023-10-08T13:10:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.879+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716410fa10 con 0x7f716410f310 2023-10-08T13:10:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.882+0000 7f714bfff700 1 -- 172.21.15.5:0/2066422969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f715800b790 con 0x7f716410f310 2023-10-08T13:10:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.883+0000 7f714bfff700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f714c0a16e0 0x7f714c0a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.883+0000 7f714bfff700 1 -- 172.21.15.5:0/2066422969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f71580ce080 con 0x7f716410f310 2023-10-08T13:10:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.883+0000 7f7162d9d700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f714c0a16e0 0x7f714c0a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.884+0000 7f7162d9d700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f714c0a16e0 0x7f714c0a3ba0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7154009710 tx=0x7f7154006c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:19.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.887+0000 7f71752cdb80 1 Processor -- start 2023-10-08T13:10:19.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 -- start start 2023-10-08T13:10:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49944e400 con 0x55f4994eb880 2023-10-08T13:10:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49943fbc0 con 0x55f4994e60b0 2023-10-08T13:10:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.888+0000 7f71752cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49943d4e0 con 0x55f4994ec1a0 2023-10-08T13:10:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.889+0000 7f716359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.889+0000 7f716359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59360/0 (socket says 172.21.15.5:59360) 2023-10-08T13:10:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.889+0000 7f716359e700 1 -- 172.21.15.5:0/13390165 learned_addr learned my addr 172.21.15.5:0/13390165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.889+0000 7f716259c700 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f716359e700 1 -- 172.21.15.5:0/13390165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 msgr2=0x55f4994e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f716359e700 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f716359e700 1 -- 172.21.15.5:0/13390165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 msgr2=0x55f4994ebc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f716359e700 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f716359e700 1 -- 172.21.15.5:0/13390165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f499263d80 con 0x55f4994e60b0 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f716359e700 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e6510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f715c011600 tx=0x7f715c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2853c203847e8c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f71497fa700 1 -- 172.21.15.5:0/13390165 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00e040 con 0x55f4994e60b0 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f71497fa700 1 -- 172.21.15.5:0/13390165 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715c00f040 con 0x55f4994e60b0 2023-10-08T13:10:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.890+0000 7f71497fa700 1 -- 172.21.15.5:0/13390165 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0047b0 con 0x55f4994e60b0 2023-10-08T13:10:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 -- 172.21.15.5:0/13390165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 msgr2=0x55f4994e6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e6510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f715c011600 tx=0x7f715c009920 comp rx=0 tx=0).stop 2023-10-08T13:10:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 -- 172.21.15.5:0/13390165 shutdown_connections 2023-10-08T13:10:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e6510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994ebc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 --2- 172.21.15.5:0/13390165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 -- 172.21.15.5:0/13390165 >> 172.21.15.5:0/13390165 conn(0x55f49945a200 msgr2=0x55f4994e0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 -- 172.21.15.5:0/13390165 shutdown_connections 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.891+0000 7f71752cdb80 1 -- 172.21.15.5:0/13390165 wait complete. 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 -- start start 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 Processor -- start 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994e60b0 0x55f4994ef610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 0x55f4994f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f499438dd0 con 0x55f4994eb880 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4993d56b0 con 0x55f4994ec1a0 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4993d5350 con 0x55f4994e60b0 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f71752cdb80 10 client.0 _ll_register_callbacks cb 0x55f4992327a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f7162d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994e60b0 0x55f4994ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f716359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 0x55f4994f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f716359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 0x55f4994f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59366/0 (socket says 172.21.15.5:59366) 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f7162d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994e60b0 0x55f4994ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49386/0 (socket says 172.21.15.5:49386) 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.892+0000 7f716359e700 1 -- 172.21.15.5:0/2397022267 learned_addr learned my addr 172.21.15.5:0/2397022267 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716259c700 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716359e700 1 -- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994e60b0 msgr2=0x55f4994ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716359e700 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994e60b0 0x55f4994ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716359e700 1 -- 172.21.15.5:0/2397022267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 msgr2=0x55f4994efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716359e700 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716359e700 1 -- 172.21.15.5:0/2397022267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c0112b0 con 0x55f4994ec1a0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f716359e700 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 0x55f4994f0090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f715c000f80 tx=0x7f715c005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2796e3cea8313119 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f7146ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f7146ff5700 1 -- 172.21.15.5:0/2397022267 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00e070 con 0x55f4994ec1a0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f499400e50 con 0x55f4994ec1a0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f7146ff5700 1 -- 172.21.15.5:0/2397022267 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f715c003c10 con 0x55f4994ec1a0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f7146ff5700 1 -- 172.21.15.5:0/2397022267 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f715c003dd0 con 0x55f4994ec1a0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f71752cdb80 10 client.25883 fetch_fsmap learned FSMap version 39 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.893+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f49924cc00 con 0x55f4994ec1a0 2023-10-08T13:10:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f7146ff5700 1 -- 172.21.15.5:0/2397022267 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f499400e50 con 0x55f4994ec1a0 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f7146ff5700 1 -- 172.21.15.5:0/2397022267 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f715c027460 con 0x55f4994ec1a0 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f71752cdb80 10 client.25883 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f71752cdb80 10 client.25883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f71752cdb80 20 client.25883 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f71752cdb80 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f4994ffce0 0x55f499502100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f71752cdb80 4 client.25883 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f499431db0 con 0x55f4994ffce0 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f7162d9d700 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f4994ffce0 0x55f499502100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f7146ff5700 10 client.25883 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.894+0000 7f7162d9d700 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f4994ffce0 0x55f499502100 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f0c3480b87a990 server_cookie=94d09f7ec5ee7be7 in_seq=0 out_seq=0 2023-10-08T13:10:19.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f7146ff5700 1 -- 172.21.15.5:0/2397022267 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f499431db0 con 0x55f4994ffce0 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f7146ff5700 10 client.25883 handle_command_reply: tid=0 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 client.25883 shutdown 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 msgr2=0x55f4994f0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 0x55f4994f0090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f715c000f80 tx=0x7f715c005b00 comp rx=0 tx=0).stop 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 shutdown_connections 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f4994ffce0 0x55f499502100 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994ec1a0 0x55f4994f0090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f7146ff5700 0 client.25883 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994e60b0 0x55f4994ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 --2- 172.21.15.5:0/2397022267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 >> 172.21.15.5:0/2397022267 conn(0x55f49945a200 msgr2=0x55f4994e0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 shutdown_connections 2023-10-08T13:10:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 1 -- 172.21.15.5:0/2397022267 wait complete. 2023-10-08T13:10:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.898+0000 7f71752cdb80 20 client.25883 trim_cache size 0 max 16384 2023-10-08T13:10:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.924+0000 7f71752cdb80 1 Processor -- start 2023-10-08T13:10:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 -- start start 2023-10-08T13:10:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4992b98c0 con 0x55f4994eb880 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4994db2b0 con 0x55f4994e60b0 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.932+0000 7f71752cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4994e1610 con 0x55f4994ec1a0 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.939+0000 7f7162d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.939+0000 7f716359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.939+0000 7f716359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49396/0 (socket says 172.21.15.5:49396) 2023-10-08T13:10:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.939+0000 7f716359e700 1 -- 172.21.15.5:0/3836972287 learned_addr learned my addr 172.21.15.5:0/3836972287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.939+0000 7f716259c700 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.940+0000 7f716259c700 1 -- 172.21.15.5:0/3836972287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 msgr2=0x55f4994e0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.940+0000 7f716259c700 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.940+0000 7f716259c700 1 -- 172.21.15.5:0/3836972287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 msgr2=0x55f4994e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.940+0000 7f716259c700 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.940+0000 7f716259c700 1 -- 172.21.15.5:0/3836972287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f49928a1f0 con 0x55f4994eb880 2023-10-08T13:10:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.959+0000 7f716259c700 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efeb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f71580cb430 tx=0x7f715809a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b601adf0788120e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.959+0000 7f7149ffb700 1 -- 172.21.15.5:0/3836972287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580b2070 con 0x55f4994eb880 2023-10-08T13:10:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.959+0000 7f7149ffb700 1 -- 172.21.15.5:0/3836972287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715800bdc0 con 0x55f4994eb880 2023-10-08T13:10:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.959+0000 7f7149ffb700 1 -- 172.21.15.5:0/3836972287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158098e90 con 0x55f4994eb880 2023-10-08T13:10:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.960+0000 7f71752cdb80 1 -- 172.21.15.5:0/3836972287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 msgr2=0x55f4994efeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.960+0000 7f71752cdb80 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efeb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f71580cb430 tx=0x7f715809a890 comp rx=0 tx=0).stop 2023-10-08T13:10:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.965+0000 7f71752cdb80 1 -- 172.21.15.5:0/3836972287 shutdown_connections 2023-10-08T13:10:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.965+0000 7f71752cdb80 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994ec1a0 0x55f4994e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.965+0000 7f71752cdb80 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.965+0000 7f71752cdb80 1 --2- 172.21.15.5:0/3836972287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994eb880 0x55f4994efeb0 secure :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f71580cb430 tx=0x7f715809a890 comp rx=0 tx=0).stop 2023-10-08T13:10:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.965+0000 7f71752cdb80 1 -- 172.21.15.5:0/3836972287 >> 172.21.15.5:0/3836972287 conn(0x55f49945a200 msgr2=0x55f4994edee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.966+0000 7f71752cdb80 1 -- 172.21.15.5:0/3836972287 shutdown_connections 2023-10-08T13:10:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.966+0000 7f71752cdb80 1 -- 172.21.15.5:0/3836972287 wait complete. 2023-10-08T13:10:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 -- start start 2023-10-08T13:10:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 Processor -- start 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994ec1a0 0x55f4994f5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994f5650 0x55f499552ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f499553010 con 0x55f4994ec1a0 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f499553150 con 0x55f4994e60b0 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f499553290 con 0x55f4994f5650 2023-10-08T13:10:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.967+0000 7f71752cdb80 10 client.0 _ll_register_callbacks cb 0x7f715c0114d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59378/0 (socket says 172.21.15.5:59378) 2023-10-08T13:10:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 -- 172.21.15.5:0/236019189 learned_addr learned my addr 172.21.15.5:0/236019189 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f716359e700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994f5650 0x55f499552ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 -- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994f5650 msgr2=0x55f499552ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f716259c700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994ec1a0 0x55f4994f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994f5650 0x55f499552ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 -- 172.21.15.5:0/236019189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994ec1a0 msgr2=0x55f4994f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994ec1a0 0x55f4994f5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f7162d9d700 1 -- 172.21.15.5:0/236019189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716410fa10 con 0x55f4994e60b0 2023-10-08T13:10:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.968+0000 7f716259c700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994ec1a0 0x55f4994f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:10:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.969+0000 7f7162d9d700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994f4bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55f4995029a0 tx=0x7f715400e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce393a81657e91f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.977+0000 7f7146ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:10:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.977+0000 7f7146ff5700 1 -- 172.21.15.5:0/236019189 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715401a040 con 0x55f4994e60b0 2023-10-08T13:10:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.977+0000 7f7146ff5700 1 -- 172.21.15.5:0/236019189 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7154024e40 con 0x55f4994e60b0 2023-10-08T13:10:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.983+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f715c00f040 con 0x55f4994e60b0 2023-10-08T13:10:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.984+0000 7f7146ff5700 1 -- 172.21.15.5:0/236019189 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71540152e0 con 0x55f4994e60b0 2023-10-08T13:10:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.987+0000 7f71752cdb80 10 client.25889 fetch_fsmap learned FSMap version 39 2023-10-08T13:10:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.987+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f499262250 con 0x55f4994e60b0 2023-10-08T13:10:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.988+0000 7f7146ff5700 1 -- 172.21.15.5:0/236019189 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f715c00f040 con 0x55f4994e60b0 2023-10-08T13:10:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f7146ff5700 1 -- 172.21.15.5:0/236019189 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f7154035070 con 0x55f4994e60b0 2023-10-08T13:10:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f71752cdb80 10 client.25889 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:10:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f71752cdb80 10 client.25889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f71752cdb80 20 client.25889 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f71752cdb80 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f499554a00 0x55f499556e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f71752cdb80 4 client.25889 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:10:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.989+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f499431ad0 con 0x55f499554a00 2023-10-08T13:10:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.990+0000 7f716259c700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f499554a00 0x55f499556e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.990+0000 7f716259c700 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f499554a00 0x55f499556e20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9aa8e4df22c1a2 server_cookie=f6be6672417a03d5 in_seq=0 out_seq=0 2023-10-08T13:10:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:19.990+0000 7f7146ff5700 10 client.25889 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f7146ff5700 1 -- 172.21.15.5:0/236019189 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f499431ad0 con 0x55f499554a00 2023-10-08T13:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f7146ff5700 10 client.25889 handle_command_reply: tid=0 2023-10-08T13:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 client.25889 shutdown 2023-10-08T13:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 msgr2=0x55f4994f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994f4bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55f4995029a0 tx=0x7f715400e000 comp rx=0 tx=0).stop 2023-10-08T13:10:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 shutdown_connections 2023-10-08T13:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f4994f5650 0x55f499552ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f499554a00 0x55f499556e20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f4994e60b0 0x55f4994f4bd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 --2- 172.21.15.5:0/236019189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4994ec1a0 0x55f4994f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f7146ff5700 0 client.25889 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 >> 172.21.15.5:0/236019189 conn(0x55f49945a200 msgr2=0x55f4994ea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 shutdown_connections 2023-10-08T13:10:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 1 -- 172.21.15.5:0/236019189 wait complete. 2023-10-08T13:10:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.030+0000 7f71752cdb80 20 client.25889 trim_cache size 0 max 16384 2023-10-08T13:10:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:10:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:10:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:10:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:10:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f714c0a16e0 msgr2=0x7f714c0a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f714c0a16e0 0x7f714c0a3ba0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7154009710 tx=0x7f7154006c60 comp rx=0 tx=0).stop 2023-10-08T13:10:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 msgr2=0x7f71641abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f71641abbd0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7158005b40 tx=0x7f71580039f0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 shutdown_connections 2023-10-08T13:10:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f714c0a16e0 0x7f714c0a3ba0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7164119fd0 0x7f71641a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f716410eea0 0x7f71641ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 --2- 172.21.15.5:0/2066422969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f716410f310 0x7f71641abbd0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 >> 172.21.15.5:0/2066422969 conn(0x7f716406b7c0 msgr2=0x7f7164117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 shutdown_connections 2023-10-08T13:10:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:20.031+0000 7f71690e4700 1 -- 172.21.15.5:0/2066422969 wait complete. 2023-10-08T13:10:21.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:21 smithi060 ceph-mon[103190]: pgmap v430: 129 pgs: 129 active+clean; 3.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 566 op/s 2023-10-08T13:10:21.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:21 smithi005 ceph-mon[99496]: pgmap v430: 129 pgs: 129 active+clean; 3.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 566 op/s 2023-10-08T13:10:21.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:21 smithi118 ceph-mon[104234]: pgmap v430: 129 pgs: 129 active+clean; 3.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 566 op/s 2023-10-08T13:10:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 240.0 s, 891.0 tps, lat 112.868 ms stddev 118.183 2023-10-08T13:10:23.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:23 smithi060 ceph-mon[103190]: pgmap v431: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 566 op/s 2023-10-08T13:10:23.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:23 smithi005 ceph-mon[99496]: pgmap v431: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 566 op/s 2023-10-08T13:10:23.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:23 smithi118 ceph-mon[104234]: pgmap v431: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 566 op/s 2023-10-08T13:10:25.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:25 smithi060 ceph-mon[103190]: pgmap v432: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.0 MiB/s wr, 570 op/s 2023-10-08T13:10:25.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:25 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:25.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:25 smithi005 ceph-mon[99496]: pgmap v432: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.0 MiB/s wr, 570 op/s 2023-10-08T13:10:25.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:25 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:25 smithi118 ceph-mon[104234]: pgmap v432: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.0 MiB/s wr, 570 op/s 2023-10-08T13:10:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:25 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:26.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 245.0 s, 847.3 tps, lat 114.982 ms stddev 144.655 2023-10-08T13:10:27.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:27 smithi060 ceph-mon[103190]: pgmap v433: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.5 MiB/s wr, 552 op/s 2023-10-08T13:10:27.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:27 smithi005 ceph-mon[99496]: pgmap v433: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.5 MiB/s wr, 552 op/s 2023-10-08T13:10:27.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:27 smithi118 ceph-mon[104234]: pgmap v433: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.5 MiB/s wr, 552 op/s 2023-10-08T13:10:29.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:29 smithi060 ceph-mon[103190]: pgmap v434: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.7 MiB/s wr, 634 op/s 2023-10-08T13:10:29.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:29 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:10:29.429 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:29 smithi005 ceph-mon[99496]: pgmap v434: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.7 MiB/s wr, 634 op/s 2023-10-08T13:10:29.429 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:29 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:10:29.527 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:29 smithi118 ceph-mon[104234]: pgmap v434: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.7 MiB/s wr, 634 op/s 2023-10-08T13:10:29.593 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:29 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:10:30.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:30 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:10:30.428 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:30 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:10:30.428 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:30 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:10:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:30 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:10:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:30 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:10:30.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:30 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:10:30.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:30 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:10:30.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:30 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:10:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:30 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:10:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:31 smithi118 ceph-mon[104234]: pgmap v435: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.9 MiB/s wr, 636 op/s 2023-10-08T13:10:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:31 smithi060 ceph-mon[103190]: pgmap v435: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.9 MiB/s wr, 636 op/s 2023-10-08T13:10:31.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:31 smithi005 ceph-mon[99496]: pgmap v435: 129 pgs: 129 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.9 MiB/s wr, 636 op/s 2023-10-08T13:10:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 250.0 s, 623.6 tps, lat 163.520 ms stddev 197.982 2023-10-08T13:10:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 -- 172.21.15.5:0/508090991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410f310 msgr2=0x7f0544107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 --2- 172.21.15.5:0/508090991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410f310 0x7f0544107d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f053c00b100 tx=0x7f053c00b410 comp rx=0 tx=0).stop 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 -- 172.21.15.5:0/508090991 shutdown_connections 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 --2- 172.21.15.5:0/508090991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0544119fd0 0x7f054411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 --2- 172.21.15.5:0/508090991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f054410eea0 0x7f05441077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 --2- 172.21.15.5:0/508090991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410f310 0x7f0544107d30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 -- 172.21.15.5:0/508090991 >> 172.21.15.5:0/508090991 conn(0x7f054406b7c0 msgr2=0x7f054406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 -- 172.21.15.5:0/508090991 shutdown_connections 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.227+0000 7f054a601700 1 -- 172.21.15.5:0/508090991 wait complete. 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.228+0000 7f054a601700 1 Processor -- start 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.228+0000 7f054a601700 1 -- start start 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f054a601700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410eea0 0x7f0544117900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f054a601700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054410f310 0x7f054410f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f054a601700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 0x7f054410fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f054a601700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544110570 con 0x7f054410f310 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f054a601700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05441106e0 con 0x7f054410eea0 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f054a601700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05441ba7c0 con 0x7f0544119fd0 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f0548b9e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 0x7f054410fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f0548b9e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 0x7f054410fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49416/0 (socket says 172.21.15.5:49416) 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f0548b9e700 1 -- 172.21.15.5:0/3537528743 learned_addr learned my addr 172.21.15.5:0/3537528743 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.229+0000 7f05437fe700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054410f310 0x7f054410f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.230+0000 7f0548b9e700 1 -- 172.21.15.5:0/3537528743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410eea0 msgr2=0x7f0544117900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:10:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.230+0000 7f0548b9e700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410eea0 0x7f0544117900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.230+0000 7f0548b9e700 1 -- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054410f310 msgr2=0x7f054410f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.230+0000 7f0548b9e700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054410f310 0x7f054410f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.230+0000 7f0548b9e700 1 -- 172.21.15.5:0/3537528743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c009d00 con 0x7f0544119fd0 2023-10-08T13:10:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.233+0000 7f0548b9e700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 0x7f054410fde0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f053400e970 tx=0x7f053400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.233+0000 7f05417fa700 1 -- 172.21.15.5:0/3537528743 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05340097b0 con 0x7f0544119fd0 2023-10-08T13:10:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.233+0000 7f05417fa700 1 -- 172.21.15.5:0/3537528743 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f053400eec0 con 0x7f0544119fd0 2023-10-08T13:10:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.233+0000 7f05417fa700 1 -- 172.21.15.5:0/3537528743 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534005560 con 0x7f0544119fd0 2023-10-08T13:10:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.237+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05441baaa0 con 0x7f0544119fd0 2023-10-08T13:10:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.237+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05441baf30 con 0x7f0544119fd0 2023-10-08T13:10:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.241+0000 7f05417fa700 1 -- 172.21.15.5:0/3537528743 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0534004750 con 0x7f0544119fd0 2023-10-08T13:10:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.242+0000 7f05417fa700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f052c0a17b0 0x7f052c0a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.242+0000 7f05567eab80 1 Processor -- start 2023-10-08T13:10:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.242+0000 7f05417fa700 1 -- 172.21.15.5:0/3537528743 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0534014070 con 0x7f0544119fd0 2023-10-08T13:10:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.243+0000 7f0543fff700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f052c0a17b0 0x7f052c0a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.243+0000 7f0543fff700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f052c0a17b0 0x7f052c0a3c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0538009af0 tx=0x7f0538009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 -- start start 2023-10-08T13:10:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e4575c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e4570510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e44d8400 con 0x5589e45700b0 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e44c9bc0 con 0x5589e45761a0 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f05567eab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e44c74e0 con 0x5589e4575880 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0543fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e4575c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0543fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e4575c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49422/0 (socket says 172.21.15.5:49422) 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0543fff700 1 -- 172.21.15.5:0/1496690956 learned_addr learned my addr 172.21.15.5:0/1496690956 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0548b9e700 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e4570510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0548b9e700 1 -- 172.21.15.5:0/1496690956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 msgr2=0x5589e4575c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0548b9e700 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e4575c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0548b9e700 1 -- 172.21.15.5:0/1496690956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 msgr2=0x5589e456fb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.244+0000 7f0548b9e700 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456fb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.245+0000 7f0548b9e700 1 -- 172.21.15.5:0/1496690956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589e42edd80 con 0x5589e45700b0 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.245+0000 7f0543fff700 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e4575c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:10:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.245+0000 7f0548b9e700 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e4570510 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f05340ca990 tx=0x7f0534099cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634cd7c0869f8d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.246+0000 7f052a7fc700 1 -- 172.21.15.5:0/1496690956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053409e370 con 0x5589e45700b0 2023-10-08T13:10:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.246+0000 7f052a7fc700 1 -- 172.21.15.5:0/1496690956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05340a25b0 con 0x5589e45700b0 2023-10-08T13:10:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.246+0000 7f052a7fc700 1 -- 172.21.15.5:0/1496690956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053409a6e0 con 0x5589e45700b0 2023-10-08T13:10:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 -- 172.21.15.5:0/1496690956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 msgr2=0x5589e4570510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e4570510 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f05340ca990 tx=0x7f0534099cb0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 -- 172.21.15.5:0/1496690956 shutdown_connections 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e4570510 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e4575c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 --2- 172.21.15.5:0/1496690956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 -- 172.21.15.5:0/1496690956 >> 172.21.15.5:0/1496690956 conn(0x5589e44e4200 msgr2=0x5589e456ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 -- 172.21.15.5:0/1496690956 shutdown_connections 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.247+0000 7f05567eab80 1 -- 172.21.15.5:0/1496690956 wait complete. 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 -- start start 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 Processor -- start 2023-10-08T13:10:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e4579550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e4579a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e4579fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e44c2dd0 con 0x5589e4575880 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e445f6b0 con 0x5589e45700b0 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.248+0000 7f05567eab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e445f350 con 0x5589e45761a0 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f05567eab80 10 client.0 _ll_register_callbacks cb 0x5589e42bc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f05437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e4579a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e4579550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f05437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e4579a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36224/0 (socket says 172.21.15.5:36224) 2023-10-08T13:10:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f05437fe700 1 -- 172.21.15.5:0/340435990 learned_addr learned my addr 172.21.15.5:0/340435990 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0548b9e700 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e4579fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 -- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 msgr2=0x5589e4579fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e4579fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 -- 172.21.15.5:0/340435990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 msgr2=0x5589e4579a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e4579a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 -- 172.21.15.5:0/340435990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053800e820 con 0x5589e45700b0 2023-10-08T13:10:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f0543fff700 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e4579550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f053801d660 tx=0x7f05380047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf41177637de474 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.249+0000 7f05237fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05237fe700 1 -- 172.21.15.5:0/340435990 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538010900 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05237fe700 1 -- 172.21.15.5:0/340435990 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0538010a60 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589e448ae50 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05237fe700 1 -- 172.21.15.5:0/340435990 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0538010c20 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 10 client.25895 fetch_fsmap learned FSMap version 40 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7f05441baf30 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05237fe700 1 -- 172.21.15.5:0/340435990 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5589e448ae50 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05237fe700 1 -- 172.21.15.5:0/340435990 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 40) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f0538018070 con 0x5589e45700b0 2023-10-08T13:10:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 10 client.25895 fetch_fsmap finished waiting for FSMap version 40 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 10 client.25895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 20 client.25895 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e45abe70 0x5589e45ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 4 client.25895 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589e44bbdb0 con 0x5589e45abe70 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.250+0000 7f05437fe700 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e45abe70 0x5589e45ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.251+0000 7f05237fe700 10 client.25895 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.251+0000 7f05437fe700 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e45abe70 0x5589e45ae290 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=795c61305a71ae40 server_cookie=a970a8d420f80446 in_seq=0 out_seq=0 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05237fe700 1 -- 172.21.15.5:0/340435990 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5589e44bbdb0 con 0x5589e45abe70 2023-10-08T13:10:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05237fe700 10 client.25895 handle_command_reply: tid=0 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 client.25895 shutdown 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 msgr2=0x5589e4579550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e4579550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f053801d660 tx=0x7f05380047c0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 shutdown_connections 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e4579fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e45abe70 0x5589e45ae290 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e4579550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 --2- 172.21.15.5:0/340435990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e4579a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05237fe700 0 client.25895 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 >> 172.21.15.5:0/340435990 conn(0x5589e44e4200 msgr2=0x5589e456a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 shutdown_connections 2023-10-08T13:10:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 1 -- 172.21.15.5:0/340435990 wait complete. 2023-10-08T13:10:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.252+0000 7f05567eab80 20 client.25895 trim_cache size 0 max 16384 2023-10-08T13:10:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.271+0000 7f05567eab80 1 Processor -- start 2023-10-08T13:10:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.271+0000 7f05567eab80 1 -- start start 2023-10-08T13:10:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05567eab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e456fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05567eab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e456a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05567eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05567eab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e43438c0 con 0x5589e45700b0 2023-10-08T13:10:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05567eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e4577590 con 0x5589e45761a0 2023-10-08T13:10:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05567eab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e4576010 con 0x5589e4575880 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e456fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e456fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36230/0 (socket says 172.21.15.5:36230) 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 -- 172.21.15.5:0/2861007860 learned_addr learned my addr 172.21.15.5:0/2861007860 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f05437fe700 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e456a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0548b9e700 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 -- 172.21.15.5:0/2861007860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 msgr2=0x5589e456a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e456a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 -- 172.21.15.5:0/2861007860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 msgr2=0x5589e456acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.272+0000 7f0543fff700 1 -- 172.21.15.5:0/2861007860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589e42d6c00 con 0x5589e45700b0 2023-10-08T13:10:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.273+0000 7f0543fff700 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e456fb70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0538013040 tx=0x7f053801de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3465a5b4a92dfcb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.273+0000 7f052affd700 1 -- 172.21.15.5:0/2861007860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538039070 con 0x5589e45700b0 2023-10-08T13:10:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.273+0000 7f052affd700 1 -- 172.21.15.5:0/2861007860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05380055b0 con 0x5589e45700b0 2023-10-08T13:10:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.273+0000 7f052affd700 1 -- 172.21.15.5:0/2861007860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538004b20 con 0x5589e45700b0 2023-10-08T13:10:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 -- 172.21.15.5:0/2861007860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 msgr2=0x5589e456fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e456fb70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0538013040 tx=0x7f053801de00 comp rx=0 tx=0).stop 2023-10-08T13:10:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 -- 172.21.15.5:0/2861007860 shutdown_connections 2023-10-08T13:10:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45761a0 0x5589e456acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e45700b0 0x5589e456fb70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 --2- 172.21.15.5:0/2861007860 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e4575880 0x5589e456a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 -- 172.21.15.5:0/2861007860 >> 172.21.15.5:0/2861007860 conn(0x5589e44e4200 msgr2=0x5589e4578de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 -- 172.21.15.5:0/2861007860 shutdown_connections 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 -- 172.21.15.5:0/2861007860 wait complete. 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 -- start start 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.274+0000 7f05567eab80 1 Processor -- start 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e45a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e45a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e45fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e45a19b0 con 0x5589e4575880 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e45a1b20 con 0x5589e45700b0 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e45ff220 con 0x5589e45761a0 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05567eab80 10 client.0 _ll_register_callbacks cb 0x7f053800ee50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e45a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f0543fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e45a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f0548b9e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e45fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f0543fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e45a0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59418/0 (socket says 172.21.15.5:59418) 2023-10-08T13:10:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f05437fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e45a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36238/0 (socket says 172.21.15.5:36238) 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.275+0000 7f0543fff700 1 -- 172.21.15.5:0/2795528286 learned_addr learned my addr 172.21.15.5:0/2795528286 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.276+0000 7f0543fff700 1 -- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 msgr2=0x5589e45fec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.276+0000 7f0543fff700 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e45fec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.276+0000 7f0543fff700 1 -- 172.21.15.5:0/2795528286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 msgr2=0x5589e45a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.276+0000 7f0543fff700 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e45a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.276+0000 7f0543fff700 1 -- 172.21.15.5:0/2795528286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05441baf30 con 0x5589e45700b0 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.277+0000 7f0543fff700 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e45a0c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f053801d660 tx=0x7f0538010cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e951a4c8395bb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.277+0000 7f05237fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.277+0000 7f0548b9e700 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e45fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:10:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.277+0000 7f05237fe700 1 -- 172.21.15.5:0/2795528286 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538039070 con 0x5589e45700b0 2023-10-08T13:10:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.277+0000 7f05237fe700 1 -- 172.21.15.5:0/2795528286 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f05380196c0 con 0x5589e45700b0 2023-10-08T13:10:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.277+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05340a25b0 con 0x5589e45700b0 2023-10-08T13:10:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05237fe700 1 -- 172.21.15.5:0/2795528286 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0538019880 con 0x5589e45700b0 2023-10-08T13:10:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05567eab80 10 client.25901 fetch_fsmap learned FSMap version 40 2023-10-08T13:10:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5589e43141f0 con 0x5589e45700b0 2023-10-08T13:10:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05237fe700 1 -- 172.21.15.5:0/2795528286 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05340a25b0 con 0x5589e45700b0 2023-10-08T13:10:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05237fe700 1 -- 172.21.15.5:0/2795528286 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 40) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f0538046070 con 0x5589e45700b0 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05567eab80 10 client.25901 fetch_fsmap finished waiting for FSMap version 40 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05567eab80 10 client.25901 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.278+0000 7f05567eab80 20 client.25901 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.279+0000 7f05567eab80 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e46007d0 0x5589e4602bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.279+0000 7f05567eab80 4 client.25901 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.279+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5589e44bbad0 con 0x5589e46007d0 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.279+0000 7f05437fe700 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e46007d0 0x5589e4602bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.279+0000 7f05237fe700 10 client.25901 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.279+0000 7f05437fe700 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e46007d0 0x5589e4602bf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b612db404981cf server_cookie=45fe19ad4298c4c in_seq=0 out_seq=0 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05237fe700 1 -- 172.21.15.5:0/2795528286 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5589e44bbad0 con 0x5589e46007d0 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05237fe700 10 client.25901 handle_command_reply: tid=0 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 client.25901 shutdown 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 msgr2=0x5589e45a0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e45a0c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f053801d660 tx=0x7f0538010cd0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 shutdown_connections 2023-10-08T13:10:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5589e45761a0 0x5589e45fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5589e46007d0 0x5589e4602bf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589e45700b0 0x5589e45a0c60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05237fe700 0 client.25901 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 --2- 172.21.15.5:0/2795528286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589e4575880 0x5589e45a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.293+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 >> 172.21.15.5:0/2795528286 conn(0x5589e44e4200 msgr2=0x5589e4578310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 shutdown_connections 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f05567eab80 1 -- 172.21.15.5:0/2795528286 wait complete. 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f05567eab80 20 client.25901 trim_cache size 0 max 16384 2023-10-08T13:10:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:10:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:10:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:10:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:10:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f052c0a17b0 msgr2=0x7f052c0a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f052c0a17b0 0x7f052c0a3c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0538009af0 tx=0x7f0538009260 comp rx=0 tx=0).stop 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 msgr2=0x7f054410fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 0x7f054410fde0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f053400e970 tx=0x7f053400ec80 comp rx=0 tx=0).stop 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 shutdown_connections 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f052c0a17b0 0x7f052c0a3c70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0544119fd0 0x7f054410fde0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f054410eea0 0x7f0544117900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 --2- 172.21.15.5:0/3537528743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f054410f310 0x7f054410f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.294+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 >> 172.21.15.5:0/3537528743 conn(0x7f054406b7c0 msgr2=0x7f0544117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.295+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 shutdown_connections 2023-10-08T13:10:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:33.295+0000 7f054a601700 1 -- 172.21.15.5:0/3537528743 wait complete. 2023-10-08T13:10:33.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:33 smithi118 ceph-mon[104234]: pgmap v436: 129 pgs: 129 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.6 MiB/s wr, 691 op/s 2023-10-08T13:10:33.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:33 smithi060 ceph-mon[103190]: pgmap v436: 129 pgs: 129 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.6 MiB/s wr, 691 op/s 2023-10-08T13:10:33.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:33 smithi005 ceph-mon[99496]: pgmap v436: 129 pgs: 129 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.6 MiB/s wr, 691 op/s 2023-10-08T13:10:34.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:34 smithi118 ceph-mon[104234]: pgmap v437: 129 pgs: 129 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 670 op/s 2023-10-08T13:10:34.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:34 smithi060 ceph-mon[103190]: pgmap v437: 129 pgs: 129 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 670 op/s 2023-10-08T13:10:34.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:34 smithi005 ceph-mon[99496]: pgmap v437: 129 pgs: 129 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.8 MiB/s wr, 670 op/s 2023-10-08T13:10:35.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:35 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:35.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:35 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:35.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:35 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:36.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:36 smithi060 ceph-mon[103190]: pgmap v438: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 655 op/s 2023-10-08T13:10:36.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:36 smithi005 ceph-mon[99496]: pgmap v438: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 655 op/s 2023-10-08T13:10:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 255.0 s, 745.6 tps, lat 133.392 ms stddev 142.054 2023-10-08T13:10:36.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:36 smithi118 ceph-mon[104234]: pgmap v438: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 655 op/s 2023-10-08T13:10:38.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:38 smithi060 ceph-mon[103190]: pgmap v439: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 716 op/s 2023-10-08T13:10:38.676 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:38 smithi005 ceph-mon[99496]: pgmap v439: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 716 op/s 2023-10-08T13:10:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:38 smithi118 ceph-mon[104234]: pgmap v439: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 716 op/s 2023-10-08T13:10:40.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:40 smithi060 ceph-mon[103190]: pgmap v440: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 686 op/s 2023-10-08T13:10:40.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:40 smithi005 ceph-mon[99496]: pgmap v440: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 686 op/s 2023-10-08T13:10:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:40 smithi118 ceph-mon[104234]: pgmap v440: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 686 op/s 2023-10-08T13:10:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 260.0 s, 823.6 tps, lat 111.059 ms stddev 129.454 2023-10-08T13:10:42.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.456+0000 7fb45e963700 1 -- 172.21.15.5:0/4241776535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458102860 msgr2=0x7fb458102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.456+0000 7fb45e963700 1 --2- 172.21.15.5:0/4241776535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458102860 0x7fb458102ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0098f0 tx=0x7fb44c009c00 comp rx=0 tx=0).stop 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.462+0000 7fb45e963700 1 -- 172.21.15.5:0/4241776535 shutdown_connections 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.462+0000 7fb45e963700 1 --2- 172.21.15.5:0/4241776535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458103220 0x7fb45810f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.462+0000 7fb45e963700 1 --2- 172.21.15.5:0/4241776535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb458108870 0x7fb458108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.462+0000 7fb45e963700 1 --2- 172.21.15.5:0/4241776535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458102860 0x7fb458102ce0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.462+0000 7fb45e963700 1 -- 172.21.15.5:0/4241776535 >> 172.21.15.5:0/4241776535 conn(0x7fb4580fe2f0 msgr2=0x7fb458100710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.463+0000 7fb45e963700 1 -- 172.21.15.5:0/4241776535 shutdown_connections 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.463+0000 7fb45e963700 1 -- 172.21.15.5:0/4241776535 wait complete. 2023-10-08T13:10:42.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.463+0000 7fb45e963700 1 Processor -- start 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 -- start start 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458102860 0x7fb45810e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458103220 0x7fb45810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb458108870 0x7fb4581a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581a9330 con 0x7fb458103220 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458111860 con 0x7fb458108870 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.464+0000 7fb45e963700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458111a20 con 0x7fb458102860 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.465+0000 7fb4577fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458103220 0x7fb45810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.465+0000 7fb4577fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458103220 0x7fb45810e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36254/0 (socket says 172.21.15.5:36254) 2023-10-08T13:10:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.465+0000 7fb4577fe700 1 -- 172.21.15.5:0/255055313 learned_addr learned my addr 172.21.15.5:0/255055313 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.465+0000 7fb457fff700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458102860 0x7fb45810e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.465+0000 7fb45cf00700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb458108870 0x7fb4581a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.469+0000 7fb457fff700 1 -- 172.21.15.5:0/255055313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb458108870 msgr2=0x7fb4581a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.469+0000 7fb457fff700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb458108870 0x7fb4581a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.469+0000 7fb457fff700 1 -- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458103220 msgr2=0x7fb45810e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.469+0000 7fb457fff700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458103220 0x7fb45810e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.469+0000 7fb457fff700 1 -- 172.21.15.5:0/255055313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009520 con 0x7fb458102860 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.472+0000 7fb457fff700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458102860 0x7fb45810e050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb44800b450 tx=0x7fb44800b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.473+0000 7fb4557fa700 1 -- 172.21.15.5:0/255055313 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448011830 con 0x7fb458102860 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.473+0000 7fb4557fa700 1 -- 172.21.15.5:0/255055313 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb44800be60 con 0x7fb458102860 2023-10-08T13:10:42.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.473+0000 7fb4557fa700 1 -- 172.21.15.5:0/255055313 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448010de0 con 0x7fb458102860 2023-10-08T13:10:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.475+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458111d00 con 0x7fb458102860 2023-10-08T13:10:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.475+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458112190 con 0x7fb458102860 2023-10-08T13:10:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.485+0000 7fb46ab4cb80 1 Processor -- start 2023-10-08T13:10:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.486+0000 7fb46ab4cb80 1 -- start start 2023-10-08T13:10:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2289260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e2294110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2296a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e21f2460 con 0x55b8e22897a0 2023-10-08T13:10:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e21e3c20 con 0x55b8e2294650 2023-10-08T13:10:42.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e21e1540 con 0x55b8e2288e80 2023-10-08T13:10:42.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb45cf00700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2289260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb45cf00700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2289260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49460/0 (socket says 172.21.15.5:49460) 2023-10-08T13:10:42.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb45cf00700 1 -- 172.21.15.5:0/874012046 learned_addr learned my addr 172.21.15.5:0/874012046 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:42.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.499+0000 7fb4557fa700 1 -- 172.21.15.5:0/255055313 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb448010480 con 0x7fb458102860 2023-10-08T13:10:42.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.500+0000 7fb4557fa700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4400a1730 0x7fb4400a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.501+0000 7fb4557fa700 1 -- 172.21.15.5:0/255055313 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb4480ccc90 con 0x7fb458102860 2023-10-08T13:10:42.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.501+0000 7fb45cf00700 1 -- 172.21.15.5:0/874012046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 msgr2=0x55b8e2296a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.501+0000 7fb45cf00700 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2296a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.501+0000 7fb45cf00700 1 -- 172.21.15.5:0/874012046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 msgr2=0x55b8e2294110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.501+0000 7fb45cf00700 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e2294110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.501+0000 7fb45cf00700 1 -- 172.21.15.5:0/874012046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8e2007de0 con 0x55b8e2288e80 2023-10-08T13:10:42.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.505+0000 7fb45cf00700 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2289260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4500116a0 tx=0x7fb4500099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45770cdd80005e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:42.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.510+0000 7fb45cf00700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4400a1730 0x7fb4400a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.511+0000 7fb45cf00700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4400a1730 0x7fb4400a3bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb45001b000 tx=0x7fb45001eb60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.514+0000 7fb43e7fc700 1 -- 172.21.15.5:0/874012046 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000e040 con 0x55b8e2288e80 2023-10-08T13:10:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.515+0000 7fb43e7fc700 1 -- 172.21.15.5:0/874012046 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb45000f040 con 0x55b8e2288e80 2023-10-08T13:10:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.515+0000 7fb43e7fc700 1 -- 172.21.15.5:0/874012046 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45001e450 con 0x55b8e2288e80 2023-10-08T13:10:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.522+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/874012046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 msgr2=0x55b8e2289260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.522+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2289260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4500116a0 tx=0x7fb4500099e0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/874012046 shutdown_connections 2023-10-08T13:10:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2296a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2289260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/874012046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e2294110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/874012046 >> 172.21.15.5:0/874012046 conn(0x55b8e21fe260 msgr2=0x55b8e22852d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/874012046 shutdown_connections 2023-10-08T13:10:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.528+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/874012046 wait complete. 2023-10-08T13:10:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.529+0000 7fb46ab4cb80 1 -- start start 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.529+0000 7fb46ab4cb80 1 Processor -- start 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.529+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2294080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.529+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e22913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.530+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2291b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.530+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e21dce30 con 0x55b8e22897a0 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.530+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e2179710 con 0x55b8e2294650 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.530+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e21793b0 con 0x55b8e2288e80 2023-10-08T13:10:42.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.530+0000 7fb46ab4cb80 10 client.0 _ll_register_callbacks cb 0x55b8e1fd6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2291b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2291b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59444/0 (socket says 172.21.15.5:59444) 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 -- 172.21.15.5:0/2285173815 learned_addr learned my addr 172.21.15.5:0/2285173815 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 -- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 msgr2=0x55b8e2294080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2294080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 -- 172.21.15.5:0/2285173815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 msgr2=0x55b8e22913c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e22913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 -- 172.21.15.5:0/2285173815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb450011350 con 0x55b8e2294650 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.532+0000 7fb45cf00700 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2291b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb45001efd0 tx=0x7fb45001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46b24b77ac549cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:42.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.535+0000 7fb4377fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:10:42.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.547+0000 7fb4377fe700 1 -- 172.21.15.5:0/2285173815 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000e070 con 0x55b8e2294650 2023-10-08T13:10:42.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.547+0000 7fb4377fe700 1 -- 172.21.15.5:0/2285173815 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb450015640 con 0x55b8e2294650 2023-10-08T13:10:42.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.550+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8e21a4eb0 con 0x55b8e2294650 2023-10-08T13:10:42.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.556+0000 7fb4377fe700 1 -- 172.21.15.5:0/2285173815 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb450009490 con 0x55b8e2294650 2023-10-08T13:10:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.559+0000 7fb46ab4cb80 10 client.25907 fetch_fsmap learned FSMap version 41 2023-10-08T13:10:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.559+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b8e1ff0c60 con 0x55b8e2294650 2023-10-08T13:10:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb4377fe700 1 -- 172.21.15.5:0/2285173815 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b8e21a4eb0 con 0x55b8e2294650 2023-10-08T13:10:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb4377fe700 1 -- 172.21.15.5:0/2285173815 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 41) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb450027070 con 0x55b8e2294650 2023-10-08T13:10:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb46ab4cb80 10 client.25907 fetch_fsmap finished waiting for FSMap version 41 2023-10-08T13:10:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb46ab4cb80 10 client.25907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb46ab4cb80 20 client.25907 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22a4150 0x55b8e22a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb46ab4cb80 4 client.25907 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:10:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.573+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8e21d5e10 con 0x55b8e22a4150 2023-10-08T13:10:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.578+0000 7fb457fff700 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22a4150 0x55b8e22a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.579+0000 7fb457fff700 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22a4150 0x55b8e22a6570 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb6f0bf4a14a97f server_cookie=89f5908f89f79109 in_seq=0 out_seq=0 2023-10-08T13:10:42.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.583+0000 7fb4377fe700 10 client.25907 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.587+0000 7fb4377fe700 1 -- 172.21.15.5:0/2285173815 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b8e21d5e10 con 0x55b8e22a4150 2023-10-08T13:10:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.588+0000 7fb4377fe700 10 client.25907 handle_command_reply: tid=0 2023-10-08T13:10:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.588+0000 7fb46ab4cb80 1 client.25907 shutdown 2023-10-08T13:10:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.600+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 msgr2=0x55b8e2291b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.600+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2291b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb45001efd0 tx=0x7fb45001c000 comp rx=0 tx=0).stop 2023-10-08T13:10:42.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 shutdown_connections 2023-10-08T13:10:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22a4150 0x55b8e22a6570 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2291b00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e2294080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2285173815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e22913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 >> 172.21.15.5:0/2285173815 conn(0x55b8e21fe260 msgr2=0x55b8e2284ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.608+0000 7fb4377fe700 0 client.25907 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:42.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.611+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 shutdown_connections 2023-10-08T13:10:42.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.621+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2285173815 wait complete. 2023-10-08T13:10:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.630+0000 7fb46ab4cb80 20 client.25907 trim_cache size 0 max 16384 2023-10-08T13:10:42.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:42 smithi060 ceph-mon[103190]: pgmap v441: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.7 MiB/s wr, 638 op/s 2023-10-08T13:10:42.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:42 smithi005 ceph-mon[99496]: pgmap v441: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.7 MiB/s wr, 638 op/s 2023-10-08T13:10:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 Processor -- start 2023-10-08T13:10:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 -- start start 2023-10-08T13:10:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e229b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e228c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2284d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e205d920 con 0x55b8e22897a0 2023-10-08T13:10:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e21a4eb0 con 0x55b8e2294650 2023-10-08T13:10:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.676+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e22929c0 con 0x55b8e2288e80 2023-10-08T13:10:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.679+0000 7fb457fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e229b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.679+0000 7fb457fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e229b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49472/0 (socket says 172.21.15.5:49472) 2023-10-08T13:10:42.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.679+0000 7fb457fff700 1 -- 172.21.15.5:0/2670433737 learned_addr learned my addr 172.21.15.5:0/2670433737 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.685+0000 7fb45cf00700 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2284d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e228c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 -- 172.21.15.5:0/2670433737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 msgr2=0x55b8e229b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e229b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 -- 172.21.15.5:0/2670433737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 msgr2=0x55b8e2284d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2284d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 -- 172.21.15.5:0/2670433737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8e22ab1e0 con 0x55b8e22897a0 2023-10-08T13:10:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.686+0000 7fb4577fe700 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e228c750 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0098c0 tx=0x7fb44c0050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b79d24927ec99b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.687+0000 7fb43effd700 1 -- 172.21.15.5:0/2670433737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c01c050 con 0x55b8e22897a0 2023-10-08T13:10:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.687+0000 7fb43effd700 1 -- 172.21.15.5:0/2670433737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb44c01d040 con 0x55b8e22897a0 2023-10-08T13:10:42.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.687+0000 7fb43effd700 1 -- 172.21.15.5:0/2670433737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00ba60 con 0x55b8e22897a0 2023-10-08T13:10:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.690+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2670433737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 msgr2=0x55b8e228c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.690+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e228c750 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0098c0 tx=0x7fb44c0050f0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.691+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2670433737 shutdown_connections 2023-10-08T13:10:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.691+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e2294650 0x55b8e2284d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.691+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2288e80 0x55b8e229b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.691+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/2670433737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e22897a0 0x55b8e228c750 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.691+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2670433737 >> 172.21.15.5:0/2670433737 conn(0x55b8e21fe260 msgr2=0x55b8e229f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:42.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.710+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2670433737 shutdown_connections 2023-10-08T13:10:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.710+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/2670433737 wait complete. 2023-10-08T13:10:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.710+0000 7fb46ab4cb80 1 -- start start 2023-10-08T13:10:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 Processor -- start 2023-10-08T13:10:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 0x55b8e2299050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e22897a0 0x55b8e2299590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2294650 0x55b8e22f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e22f7500 con 0x55b8e2288e80 2023-10-08T13:10:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e22f7640 con 0x55b8e22897a0 2023-10-08T13:10:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e22f7780 con 0x55b8e2294650 2023-10-08T13:10:42.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.711+0000 7fb46ab4cb80 10 client.0 _ll_register_callbacks cb 0x55b8e1fd6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:42.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 0x55b8e2299050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 0x55b8e2299050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36274/0 (socket says 172.21.15.5:36274) 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 -- 172.21.15.5:0/1530596840 learned_addr learned my addr 172.21.15.5:0/1530596840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 -- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2294650 msgr2=0x55b8e22f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2294650 0x55b8e22f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 -- 172.21.15.5:0/1530596840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e22897a0 msgr2=0x55b8e2299590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e22897a0 0x55b8e2299590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.712+0000 7fb457fff700 1 -- 172.21.15.5:0/1530596840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458110030 con 0x55b8e2288e80 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb457fff700 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 0x55b8e2299050 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb448099970 tx=0x7fb448004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b2d780abfcd7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb4377fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb4377fe700 1 -- 172.21.15.5:0/1530596840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480b2270 con 0x55b8e2288e80 2023-10-08T13:10:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb4377fe700 1 -- 172.21.15.5:0/1530596840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb44809a0e0 con 0x55b8e2288e80 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb45000f040 con 0x55b8e2288e80 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb4377fe700 1 -- 172.21.15.5:0/1530596840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4480999e0 con 0x55b8e2288e80 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb46ab4cb80 10 client.16410 fetch_fsmap learned FSMap version 41 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.713+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b8e202e250 con 0x55b8e2288e80 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb4377fe700 1 -- 172.21.15.5:0/1530596840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb45000f040 con 0x55b8e2288e80 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb4377fe700 1 -- 172.21.15.5:0/1530596840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb448098ed0 con 0x55b8e2288e80 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb46ab4cb80 10 client.16410 fetch_fsmap finished waiting for FSMap version 41 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb46ab4cb80 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb46ab4cb80 20 client.16410 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22f8fe0 0x55b8e22fb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb46ab4cb80 4 client.16410 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:10:42.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.714+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b8e21d5b30 con 0x55b8e22f8fe0 2023-10-08T13:10:42.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.724+0000 7fb4577fe700 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22f8fe0 0x55b8e22fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.740+0000 7fb4377fe700 10 client.16410 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.740+0000 7fb4577fe700 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22f8fe0 0x55b8e22fb460 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35a67083adefe3 server_cookie=8f9d746616163657 in_seq=0 out_seq=0 2023-10-08T13:10:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.740+0000 7fb4377fe700 1 -- 172.21.15.5:0/1530596840 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b8e21d5b30 con 0x55b8e22f8fe0 2023-10-08T13:10:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.740+0000 7fb4377fe700 10 client.16410 handle_command_reply: tid=0 2023-10-08T13:10:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.740+0000 7fb46ab4cb80 1 client.16410 shutdown 2023-10-08T13:10:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.741+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 msgr2=0x55b8e2299050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.741+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 0x55b8e2299050 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb448099970 tx=0x7fb448004860 comp rx=0 tx=0).stop 2023-10-08T13:10:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 shutdown_connections 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8e2294650 0x55b8e22f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8e2288e80 0x55b8e2299050 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8e22f8fe0 0x55b8e22fb460 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb46ab4cb80 1 --2- 172.21.15.5:0/1530596840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8e22897a0 0x55b8e2299590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb4377fe700 0 client.16410 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.750+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 >> 172.21.15.5:0/1530596840 conn(0x55b8e21fe260 msgr2=0x55b8e228c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.751+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 shutdown_connections 2023-10-08T13:10:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.751+0000 7fb46ab4cb80 1 -- 172.21.15.5:0/1530596840 wait complete. 2023-10-08T13:10:42.764 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:10:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:10:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:10:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:10:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:10:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:10:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:10:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:10:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:10:42.765 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:10:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.760+0000 7fb46ab4cb80 20 client.16410 trim_cache size 0 max 16384 2023-10-08T13:10:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.768+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4400a1730 msgr2=0x7fb4400a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.768+0000 7fb45e963700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4400a1730 0x7fb4400a3bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb45001b000 tx=0x7fb45001eb60 comp rx=0 tx=0).stop 2023-10-08T13:10:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.768+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458102860 msgr2=0x7fb45810e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.768+0000 7fb45e963700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458102860 0x7fb45810e050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb44800b450 tx=0x7fb44800b760 comp rx=0 tx=0).stop 2023-10-08T13:10:42.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:42 smithi118 ceph-mon[104234]: pgmap v441: 129 pgs: 129 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.7 MiB/s wr, 638 op/s 2023-10-08T13:10:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 shutdown_connections 2023-10-08T13:10:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb4400a1730 0x7fb4400a3bf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb458108870 0x7fb4581a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb458102860 0x7fb45810e050 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 --2- 172.21.15.5:0/255055313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb458103220 0x7fb45810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 >> 172.21.15.5:0/255055313 conn(0x7fb4580fe2f0 msgr2=0x7fb4581005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 shutdown_connections 2023-10-08T13:10:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:10:42.780+0000 7fb45e963700 1 -- 172.21.15.5:0/255055313 wait complete. 2023-10-08T13:10:42.812 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:10:44.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:44 smithi060 ceph-mon[103190]: pgmap v442: 129 pgs: 129 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 851 op/s 2023-10-08T13:10:44.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:44 smithi005 ceph-mon[99496]: pgmap v442: 129 pgs: 129 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 851 op/s 2023-10-08T13:10:44.776 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:44 smithi118 ceph-mon[104234]: pgmap v442: 129 pgs: 129 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 851 op/s 2023-10-08T13:10:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.463+0000 7f2ef7b53700 1 -- 172.21.15.5:0/2854790951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 msgr2=0x7f2ef00ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.463+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/2854790951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef00ffa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0098f0 tx=0x7f2eec009c00 comp rx=0 tx=0).stop 2023-10-08T13:10:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 -- 172.21.15.5:0/2854790951 shutdown_connections 2023-10-08T13:10:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/2854790951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ef00fff50 0x7f2ef010c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/2854790951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ef0105650 0x7f2ef0105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/2854790951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef00ffa10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 -- 172.21.15.5:0/2854790951 >> 172.21.15.5:0/2854790951 conn(0x7f2ef00fb040 msgr2=0x7f2ef00fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 -- 172.21.15.5:0/2854790951 shutdown_connections 2023-10-08T13:10:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.464+0000 7f2ef7b53700 1 -- 172.21.15.5:0/2854790951 wait complete. 2023-10-08T13:10:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 Processor -- start 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 -- start start 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef01957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ef00fff50 0x7f2ef0195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ef0105650 0x7f2ef0196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01a4ed0 con 0x7f2ef00fff50 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01a5040 con 0x7f2ef0105650 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.465+0000 7f2ef7b53700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01a5200 con 0x7f2ef00ff590 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef01957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef01957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49492/0 (socket says 172.21.15.5:49492) 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef50ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ef00fff50 0x7f2ef0195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 -- 172.21.15.5:0/87151457 learned_addr learned my addr 172.21.15.5:0/87151457 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:46.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 -- 172.21.15.5:0/87151457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ef0105650 msgr2=0x7f2ef0196240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:10:46.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ef0105650 0x7f2ef0196240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 -- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ef00fff50 msgr2=0x7f2ef0195d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ef00fff50 0x7f2ef0195d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 -- 172.21.15.5:0/87151457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009520 con 0x7f2ef00ff590 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef01957c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000e9c0 tx=0x7f2ee000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.466+0000 7f2ee6ffd700 1 -- 172.21.15.5:0/87151457 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000cbd0 con 0x7f2ef00ff590 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.467+0000 7f2ee6ffd700 1 -- 172.21.15.5:0/87151457 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ee000eeb0 con 0x7f2ef00ff590 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.467+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef01a54e0 con 0x7f2ef00ff590 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.467+0000 7f2ee6ffd700 1 -- 172.21.15.5:0/87151457 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0005580 con 0x7f2ef00ff590 2023-10-08T13:10:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.467+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef01a5a90 con 0x7f2ef00ff590 2023-10-08T13:10:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.470+0000 7f2ee6ffd700 1 -- 172.21.15.5:0/87151457 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2ee0021440 con 0x7f2ef00ff590 2023-10-08T13:10:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.471+0000 7f2f03d3cb80 1 Processor -- start 2023-10-08T13:10:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.471+0000 7f2ee6ffd700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2edc0a1660 0x7f2edc0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.471+0000 7f2ee6ffd700 1 -- 172.21.15.5:0/87151457 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2ee0014070 con 0x7f2ef00ff590 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 -- start start 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 0x56330f84f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f849380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f849d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f7a9400 con 0x56330f84f9b0 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f79abc0 con 0x56330f84f090 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.484+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f7984e0 con 0x56330f8498c0 2023-10-08T13:10:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.489+0000 7f2ef50ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f849380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.489+0000 7f2ef50ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f849380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36294/0 (socket says 172.21.15.5:36294) 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.490+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3902463901 learned_addr learned my addr 172.21.15.5:0/3902463901 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.490+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3902463901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 msgr2=0x56330f849d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.490+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f849d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.490+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3902463901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 msgr2=0x56330f84f470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.490+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 0x56330f84f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.490+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3902463901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56330f5bed80 con 0x56330f84f9b0 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.491+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f849380 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009230 tx=0x7f2eec009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e313eefed9c355 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.493+0000 7f2edbfff700 1 -- 172.21.15.5:0/3902463901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00f660 con 0x56330f84f9b0 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.493+0000 7f2edbfff700 1 -- 172.21.15.5:0/3902463901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eec01d040 con 0x56330f84f9b0 2023-10-08T13:10:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.493+0000 7f2edbfff700 1 -- 172.21.15.5:0/3902463901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec005280 con 0x56330f84f9b0 2023-10-08T13:10:46.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.495+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2edc0a1660 0x7f2edc0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.497+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3902463901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 msgr2=0x56330f849380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.497+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f849380 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009230 tx=0x7f2eec009400 comp rx=0 tx=0).stop 2023-10-08T13:10:46.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.504+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3902463901 shutdown_connections 2023-10-08T13:10:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.504+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f849d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.504+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 0x56330f84f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.504+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3902463901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f849380 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.504+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3902463901 >> 172.21.15.5:0/3902463901 conn(0x56330f7b5200 msgr2=0x56330f83bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:46.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.505+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2edc0a1660 0x7f2edc0a3b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800ab30 tx=0x7f2ee8009250 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.514+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3902463901 shutdown_connections 2023-10-08T13:10:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.517+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3902463901 wait complete. 2023-10-08T13:10:46.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.517+0000 7f2f03d3cb80 1 -- start start 2023-10-08T13:10:46.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.517+0000 7f2f03d3cb80 1 Processor -- start 2023-10-08T13:10:46.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f843000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 0x56330f843540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f848d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f793dd0 con 0x56330f84f9b0 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f7306b0 con 0x56330f84f090 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f730350 con 0x56330f8498c0 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.518+0000 7f2f03d3cb80 10 client.0 _ll_register_callbacks cb 0x56330f58d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f848d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f848d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36296/0 (socket says 172.21.15.5:36296) 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 -- 172.21.15.5:0/2630127753 learned_addr learned my addr 172.21.15.5:0/2630127753 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:46.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f843000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 -- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 msgr2=0x56330f843000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f843000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 -- 172.21.15.5:0/2630127753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 msgr2=0x56330f843540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.522+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 0x56330f843540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.523+0000 7f2ef60f0700 1 -- 172.21.15.5:0/2630127753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef010cd10 con 0x56330f84f9b0 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.523+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f848d70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800d920 tx=0x7f2ee8004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bb714d212b76d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:46.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.523+0000 7f2ed97fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.524+0000 7f2ed97fa700 1 -- 172.21.15.5:0/2630127753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee803c820 con 0x56330f84f9b0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.524+0000 7f2ed97fa700 1 -- 172.21.15.5:0/2630127753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2ee8006e40 con 0x56330f84f9b0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.524+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56330f75be50 con 0x56330f84f9b0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.524+0000 7f2ed97fa700 1 -- 172.21.15.5:0/2630127753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ee803c980 con 0x56330f84f9b0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.524+0000 7f2f03d3cb80 10 client.16419 fetch_fsmap learned FSMap version 41 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.524+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56330f5a7c00 con 0x56330f84f9b0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2ed97fa700 1 -- 172.21.15.5:0/2630127753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56330f75be50 con 0x56330f84f9b0 2023-10-08T13:10:46.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2ed97fa700 1 -- 172.21.15.5:0/2630127753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2ee8042020 con 0x56330f84f9b0 2023-10-08T13:10:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2f03d3cb80 10 client.16419 fetch_fsmap finished waiting for FSMap version 41 2023-10-08T13:10:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2f03d3cb80 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2f03d3cb80 20 client.16419 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8587e0 0x56330f85ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2f03d3cb80 4 client.16419 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:10:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.525+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56330f78cdb0 con 0x56330f8587e0 2023-10-08T13:10:46.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.526+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8587e0 0x56330f85ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.537+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8587e0 0x56330f85ac00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67cbac6c3a1ccdee server_cookie=ba9d3bc3670b1d9f in_seq=0 out_seq=0 2023-10-08T13:10:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.537+0000 7f2ed97fa700 10 client.16419 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.539+0000 7f2ed97fa700 1 -- 172.21.15.5:0/2630127753 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56330f78cdb0 con 0x56330f8587e0 2023-10-08T13:10:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.539+0000 7f2ed97fa700 10 client.16419 handle_command_reply: tid=0 2023-10-08T13:10:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.539+0000 7f2f03d3cb80 1 client.16419 shutdown 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 msgr2=0x56330f848d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f848d70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800d920 tx=0x7f2ee8004be0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 shutdown_connections 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f9b0 0x56330f848d70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f843000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8587e0 0x56330f85ac00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/2630127753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f090 0x56330f843540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 >> 172.21.15.5:0/2630127753 conn(0x56330f7b5200 msgr2=0x56330f83b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2ed97fa700 0 client.16419 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 shutdown_connections 2023-10-08T13:10:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/2630127753 wait complete. 2023-10-08T13:10:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.549+0000 7f2f03d3cb80 20 client.16419 trim_cache size 0 max 16384 2023-10-08T13:10:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.575+0000 7f2f03d3cb80 1 Processor -- start 2023-10-08T13:10:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 -- start start 2023-10-08T13:10:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f83b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f83bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f842c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f6148c0 con 0x56330f84f090 2023-10-08T13:10:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f8362b0 con 0x56330f84f9b0 2023-10-08T13:10:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.577+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f838830 con 0x56330f8498c0 2023-10-08T13:10:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.578+0000 7f2ef60f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f842c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.578+0000 7f2ef60f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f842c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59488/0 (socket says 172.21.15.5:59488) 2023-10-08T13:10:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.578+0000 7f2ef60f0700 1 -- 172.21.15.5:0/1473242153 learned_addr learned my addr 172.21.15.5:0/1473242153 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.578+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f83bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef60f0700 1 -- 172.21.15.5:0/1473242153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 msgr2=0x56330f83b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f83b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef60f0700 1 -- 172.21.15.5:0/1473242153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 msgr2=0x56330f83bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f83bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef60f0700 1 -- 172.21.15.5:0/1473242153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56330f5e51f0 con 0x56330f84f9b0 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f83bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.583+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f842c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ee804ee10 tx=0x7f2ee8007120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218b8f0b9c8ae188 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.584+0000 7f2ee4d82700 1 -- 172.21.15.5:0/1473242153 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8044400 con 0x56330f84f9b0 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.584+0000 7f2ee4d82700 1 -- 172.21.15.5:0/1473242153 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ee8044560 con 0x56330f84f9b0 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.584+0000 7f2ee4d82700 1 -- 172.21.15.5:0/1473242153 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee804e960 con 0x56330f84f9b0 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.585+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/1473242153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 msgr2=0x56330f842c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.585+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f842c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ee804ee10 tx=0x7f2ee8007120 comp rx=0 tx=0).stop 2023-10-08T13:10:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.586+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/1473242153 shutdown_connections 2023-10-08T13:10:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.586+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f842c00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.586+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f83b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.586+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/1473242153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f83bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.586+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/1473242153 >> 172.21.15.5:0/1473242153 conn(0x56330f7b5200 msgr2=0x56330f854b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.593+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/1473242153 shutdown_connections 2023-10-08T13:10:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.599+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/1473242153 wait complete. 2023-10-08T13:10:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 -- start start 2023-10-08T13:10:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 Processor -- start 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f8534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f853a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f853f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f8a9870 con 0x56330f84f090 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f8a99e0 con 0x56330f84f9b0 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330f8a9ba0 con 0x56330f8498c0 2023-10-08T13:10:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.600+0000 7f2f03d3cb80 10 client.0 _ll_register_callbacks cb 0x7f2ee800cee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:10:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.601+0000 7f2ef50ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f853a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.601+0000 7f2ef50ee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f853a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36310/0 (socket says 172.21.15.5:36310) 2023-10-08T13:10:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.601+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3053836580 learned_addr learned my addr 172.21.15.5:0/3053836580 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:10:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.601+0000 7f2ef60f0700 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f853f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 msgr2=0x56330f8534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:10:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f8534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3053836580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 msgr2=0x56330f853f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:10:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f853f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ef50ee700 1 -- 172.21.15.5:0/3053836580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56330f5a7c00 con 0x56330f84f090 2023-10-08T13:10:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ef50ee700 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f853a10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009230 tx=0x7f2eec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c346946090579e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:10:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ed97fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ed97fa700 1 -- 172.21.15.5:0/3053836580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec005240 con 0x56330f84f090 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2ed97fa700 1 -- 172.21.15.5:0/3053836580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2eec00bbc0 con 0x56330f84f090 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.602+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2eec01d040 con 0x56330f84f090 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.603+0000 7f2ed97fa700 1 -- 172.21.15.5:0/3053836580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eec005b00 con 0x56330f84f090 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.603+0000 7f2f03d3cb80 10 client.16425 fetch_fsmap learned FSMap version 41 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.603+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56330f5bd250 con 0x56330f84f090 2023-10-08T13:10:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.603+0000 7f2ed97fa700 1 -- 172.21.15.5:0/3053836580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eec01d040 con 0x56330f84f090 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2ed97fa700 1 -- 172.21.15.5:0/3053836580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2eec009c70 con 0x56330f84f090 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2f03d3cb80 10 client.16425 fetch_fsmap finished waiting for FSMap version 41 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2f03d3cb80 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2f03d3cb80 20 client.16425 populate_metadata read hostname 'smithi005' 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8aaf70 0x56330f8c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2f03d3cb80 4 client.16425 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:10:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.604+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56330f78cad0 con 0x56330f8aaf70 2023-10-08T13:10:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.605+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8aaf70 0x56330f8c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:10:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.605+0000 7f2ed97fa700 10 client.16425 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.605+0000 7f2ef58ef700 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8aaf70 0x56330f8c26e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215bf541b3160ef3 server_cookie=6c0febb9e23c08db in_seq=0 out_seq=0 2023-10-08T13:10:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.650+0000 7f2ed97fa700 1 -- 172.21.15.5:0/3053836580 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56330f78cad0 con 0x56330f8aaf70 2023-10-08T13:10:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.650+0000 7f2ed97fa700 10 client.16425 handle_command_reply: tid=0 2023-10-08T13:10:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.650+0000 7f2f03d3cb80 1 client.16425 shutdown 2023-10-08T13:10:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.650+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 msgr2=0x56330f853a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.650+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f853a10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009230 tx=0x7f2eec00b790 comp rx=0 tx=0).stop 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 shutdown_connections 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56330f8aaf70 0x56330f8c26e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56330f84f9b0 0x56330f853f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56330f8498c0 0x56330f8534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 --2- 172.21.15.5:0/3053836580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56330f84f090 0x56330f853a10 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 >> 172.21.15.5:0/3053836580 conn(0x56330f7b5200 msgr2=0x56330f84fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2ed97fa700 0 client.16425 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 shutdown_connections 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 1 -- 172.21.15.5:0/3053836580 wait complete. 2023-10-08T13:10:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.651+0000 7f2f03d3cb80 20 client.16425 trim_cache size 0 max 16384 2023-10-08T13:10:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:10:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:10:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:10:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:10:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.652+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2edc0a1660 msgr2=0x7f2edc0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.652+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2edc0a1660 0x7f2edc0a3b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800ab30 tx=0x7f2ee8009250 comp rx=0 tx=0).stop 2023-10-08T13:10:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.652+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 msgr2=0x7f2ef01957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:10:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.652+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef01957c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000e9c0 tx=0x7f2ee000ecd0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 shutdown_connections 2023-10-08T13:10:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f2edc0a1660 0x7f2edc0a3b20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ef0105650 0x7f2ef0196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ef00ff590 0x7f2ef01957c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 --2- 172.21.15.5:0/87151457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ef00fff50 0x7f2ef0195d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:10:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 >> 172.21.15.5:0/87151457 conn(0x7f2ef00fb040 msgr2=0x7f2ef00fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:10:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 shutdown_connections 2023-10-08T13:10:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:10:46.653+0000 7f2ef7b53700 1 -- 172.21.15.5:0/87151457 wait complete. 2023-10-08T13:10:46.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:46 smithi060 ceph-mon[103190]: pgmap v443: 129 pgs: 129 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-08T13:10:46.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:46 smithi005 ceph-mon[99496]: pgmap v443: 129 pgs: 129 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-08T13:10:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 265.0 s, 480.4 tps, lat 212.237 ms stddev 336.421 2023-10-08T13:10:46.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:46 smithi118 ceph-mon[104234]: pgmap v443: 129 pgs: 129 active+clean; 4.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-08T13:10:48.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:48 smithi005 ceph-mon[99496]: pgmap v444: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 1.41k op/s 2023-10-08T13:10:48.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:48 smithi118 ceph-mon[104234]: pgmap v444: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 1.41k op/s 2023-10-08T13:10:48.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:48 smithi060 ceph-mon[103190]: pgmap v444: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 1.41k op/s 2023-10-08T13:10:50.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:50 smithi118 ceph-mon[104234]: pgmap v445: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 1.44k op/s 2023-10-08T13:10:50.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:50 smithi060 ceph-mon[103190]: pgmap v445: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 1.44k op/s 2023-10-08T13:10:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:50 smithi005 ceph-mon[99496]: pgmap v445: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 1.44k op/s 2023-10-08T13:10:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 270.0 s, 912.0 tps, lat 117.492 ms stddev 185.263 2023-10-08T13:10:52.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:52 smithi118 ceph-mon[104234]: pgmap v446: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 1.50k op/s 2023-10-08T13:10:52.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:52 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:52 smithi060 ceph-mon[103190]: pgmap v446: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 1.50k op/s 2023-10-08T13:10:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:52 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:52.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:52 smithi005 ceph-mon[99496]: pgmap v446: 129 pgs: 129 active+clean; 4.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 1.50k op/s 2023-10-08T13:10:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:52 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:10:54.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:54 smithi118 ceph-mon[104234]: pgmap v447: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.57k op/s 2023-10-08T13:10:54.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:54 smithi060 ceph-mon[103190]: pgmap v447: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.57k op/s 2023-10-08T13:10:54.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:54 smithi005 ceph-mon[99496]: pgmap v447: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.57k op/s 2023-10-08T13:10:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 275.0 s, 721.7 tps, lat 138.035 ms stddev 150.998 2023-10-08T13:10:56.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:56 smithi118 ceph-mon[104234]: pgmap v448: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.31k op/s 2023-10-08T13:10:56.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:56 smithi060 ceph-mon[103190]: pgmap v448: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.31k op/s 2023-10-08T13:10:56.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:56 smithi005 ceph-mon[99496]: pgmap v448: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.31k op/s 2023-10-08T13:10:58.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:10:58 smithi118 ceph-mon[104234]: pgmap v449: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-10-08T13:10:58.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:10:58 smithi060 ceph-mon[103190]: pgmap v449: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-10-08T13:10:58.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:10:58 smithi005 ceph-mon[99496]: pgmap v449: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-10-08T13:11:00.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:00 smithi118 ceph-mon[104234]: pgmap v450: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.2 MiB/s wr, 821 op/s 2023-10-08T13:11:00.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:00 smithi060 ceph-mon[103190]: pgmap v450: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.2 MiB/s wr, 821 op/s 2023-10-08T13:11:00.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:00 smithi005 ceph-mon[99496]: pgmap v450: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.2 MiB/s wr, 821 op/s 2023-10-08T13:11:01.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 -- 172.21.15.5:0/1485273229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c105630 msgr2=0x7f977c105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 --2- 172.21.15.5:0/1485273229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c105630 0x7f977c105a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97780099c0 tx=0x7f9778009cd0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 -- 172.21.15.5:0/1485273229 shutdown_connections 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 --2- 172.21.15.5:0/1485273229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c0fff30 0x7f977c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 --2- 172.21.15.5:0/1485273229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c105630 0x7f977c105a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 --2- 172.21.15.5:0/1485273229 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0ff570 0x7f977c0ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 -- 172.21.15.5:0/1485273229 >> 172.21.15.5:0/1485273229 conn(0x7f977c0fb080 msgr2=0x7f977c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 -- 172.21.15.5:0/1485273229 shutdown_connections 2023-10-08T13:11:01.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.697+0000 7f9783947700 1 -- 172.21.15.5:0/1485273229 wait complete. 2023-10-08T13:11:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 Processor -- start 2023-10-08T13:11:01.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 -- start start 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 0x7f977c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0fff30 0x7f977c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c105630 0x7f977c195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c195e00 con 0x7f977c105630 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c195f70 con 0x7f977c0ff570 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9783947700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c196130 con 0x7f977c0fff30 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c105630 0x7f977c195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f97816e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 0x7f977c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9780ee2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0fff30 0x7f977c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f97816e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 0x7f977c19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59504/0 (socket says 172.21.15.5:59504) 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c105630 0x7f977c195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36326/0 (socket says 172.21.15.5:36326) 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.698+0000 7f97816e3700 1 -- 172.21.15.5:0/3128808767 learned_addr learned my addr 172.21.15.5:0/3128808767 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9780ee2700 1 -- 172.21.15.5:0/3128808767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 msgr2=0x7f977c19b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9780ee2700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 0x7f977c19b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9780ee2700 1 -- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c105630 msgr2=0x7f977c195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9780ee2700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c105630 0x7f977c195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9780ee2700 1 -- 172.21.15.5:0/3128808767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009c40 con 0x7f977c0fff30 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f97816e3700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 0x7f977c19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9780ee2700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0fff30 0x7f977c19bba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e9f0 tx=0x7f976c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f97727fc700 1 -- 172.21.15.5:0/3128808767 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00c9c0 con 0x7f977c0fff30 2023-10-08T13:11:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f97727fc700 1 -- 172.21.15.5:0/3128808767 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f976c010430 con 0x7f977c0fff30 2023-10-08T13:11:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97780095f0 con 0x7f977c0fff30 2023-10-08T13:11:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f97727fc700 1 -- 172.21.15.5:0/3128808767 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c018680 con 0x7f977c0fff30 2023-10-08T13:11:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.699+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c067c30 con 0x7f977c0fff30 2023-10-08T13:11:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.702+0000 7f97727fc700 1 -- 172.21.15.5:0/3128808767 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f976c010860 con 0x7f977c0fff30 2023-10-08T13:11:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.702+0000 7f97727fc700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97680a15e0 0x7f97680a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.702+0000 7f97816e3700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97680a15e0 0x7f97680a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.702+0000 7f97727fc700 1 -- 172.21.15.5:0/3128808767 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f976c014070 con 0x7f977c0fff30 2023-10-08T13:11:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.703+0000 7f97816e3700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97680a15e0 0x7f97680a3aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9778000c00 tx=0x7f9778005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.703+0000 7f978fb30b80 1 Processor -- start 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 -- start start 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c71a0 0x5628f90c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 0x5628f90c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f9029400 con 0x5628f90c10b0 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f901abc0 con 0x5628f90c6880 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f978fb30b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f90184e0 con 0x5628f90c71a0 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 0x5628f90c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f9780ee2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c71a0 0x5628f90c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59512/0 (socket says 172.21.15.5:59512) 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 0x5628f90c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36334/0 (socket says 172.21.15.5:36334) 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 -- 172.21.15.5:0/3257213460 learned_addr learned my addr 172.21.15.5:0/3257213460 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 -- 172.21.15.5:0/3257213460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c71a0 msgr2=0x5628f90c0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c71a0 0x5628f90c0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 -- 172.21.15.5:0/3257213460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 msgr2=0x5628f90c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 0x5628f90c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f97816e3700 1 -- 172.21.15.5:0/3257213460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628f8e3ed80 con 0x5628f90c6880 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.704+0000 7f9781ee4700 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 0x5628f90c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.705+0000 7f97816e3700 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c6c60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9778005cd0 tx=0x7f9778023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0126cdc533c09f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.705+0000 7f97677fe700 1 -- 172.21.15.5:0/3257213460 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977802e070 con 0x5628f90c6880 2023-10-08T13:11:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.705+0000 7f97677fe700 1 -- 172.21.15.5:0/3257213460 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9778021040 con 0x5628f90c6880 2023-10-08T13:11:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.705+0000 7f97677fe700 1 -- 172.21.15.5:0/3257213460 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778003dd0 con 0x5628f90c6880 2023-10-08T13:11:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.705+0000 7f978fb30b80 1 -- 172.21.15.5:0/3257213460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 msgr2=0x5628f90c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.705+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c6c60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9778005cd0 tx=0x7f9778023000 comp rx=0 tx=0).stop 2023-10-08T13:11:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 -- 172.21.15.5:0/3257213460 shutdown_connections 2023-10-08T13:11:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c10b0 0x5628f90c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c6c60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3257213460 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c71a0 0x5628f90c0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 -- 172.21.15.5:0/3257213460 >> 172.21.15.5:0/3257213460 conn(0x5628f9035200 msgr2=0x5628f90bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 -- 172.21.15.5:0/3257213460 shutdown_connections 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 -- 172.21.15.5:0/3257213460 wait complete. 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 -- start start 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.706+0000 7f978fb30b80 1 Processor -- start 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 0x5628f90ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c6880 0x5628f90caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f9013dd0 con 0x5628f90c71a0 2023-10-08T13:11:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f8fb06b0 con 0x5628f90c10b0 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f8fb0350 con 0x5628f90c6880 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f978fb30b80 10 client.0 _ll_register_callbacks cb 0x5628f8e0d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 0x5628f90ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f9780ee2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c6880 0x5628f90caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 0x5628f90ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59518/0 (socket says 172.21.15.5:59518) 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36340/0 (socket says 172.21.15.5:36340) 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 -- 172.21.15.5:0/3938560407 learned_addr learned my addr 172.21.15.5:0/3938560407 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 -- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c6880 msgr2=0x5628f90caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c6880 0x5628f90caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 -- 172.21.15.5:0/3938560407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 msgr2=0x5628f90cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 -- 172.21.15.5:0/3938560407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977400e330 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f97816e3700 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 0x5628f90ca580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9778034040 tx=0x7f977800b5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef57b4f410f6f22c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.707+0000 7f9764ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f9764ff9700 1 -- 172.21.15.5:0/3938560407 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977802e040 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f9764ff9700 1 -- 172.21.15.5:0/3938560407 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f977800bc60 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628f8fdbe50 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f9764ff9700 1 -- 172.21.15.5:0/3938560407 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f977800be20 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 10 client.25931 fetch_fsmap learned FSMap version 43 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f977c10ccf0 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f9764ff9700 1 -- 172.21.15.5:0/3938560407 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5628f8fdbe50 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f9764ff9700 1 -- 172.21.15.5:0/3938560407 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f9778027670 con 0x5628f90c10b0 2023-10-08T13:11:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 10 client.25931 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 20 client.25931 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f90da720 0x5628f90dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 4 client.25931 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.708+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628f900cdb0 con 0x5628f90da720 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.709+0000 7f9780ee2700 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f90da720 0x5628f90dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.709+0000 7f9780ee2700 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f90da720 0x5628f90dcb10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d7e556aac6e9ee server_cookie=2c4063793d845caa in_seq=0 out_seq=0 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.709+0000 7f9764ff9700 10 client.25931 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f9764ff9700 1 -- 172.21.15.5:0/3938560407 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5628f900cdb0 con 0x5628f90da720 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f9764ff9700 10 client.25931 handle_command_reply: tid=0 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 client.25931 shutdown 2023-10-08T13:11:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 msgr2=0x5628f90ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 0x5628f90ca580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9778034040 tx=0x7f977800b5c0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 shutdown_connections 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f90da720 0x5628f90dcb10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c10b0 0x5628f90ca580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 --2- 172.21.15.5:0/3938560407 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c6880 0x5628f90caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f9764ff9700 0 client.25931 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 >> 172.21.15.5:0/3938560407 conn(0x5628f9035200 msgr2=0x5628f90bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 shutdown_connections 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 1 -- 172.21.15.5:0/3938560407 wait complete. 2023-10-08T13:11:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.710+0000 7f978fb30b80 20 client.25931 trim_cache size 0 max 16384 2023-10-08T13:11:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 Processor -- start 2023-10-08T13:11:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 -- start start 2023-10-08T13:11:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90d6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f8e948c0 con 0x5628f90c71a0 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f90bd330 con 0x5628f90c6880 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f978fb30b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f90cbbf0 con 0x5628f90c10b0 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36348/0 (socket says 172.21.15.5:36348) 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f9781ee4700 1 -- 172.21.15.5:0/581954380 learned_addr learned my addr 172.21.15.5:0/581954380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f97816e3700 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90d6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.726+0000 7f9780ee2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9781ee4700 1 -- 172.21.15.5:0/581954380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 msgr2=0x5628f90d6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9781ee4700 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90d6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9781ee4700 1 -- 172.21.15.5:0/581954380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 msgr2=0x5628f90c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9781ee4700 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9781ee4700 1 -- 172.21.15.5:0/581954380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628f90c1b50 con 0x5628f90c71a0 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9780ee2700 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f97816e3700 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90d6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9781ee4700 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cae20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f977400eae0 tx=0x7f9774009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1d2085e6105a4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9767fff700 1 -- 172.21.15.5:0/581954380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400e040 con 0x5628f90c71a0 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9767fff700 1 -- 172.21.15.5:0/581954380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f977400f040 con 0x5628f90c71a0 2023-10-08T13:11:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.727+0000 7f9767fff700 1 -- 172.21.15.5:0/581954380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774017e20 con 0x5628f90c71a0 2023-10-08T13:11:01.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 -- 172.21.15.5:0/581954380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 msgr2=0x5628f90cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cae20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f977400eae0 tx=0x7f9774009920 comp rx=0 tx=0).stop 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 -- 172.21.15.5:0/581954380 shutdown_connections 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f90cae20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90d6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 --2- 172.21.15.5:0/581954380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 -- 172.21.15.5:0/581954380 >> 172.21.15.5:0/581954380 conn(0x5628f9035200 msgr2=0x5628f90c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 -- 172.21.15.5:0/581954380 shutdown_connections 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 -- 172.21.15.5:0/581954380 wait complete. 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 -- start start 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.728+0000 7f978fb30b80 1 Processor -- start 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f912d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f912da60 con 0x5628f90c71a0 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f912dbd0 con 0x5628f90c6880 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628f912dd90 con 0x5628f90c10b0 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f912d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f97816e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f9780ee2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f978fb30b80 10 client.0 _ll_register_callbacks cb 0x7f977400e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f97816e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49554/0 (socket says 172.21.15.5:49554) 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f9781ee4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f912d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36354/0 (socket says 172.21.15.5:36354) 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f9780ee2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59534/0 (socket says 172.21.15.5:59534) 2023-10-08T13:11:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.729+0000 7f97816e3700 1 -- 172.21.15.5:0/2725326118 learned_addr learned my addr 172.21.15.5:0/2725326118 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9780ee2700 1 -- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 msgr2=0x5628f90cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9780ee2700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9780ee2700 1 -- 172.21.15.5:0/2725326118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 msgr2=0x5628f912d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9780ee2700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f912d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9780ee2700 1 -- 172.21.15.5:0/2725326118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c10ccf0 con 0x5628f90c6880 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f97816e3700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9781ee4700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f912d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9780ee2700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90d00c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f976c0cab80 tx=0x7f976c009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d9b15150a9f8fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9764ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9764ff9700 1 -- 172.21.15.5:0/2725326118 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0a27a0 con 0x5628f90c6880 2023-10-08T13:11:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9778021040 con 0x5628f90c6880 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9764ff9700 1 -- 172.21.15.5:0/2725326118 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f976c0cd3b0 con 0x5628f90c6880 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9764ff9700 1 -- 172.21.15.5:0/2725326118 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976c0cd570 con 0x5628f90c6880 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f978fb30b80 10 client.25937 fetch_fsmap learned FSMap version 43 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f977c067c30 con 0x5628f90c6880 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9764ff9700 1 -- 172.21.15.5:0/2725326118 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9778021040 con 0x5628f90c6880 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.730+0000 7f9764ff9700 1 -- 172.21.15.5:0/2725326118 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f976c099900 con 0x5628f90c6880 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f978fb30b80 10 client.25937 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f978fb30b80 10 client.25937 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f978fb30b80 20 client.25937 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f978fb30b80 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f912f5e0 0x5628f9131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f978fb30b80 4 client.25937 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:11:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5628f900cad0 con 0x5628f912f5e0 2023-10-08T13:11:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f97816e3700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f912f5e0 0x5628f9131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f9764ff9700 10 client.25937 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.731+0000 7f97816e3700 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f912f5e0 0x5628f9131a00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba985240e221d661 server_cookie=431014d31d4f4961 in_seq=0 out_seq=0 2023-10-08T13:11:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.741+0000 7f9764ff9700 1 -- 172.21.15.5:0/2725326118 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5628f900cad0 con 0x5628f912f5e0 2023-10-08T13:11:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.741+0000 7f9764ff9700 10 client.25937 handle_command_reply: tid=0 2023-10-08T13:11:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.741+0000 7f978fb30b80 1 client.25937 shutdown 2023-10-08T13:11:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 msgr2=0x5628f90d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90d00c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f976c0cab80 tx=0x7f976c009790 comp rx=0 tx=0).stop 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 shutdown_connections 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5628f90c71a0 0x5628f912d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5628f90c10b0 0x5628f90cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5628f912f5e0 0x5628f9131a00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 --2- 172.21.15.5:0/2725326118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628f90c6880 0x5628f90d00c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f9764ff9700 0 client.25937 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 >> 172.21.15.5:0/2725326118 conn(0x5628f9035200 msgr2=0x5628f90cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 shutdown_connections 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 1 -- 172.21.15.5:0/2725326118 wait complete. 2023-10-08T13:11:01.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f978fb30b80 20 client.25937 trim_cache size 0 max 16384 2023-10-08T13:11:01.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:11:01.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:11:01.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:11:01.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97680a15e0 msgr2=0x7f97680a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f9783947700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97680a15e0 0x7f97680a3aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9778000c00 tx=0x7f9778005fb0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0fff30 msgr2=0x7f977c19bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.742+0000 7f9783947700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0fff30 0x7f977c19bba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e9f0 tx=0x7f976c00ed00 comp rx=0 tx=0).stop 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 shutdown_connections 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f97680a15e0 0x7f97680a3aa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f977c105630 0x7f977c195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f977c0ff570 0x7f977c19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 --2- 172.21.15.5:0/3128808767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f977c0fff30 0x7f977c19bba0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 >> 172.21.15.5:0/3128808767 conn(0x7f977c0fb080 msgr2=0x7f977c0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 shutdown_connections 2023-10-08T13:11:01.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:01.743+0000 7f9783947700 1 -- 172.21.15.5:0/3128808767 wait complete. 2023-10-08T13:11:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 280.0 s, 138.3 tps, lat 164.007 ms stddev 187.878 2023-10-08T13:11:02.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:02 smithi060 ceph-mon[103190]: pgmap v451: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-10-08T13:11:02.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:02 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:02.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:02 smithi005 ceph-mon[99496]: pgmap v451: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-10-08T13:11:02.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:02 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:03.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:02 smithi118 ceph-mon[104234]: pgmap v451: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-10-08T13:11:03.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:02 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:04.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:04 smithi060 ceph-mon[103190]: pgmap v452: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 640 op/s 2023-10-08T13:11:04.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:04 smithi005 ceph-mon[99496]: pgmap v452: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 640 op/s 2023-10-08T13:11:05.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:04 smithi118 ceph-mon[104234]: pgmap v452: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 640 op/s 2023-10-08T13:11:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 285.0 s, 498.0 tps, lat 350.503 ms stddev 846.258 2023-10-08T13:11:06.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:06 smithi060 ceph-mon[103190]: pgmap v453: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2023-10-08T13:11:06.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:06 smithi005 ceph-mon[99496]: pgmap v453: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2023-10-08T13:11:07.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:06 smithi118 ceph-mon[104234]: pgmap v453: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2023-10-08T13:11:07.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:07 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:07.931 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:07 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:08.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:07 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:08.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:08 smithi060 ceph-mon[103190]: pgmap v454: 129 pgs: 129 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 639 op/s 2023-10-08T13:11:08.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:08 smithi005 ceph-mon[99496]: pgmap v454: 129 pgs: 129 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 639 op/s 2023-10-08T13:11:09.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:08 smithi118 ceph-mon[104234]: pgmap v454: 129 pgs: 129 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.7 MiB/s wr, 639 op/s 2023-10-08T13:11:10.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:10 smithi060 ceph-mon[103190]: pgmap v455: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.8 MiB/s wr, 707 op/s 2023-10-08T13:11:10.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:10 smithi005 ceph-mon[99496]: pgmap v455: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.8 MiB/s wr, 707 op/s 2023-10-08T13:11:11.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:10 smithi118 ceph-mon[104234]: pgmap v455: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.8 MiB/s wr, 707 op/s 2023-10-08T13:11:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 290.0 s, 475.7 tps, lat 213.735 ms stddev 262.382 2023-10-08T13:11:12.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:11:12.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:12 smithi005 ceph-mon[99496]: pgmap v456: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.5 MiB/s wr, 698 op/s 2023-10-08T13:11:12.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:12 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:12.924 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:12 smithi060 ceph-mon[103190]: pgmap v456: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.5 MiB/s wr, 698 op/s 2023-10-08T13:11:12.924 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:12 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:13.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:12 smithi118 ceph-mon[104234]: pgmap v456: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.5 MiB/s wr, 698 op/s 2023-10-08T13:11:13.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:12 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:11:13.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.278+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3815800992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 msgr2=0x7fbad81059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.278+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3815800992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad81059e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbac800bab0 tx=0x7fbac800bdc0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3815800992 shutdown_connections 2023-10-08T13:11:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3815800992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 0x7fbad810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3815800992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad81059e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3815800992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad80ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3815800992 >> 172.21.15.5:0/3815800992 conn(0x7fbad80fafb0 msgr2=0x7fbad80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:13.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3815800992 shutdown_connections 2023-10-08T13:11:13.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.287+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3815800992 wait complete. 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 Processor -- start 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 -- start start 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 0x7fbad819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad8194730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8194f00 con 0x7fbad80fff00 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8195070 con 0x7fbad8105600 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadf8b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8195230 con 0x7fbad80ff540 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadce50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 0x7fbad819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadd651700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadd651700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49568/0 (socket says 172.21.15.5:49568) 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.288+0000 7fbadd651700 1 -- 172.21.15.5:0/3705421706 learned_addr learned my addr 172.21.15.5:0/3705421706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadde52700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad8194730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadd651700 1 -- 172.21.15.5:0/3705421706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 msgr2=0x7fbad8194730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadd651700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad8194730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadd651700 1 -- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 msgr2=0x7fbad819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadd651700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 0x7fbad819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadd651700 1 -- 172.21.15.5:0/3705421706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac800b730 con 0x7fbad80ff540 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadde52700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad8194730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadce50700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 0x7fbad819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbadd651700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad819a690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbac800dc20 tx=0x7fbac8014d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbace7fc700 1 -- 172.21.15.5:0/3705421706 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8010040 con 0x7fbad80ff540 2023-10-08T13:11:13.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbace7fc700 1 -- 172.21.15.5:0/3705421706 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbac8005700 con 0x7fbad80ff540 2023-10-08T13:11:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.289+0000 7fbace7fc700 1 -- 172.21.15.5:0/3705421706 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac801d680 con 0x7fbad80ff540 2023-10-08T13:11:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.290+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad81954b0 con 0x7fbad80ff540 2023-10-08T13:11:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.290+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad81a1610 con 0x7fbad80ff540 2023-10-08T13:11:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.293+0000 7fbace7fc700 1 -- 172.21.15.5:0/3705421706 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fbac80047d0 con 0x7fbad80ff540 2023-10-08T13:11:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.293+0000 7fbace7fc700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbac40a1670 0x7fbac40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.294+0000 7fbace7fc700 1 -- 172.21.15.5:0/3705421706 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbac80d08b0 con 0x7fbad80ff540 2023-10-08T13:11:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.298+0000 7fbadce50700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbac40a1670 0x7fbac40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.299+0000 7fbadce50700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbac40a1670 0x7fbac40a3b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbad8195f10 tx=0x7fbad000d040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.309+0000 7fbaeba9eb80 1 Processor -- start 2023-10-08T13:11:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 -- start start 2023-10-08T13:11:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 0x55fb89de1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89dfd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89dfd660 0x55fb89dffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89d4a460 con 0x55fb89de0e80 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89d3bc20 con 0x55fb89dfd660 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89d39540 con 0x55fb89de17a0 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbadd651700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 0x55fb89de1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbadd651700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 0x55fb89de1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36374/0 (socket says 172.21.15.5:36374) 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.314+0000 7fbadd651700 1 -- 172.21.15.5:0/3524391686 learned_addr learned my addr 172.21.15.5:0/3524391686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.315+0000 7fbadd651700 1 -- 172.21.15.5:0/3524391686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 msgr2=0x55fb89dfd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.315+0000 7fbadd651700 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89dfd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.315+0000 7fbadd651700 1 -- 172.21.15.5:0/3524391686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89dfd660 msgr2=0x55fb89dffa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.315+0000 7fbadd651700 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89dfd660 0x55fb89dffa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.315+0000 7fbadd651700 1 -- 172.21.15.5:0/3524391686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb89b5fde0 con 0x55fb89de0e80 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.316+0000 7fbadd651700 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 0x55fb89de1260 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbac809a110 tx=0x7fbac8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e60f5e385eda7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.317+0000 7fbac37fe700 1 -- 172.21.15.5:0/3524391686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac809d000 con 0x55fb89de0e80 2023-10-08T13:11:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.317+0000 7fbac37fe700 1 -- 172.21.15.5:0/3524391686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbac8028e90 con 0x55fb89de0e80 2023-10-08T13:11:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.317+0000 7fbac37fe700 1 -- 172.21.15.5:0/3524391686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac809d900 con 0x55fb89de0e80 2023-10-08T13:11:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.318+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/3524391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 msgr2=0x55fb89de1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.318+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 0x55fb89de1260 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbac809a110 tx=0x7fbac8004f90 comp rx=0 tx=0).stop 2023-10-08T13:11:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.339+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/3524391686 shutdown_connections 2023-10-08T13:11:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.339+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89dfd660 0x55fb89dffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.339+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de0e80 0x55fb89de1260 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.339+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/3524391686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89dfd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.339+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/3524391686 >> 172.21.15.5:0/3524391686 conn(0x55fb89d56260 msgr2=0x55fb89ddd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:13.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.350+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/3524391686 shutdown_connections 2023-10-08T13:11:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.363+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/3524391686 wait complete. 2023-10-08T13:11:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.363+0000 7fbaeba9eb80 1 -- start start 2023-10-08T13:11:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.363+0000 7fbaeba9eb80 1 Processor -- start 2023-10-08T13:11:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89dfcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de17a0 0x55fb89df3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 0x55fb89df4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89d34e30 con 0x55fb89de17a0 2023-10-08T13:11:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89cd1710 con 0x55fb89de0e80 2023-10-08T13:11:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89cd13b0 con 0x55fb89dfd660 2023-10-08T13:11:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.368+0000 7fbaeba9eb80 10 client.0 _ll_register_callbacks cb 0x55fb89b2e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.371+0000 7fbadde52700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 0x55fb89df4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 0x55fb89df4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49582/0 (socket says 172.21.15.5:49582) 2023-10-08T13:11:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 -- 172.21.15.5:0/814469026 learned_addr learned my addr 172.21.15.5:0/814469026 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadd651700 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89dfcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 -- 172.21.15.5:0/814469026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 msgr2=0x55fb89dfcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89dfcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 -- 172.21.15.5:0/814469026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de17a0 msgr2=0x55fb89df3ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:11:13.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de17a0 0x55fb89df3ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.372+0000 7fbadde52700 1 -- 172.21.15.5:0/814469026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad81a1610 con 0x55fb89dfd660 2023-10-08T13:11:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.377+0000 7fbadde52700 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 0x55fb89df4530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbad4011d10 tx=0x7fbad400f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ff52695afa231c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.377+0000 7fbac0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:11:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.378+0000 7fbac0ff9700 1 -- 172.21.15.5:0/814469026 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400fe30 con 0x55fb89dfd660 2023-10-08T13:11:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.378+0000 7fbac0ff9700 1 -- 172.21.15.5:0/814469026 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbad4004030 con 0x55fb89dfd660 2023-10-08T13:11:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.378+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb89cfceb0 con 0x55fb89dfd660 2023-10-08T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.378+0000 7fbac0ff9700 1 -- 172.21.15.5:0/814469026 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad40041f0 con 0x55fb89dfd660 2023-10-08T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.378+0000 7fbaeba9eb80 10 client.25996 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.378+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55fb89b48c60 con 0x55fb89dfd660 2023-10-08T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbac0ff9700 1 -- 172.21.15.5:0/814469026 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb89cfceb0 con 0x55fb89dfd660 2023-10-08T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbac0ff9700 1 -- 172.21.15.5:0/814469026 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fbad40234d0 con 0x55fb89dfd660 2023-10-08T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbaeba9eb80 10 client.25996 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbaeba9eb80 10 client.25996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbaeba9eb80 20 client.25996 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e04690 0x55fb89e06ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbaeba9eb80 4 client.25996 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.379+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb89d2de10 con 0x55fb89e04690 2023-10-08T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.381+0000 7fbadd651700 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e04690 0x55fb89e06ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.382+0000 7fbadd651700 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e04690 0x55fb89e06ab0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7899e2511b4ca25d server_cookie=1d900fb943b0d819 in_seq=0 out_seq=0 2023-10-08T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.387+0000 7fbac0ff9700 10 client.25996 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.387+0000 7fbac0ff9700 1 -- 172.21.15.5:0/814469026 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb89d2de10 con 0x55fb89e04690 2023-10-08T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.387+0000 7fbac0ff9700 10 client.25996 handle_command_reply: tid=0 2023-10-08T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.387+0000 7fbaeba9eb80 1 client.25996 shutdown 2023-10-08T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.387+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 msgr2=0x55fb89df4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.387+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 0x55fb89df4530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbad4011d10 tx=0x7fbad400f6a0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 shutdown_connections 2023-10-08T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89dfd660 0x55fb89df4530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e04690 0x55fb89e06ab0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89dfcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/814469026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89de17a0 0x55fb89df3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 >> 172.21.15.5:0/814469026 conn(0x55fb89d56260 msgr2=0x55fb89ddcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbac0ff9700 0 client.25996 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.388+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 shutdown_connections 2023-10-08T13:11:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.393+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/814469026 wait complete. 2023-10-08T13:11:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.401+0000 7fbaeba9eb80 20 client.25996 trim_cache size 0 max 16384 2023-10-08T13:11:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 Processor -- start 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 -- start start 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de0e80 0x55fb89dfca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de17a0 0x55fb89df28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89bb5920 con 0x55fb89dfd660 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89df8ff0 con 0x55fb89de17a0 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89df55f0 con 0x55fb89de0e80 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbadde52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbadde52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36386/0 (socket says 172.21.15.5:36386) 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbadde52700 1 -- 172.21.15.5:0/2786132948 learned_addr learned my addr 172.21.15.5:0/2786132948 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.428+0000 7fbadce50700 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de17a0 0x55fb89df28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbadde52700 1 -- 172.21.15.5:0/2786132948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de0e80 msgr2=0x55fb89dfca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbadde52700 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de0e80 0x55fb89dfca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbadde52700 1 -- 172.21.15.5:0/2786132948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de17a0 msgr2=0x55fb89df28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbadde52700 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de17a0 0x55fb89df28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbadde52700 1 -- 172.21.15.5:0/2786132948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb89e0b6e0 con 0x55fb89dfd660 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbadde52700 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df2e00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009b80 tx=0x7fbad40058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8613778db7d04c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbac3fff700 1 -- 172.21.15.5:0/2786132948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40234b0 con 0x55fb89dfd660 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbac3fff700 1 -- 172.21.15.5:0/2786132948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad4023610 con 0x55fb89dfd660 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.429+0000 7fbac3fff700 1 -- 172.21.15.5:0/2786132948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4003680 con 0x55fb89dfd660 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/2786132948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 msgr2=0x55fb89df2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df2e00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009b80 tx=0x7fbad40058e0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/2786132948 shutdown_connections 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df2e00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de0e80 0x55fb89dfca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/2786132948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de17a0 0x55fb89df28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/2786132948 >> 172.21.15.5:0/2786132948 conn(0x55fb89d56260 msgr2=0x55fb89def310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/2786132948 shutdown_connections 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/2786132948 wait complete. 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 -- start start 2023-10-08T13:11:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.430+0000 7fbaeba9eb80 1 Processor -- start 2023-10-08T13:11:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89df1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89df1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89df2110 con 0x55fb89dfd660 2023-10-08T13:11:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89df07a0 con 0x55fb89de0e80 2023-10-08T13:11:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb89df0960 con 0x55fb89de17a0 2023-10-08T13:11:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbaeba9eb80 10 client.0 _ll_register_callbacks cb 0x7fbad40117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbadde52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbadd651700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89df1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbadde52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36392/0 (socket says 172.21.15.5:36392) 2023-10-08T13:11:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbadde52700 1 -- 172.21.15.5:0/806972973 learned_addr learned my addr 172.21.15.5:0/806972973 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.431+0000 7fbadce50700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89df1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadd651700 1 -- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 msgr2=0x55fb89df1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadd651700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89df1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadd651700 1 -- 172.21.15.5:0/806972973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 msgr2=0x55fb89df0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadd651700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadd651700 1 -- 172.21.15.5:0/806972973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb89b48c60 con 0x55fb89de0e80 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadde52700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbadd651700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89df1540 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbac80a5470 tx=0x7fbac80148b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25342f2175346da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbac0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbac0ff9700 1 -- 172.21.15.5:0/806972973 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ce0e0 con 0x55fb89de0e80 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbac0ff9700 1 -- 172.21.15.5:0/806972973 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbac809dda0 con 0x55fb89de0e80 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbac8028e90 con 0x55fb89de0e80 2023-10-08T13:11:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbac0ff9700 1 -- 172.21.15.5:0/806972973 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbac809d6a0 con 0x55fb89de0e80 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbaeba9eb80 10 client.25952 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55fb89ddcb60 con 0x55fb89de0e80 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.432+0000 7fbac0ff9700 1 -- 172.21.15.5:0/806972973 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbac8082080 con 0x55fb89de0e80 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbac0ff9700 1 -- 172.21.15.5:0/806972973 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fbac809d900 con 0x55fb89de0e80 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbaeba9eb80 10 client.25952 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbaeba9eb80 10 client.25952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbaeba9eb80 20 client.25952 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e597c0 0x55fb89e5bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbaeba9eb80 4 client.25952 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fb89d2db30 con 0x55fb89e597c0 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.433+0000 7fbadce50700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e597c0 0x55fb89e5bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbac0ff9700 10 client.25952 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbadce50700 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e597c0 0x55fb89e5bbe0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca8520eaaa72d73 server_cookie=2dfac4569cf5b6f7 in_seq=0 out_seq=0 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbac0ff9700 1 -- 172.21.15.5:0/806972973 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fb89d2db30 con 0x55fb89e597c0 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbac0ff9700 10 client.25952 handle_command_reply: tid=0 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 client.25952 shutdown 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 msgr2=0x55fb89df1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89df1540 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbac80a5470 tx=0x7fbac80148b0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 shutdown_connections 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb89dfd660 0x55fb89df0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb89e597c0 0x55fb89e5bbe0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb89de0e80 0x55fb89df1540 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbac0ff9700 0 client.25952 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 --2- 172.21.15.5:0/806972973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb89de17a0 0x55fb89df1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 >> 172.21.15.5:0/806972973 conn(0x55fb89d56260 msgr2=0x55fb89df2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 shutdown_connections 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.434+0000 7fbaeba9eb80 1 -- 172.21.15.5:0/806972973 wait complete. 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbaeba9eb80 20 client.25952 trim_cache size 0 max 16384 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:11:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:11:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:11:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:11:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:11:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:11:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:11:13.446 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbac40a1670 msgr2=0x7fbac40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbac40a1670 0x7fbac40a3b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbad8195f10 tx=0x7fbad000d040 comp rx=0 tx=0).stop 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 msgr2=0x7fbad819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad819a690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbac800dc20 tx=0x7fbac8014d70 comp rx=0 tx=0).stop 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 shutdown_connections 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbac40a1670 0x7fbac40a3b30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8105600 0x7fbad8194730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad80ff540 0x7fbad819a690 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 --2- 172.21.15.5:0/3705421706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbad80fff00 0x7fbad819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 >> 172.21.15.5:0/3705421706 conn(0x7fbad80fafb0 msgr2=0x7fbad80fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 shutdown_connections 2023-10-08T13:11:13.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:13.435+0000 7fbadf8b5700 1 -- 172.21.15.5:0/3705421706 wait complete. 2023-10-08T13:11:13.452 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:11:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:14 smithi060 ceph-mon[103190]: pgmap v457: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 646 op/s 2023-10-08T13:11:14.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:14 smithi005 ceph-mon[99496]: pgmap v457: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 646 op/s 2023-10-08T13:11:15.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:14 smithi118 ceph-mon[104234]: pgmap v457: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 646 op/s 2023-10-08T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.138+0000 7ff752216700 1 -- 172.21.15.5:0/3089332112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 msgr2=0x7ff74c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.138+0000 7ff752216700 1 --2- 172.21.15.5:0/3089332112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c10b8d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff734009990 tx=0x7ff734009ca0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.146+0000 7ff752216700 1 -- 172.21.15.5:0/3089332112 shutdown_connections 2023-10-08T13:11:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.146+0000 7ff752216700 1 --2- 172.21.15.5:0/3089332112 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff74c10c000 0x7ff74c078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.146+0000 7ff752216700 1 --2- 172.21.15.5:0/3089332112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c107a60 0x7ff74c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.146+0000 7ff752216700 1 --2- 172.21.15.5:0/3089332112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c10b8d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.146+0000 7ff752216700 1 -- 172.21.15.5:0/3089332112 >> 172.21.15.5:0/3089332112 conn(0x7ff74c06b7c0 msgr2=0x7ff74c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.150+0000 7ff752216700 1 -- 172.21.15.5:0/3089332112 shutdown_connections 2023-10-08T13:11:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.161+0000 7ff752216700 1 -- 172.21.15.5:0/3089332112 wait complete. 2023-10-08T13:11:15.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.162+0000 7ff752216700 1 Processor -- start 2023-10-08T13:11:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 -- start start 2023-10-08T13:11:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c107a60 0x7ff74c083260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c07d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff74c10c000 0x7ff74c07d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c07dfc0 con 0x7ff74c108380 2023-10-08T13:11:15.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c07e130 con 0x7ff74c107a60 2023-10-08T13:11:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.170+0000 7ff752216700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c1ba850 con 0x7ff74c10c000 2023-10-08T13:11:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c07d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c07d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36402/0 (socket says 172.21.15.5:36402) 2023-10-08T13:11:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 -- 172.21.15.5:0/2886243440 learned_addr learned my addr 172.21.15.5:0/2886243440 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 -- 172.21.15.5:0/2886243440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff74c10c000 msgr2=0x7ff74c07d860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:11:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff74c10c000 0x7ff74c07d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 -- 172.21.15.5:0/2886243440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c107a60 msgr2=0x7ff74c083260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c107a60 0x7ff74c083260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 -- 172.21.15.5:0/2886243440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340095f0 con 0x7ff74c108380 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.171+0000 7ff743fff700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c07d320 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff734006010 tx=0x7ff734003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.172+0000 7ff7497fa700 1 -- 172.21.15.5:0/2886243440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73401d070 con 0x7ff74c108380 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.172+0000 7ff7497fa700 1 -- 172.21.15.5:0/2886243440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff734003e30 con 0x7ff74c108380 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.172+0000 7ff7497fa700 1 -- 172.21.15.5:0/2886243440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340173f0 con 0x7ff74c108380 2023-10-08T13:11:15.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.174+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c1baa70 con 0x7ff74c108380 2023-10-08T13:11:15.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.174+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c1baea0 con 0x7ff74c108380 2023-10-08T13:11:15.180 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.178+0000 7ff75e3ffb80 1 Processor -- start 2023-10-08T13:11:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.186+0000 7ff7497fa700 1 -- 172.21.15.5:0/2886243440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff73400f5f0 con 0x7ff74c108380 2023-10-08T13:11:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.186+0000 7ff7497fa700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff7380a1720 0x7ff7380a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.187+0000 7ff7497fa700 1 -- 172.21.15.5:0/2886243440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff7340cea50 con 0x7ff74c108380 2023-10-08T13:11:15.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.191+0000 7ff74bfff700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff7380a1720 0x7ff7380a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff74bfff700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff7380a1720 0x7ff7380a3be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff74400ab10 tx=0x7ff744009230 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 -- start start 2023-10-08T13:11:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 0x56025c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 0x56025c065b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c0660b0 0x56025c066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025bfce400 con 0x56025c06c1a0 2023-10-08T13:11:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025bfbfbc0 con 0x56025c0660b0 2023-10-08T13:11:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.192+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025bfbd4e0 con 0x56025c06b880 2023-10-08T13:11:15.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 0x56025c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 0x56025c06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49610/0 (socket says 172.21.15.5:49610) 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 -- 172.21.15.5:0/2556099412 learned_addr learned my addr 172.21.15.5:0/2556099412 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 -- 172.21.15.5:0/2556099412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c0660b0 msgr2=0x56025c066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c0660b0 0x56025c066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 -- 172.21.15.5:0/2556099412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 msgr2=0x56025c065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 0x56025c065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 -- 172.21.15.5:0/2556099412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56025bde3d80 con 0x56025c06b880 2023-10-08T13:11:15.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.193+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 0x56025c06bc60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0098a0 tx=0x7ff73c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a3e33902a5f9ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.194+0000 7ff741ffb700 1 -- 172.21.15.5:0/2556099412 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00b870 con 0x56025c06b880 2023-10-08T13:11:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.194+0000 7ff741ffb700 1 -- 172.21.15.5:0/2556099412 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff73c00be90 con 0x56025c06b880 2023-10-08T13:11:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.194+0000 7ff741ffb700 1 -- 172.21.15.5:0/2556099412 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c010380 con 0x56025c06b880 2023-10-08T13:11:15.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2556099412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 msgr2=0x56025c06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 0x56025c06bc60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0098a0 tx=0x7ff73c009bb0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2556099412 shutdown_connections 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c0660b0 0x56025c066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06b880 0x56025c06bc60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2556099412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 0x56025c065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2556099412 >> 172.21.15.5:0/2556099412 conn(0x56025bfda200 msgr2=0x56025c060b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:15.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2556099412 shutdown_connections 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.195+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2556099412 wait complete. 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 -- start start 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 Processor -- start 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c0660b0 0x56025c06f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c06fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 0x56025c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025bfb8dd0 con 0x56025c0660b0 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025bf556b0 con 0x56025c06b880 2023-10-08T13:11:15.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025bf55350 con 0x56025c06c1a0 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff75e3ffb80 10 client.0 _ll_register_callbacks cb 0x56025bdb27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff74bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 0x56025c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff74bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 0x56025c0700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49620/0 (socket says 172.21.15.5:49620) 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff74bfff700 1 -- 172.21.15.5:0/2612576366 learned_addr learned my addr 172.21.15.5:0/2612576366 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.196+0000 7ff743fff700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c06fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff74bfff700 1 -- 172.21.15.5:0/2612576366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 msgr2=0x56025c06fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff74bfff700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c06fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff74bfff700 1 -- 172.21.15.5:0/2612576366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c0660b0 msgr2=0x56025c06f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff74bfff700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c0660b0 0x56025c06f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff74bfff700 1 -- 172.21.15.5:0/2612576366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c0094d0 con 0x56025c06c1a0 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff743fff700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c06fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.197+0000 7ff74bfff700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 0x56025c0700f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff74400da60 tx=0x7ff744004b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=703380c249c87b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.198+0000 7ff72affd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.198+0000 7ff72affd700 1 -- 172.21.15.5:0/2612576366 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400ca80 con 0x56025c06c1a0 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.198+0000 7ff72affd700 1 -- 172.21.15.5:0/2612576366 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff74401e070 con 0x56025c06c1a0 2023-10-08T13:11:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.198+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56025bf80e50 con 0x56025c06c1a0 2023-10-08T13:11:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.201+0000 7ff72affd700 1 -- 172.21.15.5:0/2612576366 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff744018b60 con 0x56025c06c1a0 2023-10-08T13:11:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.204+0000 7ff75e3ffb80 10 client.26005 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.204+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56025bdccc00 con 0x56025c06c1a0 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.207+0000 7ff72affd700 1 -- 172.21.15.5:0/2612576366 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56025bf80e50 con 0x56025c06c1a0 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.207+0000 7ff72affd700 1 -- 172.21.15.5:0/2612576366 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff74401a420 con 0x56025c06c1a0 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff75e3ffb80 10 client.26005 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff75e3ffb80 10 client.26005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff75e3ffb80 20 client.26005 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c07fde0 0x56025c082200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff75e3ffb80 4 client.26005 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56025bfb1db0 con 0x56025c07fde0 2023-10-08T13:11:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.208+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c07fde0 0x56025c082200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.209+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c07fde0 0x56025c082200 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d38c4a5bf0b0f7 server_cookie=6f0d527beb11cb0 in_seq=0 out_seq=0 2023-10-08T13:11:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.209+0000 7ff72affd700 10 client.26005 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.209+0000 7ff72affd700 1 -- 172.21.15.5:0/2612576366 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56025bfb1db0 con 0x56025c07fde0 2023-10-08T13:11:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.209+0000 7ff72affd700 10 client.26005 handle_command_reply: tid=0 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.209+0000 7ff75e3ffb80 1 client.26005 shutdown 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 msgr2=0x56025c0700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 0x56025c0700f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff74400da60 tx=0x7ff744004b10 comp rx=0 tx=0).stop 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 shutdown_connections 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c06c1a0 0x56025c0700f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c0660b0 0x56025c06f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c07fde0 0x56025c082200 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/2612576366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c06fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff72affd700 0 client.26005 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 >> 172.21.15.5:0/2612576366 conn(0x56025bfda200 msgr2=0x56025c060010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 shutdown_connections 2023-10-08T13:11:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/2612576366 wait complete. 2023-10-08T13:11:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.210+0000 7ff75e3ffb80 20 client.26005 trim_cache size 0 max 16384 2023-10-08T13:11:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.237+0000 7ff75e3ffb80 1 Processor -- start 2023-10-08T13:11:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 -- start start 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c065b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06b880 0x56025c060790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 0x56025c060cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025be398c0 con 0x56025c06b880 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025c07d4e0 con 0x56025c06c1a0 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.238+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025c05b2b0 con 0x56025c0660b0 2023-10-08T13:11:15.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.239+0000 7ff74bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 0x56025c060cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.239+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 0x56025c060cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59604/0 (socket says 172.21.15.5:59604) 2023-10-08T13:11:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 -- 172.21.15.5:0/1815785219 learned_addr learned my addr 172.21.15.5:0/1815785219 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 -- 172.21.15.5:0/1815785219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 msgr2=0x56025c065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c065b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 -- 172.21.15.5:0/1815785219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06b880 msgr2=0x56025c060790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06b880 0x56025c060790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.240+0000 7ff74bfff700 1 -- 172.21.15.5:0/1815785219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56025be0a1f0 con 0x56025c06c1a0 2023-10-08T13:11:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.241+0000 7ff74bfff700 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 0x56025c060cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff74401a7b0 tx=0x7ff74400ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d13a24313b5e1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.241+0000 7ff7427fc700 1 -- 172.21.15.5:0/1815785219 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400a700 con 0x56025c06c1a0 2023-10-08T13:11:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.241+0000 7ff7427fc700 1 -- 172.21.15.5:0/1815785219 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff744011070 con 0x56025c06c1a0 2023-10-08T13:11:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.241+0000 7ff7427fc700 1 -- 172.21.15.5:0/1815785219 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744018ea0 con 0x56025c06c1a0 2023-10-08T13:11:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.242+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/1815785219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 msgr2=0x56025c060cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.242+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 0x56025c060cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff74401a7b0 tx=0x7ff74400ded0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.245+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/1815785219 shutdown_connections 2023-10-08T13:11:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.245+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06c1a0 0x56025c060cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.245+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.245+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/1815785219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06b880 0x56025c060790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.245+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/1815785219 >> 172.21.15.5:0/1815785219 conn(0x56025bfda200 msgr2=0x56025c06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.248+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/1815785219 shutdown_connections 2023-10-08T13:11:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.248+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/1815785219 wait complete. 2023-10-08T13:11:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.248+0000 7ff75e3ffb80 1 -- start start 2023-10-08T13:11:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 Processor -- start 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c074c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c075170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 0x56025c0756b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025c0d2c30 con 0x56025c06c1a0 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025c0d2da0 con 0x56025c06b880 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025c0d2f60 con 0x56025c0660b0 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff75e3ffb80 10 client.0 _ll_register_callbacks cb 0x7ff74400d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff743fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c075170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff743fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c075170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59610/0 (socket says 172.21.15.5:59610) 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff74b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c074c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49630/0 (socket says 172.21.15.5:49630) 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.249+0000 7ff743fff700 1 -- 172.21.15.5:0/3854617629 learned_addr learned my addr 172.21.15.5:0/3854617629 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff74b7fe700 1 -- 172.21.15.5:0/3854617629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 msgr2=0x56025c075170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c075170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff74b7fe700 1 -- 172.21.15.5:0/3854617629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 msgr2=0x56025c0756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 0x56025c0756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff74b7fe700 1 -- 172.21.15.5:0/3854617629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56025bdccc00 con 0x56025c0660b0 2023-10-08T13:11:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff74b7fe700 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c074c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x56025c082af0 tx=0x7ff73c011ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc6e2d3b792cbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff72affd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:11:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff72affd700 1 -- 172.21.15.5:0/3854617629 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011db0 con 0x56025c0660b0 2023-10-08T13:11:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff73c00be90 con 0x56025c0660b0 2023-10-08T13:11:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.250+0000 7ff72affd700 1 -- 172.21.15.5:0/3854617629 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff73c020040 con 0x56025c0660b0 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff72affd700 1 -- 172.21.15.5:0/3854617629 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff73c011420 con 0x56025c0660b0 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 10 client.26011 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56025bde2250 con 0x56025c0660b0 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff72affd700 1 -- 172.21.15.5:0/3854617629 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff73c00be90 con 0x56025c0660b0 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff72affd700 1 -- 172.21.15.5:0/3854617629 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff73c00b670 con 0x56025c0660b0 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 10 client.26011 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 20 client.26011 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c0d4700 0x56025c0d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 4 client.26011 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.251+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56025bfb1ad0 con 0x56025c0d4700 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.254+0000 7ff743fff700 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c0d4700 0x56025c0d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.255+0000 7ff72affd700 10 client.26011 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.255+0000 7ff743fff700 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c0d4700 0x56025c0d6b20 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e96a73baf4ba3 server_cookie=16322475932702e2 in_seq=0 out_seq=0 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.271+0000 7ff72affd700 1 -- 172.21.15.5:0/3854617629 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56025bfb1ad0 con 0x56025c0d4700 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.271+0000 7ff72affd700 10 client.26011 handle_command_reply: tid=0 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.271+0000 7ff75e3ffb80 1 client.26011 shutdown 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.271+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 msgr2=0x56025c074c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.271+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c074c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x56025c082af0 tx=0x7ff73c011ac0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 shutdown_connections 2023-10-08T13:11:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56025c06c1a0 0x56025c0756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56025c0660b0 0x56025c074c30 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x56025c082af0 tx=0x7ff73c011ac0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56025c0d4700 0x56025c0d6b20 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 --2- 172.21.15.5:0/3854617629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56025c06b880 0x56025c075170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff72affd700 0 client.26011 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 >> 172.21.15.5:0/3854617629 conn(0x56025bfda200 msgr2=0x56025c06db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 shutdown_connections 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 1 -- 172.21.15.5:0/3854617629 wait complete. 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.272+0000 7ff75e3ffb80 20 client.26011 trim_cache size 0 max 16384 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:11:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:11:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:11:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:11:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff7380a1720 msgr2=0x7ff7380a3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff7380a1720 0x7ff7380a3be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff74400ab10 tx=0x7ff744009230 comp rx=0 tx=0).stop 2023-10-08T13:11:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 msgr2=0x7ff74c07d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c07d320 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff734006010 tx=0x7ff734003c10 comp rx=0 tx=0).stop 2023-10-08T13:11:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 shutdown_connections 2023-10-08T13:11:15.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff7380a1720 0x7ff7380a3be0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff74c10c000 0x7ff74c07d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c107a60 0x7ff74c083260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 --2- 172.21.15.5:0/2886243440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff74c108380 0x7ff74c07d320 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 >> 172.21.15.5:0/2886243440 conn(0x7ff74c06b7c0 msgr2=0x7ff74c0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 shutdown_connections 2023-10-08T13:11:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:15.275+0000 7ff752216700 1 -- 172.21.15.5:0/2886243440 wait complete. 2023-10-08T13:11:16.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 295.0 s, 582.9 tps, lat 172.778 ms stddev 199.688 2023-10-08T13:11:16.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:16 smithi005 ceph-mon[99496]: pgmap v458: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 692 op/s 2023-10-08T13:11:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:16 smithi118 ceph-mon[104234]: pgmap v458: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 692 op/s 2023-10-08T13:11:17.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:16 smithi060 ceph-mon[103190]: pgmap v458: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 692 op/s 2023-10-08T13:11:18.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:18 smithi005 ceph-mon[99496]: pgmap v459: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.1 MiB/s wr, 660 op/s 2023-10-08T13:11:19.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:18 smithi118 ceph-mon[104234]: pgmap v459: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.1 MiB/s wr, 660 op/s 2023-10-08T13:11:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:18 smithi060 ceph-mon[103190]: pgmap v459: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.1 MiB/s wr, 660 op/s 2023-10-08T13:11:21.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:20 smithi118 ceph-mon[104234]: pgmap v460: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 9.7 MiB/s wr, 692 op/s 2023-10-08T13:11:21.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:20 smithi060 ceph-mon[103190]: pgmap v460: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 9.7 MiB/s wr, 692 op/s 2023-10-08T13:11:21.179 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:20 smithi005 ceph-mon[99496]: pgmap v460: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 9.7 MiB/s wr, 692 op/s 2023-10-08T13:11:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 300.0 s, 750.7 tps, lat 133.728 ms stddev 152.646 2023-10-08T13:11:23.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:22 smithi118 ceph-mon[104234]: pgmap v461: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 8.9 MiB/s wr, 633 op/s 2023-10-08T13:11:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:22 smithi060 ceph-mon[103190]: pgmap v461: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 8.9 MiB/s wr, 633 op/s 2023-10-08T13:11:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:22 smithi005 ceph-mon[99496]: pgmap v461: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 8.9 MiB/s wr, 633 op/s 2023-10-08T13:11:25.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:24 smithi118 ceph-mon[104234]: pgmap v462: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.2 MiB/s wr, 557 op/s 2023-10-08T13:11:25.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:24 smithi060 ceph-mon[103190]: pgmap v462: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.2 MiB/s wr, 557 op/s 2023-10-08T13:11:25.236 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:24 smithi005 ceph-mon[99496]: pgmap v462: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.2 MiB/s wr, 557 op/s 2023-10-08T13:11:26.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:26 smithi060 ceph-mon[103190]: pgmap v463: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 9.8 MiB/s wr, 651 op/s 2023-10-08T13:11:26.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:26 smithi005 ceph-mon[99496]: pgmap v463: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 9.8 MiB/s wr, 651 op/s 2023-10-08T13:11:26.758 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 305.0 s, 671.8 tps, lat 147.379 ms stddev 161.968 2023-10-08T13:11:26.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:26 smithi118 ceph-mon[104234]: pgmap v463: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 9.8 MiB/s wr, 651 op/s 2023-10-08T13:11:28.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:28 smithi060 ceph-mon[103190]: pgmap v464: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 680 op/s 2023-10-08T13:11:28.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:28 smithi005 ceph-mon[99496]: pgmap v464: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 680 op/s 2023-10-08T13:11:28.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:28 smithi118 ceph-mon[104234]: pgmap v464: 129 pgs: 129 active+clean; 4.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 680 op/s 2023-10-08T13:11:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.748+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/2289224051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b7810bff0 msgr2=0x7f4b78113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.748+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/2289224051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b7810bff0 0x7f4b78113b70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000b0a0 tx=0x7f4b7000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.764+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/2289224051 shutdown_connections 2023-10-08T13:11:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.764+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/2289224051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b7810bff0 0x7f4b78113b70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.764+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/2289224051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b78106fa0 0x7f4b78107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.764+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/2289224051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78107950 0x7f4b7810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.764+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/2289224051 >> 172.21.15.5:0/2289224051 conn(0x7f4b780765d0 msgr2=0x7f4b78105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:29.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.766+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/2289224051 shutdown_connections 2023-10-08T13:11:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.766+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/2289224051 wait complete. 2023-10-08T13:11:29.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.767+0000 7f4b7d2ff700 1 Processor -- start 2023-10-08T13:11:29.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 -- start start 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b78106fa0 0x7f4b78071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b7810bff0 0x7f4b78072400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b7806afc0 0x7f4b7806b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7806bc00 con 0x7f4b7810bff0 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7806bd70 con 0x7f4b7806afc0 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.770+0000 7f4b7d2ff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7806f9e0 con 0x7f4b78106fa0 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.771+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b7806afc0 0x7f4b7806b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.771+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b7806afc0 0x7f4b7806b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59620/0 (socket says 172.21.15.5:59620) 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.771+0000 7f4b777fe700 1 -- 172.21.15.5:0/164112756 learned_addr learned my addr 172.21.15.5:0/164112756 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.771+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b78106fa0 0x7f4b78071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.771+0000 7f4b767fc700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b7810bff0 0x7f4b78072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.772+0000 7f4b767fc700 1 -- 172.21.15.5:0/164112756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b78106fa0 msgr2=0x7f4b78071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.772+0000 7f4b767fc700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b78106fa0 0x7f4b78071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.772+0000 7f4b767fc700 1 -- 172.21.15.5:0/164112756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b7806afc0 msgr2=0x7f4b7806b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.772+0000 7f4b767fc700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b7806afc0 0x7f4b7806b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.772+0000 7f4b767fc700 1 -- 172.21.15.5:0/164112756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70009d00 con 0x7f4b7810bff0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.772+0000 7f4b767fc700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b7810bff0 0x7f4b78072400 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4b78069d70 tx=0x7f4b6800b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.774+0000 7f4b5ffff700 1 -- 172.21.15.5:0/164112756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011830 con 0x7f4b7810bff0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.774+0000 7f4b5ffff700 1 -- 172.21.15.5:0/164112756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b6800be50 con 0x7f4b7810bff0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.774+0000 7f4b5ffff700 1 -- 172.21.15.5:0/164112756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68010d70 con 0x7f4b7810bff0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.774+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7806fcc0 con 0x7f4b7810bff0 2023-10-08T13:11:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.774+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b78070180 con 0x7f4b7810bff0 2023-10-08T13:11:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.784+0000 7f4b894e8b80 1 Processor -- start 2023-10-08T13:11:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.785+0000 7f4b894e8b80 1 -- start start 2023-10-08T13:11:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.792+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.792+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.792+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.792+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae91816400 con 0x55ae918ae0b0 2023-10-08T13:11:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.792+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae91807bc0 con 0x55ae918b41a0 2023-10-08T13:11:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.792+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae918054e0 con 0x55ae918b3880 2023-10-08T13:11:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.793+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.793+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49648/0 (socket says 172.21.15.5:49648) 2023-10-08T13:11:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.793+0000 7f4b777fe700 1 -- 172.21.15.5:0/3240993764 learned_addr learned my addr 172.21.15.5:0/3240993764 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.799+0000 7f4b5ffff700 1 -- 172.21.15.5:0/164112756 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4b68011990 con 0x7f4b7810bff0 2023-10-08T13:11:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.799+0000 7f4b5ffff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b600a17f0 0x7f4b600a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.800+0000 7f4b5ffff700 1 -- 172.21.15.5:0/164112756 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4b680ccab0 con 0x7f4b7810bff0 2023-10-08T13:11:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.802+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.803+0000 7f4b767fc700 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.805+0000 7f4b767fc700 1 -- 172.21.15.5:0/3240993764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 msgr2=0x55ae918b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.805+0000 7f4b767fc700 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.805+0000 7f4b767fc700 1 -- 172.21.15.5:0/3240993764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 msgr2=0x55ae918adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.805+0000 7f4b767fc700 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.805+0000 7f4b767fc700 1 -- 172.21.15.5:0/3240993764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae9162bd80 con 0x55ae918ae0b0 2023-10-08T13:11:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.807+0000 7f4b767fc700 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ae510 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4b680c9f70 tx=0x7f4b68099460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62ffb4d377b1b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.808+0000 7f4b777fe700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b600a17f0 0x7f4b600a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.809+0000 7f4b5d7fa700 1 -- 172.21.15.5:0/3240993764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680ccea0 con 0x55ae918ae0b0 2023-10-08T13:11:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.809+0000 7f4b5d7fa700 1 -- 172.21.15.5:0/3240993764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b68099800 con 0x55ae918ae0b0 2023-10-08T13:11:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.809+0000 7f4b5d7fa700 1 -- 172.21.15.5:0/3240993764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680ca0e0 con 0x55ae918ae0b0 2023-10-08T13:11:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.810+0000 7f4b894e8b80 1 -- 172.21.15.5:0/3240993764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 msgr2=0x55ae918ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.810+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ae510 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4b680c9f70 tx=0x7f4b68099460 comp rx=0 tx=0).stop 2023-10-08T13:11:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.811+0000 7f4b777fe700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b600a17f0 0x7f4b600a3cb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000d010 tx=0x7f4b7000b3b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.812+0000 7f4b894e8b80 1 -- 172.21.15.5:0/3240993764 shutdown_connections 2023-10-08T13:11:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.812+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ae510 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.812+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.812+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/3240993764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.812+0000 7f4b894e8b80 1 -- 172.21.15.5:0/3240993764 >> 172.21.15.5:0/3240993764 conn(0x55ae91822200 msgr2=0x55ae918a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.823+0000 7f4b894e8b80 1 -- 172.21.15.5:0/3240993764 shutdown_connections 2023-10-08T13:11:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.823+0000 7f4b894e8b80 1 -- 172.21.15.5:0/3240993764 wait complete. 2023-10-08T13:11:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.823+0000 7f4b894e8b80 1 -- start start 2023-10-08T13:11:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.823+0000 7f4b894e8b80 1 Processor -- start 2023-10-08T13:11:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae91800dd0 con 0x55ae918ae0b0 2023-10-08T13:11:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae9179d6b0 con 0x55ae918b41a0 2023-10-08T13:11:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae9179d350 con 0x55ae918b3880 2023-10-08T13:11:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.845+0000 7f4b894e8b80 10 client.0 _ll_register_callbacks cb 0x55ae915fa7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918b7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59638/0 (socket says 172.21.15.5:59638) 2023-10-08T13:11:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 -- 172.21.15.5:0/2554707383 learned_addr learned my addr 172.21.15.5:0/2554707383 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 -- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 msgr2=0x55ae918b74c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:11:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b74c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 -- 172.21.15.5:0/2554707383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 msgr2=0x55ae918ba1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.847+0000 7f4b777fe700 1 -- 172.21.15.5:0/2554707383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b78070180 con 0x55ae918b41a0 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.848+0000 7f4b777fe700 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918b7c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000b070 tx=0x7f4b7000b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=783005d0d0dd64f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.848+0000 7f4b5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.848+0000 7f4b5aff5700 1 -- 172.21.15.5:0/2554707383 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7002c070 con 0x55ae918b41a0 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.848+0000 7f4b5aff5700 1 -- 172.21.15.5:0/2554707383 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4b70005750 con 0x55ae918b41a0 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.857+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae917c8e50 con 0x55ae918b41a0 2023-10-08T13:11:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.858+0000 7f4b5aff5700 1 -- 172.21.15.5:0/2554707383 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7000e040 con 0x55ae918b41a0 2023-10-08T13:11:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.867+0000 7f4b894e8b80 10 client.25970 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.867+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ae91614c00 con 0x55ae918b41a0 2023-10-08T13:11:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b5aff5700 1 -- 172.21.15.5:0/2554707383 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ae917c8e50 con 0x55ae918b41a0 2023-10-08T13:11:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b5aff5700 1 -- 172.21.15.5:0/2554707383 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4b7002f030 con 0x55ae918b41a0 2023-10-08T13:11:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b894e8b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b894e8b80 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b894e8b80 20 client.25970 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae918c7de0 0x55ae918ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b894e8b80 4 client.25970 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.877+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae917f9db0 con 0x55ae918c7de0 2023-10-08T13:11:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.878+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae918c7de0 0x55ae918ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.879+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae918c7de0 0x55ae918ca200 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b67c4aa75a24134b server_cookie=a21fa5028e98adb6 in_seq=0 out_seq=0 2023-10-08T13:11:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.879+0000 7f4b5aff5700 10 client.25970 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.880+0000 7f4b5aff5700 1 -- 172.21.15.5:0/2554707383 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ae917f9db0 con 0x55ae918c7de0 2023-10-08T13:11:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.880+0000 7f4b5aff5700 10 client.25970 handle_command_reply: tid=0 2023-10-08T13:11:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.880+0000 7f4b894e8b80 1 client.25970 shutdown 2023-10-08T13:11:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 msgr2=0x55ae918b7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918b7c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000b070 tx=0x7f4b7000b7b0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 shutdown_connections 2023-10-08T13:11:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae918c7de0 0x55ae918ca200 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918b41a0 0x55ae918b7c00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918ae0b0 0x55ae918ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2554707383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 >> 172.21.15.5:0/2554707383 conn(0x55ae91822200 msgr2=0x55ae918a8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.883+0000 7f4b5aff5700 0 client.25970 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.884+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 shutdown_connections 2023-10-08T13:11:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.884+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2554707383 wait complete. 2023-10-08T13:11:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.884+0000 7f4b894e8b80 20 client.25970 trim_cache size 0 max 16384 2023-10-08T13:11:29.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 Processor -- start 2023-10-08T13:11:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 -- start start 2023-10-08T13:11:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae916818c0 con 0x55ae918b41a0 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae918b3fe0 con 0x55ae918ae0b0 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae918aa100 con 0x55ae918b3880 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b76ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918a8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36464/0 (socket says 172.21.15.5:36464) 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b777fe700 1 -- 172.21.15.5:0/2054085068 learned_addr learned my addr 172.21.15.5:0/2054085068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b767fc700 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.908+0000 7f4b777fe700 1 -- 172.21.15.5:0/2054085068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 msgr2=0x55ae918a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b777fe700 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b777fe700 1 -- 172.21.15.5:0/2054085068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 msgr2=0x55ae918adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b777fe700 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b777fe700 1 -- 172.21.15.5:0/2054085068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae916521f0 con 0x55ae918b41a0 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b777fe700 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918a8cd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4b70005440 tx=0x7f4b70005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c09929201002c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b5dffb700 1 -- 172.21.15.5:0/2054085068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7002c070 con 0x55ae918b41a0 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b5dffb700 1 -- 172.21.15.5:0/2054085068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b70005950 con 0x55ae918b41a0 2023-10-08T13:11:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.909+0000 7f4b5dffb700 1 -- 172.21.15.5:0/2054085068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000e070 con 0x55ae918b41a0 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2054085068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 msgr2=0x55ae918a8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918a8cd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4b70005440 tx=0x7f4b70005470 comp rx=0 tx=0).stop 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2054085068 shutdown_connections 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918a8cd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/2054085068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2054085068 >> 172.21.15.5:0/2054085068 conn(0x55ae91822200 msgr2=0x55ae918b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2054085068 shutdown_connections 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 -- 172.21.15.5:0/2054085068 wait complete. 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 -- start start 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.910+0000 7f4b894e8b80 1 Processor -- start 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918bcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae9191ae20 con 0x55ae918b41a0 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae9191af90 con 0x55ae918ae0b0 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae9191b150 con 0x55ae918b3880 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 10 client.0 _ll_register_callbacks cb 0x7f4b700077f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b76ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918bcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918bd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36470/0 (socket says 172.21.15.5:36470) 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 -- 172.21.15.5:0/763067030 learned_addr learned my addr 172.21.15.5:0/763067030 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b767fc700 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 -- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 msgr2=0x55ae918bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 -- 172.21.15.5:0/763067030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 msgr2=0x55ae918bcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918bcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 -- 172.21.15.5:0/763067030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c0096c0 con 0x55ae918b41a0 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b777fe700 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918bd6f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000b070 tx=0x7f4b70020c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eeb66da05c1fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:11:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b5aff5700 1 -- 172.21.15.5:0/763067030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7002c070 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b5aff5700 1 -- 172.21.15.5:0/763067030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4b70005750 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.911+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b68099800 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b5aff5700 1 -- 172.21.15.5:0/763067030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7000e070 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 10 client.16476 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ae91614c00 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b5aff5700 1 -- 172.21.15.5:0/763067030 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b68099800 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b5aff5700 1 -- 172.21.15.5:0/763067030 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4b7002f040 con 0x55ae918b41a0 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 10 client.16476 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 10 client.16476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 20 client.16476 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:29.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae9191c4f0 0x55ae9191e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 4 client.16476 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:11:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ae917f9ad0 con 0x55ae9191c4f0 2023-10-08T13:11:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.912+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae9191c4f0 0x55ae9191e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.913+0000 7f4b5aff5700 10 client.16476 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:29.913+0000 7f4b76ffd700 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae9191c4f0 0x55ae9191e910 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5af55049d48e76 server_cookie=19a7bb033f2f357b in_seq=0 out_seq=0 2023-10-08T13:11:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.081+0000 7f4b5aff5700 1 -- 172.21.15.5:0/763067030 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ae917f9ad0 con 0x55ae9191c4f0 2023-10-08T13:11:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.081+0000 7f4b5aff5700 10 client.16476 handle_command_reply: tid=0 2023-10-08T13:11:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.081+0000 7f4b894e8b80 1 client.16476 shutdown 2023-10-08T13:11:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 msgr2=0x55ae918bd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918bd6f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000b070 tx=0x7f4b70020c80 comp rx=0 tx=0).stop 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 shutdown_connections 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae918b41a0 0x55ae918bd6f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ae9191c4f0 0x55ae9191e910 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae918ae0b0 0x55ae918bcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 --2- 172.21.15.5:0/763067030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ae918b3880 0x55ae918bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.084+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 >> 172.21.15.5:0/763067030 conn(0x55ae91822200 msgr2=0x55ae918b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.089+0000 7f4b5aff5700 0 client.16476 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.102+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 shutdown_connections 2023-10-08T13:11:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.106+0000 7f4b894e8b80 1 -- 172.21.15.5:0/763067030 wait complete. 2023-10-08T13:11:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:11:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:11:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:11:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:11:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.107+0000 7f4b894e8b80 20 client.16476 trim_cache size 0 max 16384 2023-10-08T13:11:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.120+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b600a17f0 msgr2=0x7f4b600a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.120+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b600a17f0 0x7f4b600a3cb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000d010 tx=0x7f4b7000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.120+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b7810bff0 msgr2=0x7f4b78072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.120+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b7810bff0 0x7f4b78072400 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4b78069d70 tx=0x7f4b6800b750 comp rx=0 tx=0).stop 2023-10-08T13:11:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.122+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 shutdown_connections 2023-10-08T13:11:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.122+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b600a17f0 0x7f4b600a3cb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.122+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b7806afc0 0x7f4b7806b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.122+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b78106fa0 0x7f4b78071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.122+0000 7f4b7d2ff700 1 --2- 172.21.15.5:0/164112756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b7810bff0 0x7f4b78072400 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.122+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 >> 172.21.15.5:0/164112756 conn(0x7f4b780765d0 msgr2=0x7f4b78078220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.125+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 shutdown_connections 2023-10-08T13:11:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:30.125+0000 7f4b7d2ff700 1 -- 172.21.15.5:0/164112756 wait complete. 2023-10-08T13:11:30.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:30 smithi118 ceph-mon[104234]: pgmap v465: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 12 MiB/s wr, 720 op/s 2023-10-08T13:11:30.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:30 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:11:30.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:30 smithi060 ceph-mon[103190]: pgmap v465: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 12 MiB/s wr, 720 op/s 2023-10-08T13:11:30.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:30 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:11:30.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:30 smithi005 ceph-mon[99496]: pgmap v465: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 12 MiB/s wr, 720 op/s 2023-10-08T13:11:30.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:30 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:11:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 310.0 s, 657.7 tps, lat 149.863 ms stddev 172.516 2023-10-08T13:11:32.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:32 smithi118 ceph-mon[104234]: pgmap v466: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 611 op/s 2023-10-08T13:11:32.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:32 smithi060 ceph-mon[103190]: pgmap v466: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 611 op/s 2023-10-08T13:11:32.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:32 smithi005 ceph-mon[99496]: pgmap v466: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 10 MiB/s wr, 611 op/s 2023-10-08T13:11:33.777 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:11:33.777 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:11:33.777 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:33 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:11:33.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:11:33.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:11:33.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:33 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:11:33.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:11:33.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:11:33.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:33 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:11:34.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:34 smithi118 ceph-mon[104234]: pgmap v467: 129 pgs: 129 active+clean; 4.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.6 MiB/s wr, 629 op/s 2023-10-08T13:11:34.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:34 smithi060 ceph-mon[103190]: pgmap v467: 129 pgs: 129 active+clean; 4.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.6 MiB/s wr, 629 op/s 2023-10-08T13:11:34.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:34 smithi005 ceph-mon[99496]: pgmap v467: 129 pgs: 129 active+clean; 4.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.6 MiB/s wr, 629 op/s 2023-10-08T13:11:36.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:36 smithi060 ceph-mon[103190]: pgmap v468: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 715 op/s 2023-10-08T13:11:36.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:36 smithi005 ceph-mon[99496]: pgmap v468: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 715 op/s 2023-10-08T13:11:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 315.0 s, 440.4 tps, lat 201.925 ms stddev 247.526 2023-10-08T13:11:36.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:36 smithi118 ceph-mon[104234]: pgmap v468: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 715 op/s 2023-10-08T13:11:38.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:38 smithi118 ceph-mon[104234]: pgmap v469: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 669 op/s 2023-10-08T13:11:38.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:38 smithi060 ceph-mon[103190]: pgmap v469: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 669 op/s 2023-10-08T13:11:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:38 smithi005 ceph-mon[99496]: pgmap v469: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 669 op/s 2023-10-08T13:11:40.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:40 smithi118 ceph-mon[104234]: pgmap v470: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.0 MiB/s wr, 634 op/s 2023-10-08T13:11:40.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:40 smithi060 ceph-mon[103190]: pgmap v470: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.0 MiB/s wr, 634 op/s 2023-10-08T13:11:40.930 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:40 smithi005 ceph-mon[99496]: pgmap v470: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.0 MiB/s wr, 634 op/s 2023-10-08T13:11:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 320.0 s, 168.6 tps, lat 662.229 ms stddev 1540.049 2023-10-08T13:11:42.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:42 smithi118 ceph-mon[104234]: pgmap v471: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 497 op/s 2023-10-08T13:11:42.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:42 smithi060 ceph-mon[103190]: pgmap v471: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 497 op/s 2023-10-08T13:11:42.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:42 smithi005 ceph-mon[99496]: pgmap v471: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 497 op/s 2023-10-08T13:11:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.344+0000 7f7adcde3700 1 -- 172.21.15.5:0/2115383348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8109ab0 msgr2=0x7f7ad8112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.344+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2115383348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8109ab0 0x7f7ad8112200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009990 tx=0x7f7acc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.345+0000 7f7adcde3700 1 -- 172.21.15.5:0/2115383348 shutdown_connections 2023-10-08T13:11:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.345+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2115383348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8112740 0x7f7ad8114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.345+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2115383348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ad8109190 0x7f7ad8109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.345+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2115383348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8109ab0 0x7f7ad8112200 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.345+0000 7f7adcde3700 1 -- 172.21.15.5:0/2115383348 >> 172.21.15.5:0/2115383348 conn(0x7f7ad806b7c0 msgr2=0x7f7ad806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.349+0000 7f7adcde3700 1 -- 172.21.15.5:0/2115383348 shutdown_connections 2023-10-08T13:11:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.349+0000 7f7adcde3700 1 -- 172.21.15.5:0/2115383348 wait complete. 2023-10-08T13:11:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 Processor -- start 2023-10-08T13:11:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 -- start start 2023-10-08T13:11:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ad8109ab0 0x7f7ad811d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8112740 0x7f7ad811d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8118390 0x7f7ad8118840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8118e40 con 0x7f7ad8112740 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8118fb0 con 0x7f7ad8109ab0 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7adcde3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8119170 con 0x7f7ad8118390 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7ad5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8112740 0x7f7ad811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7ad6d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8118390 0x7f7ad8118840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7ad5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8112740 0x7f7ad811d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36478/0 (socket says 172.21.15.5:36478) 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7ad5d9b700 1 -- 172.21.15.5:0/2023597137 learned_addr learned my addr 172.21.15.5:0/2023597137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.350+0000 7f7ad659c700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ad8109ab0 0x7f7ad811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/2023597137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ad8109ab0 msgr2=0x7f7ad811d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ad8109ab0 0x7f7ad811d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8112740 msgr2=0x7f7ad811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8112740 0x7f7ad811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/2023597137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0095f0 con 0x7f7ad8118390 2023-10-08T13:11:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8118390 0x7f7ad8118840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ad806cfa0 tx=0x7f7ad000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ac77fe700 1 -- 172.21.15.5:0/2023597137 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0018070 con 0x7f7ad8118390 2023-10-08T13:11:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ac77fe700 1 -- 172.21.15.5:0/2023597137 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ad000f040 con 0x7f7ad8118390 2023-10-08T13:11:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7ac77fe700 1 -- 172.21.15.5:0/2023597137 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000ccd0 con 0x7f7ad8118390 2023-10-08T13:11:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.351+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad81baec0 con 0x7f7ad8118390 2023-10-08T13:11:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.352+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad81bb290 con 0x7f7ad8118390 2023-10-08T13:11:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.361+0000 7f7ac77fe700 1 -- 172.21.15.5:0/2023597137 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7ad0004000 con 0x7f7ad8118390 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.362+0000 7f7ac77fe700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ac00a16e0 0x7f7ac00a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.362+0000 7f7ac77fe700 1 -- 172.21.15.5:0/2023597137 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7ad00ccef0 con 0x7f7ad8118390 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 Processor -- start 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 -- start start 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 0x5605152b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56051521f400 con 0x5605152bc880 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x560515210bc0 con 0x5605152b70b0 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56051520e4e0 con 0x5605152bd1a0 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ad5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 0x5605152b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ad5d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 0x5605152b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49692/0 (socket says 172.21.15.5:49692) 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.363+0000 7f7ad5d9b700 1 -- 172.21.15.5:0/248476384 learned_addr learned my addr 172.21.15.5:0/248476384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.364+0000 7f7ad5d9b700 1 -- 172.21.15.5:0/248476384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 msgr2=0x5605152b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.364+0000 7f7ad5d9b700 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.364+0000 7f7ad5d9b700 1 -- 172.21.15.5:0/248476384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 msgr2=0x5605152bcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.364+0000 7f7ad5d9b700 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.364+0000 7f7ad5d9b700 1 -- 172.21.15.5:0/248476384 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560515034d80 con 0x5605152bd1a0 2023-10-08T13:11:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.364+0000 7f7ad5d9b700 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 0x5605152b6b70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7acc005ed0 tx=0x7f7acc005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb0060f75fbe0ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.365+0000 7f7ad659c700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ac00a16e0 0x7f7ac00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.365+0000 7f7ad659c700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ac00a16e0 0x7f7ac00a3ba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006e20 tx=0x7f7ac8006d70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.371+0000 7f7ac4ff9700 1 -- 172.21.15.5:0/248476384 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00b6e0 con 0x5605152bd1a0 2023-10-08T13:11:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.371+0000 7f7ac4ff9700 1 -- 172.21.15.5:0/248476384 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7acc03f070 con 0x5605152bd1a0 2023-10-08T13:11:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.371+0000 7f7ac4ff9700 1 -- 172.21.15.5:0/248476384 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc004cb0 con 0x5605152bd1a0 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/248476384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 msgr2=0x5605152b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 0x5605152b6b70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7acc005ed0 tx=0x7f7acc005f00 comp rx=0 tx=0).stop 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/248476384 shutdown_connections 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152bcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/248476384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bd1a0 0x5605152b6b70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.372+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/248476384 >> 172.21.15.5:0/248476384 conn(0x56051522b200 msgr2=0x5605152b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.375+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/248476384 shutdown_connections 2023-10-08T13:11:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.375+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/248476384 wait complete. 2023-10-08T13:11:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.375+0000 7f7ae8fccb80 1 -- start start 2023-10-08T13:11:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.375+0000 7f7ae8fccb80 1 Processor -- start 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152b70b0 0x5605152c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560515209dd0 con 0x5605152bc880 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605151a66b0 con 0x5605152bd1a0 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605151a6350 con 0x5605152b70b0 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ae8fccb80 10 client.0 _ll_register_callbacks cb 0x5605150037a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ad5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ad6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ad6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152c0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59678/0 (socket says 172.21.15.5:59678) 2023-10-08T13:11:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/3032569447 learned_addr learned my addr 172.21.15.5:0/3032569447 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.376+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152b70b0 0x5605152c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152b70b0 msgr2=0x5605152c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152b70b0 0x5605152c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/3032569447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 msgr2=0x5605152c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad6d9d700 1 -- 172.21.15.5:0/3032569447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad8115500 con 0x5605152bd1a0 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152b70b0 0x5605152c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152c0c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00998c0 tx=0x7f7ad0004db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d2e37e03609c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7abdffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7abdffb700 1 -- 172.21.15.5:0/3032569447 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad009a2c0 con 0x5605152bd1a0 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7abdffb700 1 -- 172.21.15.5:0/3032569447 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7ad0099bc0 con 0x5605152bd1a0 2023-10-08T13:11:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605151d1e50 con 0x5605152bd1a0 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7abdffb700 1 -- 172.21.15.5:0/3032569447 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad009dd10 con 0x5605152bd1a0 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ae8fccb80 10 client.25982 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.377+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56051501dc00 con 0x5605152bd1a0 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.378+0000 7f7abdffb700 1 -- 172.21.15.5:0/3032569447 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5605151d1e50 con 0x5605152bd1a0 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7abdffb700 1 -- 172.21.15.5:0/3032569447 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7ad00990b0 con 0x5605152bd1a0 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7ae8fccb80 10 client.25982 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7ae8fccb80 10 client.25982 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7ae8fccb80 20 client.25982 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605152d0c00 0x5605152d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7ae8fccb80 4 client.25982 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.379+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560515202db0 con 0x5605152d0c00 2023-10-08T13:11:43.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.381+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605152d0c00 0x5605152d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.382+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605152d0c00 0x5605152d3020 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4757bc7684ff687 server_cookie=70751d956fffc950 in_seq=0 out_seq=0 2023-10-08T13:11:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.382+0000 7f7abdffb700 10 client.25982 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.387+0000 7f7abdffb700 1 -- 172.21.15.5:0/3032569447 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560515202db0 con 0x5605152d0c00 2023-10-08T13:11:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.387+0000 7f7abdffb700 10 client.25982 handle_command_reply: tid=0 2023-10-08T13:11:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.388+0000 7f7ae8fccb80 1 client.25982 shutdown 2023-10-08T13:11:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.393+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 msgr2=0x5605152c0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.393+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152c0c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00998c0 tx=0x7f7ad0004db0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.397+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 shutdown_connections 2023-10-08T13:11:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.397+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605152d0c00 0x5605152d3020 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.397+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152c0c30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.397+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152b70b0 0x5605152c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.397+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3032569447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bc880 0x5605152c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.397+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 >> 172.21.15.5:0/3032569447 conn(0x56051522b200 msgr2=0x5605152b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.398+0000 7f7abdffb700 0 client.25982 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.398+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 shutdown_connections 2023-10-08T13:11:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.399+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3032569447 wait complete. 2023-10-08T13:11:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.428+0000 7f7ae8fccb80 20 client.25982 trim_cache size 0 max 16384 2023-10-08T13:11:43.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 Processor -- start 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 -- start start 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 0x5605152b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bd1a0 0x5605152ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56051508a8c0 con 0x5605152bd1a0 2023-10-08T13:11:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605152c1230 con 0x5605152b70b0 2023-10-08T13:11:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.456+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605152c1840 con 0x5605152bc880 2023-10-08T13:11:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.457+0000 7f7ad659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.462+0000 7f7ad659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59684/0 (socket says 172.21.15.5:59684) 2023-10-08T13:11:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.462+0000 7f7ad659c700 1 -- 172.21.15.5:0/3795871055 learned_addr learned my addr 172.21.15.5:0/3795871055 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.462+0000 7f7ad659c700 1 -- 172.21.15.5:0/3795871055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 msgr2=0x5605152b1cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:11:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.462+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 0x5605152b1cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ad659c700 1 -- 172.21.15.5:0/3795871055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bd1a0 msgr2=0x5605152ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bd1a0 0x5605152ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ad659c700 1 -- 172.21.15.5:0/3795871055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56051505b1f0 con 0x5605152b70b0 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ad659c700 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b1790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80729f0 tx=0x7f7ac8011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2900a7c0b008ac80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ac57fa700 1 -- 172.21.15.5:0/3795871055 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8015620 con 0x5605152b70b0 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ac57fa700 1 -- 172.21.15.5:0/3795871055 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ac802a070 con 0x5605152b70b0 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.463+0000 7f7ac57fa700 1 -- 172.21.15.5:0/3795871055 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8021bb0 con 0x5605152b70b0 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.464+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3795871055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 msgr2=0x5605152b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.464+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b1790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80729f0 tx=0x7f7ac8011000 comp rx=0 tx=0).stop 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.472+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3795871055 shutdown_connections 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.472+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152bd1a0 0x5605152ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.472+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152b70b0 0x5605152b1790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.472+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/3795871055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 0x5605152b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.472+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3795871055 >> 172.21.15.5:0/3795871055 conn(0x56051522b200 msgr2=0x5605152bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.483+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3795871055 shutdown_connections 2023-10-08T13:11:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.483+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/3795871055 wait complete. 2023-10-08T13:11:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.483+0000 7f7ae8fccb80 1 -- start start 2023-10-08T13:11:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.483+0000 7f7ae8fccb80 1 Processor -- start 2023-10-08T13:11:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 0x5605152b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 0x5605152b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605152b93a0 con 0x5605152b70b0 2023-10-08T13:11:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605152b9510 con 0x5605152bd1a0 2023-10-08T13:11:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605152b96d0 con 0x5605152bc880 2023-10-08T13:11:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.484+0000 7f7ae8fccb80 10 client.0 _ll_register_callbacks cb 0x7f7ad00997b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.485+0000 7f7ad659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 0x5605152b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.485+0000 7f7ad659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 0x5605152b8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36510/0 (socket says 172.21.15.5:36510) 2023-10-08T13:11:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.485+0000 7f7ad659c700 1 -- 172.21.15.5:0/2555496661 learned_addr learned my addr 172.21.15.5:0/2555496661 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.487+0000 7f7ad6d9d700 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.490+0000 7f7ad659c700 1 -- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 msgr2=0x5605152b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.490+0000 7f7ad659c700 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 0x5605152b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.490+0000 7f7ad659c700 1 -- 172.21.15.5:0/2555496661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 msgr2=0x5605152b8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.490+0000 7f7ad659c700 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152b8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.490+0000 7f7ad659c700 1 -- 172.21.15.5:0/2555496661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac801a040 con 0x5605152b70b0 2023-10-08T13:11:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.504+0000 7f7ad659c700 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 0x5605152b8390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac8021530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e12cf5ab1babf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.504+0000 7f7abdffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:11:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.511+0000 7f7abdffb700 1 -- 172.21.15.5:0/2555496661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8025070 con 0x5605152b70b0 2023-10-08T13:11:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.511+0000 7f7abdffb700 1 -- 172.21.15.5:0/2555496661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7ac8021c90 con 0x5605152b70b0 2023-10-08T13:11:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.511+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7acc03f070 con 0x5605152b70b0 2023-10-08T13:11:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.517+0000 7f7abdffb700 1 -- 172.21.15.5:0/2555496661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ac8027040 con 0x5605152b70b0 2023-10-08T13:11:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.517+0000 7f7ae8fccb80 10 client.16488 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.517+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560515033250 con 0x5605152b70b0 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7abdffb700 1 -- 172.21.15.5:0/2555496661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ac803c030 con 0x5605152b70b0 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7abdffb700 1 -- 172.21.15.5:0/2555496661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7ac8015620 con 0x5605152b70b0 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7ae8fccb80 10 client.16488 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7ae8fccb80 10 client.16488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7ae8fccb80 20 client.16488 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605153254d0 0x5605153278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7ae8fccb80 4 client.16488 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:11:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.528+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560515202ad0 con 0x5605153254d0 2023-10-08T13:11:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.529+0000 7f7ad5d9b700 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605153254d0 0x5605153278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.529+0000 7f7ad5d9b700 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605153254d0 0x5605153278f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb40be72422f7875 server_cookie=ffc96b4f02268bfe in_seq=0 out_seq=0 2023-10-08T13:11:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.533+0000 7f7abdffb700 10 client.16488 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.626+0000 7f7abdffb700 1 -- 172.21.15.5:0/2555496661 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560515202ad0 con 0x5605153254d0 2023-10-08T13:11:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.626+0000 7f7abdffb700 10 client.16488 handle_command_reply: tid=0 2023-10-08T13:11:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.627+0000 7f7ae8fccb80 1 client.16488 shutdown 2023-10-08T13:11:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.627+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 msgr2=0x5605152b8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.627+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 0x5605152b8390 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac8021530 comp rx=0 tx=0).stop 2023-10-08T13:11:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 shutdown_connections 2023-10-08T13:11:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5605153254d0 0x5605153278f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605152bd1a0 0x5605152b8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5605152b70b0 0x5605152b8390 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7abdffb700 0 client.16488 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 --2- 172.21.15.5:0/2555496661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5605152bc880 0x5605152b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 >> 172.21.15.5:0/2555496661 conn(0x56051522b200 msgr2=0x5605152ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 shutdown_connections 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 1 -- 172.21.15.5:0/2555496661 wait complete. 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7ae8fccb80 20 client.16488 trim_cache size 0 max 16384 2023-10-08T13:11:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:11:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:11:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:11:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:11:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ac00a16e0 msgr2=0x7f7ac00a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ac00a16e0 0x7f7ac00a3ba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006e20 tx=0x7f7ac8006d70 comp rx=0 tx=0).stop 2023-10-08T13:11:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8118390 msgr2=0x7f7ad8118840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.628+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8118390 0x7f7ad8118840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ad806cfa0 tx=0x7f7ad000ef90 comp rx=0 tx=0).stop 2023-10-08T13:11:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 shutdown_connections 2023-10-08T13:11:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7ac00a16e0 0x7f7ac00a3ba0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad8118390 0x7f7ad8118840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ad8109ab0 0x7f7ad811d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 --2- 172.21.15.5:0/2023597137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad8112740 0x7f7ad811d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 >> 172.21.15.5:0/2023597137 conn(0x7f7ad806b7c0 msgr2=0x7f7ad806f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 shutdown_connections 2023-10-08T13:11:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:43.629+0000 7f7adcde3700 1 -- 172.21.15.5:0/2023597137 wait complete. 2023-10-08T13:11:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.844+0000 7f2348111700 1 -- 172.21.15.5:0/2862584963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2340107a60 msgr2=0x7f2340107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.844+0000 7f2348111700 1 --2- 172.21.15.5:0/2862584963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2340107a60 0x7f2340107e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f233c009de0 tx=0x7f233c00b540 comp rx=0 tx=0).stop 2023-10-08T13:11:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.873+0000 7f2348111700 1 -- 172.21.15.5:0/2862584963 shutdown_connections 2023-10-08T13:11:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.873+0000 7f2348111700 1 --2- 172.21.15.5:0/2862584963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234010c000 0x7f2340078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.873+0000 7f2348111700 1 --2- 172.21.15.5:0/2862584963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2340107a60 0x7f2340107e40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.873+0000 7f2348111700 1 --2- 172.21.15.5:0/2862584963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2340108410 0x7f234010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.873+0000 7f2348111700 1 -- 172.21.15.5:0/2862584963 >> 172.21.15.5:0/2862584963 conn(0x7f234006b770 msgr2=0x7f234006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.895+0000 7f2348111700 1 -- 172.21.15.5:0/2862584963 shutdown_connections 2023-10-08T13:11:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.896+0000 7f2348111700 1 -- 172.21.15.5:0/2862584963 wait complete. 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.896+0000 7f2348111700 1 Processor -- start 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 -- start start 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2340107a60 0x7f23400833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 0x7f234007d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234007d7a0 0x7f234007dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23401bc980 con 0x7f234007d7a0 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23401bcaf0 con 0x7f234010c000 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f2348111700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23401bccb0 con 0x7f2340107a60 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f23456ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 0x7f234007d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f23456ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 0x7f234007d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59702/0 (socket says 172.21.15.5:59702) 2023-10-08T13:11:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.905+0000 7f23456ac700 1 -- 172.21.15.5:0/2075787182 learned_addr learned my addr 172.21.15.5:0/2075787182 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.910+0000 7f23456ac700 1 -- 172.21.15.5:0/2075787182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2340107a60 msgr2=0x7f23400833b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.910+0000 7f23456ac700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2340107a60 0x7f23400833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.910+0000 7f23456ac700 1 -- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234007d7a0 msgr2=0x7f234007dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.910+0000 7f23456ac700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234007d7a0 0x7f234007dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.910+0000 7f23456ac700 1 -- 172.21.15.5:0/2075787182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0095f0 con 0x7f234010c000 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.917+0000 7f23456ac700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 0x7f234007d260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f233000e970 tx=0x7f233000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.918+0000 7f2336ffd700 1 -- 172.21.15.5:0/2075787182 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2330009790 con 0x7f234010c000 2023-10-08T13:11:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.918+0000 7f2336ffd700 1 -- 172.21.15.5:0/2075787182 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2330004cf0 con 0x7f234010c000 2023-10-08T13:11:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.918+0000 7f2336ffd700 1 -- 172.21.15.5:0/2075787182 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2330005620 con 0x7f234010c000 2023-10-08T13:11:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.922+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234007ecb0 con 0x7f234010c000 2023-10-08T13:11:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.922+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234007f140 con 0x7f234010c000 2023-10-08T13:11:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.927+0000 7f2336ffd700 1 -- 172.21.15.5:0/2075787182 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f233000cc60 con 0x7f234010c000 2023-10-08T13:11:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 Processor -- start 2023-10-08T13:11:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 -- start start 2023-10-08T13:11:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f2336ffd700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f232c0a1780 0x7f232c0a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d590a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d590fb0 0x55ce6d59b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 0x55ce6d59e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d4f1460 con 0x55ce6d590690 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d4e2c20 con 0x55ce6d590fb0 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23542fab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d4e0540 con 0x55ce6d59be60 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f2336ffd700 1 -- 172.21.15.5:0/2075787182 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2330014070 con 0x7f234010c000 2023-10-08T13:11:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.928+0000 7f23466ae700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f232c0a1780 0x7f232c0a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 0x55ce6d59e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 0x55ce6d59e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49732/0 (socket says 172.21.15.5:49732) 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 -- 172.21.15.5:0/3278124749 learned_addr learned my addr 172.21.15.5:0/3278124749 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 -- 172.21.15.5:0/3278124749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d590fb0 msgr2=0x55ce6d59b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d590fb0 0x55ce6d59b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 -- 172.21.15.5:0/3278124749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 msgr2=0x55ce6d590a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d590a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.929+0000 7f23466ae700 1 -- 172.21.15.5:0/3278124749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce6d306de0 con 0x55ce6d59be60 2023-10-08T13:11:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.934+0000 7f23466ae700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f232c0a1780 0x7f232c0a3c40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2338010cf0 tx=0x7f2338010370 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.934+0000 7f23466ae700 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 0x55ce6d59e250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2338010160 tx=0x7f233801a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a78d71b85016c03e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.934+0000 7f232bfff700 1 -- 172.21.15.5:0/3278124749 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800e070 con 0x55ce6d59be60 2023-10-08T13:11:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.934+0000 7f232bfff700 1 -- 172.21.15.5:0/3278124749 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2338017e80 con 0x55ce6d59be60 2023-10-08T13:11:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.934+0000 7f232bfff700 1 -- 172.21.15.5:0/3278124749 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338019d40 con 0x55ce6d59be60 2023-10-08T13:11:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.935+0000 7f23542fab80 1 -- 172.21.15.5:0/3278124749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 msgr2=0x55ce6d59e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.935+0000 7f23542fab80 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 0x55ce6d59e250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2338010160 tx=0x7f233801a000 comp rx=0 tx=0).stop 2023-10-08T13:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.944+0000 7f23542fab80 1 -- 172.21.15.5:0/3278124749 shutdown_connections 2023-10-08T13:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.944+0000 7f23542fab80 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d59be60 0x55ce6d59e250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.944+0000 7f23542fab80 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d590a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.944+0000 7f23542fab80 1 --2- 172.21.15.5:0/3278124749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d590fb0 0x55ce6d59b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.944+0000 7f23542fab80 1 -- 172.21.15.5:0/3278124749 >> 172.21.15.5:0/3278124749 conn(0x55ce6d4fd260 msgr2=0x55ce6d5842d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.948+0000 7f23542fab80 1 -- 172.21.15.5:0/3278124749 shutdown_connections 2023-10-08T13:11:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.954+0000 7f23542fab80 1 -- 172.21.15.5:0/3278124749 wait complete. 2023-10-08T13:11:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.955+0000 7f23542fab80 1 -- start start 2023-10-08T13:11:43.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.955+0000 7f23542fab80 1 Processor -- start 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d598cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d599230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d599770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d4dbe30 con 0x55ce6d590690 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d478710 con 0x55ce6d59be60 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d4783b0 con 0x55ce6d590fb0 2023-10-08T13:11:43.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23542fab80 10 client.0 _ll_register_callbacks cb 0x55ce6d2d5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23466ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d599770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23466ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d599770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59714/0 (socket says 172.21.15.5:59714) 2023-10-08T13:11:43.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.956+0000 7f23466ae700 1 -- 172.21.15.5:0/3928987971 learned_addr learned my addr 172.21.15.5:0/3928987971 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.961+0000 7f23466ae700 1 -- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 msgr2=0x55ce6d599230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.961+0000 7f23466ae700 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d599230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.961+0000 7f23466ae700 1 -- 172.21.15.5:0/3928987971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 msgr2=0x55ce6d598cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.961+0000 7f23466ae700 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d598cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.961+0000 7f23466ae700 1 -- 172.21.15.5:0/3928987971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2338011040 con 0x55ce6d59be60 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23466ae700 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d599770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2338019b00 tx=0x7f2338017960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3872dcc4182cd9db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23297fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23297fa700 1 -- 172.21.15.5:0/3928987971 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800e050 con 0x55ce6d59be60 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce6d4a3eb0 con 0x55ce6d59be60 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23297fa700 1 -- 172.21.15.5:0/3928987971 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2338003a00 con 0x55ce6d59be60 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23297fa700 1 -- 172.21.15.5:0/3928987971 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2338003bc0 con 0x55ce6d59be60 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23542fab80 10 client.25997 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.962+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ce6d2efc60 con 0x55ce6d59be60 2023-10-08T13:11:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23297fa700 1 -- 172.21.15.5:0/3928987971 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ce6d4a3eb0 con 0x55ce6d59be60 2023-10-08T13:11:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23297fa700 1 -- 172.21.15.5:0/3928987971 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f233801a560 con 0x55ce6d59be60 2023-10-08T13:11:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23542fab80 10 client.25997 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23542fab80 10 client.25997 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23542fab80 20 client.25997 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23542fab80 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5ab940 0x55ce6d5add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23542fab80 4 client.25997 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce6d4d4e10 con 0x55ce6d5ab940 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.963+0000 7f2345ead700 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5ab940 0x55ce6d5add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.964+0000 7f2345ead700 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5ab940 0x55ce6d5add80 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d2dc6e73c050989 server_cookie=80e232e9817283be in_seq=0 out_seq=0 2023-10-08T13:11:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.965+0000 7f23297fa700 10 client.25997 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.976+0000 7f23297fa700 1 -- 172.21.15.5:0/3928987971 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ce6d4d4e10 con 0x55ce6d5ab940 2023-10-08T13:11:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.976+0000 7f23297fa700 10 client.25997 handle_command_reply: tid=0 2023-10-08T13:11:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 client.25997 shutdown 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 msgr2=0x55ce6d599770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d599770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2338019b00 tx=0x7f2338017960 comp rx=0 tx=0).stop 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 shutdown_connections 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5ab940 0x55ce6d5add80 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d599770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d598cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23297fa700 0 client.25997 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 --2- 172.21.15.5:0/3928987971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d599230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 >> 172.21.15.5:0/3928987971 conn(0x55ce6d4fd260 msgr2=0x55ce6d583ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 shutdown_connections 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 1 -- 172.21.15.5:0/3928987971 wait complete. 2023-10-08T13:11:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:43.977+0000 7f23542fab80 20 client.25997 trim_cache size 0 max 16384 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.009+0000 7f23542fab80 1 Processor -- start 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.009+0000 7f23542fab80 1 -- start start 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23542fab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d597cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23542fab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d595f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23542fab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d596460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23542fab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d35c920 con 0x55ce6d590690 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23542fab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d4a3eb0 con 0x55ce6d59be60 2023-10-08T13:11:44.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23542fab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d59a2a0 con 0x55ce6d590fb0 2023-10-08T13:11:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23456ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d595f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23456ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d595f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49744/0 (socket says 172.21.15.5:49744) 2023-10-08T13:11:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23456ac700 1 -- 172.21.15.5:0/3089429282 learned_addr learned my addr 172.21.15.5:0/3089429282 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:44.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f23466ae700 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d596460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.010+0000 7f2345ead700 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d597cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.011+0000 7f23456ac700 1 -- 172.21.15.5:0/3089429282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 msgr2=0x55ce6d596460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:44.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.011+0000 7f23456ac700 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d596460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.011+0000 7f23456ac700 1 -- 172.21.15.5:0/3089429282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 msgr2=0x55ce6d597cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.011+0000 7f23456ac700 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d597cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.011+0000 7f23456ac700 1 -- 172.21.15.5:0/3089429282 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce6d32d250 con 0x55ce6d590fb0 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.011+0000 7f23456ac700 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d595f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23300cb080 tx=0x7f2330099ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51e069c100fdaf5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.012+0000 7f2334ff9700 1 -- 172.21.15.5:0/3089429282 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233009a310 con 0x55ce6d590fb0 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.012+0000 7f2334ff9700 1 -- 172.21.15.5:0/3089429282 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f233009e460 con 0x55ce6d590fb0 2023-10-08T13:11:44.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.012+0000 7f2334ff9700 1 -- 172.21.15.5:0/3089429282 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300cd2f0 con 0x55ce6d590fb0 2023-10-08T13:11:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.013+0000 7f23542fab80 1 -- 172.21.15.5:0/3089429282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 msgr2=0x55ce6d595f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.013+0000 7f23542fab80 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d595f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23300cb080 tx=0x7f2330099ed0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.013+0000 7f23542fab80 1 -- 172.21.15.5:0/3089429282 shutdown_connections 2023-10-08T13:11:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.013+0000 7f23542fab80 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d596460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.013+0000 7f23542fab80 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d597cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.013+0000 7f23542fab80 1 --2- 172.21.15.5:0/3089429282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d595f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.014+0000 7f23542fab80 1 -- 172.21.15.5:0/3089429282 >> 172.21.15.5:0/3089429282 conn(0x55ce6d4fd260 msgr2=0x55ce6d5975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.014+0000 7f23542fab80 1 -- 172.21.15.5:0/3089429282 shutdown_connections 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.014+0000 7f23542fab80 1 -- 172.21.15.5:0/3089429282 wait complete. 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 -- start start 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 Processor -- start 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d5a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d58de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d5a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d5a1d90 con 0x55ce6d590690 2023-10-08T13:11:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d5a1f00 con 0x55ce6d59be60 2023-10-08T13:11:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6d5a20c0 con 0x55ce6d590fb0 2023-10-08T13:11:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.015+0000 7f23542fab80 10 client.0 _ll_register_callbacks cb 0x7f2338010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.016+0000 7f23466ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d5a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.016+0000 7f23466ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d5a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59730/0 (socket says 172.21.15.5:59730) 2023-10-08T13:11:44.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.016+0000 7f23466ae700 1 -- 172.21.15.5:0/1482408689 learned_addr learned my addr 172.21.15.5:0/1482408689 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:44.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.021+0000 7f2345ead700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d5a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.023+0000 7f23456ac700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d58de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.023+0000 7f2345ead700 1 -- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 msgr2=0x55ce6d58de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.023+0000 7f2345ead700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d58de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.023+0000 7f2345ead700 1 -- 172.21.15.5:0/1482408689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 msgr2=0x55ce6d5a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.023+0000 7f2345ead700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d5a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.023+0000 7f2345ead700 1 -- 172.21.15.5:0/1482408689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234007f140 con 0x55ce6d590690 2023-10-08T13:11:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.024+0000 7f2345ead700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d5a1310 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55ce6d5ae690 tx=0x7f233c009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d81f599483f4d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.024+0000 7f23297fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:11:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.024+0000 7f23297fa700 1 -- 172.21.15.5:0/1482408689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c01d040 con 0x55ce6d590690 2023-10-08T13:11:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.024+0000 7f23297fa700 1 -- 172.21.15.5:0/1482408689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f233c003bd0 con 0x55ce6d590690 2023-10-08T13:11:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.025+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2338017e80 con 0x55ce6d590690 2023-10-08T13:11:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.025+0000 7f23297fa700 1 -- 172.21.15.5:0/1482408689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f233c021730 con 0x55ce6d590690 2023-10-08T13:11:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.025+0000 7f23542fab80 10 client.16497 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.025+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ce6d3052b0 con 0x55ce6d590690 2023-10-08T13:11:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.025+0000 7f23297fa700 1 -- 172.21.15.5:0/1482408689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2338017e80 con 0x55ce6d590690 2023-10-08T13:11:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23297fa700 1 -- 172.21.15.5:0/1482408689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f233c027020 con 0x55ce6d590690 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23542fab80 10 client.16497 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23542fab80 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23542fab80 20 client.16497 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23542fab80 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5f6be0 0x55ce6d5f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23542fab80 4 client.16497 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce6d4d4b30 con 0x55ce6d5f6be0 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.026+0000 7f23456ac700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5f6be0 0x55ce6d5f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.027+0000 7f23297fa700 10 client.16497 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.027+0000 7f23456ac700 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5f6be0 0x55ce6d5f8ff0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=668b770202381e02 server_cookie=22c1fe85d1528a0a in_seq=0 out_seq=0 2023-10-08T13:11:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.028+0000 7f23297fa700 1 -- 172.21.15.5:0/1482408689 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ce6d4d4b30 con 0x55ce6d5f6be0 2023-10-08T13:11:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.028+0000 7f23297fa700 10 client.16497 handle_command_reply: tid=0 2023-10-08T13:11:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.028+0000 7f23542fab80 1 client.16497 shutdown 2023-10-08T13:11:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.028+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 msgr2=0x55ce6d5a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.028+0000 7f23542fab80 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d5a1310 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55ce6d5ae690 tx=0x7f233c009ab0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 shutdown_connections 2023-10-08T13:11:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23542fab80 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55ce6d5f6be0 0x55ce6d5f8ff0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23542fab80 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ce6d59be60 0x55ce6d5a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23542fab80 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce6d590690 0x55ce6d5a1310 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23542fab80 1 --2- 172.21.15.5:0/1482408689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ce6d590fb0 0x55ce6d58de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 >> 172.21.15.5:0/1482408689 conn(0x55ce6d4fd260 msgr2=0x55ce6d597e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.034+0000 7f23297fa700 0 client.16497 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.052+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 shutdown_connections 2023-10-08T13:11:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.070+0000 7f23542fab80 1 -- 172.21.15.5:0/1482408689 wait complete. 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:11:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:11:44.083 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:11:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.076+0000 7f23542fab80 20 client.16497 trim_cache size 0 max 16384 2023-10-08T13:11:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.077+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f232c0a1780 msgr2=0x7f232c0a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.077+0000 7f2348111700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f232c0a1780 0x7f232c0a3c40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2338010cf0 tx=0x7f2338010370 comp rx=0 tx=0).stop 2023-10-08T13:11:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.077+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 msgr2=0x7f234007d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.077+0000 7f2348111700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 0x7f234007d260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f233000e970 tx=0x7f233000ed30 comp rx=0 tx=0).stop 2023-10-08T13:11:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.091+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 shutdown_connections 2023-10-08T13:11:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.091+0000 7f2348111700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f232c0a1780 0x7f232c0a3c40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.091+0000 7f2348111700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234007d7a0 0x7f234007dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.091+0000 7f2348111700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2340107a60 0x7f23400833b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.091+0000 7f2348111700 1 --2- 172.21.15.5:0/2075787182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f234010c000 0x7f234007d260 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:44.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.091+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 >> 172.21.15.5:0/2075787182 conn(0x7f234006b770 msgr2=0x7f23400703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.097+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 shutdown_connections 2023-10-08T13:11:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:11:44.109+0000 7f2348111700 1 -- 172.21.15.5:0/2075787182 wait complete. 2023-10-08T13:11:44.137 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:11:44.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:44 smithi060 ceph-mon[103190]: pgmap v472: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.9 MiB/s wr, 495 op/s 2023-10-08T13:11:44.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:44 smithi005 ceph-mon[99496]: pgmap v472: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.9 MiB/s wr, 495 op/s 2023-10-08T13:11:45.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:44 smithi118 ceph-mon[104234]: pgmap v472: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.9 MiB/s wr, 495 op/s 2023-10-08T13:11:46.667 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:46 smithi060 ceph-mon[103190]: pgmap v473: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 470 op/s 2023-10-08T13:11:46.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:46 smithi005 ceph-mon[99496]: pgmap v473: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 470 op/s 2023-10-08T13:11:46.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 325.0 s, 590.4 tps, lat 169.705 ms stddev 211.814 2023-10-08T13:11:46.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:46 smithi118 ceph-mon[104234]: pgmap v473: 129 pgs: 129 active+clean; 4.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 470 op/s 2023-10-08T13:11:48.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:48 smithi118 ceph-mon[104234]: pgmap v474: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.6 MiB/s wr, 444 op/s 2023-10-08T13:11:48.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:48 smithi060 ceph-mon[103190]: pgmap v474: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.6 MiB/s wr, 444 op/s 2023-10-08T13:11:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:48 smithi005 ceph-mon[99496]: pgmap v474: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.6 MiB/s wr, 444 op/s 2023-10-08T13:11:50.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:50 smithi118 ceph-mon[104234]: pgmap v475: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.4 MiB/s wr, 487 op/s 2023-10-08T13:11:50.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:50 smithi060 ceph-mon[103190]: pgmap v475: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.4 MiB/s wr, 487 op/s 2023-10-08T13:11:50.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:50 smithi005 ceph-mon[99496]: pgmap v475: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.4 MiB/s wr, 487 op/s 2023-10-08T13:11:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 330.0 s, 594.2 tps, lat 170.732 ms stddev 175.754 2023-10-08T13:11:52.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:52 smithi118 ceph-mon[104234]: pgmap v476: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.8 MiB/s wr, 430 op/s 2023-10-08T13:11:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:52 smithi060 ceph-mon[103190]: pgmap v476: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.8 MiB/s wr, 430 op/s 2023-10-08T13:11:52.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:52 smithi005 ceph-mon[99496]: pgmap v476: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.8 MiB/s wr, 430 op/s 2023-10-08T13:11:54.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:54 smithi118 ceph-mon[104234]: pgmap v477: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.1 MiB/s wr, 532 op/s 2023-10-08T13:11:54.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:54 smithi060 ceph-mon[103190]: pgmap v477: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.1 MiB/s wr, 532 op/s 2023-10-08T13:11:54.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:54 smithi005 ceph-mon[99496]: pgmap v477: 129 pgs: 129 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.1 MiB/s wr, 532 op/s 2023-10-08T13:11:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 335.0 s, 503.9 tps, lat 193.680 ms stddev 200.991 2023-10-08T13:11:56.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:56 smithi118 ceph-mon[104234]: pgmap v478: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.6 MiB/s wr, 589 op/s 2023-10-08T13:11:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.837+0000 7fbc508bf700 1 -- 172.21.15.5:0/1897888688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0fff30 msgr2=0x7fbc4c067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.837+0000 7fbc508bf700 1 --2- 172.21.15.5:0/1897888688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0fff30 0x7fbc4c067c30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009f90 tx=0x7fbc4400b330 comp rx=0 tx=0).stop 2023-10-08T13:11:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.844+0000 7fbc508bf700 1 -- 172.21.15.5:0/1897888688 shutdown_connections 2023-10-08T13:11:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.844+0000 7fbc508bf700 1 --2- 172.21.15.5:0/1897888688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0fff30 0x7fbc4c067c30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.844+0000 7fbc508bf700 1 --2- 172.21.15.5:0/1897888688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.844+0000 7fbc508bf700 1 --2- 172.21.15.5:0/1897888688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc4c0ff570 0x7fbc4c0ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.844+0000 7fbc508bf700 1 -- 172.21.15.5:0/1897888688 >> 172.21.15.5:0/1897888688 conn(0x7fbc4c0fb080 msgr2=0x7fbc4c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.848+0000 7fbc508bf700 1 -- 172.21.15.5:0/1897888688 shutdown_connections 2023-10-08T13:11:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.850+0000 7fbc508bf700 1 -- 172.21.15.5:0/1897888688 wait complete. 2023-10-08T13:11:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.851+0000 7fbc508bf700 1 Processor -- start 2023-10-08T13:11:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 -- start start 2023-10-08T13:11:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0ff570 0x7fbc4c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc4c0fff30 0x7fbc4c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c1947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c194e50 con 0x7fbc4c105630 2023-10-08T13:11:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c194fc0 con 0x7fbc4c0ff570 2023-10-08T13:11:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.852+0000 7fbc508bf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c195180 con 0x7fbc4c0fff30 2023-10-08T13:11:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.853+0000 7fbc4ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c1947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.853+0000 7fbc4ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c1947e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36560/0 (socket says 172.21.15.5:36560) 2023-10-08T13:11:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.853+0000 7fbc4ad9d700 1 -- 172.21.15.5:0/638471886 learned_addr learned my addr 172.21.15.5:0/638471886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.853+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc4c0fff30 0x7fbc4c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.853+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0ff570 0x7fbc4c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.853+0000 7fbc4ad9d700 1 -- 172.21.15.5:0/638471886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc4c0fff30 msgr2=0x7fbc4c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc4ad9d700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc4c0fff30 0x7fbc4c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc4ad9d700 1 -- 172.21.15.5:0/638471886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0ff570 msgr2=0x7fbc4c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc4ad9d700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0ff570 0x7fbc4c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc4ad9d700 1 -- 172.21.15.5:0/638471886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c011e00 con 0x7fbc4c105630 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc4ad9d700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c1947e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbc44007960 tx=0x7fbc440079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc3b7fe700 1 -- 172.21.15.5:0/638471886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400e040 con 0x7fbc4c105630 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.854+0000 7fbc3b7fe700 1 -- 172.21.15.5:0/638471886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc44005040 con 0x7fbc4c105630 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.855+0000 7fbc3b7fe700 1 -- 172.21.15.5:0/638471886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4401c660 con 0x7fbc4c105630 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.855+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44009c40 con 0x7fbc4c105630 2023-10-08T13:11:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.855+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c195640 con 0x7fbc4c105630 2023-10-08T13:11:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.859+0000 7fbc5caa8b80 1 Processor -- start 2023-10-08T13:11:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.861+0000 7fbc3b7fe700 1 -- 172.21.15.5:0/638471886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fbc440051b0 con 0x7fbc4c105630 2023-10-08T13:11:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.861+0000 7fbc5caa8b80 1 -- start start 2023-10-08T13:11:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53f880 0x55a7df53fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df539b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df53a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df4a2400 con 0x55a7df53a0b0 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df493bc0 con 0x55a7df5401a0 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df4914e0 con 0x55a7df53f880 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df539b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df539b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59748/0 (socket says 172.21.15.5:59748) 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc4a59c700 1 -- 172.21.15.5:0/3897300764 learned_addr learned my addr 172.21.15.5:0/3897300764 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df53a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc3b7fe700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc340a16b0 0x7fbc340a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53f880 0x55a7df53fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc3b7fe700 1 -- 172.21.15.5:0/638471886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbc440d0240 con 0x7fbc4c105630 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 -- 172.21.15.5:0/3897300764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53f880 msgr2=0x55a7df53fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53f880 0x55a7df53fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 -- 172.21.15.5:0/3897300764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 msgr2=0x55a7df539b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df539b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 -- 172.21.15.5:0/3897300764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7df2b7d80 con 0x55a7df53a0b0 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.862+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df53a510 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c195c00 tx=0x7fbc40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637a1d31be3e7317 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.863+0000 7fbc4ad9d700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc340a16b0 0x7fbc340a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.863+0000 7fbc38ff9700 1 -- 172.21.15.5:0/3897300764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40022ea0 con 0x55a7df53a0b0 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.863+0000 7fbc38ff9700 1 -- 172.21.15.5:0/3897300764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc40004510 con 0x55a7df53a0b0 2023-10-08T13:11:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.863+0000 7fbc38ff9700 1 -- 172.21.15.5:0/3897300764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40005280 con 0x55a7df53a0b0 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/3897300764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 msgr2=0x55a7df53a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df53a510 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c195c00 tx=0x7fbc40009750 comp rx=0 tx=0).stop 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc4ad9d700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc340a16b0 0x7fbc340a3b70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c195340 tx=0x7fbc4400b680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/3897300764 shutdown_connections 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df53a510 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53f880 0x55a7df53fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/3897300764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df539b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/3897300764 >> 172.21.15.5:0/3897300764 conn(0x55a7df4ae200 msgr2=0x55a7df534b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/3897300764 shutdown_connections 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/3897300764 wait complete. 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- start start 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 Processor -- start 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53a0b0 0x55a7df543510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df543a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df543f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df48cdd0 con 0x55a7df53f880 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df4296b0 con 0x55a7df53a0b0 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.864+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df429350 con 0x55a7df5401a0 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc5caa8b80 10 client.0 _ll_register_callbacks cb 0x55a7df2867a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df543a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df543a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36578/0 (socket says 172.21.15.5:36578) 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 -- 172.21.15.5:0/578848937 learned_addr learned my addr 172.21.15.5:0/578848937 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 -- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 msgr2=0x55a7df543f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df543f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 -- 172.21.15.5:0/578848937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53a0b0 msgr2=0x55a7df543510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53a0b0 0x55a7df543510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 -- 172.21.15.5:0/578848937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4002a040 con 0x55a7df53f880 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df543a50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c003ce0 tx=0x7fbc3c011330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d7095b9bf53b2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc31ffb700 1 -- 172.21.15.5:0/578848937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c016040 con 0x55a7df53f880 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc31ffb700 1 -- 172.21.15.5:0/578848937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbc3c009690 con 0x55a7df53f880 2023-10-08T13:11:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.865+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7df454e50 con 0x55a7df53f880 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.866+0000 7fbc31ffb700 1 -- 172.21.15.5:0/578848937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc3c009850 con 0x55a7df53f880 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.866+0000 7fbc5caa8b80 10 client.16509 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.866+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a7df2a0c00 con 0x55a7df53f880 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.866+0000 7fbc31ffb700 1 -- 172.21.15.5:0/578848937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a7df454e50 con 0x55a7df53f880 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.866+0000 7fbc31ffb700 1 -- 172.21.15.5:0/578848937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fbc3c00b070 con 0x55a7df53f880 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.867+0000 7fbc5caa8b80 10 client.16509 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.867+0000 7fbc5caa8b80 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.867+0000 7fbc5caa8b80 20 client.16509 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.867+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df553dd0 0x55a7df556290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.867+0000 7fbc5caa8b80 4 client.16509 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:11:56.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.867+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7df485db0 con 0x55a7df553dd0 2023-10-08T13:11:56.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.874+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df553dd0 0x55a7df556290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.876+0000 7fbc31ffb700 10 client.16509 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:56.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.876+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df553dd0 0x55a7df556290 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97805e5a7b67034 server_cookie=89dbfd2c6c274d51 in_seq=0 out_seq=0 2023-10-08T13:11:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc31ffb700 1 -- 172.21.15.5:0/578848937 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7df485db0 con 0x55a7df553dd0 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc31ffb700 10 client.16509 handle_command_reply: tid=0 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 client.16509 shutdown 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 msgr2=0x55a7df543a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df543a50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c003ce0 tx=0x7fbc3c011330 comp rx=0 tx=0).stop 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 shutdown_connections 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df543f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df553dd0 0x55a7df556290 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53a0b0 0x55a7df543510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/578848937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df543a50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 >> 172.21.15.5:0/578848937 conn(0x55a7df4ae200 msgr2=0x55a7df534010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc31ffb700 0 client.16509 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 shutdown_connections 2023-10-08T13:11:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.877+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/578848937 wait complete. 2023-10-08T13:11:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.878+0000 7fbc5caa8b80 20 client.16509 trim_cache size 0 max 16384 2023-10-08T13:11:56.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.905+0000 7fbc5caa8b80 1 Processor -- start 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.905+0000 7fbc5caa8b80 1 -- start start 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df539b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53f880 0x55a7df53ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df534790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df30d8c0 con 0x55a7df53a0b0 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df535a40 con 0x55a7df53f880 2023-10-08T13:11:56.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df556660 con 0x55a7df5401a0 2023-10-08T13:11:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc49d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df539b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53f880 0x55a7df53ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc49d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df539b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36582/0 (socket says 172.21.15.5:36582) 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc49d9b700 1 -- 172.21.15.5:0/4269378459 learned_addr learned my addr 172.21.15.5:0/4269378459 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df534790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc4a59c700 1 -- 172.21.15.5:0/4269378459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 msgr2=0x55a7df534790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df534790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc4a59c700 1 -- 172.21.15.5:0/4269378459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 msgr2=0x55a7df539b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df539b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc4a59c700 1 -- 172.21.15.5:0/4269378459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7df2de1f0 con 0x55a7df53f880 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.906+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df539b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.907+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53f880 0x55a7df53ecc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c01bda0 tx=0x7fbc3c011730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3df680b30d5700e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:56.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.907+0000 7fbc397fa700 1 -- 172.21.15.5:0/4269378459 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c016040 con 0x55a7df53f880 2023-10-08T13:11:56.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.907+0000 7fbc397fa700 1 -- 172.21.15.5:0/4269378459 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc3c004710 con 0x55a7df53f880 2023-10-08T13:11:56.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.907+0000 7fbc397fa700 1 -- 172.21.15.5:0/4269378459 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0052a0 con 0x55a7df53f880 2023-10-08T13:11:56.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:56 smithi060 ceph-mon[103190]: pgmap v478: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.6 MiB/s wr, 589 op/s 2023-10-08T13:11:56.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.908+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/4269378459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53f880 msgr2=0x55a7df53ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.908+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53f880 0x55a7df53ecc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c01bda0 tx=0x7fbc3c011730 comp rx=0 tx=0).stop 2023-10-08T13:11:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.913+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/4269378459 shutdown_connections 2023-10-08T13:11:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.913+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df5401a0 0x55a7df534790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.913+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53a0b0 0x55a7df539b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.913+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/4269378459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df53f880 0x55a7df53ecc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.913+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/4269378459 >> 172.21.15.5:0/4269378459 conn(0x55a7df4ae200 msgr2=0x55a7df53e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.914+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/4269378459 shutdown_connections 2023-10-08T13:11:56.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.915+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/4269378459 wait complete. 2023-10-08T13:11:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.915+0000 7fbc5caa8b80 1 -- start start 2023-10-08T13:11:56.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.915+0000 7fbc5caa8b80 1 Processor -- start 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53a0b0 0x55a7df548e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df549380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df5a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df5a7220 con 0x55a7df53f880 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df5a7360 con 0x55a7df5401a0 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7df5a74f0 con 0x55a7df53a0b0 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc5caa8b80 10 client.0 _ll_register_callbacks cb 0x7fbc3c004600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc49d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53a0b0 0x55a7df548e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc49d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53a0b0 0x55a7df548e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49792/0 (socket says 172.21.15.5:49792) 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc49d9b700 1 -- 172.21.15.5:0/2013019445 learned_addr learned my addr 172.21.15.5:0/2013019445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:11:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.916+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df5a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.917+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df549380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.917+0000 7fbc4a59c700 1 -- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53a0b0 msgr2=0x55a7df548e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.917+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53a0b0 0x55a7df548e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.917+0000 7fbc4a59c700 1 -- 172.21.15.5:0/2013019445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 msgr2=0x55a7df5a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:11:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.917+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df5a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.917+0000 7fbc4a59c700 1 -- 172.21.15.5:0/2013019445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7df2b7d80 con 0x55a7df53f880 2023-10-08T13:11:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.918+0000 7fbc4a59c700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df549380 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55a7df485ef0 tx=0x7fbc3c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56f6c95f6c9f340 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:11:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.918+0000 7fbc31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:11:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.918+0000 7fbc31ffb700 1 -- 172.21.15.5:0/2013019445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c01b850 con 0x55a7df53f880 2023-10-08T13:11:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.918+0000 7fbc31ffb700 1 -- 172.21.15.5:0/2013019445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbc3c01b9b0 con 0x55a7df53f880 2023-10-08T13:11:56.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.918+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc40004510 con 0x55a7df53f880 2023-10-08T13:11:56.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:56 smithi005 ceph-mon[99496]: pgmap v478: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.6 MiB/s wr, 589 op/s 2023-10-08T13:11:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.924+0000 7fbc31ffb700 1 -- 172.21.15.5:0/2013019445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc3c005000 con 0x55a7df53f880 2023-10-08T13:11:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.924+0000 7fbc5caa8b80 10 client.16515 fetch_fsmap learned FSMap version 45 2023-10-08T13:11:56.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.924+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a7df2a0c00 con 0x55a7df53f880 2023-10-08T13:11:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc31ffb700 1 -- 172.21.15.5:0/2013019445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc40004510 con 0x55a7df53f880 2023-10-08T13:11:56.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc31ffb700 1 -- 172.21.15.5:0/2013019445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 45) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fbc3c00b070 con 0x55a7df53f880 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc5caa8b80 10 client.16515 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc5caa8b80 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc5caa8b80 20 client.16515 populate_metadata read hostname 'smithi005' 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df5ca830 0x55a7df5ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc5caa8b80 4 client.16515 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.928+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a7df485ad0 con 0x55a7df5ca830 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.929+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df5ca830 0x55a7df5ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.930+0000 7fbc31ffb700 10 client.16515 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.930+0000 7fbc49d9b700 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df5ca830 0x55a7df5ccc20 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c7a2f69c1975eb1 server_cookie=4f10ae3f63fe348e in_seq=0 out_seq=0 2023-10-08T13:11:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.951+0000 7fbc31ffb700 1 -- 172.21.15.5:0/2013019445 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a7df485ad0 con 0x55a7df5ca830 2023-10-08T13:11:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.951+0000 7fbc31ffb700 10 client.16515 handle_command_reply: tid=0 2023-10-08T13:11:56.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.951+0000 7fbc5caa8b80 1 client.16515 shutdown 2023-10-08T13:11:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.956+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 msgr2=0x55a7df549380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.956+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df549380 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55a7df485ef0 tx=0x7fbc3c0093b0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.956+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 shutdown_connections 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.956+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a7df5ca830 0x55a7df5ccc20 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a7df5401a0 0x55a7df5a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a7df53a0b0 0x55a7df548e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 1 --2- 172.21.15.5:0/2013019445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7df53f880 0x55a7df549380 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc31ffb700 0 client.16515 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:11:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 >> 172.21.15.5:0/2013019445 conn(0x55a7df4ae200 msgr2=0x55a7df542670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 shutdown_connections 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 1 -- 172.21.15.5:0/2013019445 wait complete. 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc5caa8b80 20 client.16515 trim_cache size 0 max 16384 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:11:56.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:11:56.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc340a16b0 msgr2=0x7fbc340a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc340a16b0 0x7fbc340a3b70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c195340 tx=0x7fbc4400b680 comp rx=0 tx=0).stop 2023-10-08T13:11:56.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 msgr2=0x7fbc4c1947e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c1947e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbc44007960 tx=0x7fbc440079d0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 shutdown_connections 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fbc340a16b0 0x7fbc340a3b70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4c105630 0x7fbc4c1947e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.957+0000 7fbc508bf700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4c0ff570 0x7fbc4c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.958+0000 7fbc508bf700 1 --2- 172.21.15.5:0/638471886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc4c0fff30 0x7fbc4c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.958+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 >> 172.21.15.5:0/638471886 conn(0x7fbc4c0fb080 msgr2=0x7fbc4c103120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.958+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 shutdown_connections 2023-10-08T13:11:56.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:11:56.958+0000 7fbc508bf700 1 -- 172.21.15.5:0/638471886 wait complete. 2023-10-08T13:11:58.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:11:58 smithi060 ceph-mon[103190]: pgmap v479: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.8 MiB/s wr, 604 op/s 2023-10-08T13:11:58.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:11:58 smithi005 ceph-mon[99496]: pgmap v479: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.8 MiB/s wr, 604 op/s 2023-10-08T13:11:59.026 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:11:58 smithi118 ceph-mon[104234]: pgmap v479: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.8 MiB/s wr, 604 op/s 2023-10-08T13:12:00.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:00 smithi060 ceph-mon[103190]: pgmap v480: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.2 MiB/s wr, 660 op/s 2023-10-08T13:12:00.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:00 smithi005 ceph-mon[99496]: pgmap v480: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.2 MiB/s wr, 660 op/s 2023-10-08T13:12:01.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:00 smithi118 ceph-mon[104234]: pgmap v480: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.2 MiB/s wr, 660 op/s 2023-10-08T13:12:01.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 340.0 s, 645.7 tps, lat 158.986 ms stddev 196.017 2023-10-08T13:12:02.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:02 smithi060 ceph-mon[103190]: pgmap v481: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.2 MiB/s wr, 550 op/s 2023-10-08T13:12:02.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:02 smithi005 ceph-mon[99496]: pgmap v481: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.2 MiB/s wr, 550 op/s 2023-10-08T13:12:03.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:02 smithi118 ceph-mon[104234]: pgmap v481: 129 pgs: 129 active+clean; 4.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.2 MiB/s wr, 550 op/s 2023-10-08T13:12:03.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:03 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:03.929 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:03 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:04.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:03 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:04.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:04 smithi060 ceph-mon[103190]: pgmap v482: 129 pgs: 129 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.7 MiB/s wr, 626 op/s 2023-10-08T13:12:04.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:04 smithi005 ceph-mon[99496]: pgmap v482: 129 pgs: 129 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.7 MiB/s wr, 626 op/s 2023-10-08T13:12:05.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:04 smithi118 ceph-mon[104234]: pgmap v482: 129 pgs: 129 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.7 MiB/s wr, 626 op/s 2023-10-08T13:12:05.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:05 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:05.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:05 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:06.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:05 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:06.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 345.0 s, 615.9 tps, lat 159.023 ms stddev 190.499 2023-10-08T13:12:06.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:06 smithi060 ceph-mon[103190]: pgmap v483: 129 pgs: 129 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.1 MiB/s wr, 615 op/s 2023-10-08T13:12:06.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:06 smithi005 ceph-mon[99496]: pgmap v483: 129 pgs: 129 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.1 MiB/s wr, 615 op/s 2023-10-08T13:12:07.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:06 smithi118 ceph-mon[104234]: pgmap v483: 129 pgs: 129 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.1 MiB/s wr, 615 op/s 2023-10-08T13:12:08.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:08 smithi060 ceph-mon[103190]: pgmap v484: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.3 MiB/s wr, 607 op/s 2023-10-08T13:12:08.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:08 smithi005 ceph-mon[99496]: pgmap v484: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.3 MiB/s wr, 607 op/s 2023-10-08T13:12:09.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:08 smithi118 ceph-mon[104234]: pgmap v484: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.3 MiB/s wr, 607 op/s 2023-10-08T13:12:10.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.165+0000 7f236244a700 1 -- 172.21.15.5:0/3680779821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10eea0 msgr2=0x7f235c1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.165+0000 7f236244a700 1 --2- 172.21.15.5:0/3680779821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10eea0 0x7f235c1077f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f235001a9d0 tx=0x7f235001ace0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.173+0000 7f236244a700 1 -- 172.21.15.5:0/3680779821 shutdown_connections 2023-10-08T13:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.173+0000 7f236244a700 1 --2- 172.21.15.5:0/3680779821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.173+0000 7f236244a700 1 --2- 172.21.15.5:0/3680779821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10eea0 0x7f235c1077f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.173+0000 7f236244a700 1 --2- 172.21.15.5:0/3680779821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f235c10f310 0x7f235c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.173+0000 7f236244a700 1 -- 172.21.15.5:0/3680779821 >> 172.21.15.5:0/3680779821 conn(0x7f235c06b7c0 msgr2=0x7f235c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:10.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.185+0000 7f236244a700 1 -- 172.21.15.5:0/3680779821 shutdown_connections 2023-10-08T13:12:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.191+0000 7f236244a700 1 -- 172.21.15.5:0/3680779821 wait complete. 2023-10-08T13:12:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.192+0000 7f236244a700 1 Processor -- start 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 -- start start 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f235c10eea0 0x7f235c115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10f310 0x7f235c115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c1a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1a22c0 con 0x7f235c119fd0 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1a2430 con 0x7f235c10eea0 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.200+0000 7f236244a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1a25f0 con 0x7f235c10f310 2023-10-08T13:12:10.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.203+0000 7f23609e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c1a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.203+0000 7f23609e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c1a1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36600/0 (socket says 172.21.15.5:36600) 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.203+0000 7f23609e7700 1 -- 172.21.15.5:0/3335601399 learned_addr learned my addr 172.21.15.5:0/3335601399 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.204+0000 7f23609e7700 1 -- 172.21.15.5:0/3335601399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10f310 msgr2=0x7f235c115d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.204+0000 7f23609e7700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10f310 0x7f235c115d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.204+0000 7f23609e7700 1 -- 172.21.15.5:0/3335601399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f235c10eea0 msgr2=0x7f235c115800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.204+0000 7f23609e7700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f235c10eea0 0x7f235c115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.204+0000 7f23609e7700 1 -- 172.21.15.5:0/3335601399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235001a600 con 0x7f235c119fd0 2023-10-08T13:12:10.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.204+0000 7f23609e7700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c1a1b30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f235400b970 tx=0x7f235400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.208+0000 7f23597fa700 1 -- 172.21.15.5:0/3335601399 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400c9b0 con 0x7f235c119fd0 2023-10-08T13:12:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.209+0000 7f23597fa700 1 -- 172.21.15.5:0/3335601399 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2354014440 con 0x7f235c119fd0 2023-10-08T13:12:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.209+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c1a28d0 con 0x7f235c119fd0 2023-10-08T13:12:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.209+0000 7f23597fa700 1 -- 172.21.15.5:0/3335601399 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354007550 con 0x7f235c119fd0 2023-10-08T13:12:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.209+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c1a9fc0 con 0x7f235c119fd0 2023-10-08T13:12:10.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 Processor -- start 2023-10-08T13:12:10.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f23597fa700 1 -- 172.21.15.5:0/3335601399 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f23540145b0 con 0x7f235c119fd0 2023-10-08T13:12:10.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 -- start start 2023-10-08T13:12:10.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 0x55714c9e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c94b400 con 0x55714c9e8880 2023-10-08T13:12:10.215 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c93cbc0 con 0x55714c9e91a0 2023-10-08T13:12:10.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.214+0000 7f236e633b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c93a4e0 con 0x55714c9e30b0 2023-10-08T13:12:10.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.215+0000 7f23597fa700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23440a1730 0x7f23440a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.215+0000 7f23597fa700 1 -- 172.21.15.5:0/3335601399 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f23540ccb80 con 0x7f235c119fd0 2023-10-08T13:12:10.216 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.216+0000 7f23609e7700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23440a1730 0x7f23440a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.217+0000 7f23609e7700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23440a1730 0x7f23440a3bf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23540ca0a0 tx=0x7f235400c420 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.217+0000 7f235bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 0x55714c9e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.217+0000 7f235bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 0x55714c9e2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59788/0 (socket says 172.21.15.5:59788) 2023-10-08T13:12:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.217+0000 7f235bfff700 1 -- 172.21.15.5:0/71497216 learned_addr learned my addr 172.21.15.5:0/71497216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235b7fe700 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235b7fe700 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235bfff700 1 -- 172.21.15.5:0/71497216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 msgr2=0x55714c9e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235bfff700 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235bfff700 1 -- 172.21.15.5:0/71497216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 msgr2=0x55714c9e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235bfff700 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9e8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.218+0000 7f235bfff700 1 -- 172.21.15.5:0/71497216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55714c760d80 con 0x55714c9e91a0 2023-10-08T13:12:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.220+0000 7f235bfff700 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 0x55714c9e2b70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f23500036a0 tx=0x7f2350000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc762d0e333ae452 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.220+0000 7f23427fc700 1 -- 172.21.15.5:0/71497216 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500041a0 con 0x55714c9e91a0 2023-10-08T13:12:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.220+0000 7f23427fc700 1 -- 172.21.15.5:0/71497216 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f235001ce70 con 0x55714c9e91a0 2023-10-08T13:12:10.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.220+0000 7f23427fc700 1 -- 172.21.15.5:0/71497216 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350030420 con 0x55714c9e91a0 2023-10-08T13:12:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 -- 172.21.15.5:0/71497216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 msgr2=0x55714c9e2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 0x55714c9e2b70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f23500036a0 tx=0x7f2350000bc0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 -- 172.21.15.5:0/71497216 shutdown_connections 2023-10-08T13:12:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 --2- 172.21.15.5:0/71497216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e91a0 0x55714c9e2b70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.221+0000 7f236e633b80 1 -- 172.21.15.5:0/71497216 >> 172.21.15.5:0/71497216 conn(0x55714c957200 msgr2=0x55714c9ddb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.222+0000 7f236e633b80 1 -- 172.21.15.5:0/71497216 shutdown_connections 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.222+0000 7f236e633b80 1 -- 172.21.15.5:0/71497216 wait complete. 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.222+0000 7f236e633b80 1 -- start start 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.222+0000 7f236e633b80 1 Processor -- start 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e91a0 0x55714c9ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c935dd0 con 0x55714c9e8880 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c8d26b0 con 0x55714c9e30b0 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c8d2350 con 0x55714c9e91a0 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f236e633b80 10 client.0 _ll_register_callbacks cb 0x55714c72f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9ec5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36614/0 (socket says 172.21.15.5:36614) 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 -- 172.21.15.5:0/1728416215 learned_addr learned my addr 172.21.15.5:0/1728416215 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235b7fe700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e91a0 0x55714c9ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 -- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e91a0 msgr2=0x55714c9ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e91a0 0x55714c9ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 -- 172.21.15.5:0/1728416215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 msgr2=0x55714c9ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235bfff700 1 -- 172.21.15.5:0/1728416215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c11cbd0 con 0x55714c9e8880 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.223+0000 7f235b7fe700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f235bfff700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9ec5e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2350003c30 tx=0x7f235001c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff707a6ce52d02a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f233b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f233b7fe700 1 -- 172.21.15.5:0/1728416215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500043b0 con 0x55714c9e8880 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f233b7fe700 1 -- 172.21.15.5:0/1728416215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f235001c9b0 con 0x55714c9e8880 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55714c8fde50 con 0x55714c9e8880 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f233b7fe700 1 -- 172.21.15.5:0/1728416215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f235001cb70 con 0x55714c9e8880 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f236e633b80 10 client.16524 fetch_fsmap learned FSMap version 48 2023-10-08T13:12:10.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55714c749c00 con 0x55714c9e8880 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.224+0000 7f233b7fe700 1 -- 172.21.15.5:0/1728416215 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55714c8fde50 con 0x55714c9e8880 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f233b7fe700 1 -- 172.21.15.5:0/1728416215 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 48) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2350004950 con 0x55714c9e8880 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f236e633b80 10 client.16524 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f236e633b80 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f236e633b80 20 client.16524 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f236e633b80 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714c9fc860 0x55714c9fec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f236e633b80 4 client.16524 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55714c92edb0 con 0x55714c9fc860 2023-10-08T13:12:10.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f235b7fe700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714c9fc860 0x55714c9fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f233b7fe700 10 client.16524 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.225+0000 7f235b7fe700 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714c9fc860 0x55714c9fec80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294fe54fd3747df server_cookie=16c82ed405d45e4d in_seq=0 out_seq=0 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.226+0000 7f233b7fe700 1 -- 172.21.15.5:0/1728416215 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55714c92edb0 con 0x55714c9fc860 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.226+0000 7f233b7fe700 10 client.16524 handle_command_reply: tid=0 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 client.16524 shutdown 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 msgr2=0x55714c9ec5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9ec5e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2350003c30 tx=0x7f235001c550 comp rx=0 tx=0).stop 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 shutdown_connections 2023-10-08T13:12:10.230 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e91a0 0x55714c9ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714c9fc860 0x55714c9fec80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 --2- 172.21.15.5:0/1728416215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e8880 0x55714c9ec5e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f233b7fe700 0 client.16524 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 >> 172.21.15.5:0/1728416215 conn(0x55714c957200 msgr2=0x55714c9dd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 shutdown_connections 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 1 -- 172.21.15.5:0/1728416215 wait complete. 2023-10-08T13:12:10.231 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.228+0000 7f236e633b80 20 client.16524 trim_cache size 0 max 16384 2023-10-08T13:12:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 Processor -- start 2023-10-08T13:12:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 -- start start 2023-10-08T13:12:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 0x55714c9eee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9dd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c7b68c0 con 0x55714c9e91a0 2023-10-08T13:12:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c92edb0 con 0x55714c9e8880 2023-10-08T13:12:10.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f236e633b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c8fde50 con 0x55714c9e30b0 2023-10-08T13:12:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 0x55714c9eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9ec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49824/0 (socket says 172.21.15.5:49824) 2023-10-08T13:12:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 0x55714c9eee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59804/0 (socket says 172.21.15.5:59804) 2023-10-08T13:12:10.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235b7fe700 1 -- 172.21.15.5:0/3073437117 learned_addr learned my addr 172.21.15.5:0/3073437117 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235b7fe700 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9dd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235bfff700 1 -- 172.21.15.5:0/3073437117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 msgr2=0x55714c9ec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235bfff700 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9ec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235bfff700 1 -- 172.21.15.5:0/3073437117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 msgr2=0x55714c9dd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.250+0000 7f235bfff700 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9dd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.251+0000 7f235bfff700 1 -- 172.21.15.5:0/3073437117 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55714c7871f0 con 0x55714c9e8880 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.251+0000 7f235bfff700 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 0x55714c9eee20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2350004ce0 tx=0x7f235001a320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c2731c411d9528 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.251+0000 7f2342ffd700 1 -- 172.21.15.5:0/3073437117 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350003680 con 0x55714c9e8880 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.251+0000 7f2342ffd700 1 -- 172.21.15.5:0/3073437117 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2350003c60 con 0x55714c9e8880 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.251+0000 7f2342ffd700 1 -- 172.21.15.5:0/3073437117 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500308e0 con 0x55714c9e8880 2023-10-08T13:12:10.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 -- 172.21.15.5:0/3073437117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 msgr2=0x55714c9eee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 0x55714c9eee20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2350004ce0 tx=0x7f235001a320 comp rx=0 tx=0).stop 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 -- 172.21.15.5:0/3073437117 shutdown_connections 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9dd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e30b0 0x55714c9ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 --2- 172.21.15.5:0/3073437117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e8880 0x55714c9eee20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 -- 172.21.15.5:0/3073437117 >> 172.21.15.5:0/3073437117 conn(0x55714c957200 msgr2=0x55714c9ebe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 -- 172.21.15.5:0/3073437117 shutdown_connections 2023-10-08T13:12:10.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 -- 172.21.15.5:0/3073437117 wait complete. 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.252+0000 7f236e633b80 1 -- start start 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 Processor -- start 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 0x55714c9f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c9f2880 con 0x55714c9e91a0 2023-10-08T13:12:10.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714c9f29c0 con 0x55714c9e30b0 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55714ca4f690 con 0x55714c9e8880 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.253+0000 7f236e633b80 10 client.0 _ll_register_callbacks cb 0x7f234c00ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 0x55714c9f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 0x55714c9f1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49834/0 (socket says 172.21.15.5:49834) 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 -- 172.21.15.5:0/976549403 learned_addr learned my addr 172.21.15.5:0/976549403 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 -- 172.21.15.5:0/976549403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 msgr2=0x55714c9f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 -- 172.21.15.5:0/976549403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 msgr2=0x55714c9f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 -- 172.21.15.5:0/976549403 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55714c749c00 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f235bfff700 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 0x55714c9f1b70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f235001a8f0 tx=0x7f2350005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62f6a850d372171 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f233b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.254+0000 7f233b7fe700 1 -- 172.21.15.5:0/976549403 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235001c9b0 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f233b7fe700 1 -- 172.21.15.5:0/976549403 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2350000e40 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f235001ce70 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f233b7fe700 1 -- 172.21.15.5:0/976549403 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f235001cb10 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 10 client.26080 fetch_fsmap learned FSMap version 48 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55714c75f250 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f233b7fe700 1 -- 172.21.15.5:0/976549403 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f235001ce70 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f233b7fe700 1 -- 172.21.15.5:0/976549403 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 48) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2350004ed0 con 0x55714c9e8880 2023-10-08T13:12:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 10 client.26080 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 10 client.26080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 20 client.26080 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714ca50b20 0x55714ca52fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 4 client.26080 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.255+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55714c92ead0 con 0x55714ca50b20 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.256+0000 7f235b7fe700 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714ca50b20 0x55714ca52fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.256+0000 7f233b7fe700 10 client.26080 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:10.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.256+0000 7f235b7fe700 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714ca50b20 0x55714ca52fe0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395044cea46a8eed server_cookie=dff1618e40b594e4 in_seq=0 out_seq=0 2023-10-08T13:12:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.278+0000 7f233b7fe700 1 -- 172.21.15.5:0/976549403 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55714c92ead0 con 0x55714ca50b20 2023-10-08T13:12:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.278+0000 7f233b7fe700 10 client.26080 handle_command_reply: tid=0 2023-10-08T13:12:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.278+0000 7f236e633b80 1 client.26080 shutdown 2023-10-08T13:12:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 msgr2=0x55714c9f1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 0x55714c9f1b70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f235001a8f0 tx=0x7f2350005d90 comp rx=0 tx=0).stop 2023-10-08T13:12:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 shutdown_connections 2023-10-08T13:12:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55714c9e91a0 0x55714c9f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55714ca50b20 0x55714ca52fe0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55714c9e30b0 0x55714c9f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 --2- 172.21.15.5:0/976549403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55714c9e8880 0x55714c9f1b70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f233b7fe700 0 client.26080 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 >> 172.21.15.5:0/976549403 conn(0x55714c957200 msgr2=0x55714c9e76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 shutdown_connections 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 1 -- 172.21.15.5:0/976549403 wait complete. 2023-10-08T13:12:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.280+0000 7f236e633b80 20 client.26080 trim_cache size 0 max 16384 2023-10-08T13:12:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:12:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:12:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:12:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23440a1730 msgr2=0x7f23440a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23440a1730 0x7f23440a3bf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23540ca0a0 tx=0x7f235400c420 comp rx=0 tx=0).stop 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 msgr2=0x7f235c1a1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c1a1b30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f235400b970 tx=0x7f235400bd30 comp rx=0 tx=0).stop 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 shutdown_connections 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f23440a1730 0x7f23440a3bf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f235c119fd0 0x7f235c1a1b30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f235c10eea0 0x7f235c115800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 --2- 172.21.15.5:0/3335601399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f235c10f310 0x7f235c115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 >> 172.21.15.5:0/3335601399 conn(0x7f235c06b7c0 msgr2=0x7f235c071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 shutdown_connections 2023-10-08T13:12:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:10.281+0000 7f236244a700 1 -- 172.21.15.5:0/3335601399 wait complete. 2023-10-08T13:12:10.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:10 smithi005 ceph-mon[99496]: pgmap v485: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 7.7 MiB/s wr, 628 op/s 2023-10-08T13:12:10.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:10 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:11.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:10 smithi118 ceph-mon[104234]: pgmap v485: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 7.7 MiB/s wr, 628 op/s 2023-10-08T13:12:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:10 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:11.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:10 smithi060 ceph-mon[103190]: pgmap v485: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 7.7 MiB/s wr, 628 op/s 2023-10-08T13:12:11.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:10 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 350.0 s, 727.0 tps, lat 140.463 ms stddev 182.638 2023-10-08T13:12:13.025 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:12 smithi118 ceph-mon[104234]: pgmap v486: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 6.9 MiB/s wr, 523 op/s 2023-10-08T13:12:13.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:12 smithi060 ceph-mon[103190]: pgmap v486: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 6.9 MiB/s wr, 523 op/s 2023-10-08T13:12:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:12 smithi005 ceph-mon[99496]: pgmap v486: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 6.9 MiB/s wr, 523 op/s 2023-10-08T13:12:14.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/281761601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8108410 msgr2=0x7fcbb810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/281761601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8108410 0x7fcbb810b8d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009f90 tx=0x7fcbb000b780 comp rx=0 tx=0).stop 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/281761601 shutdown_connections 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/281761601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb810c000 0x7fcbb8078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/281761601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb8107a60 0x7fcbb8107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/281761601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8108410 0x7fcbb810b8d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.355+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/281761601 >> 172.21.15.5:0/281761601 conn(0x7fcbb806b770 msgr2=0x7fcbb806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/281761601 shutdown_connections 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/281761601 wait complete. 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 Processor -- start 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 -- start start 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8107a60 0x7fcbb80833f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 0x7fcbb80700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb8070610 0x7fcbb8070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb81bc9f0 con 0x7fcbb810c000 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb81bcb60 con 0x7fcbb8107a60 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.356+0000 7fcbbe0a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb81bcd20 con 0x7fcbb8070610 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 0x7fcbb80700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 0x7fcbb80700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36642/0 (socket says 172.21.15.5:36642) 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8107a60 0x7fcbb80833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/4234222646 learned_addr learned my addr 172.21.15.5:0/4234222646 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb7fff700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb8070610 0x7fcbb8070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/4234222646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb8070610 msgr2=0x7fcbb8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb8070610 0x7fcbb8070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/4234222646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8107a60 msgr2=0x7fcbb80833f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8107a60 0x7fcbb80833f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/4234222646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009c40 con 0x7fcbb810c000 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8107a60 0x7fcbb80833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb7fff700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb8070610 0x7fcbb8070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:12:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 0x7fcbb80700d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0004fd0 tx=0x7fcbb000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbb4ff9700 1 -- 172.21.15.5:0/4234222646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000e040 con 0x7fcbb810c000 2023-10-08T13:12:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb81bcf40 con 0x7fcbb810c000 2023-10-08T13:12:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.357+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb81bd2b0 con 0x7fcbb810c000 2023-10-08T13:12:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.358+0000 7fcbb4ff9700 1 -- 172.21.15.5:0/4234222646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbb0005040 con 0x7fcbb810c000 2023-10-08T13:12:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.358+0000 7fcbb4ff9700 1 -- 172.21.15.5:0/4234222646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb001b680 con 0x7fcbb810c000 2023-10-08T13:12:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.360+0000 7fcbb4ff9700 1 -- 172.21.15.5:0/4234222646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcbb0007910 con 0x7fcbb810c000 2023-10-08T13:12:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.361+0000 7fcbb4ff9700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcba00a1660 0x7fcba00a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.361+0000 7fcbb4ff9700 1 -- 172.21.15.5:0/4234222646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcbb00ce7d0 con 0x7fcbb810c000 2023-10-08T13:12:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.361+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcba00a1660 0x7fcba00a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.362+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcba00a1660 0x7fcba00a3b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcbac011490 tx=0x7fcbac009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.362+0000 7fcbca289b80 1 Processor -- start 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.362+0000 7fcbca289b80 1 -- start start 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.362+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abe3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.362+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.362+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf2a60 0x55c64abf4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbca289b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64ab4c460 con 0x55c64abf2a60 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbca289b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64ab3dc20 con 0x55c64abe37a0 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbca289b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64ab3b540 con 0x55c64abe2e80 2023-10-08T13:12:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abe3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abe3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49852/0 (socket says 172.21.15.5:49852) 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59832/0 (socket says 172.21.15.5:59832) 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb77fe700 1 -- 172.21.15.5:0/794506911 learned_addr learned my addr 172.21.15.5:0/794506911 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb7fff700 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf2a60 0x55c64abf4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/794506911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 msgr2=0x55c64abe3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abe3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/794506911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf2a60 msgr2=0x55c64abf4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf2a60 0x55c64abf4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/794506911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64a961de0 con 0x55c64abe37a0 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abe3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:12:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf2520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00cbbb0 tx=0x7fcbb0097950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4362abc6f8f8c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcb9dffb700 1 -- 172.21.15.5:0/794506911 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0015120 con 0x55c64abe37a0 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcb9dffb700 1 -- 172.21.15.5:0/794506911 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbb009bc00 con 0x55c64abe37a0 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.363+0000 7fcb9dffb700 1 -- 172.21.15.5:0/794506911 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0099980 con 0x55c64abe37a0 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 -- 172.21.15.5:0/794506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 msgr2=0x55c64abf2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf2520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00cbbb0 tx=0x7fcbb0097950 comp rx=0 tx=0).stop 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 -- 172.21.15.5:0/794506911 shutdown_connections 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf2a60 0x55c64abf4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abe3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 --2- 172.21.15.5:0/794506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf2520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 -- 172.21.15.5:0/794506911 >> 172.21.15.5:0/794506911 conn(0x55c64ab58260 msgr2=0x55c64abdf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 -- 172.21.15.5:0/794506911 shutdown_connections 2023-10-08T13:12:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.364+0000 7fcbca289b80 1 -- 172.21.15.5:0/794506911 wait complete. 2023-10-08T13:12:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 -- start start 2023-10-08T13:12:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 Processor -- start 2023-10-08T13:12:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abe2e80 0x55c64abf2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abfdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64ab36e30 con 0x55c64abe2e80 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64aad3710 con 0x55c64abe37a0 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64aad33b0 con 0x55c64abf2a60 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbca289b80 10 client.0 _ll_register_callbacks cb 0x55c64a930800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59838/0 (socket says 172.21.15.5:59838) 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/2540684338 learned_addr learned my addr 172.21.15.5:0/2540684338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.365+0000 7fcbb7fff700 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abfdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 msgr2=0x55c64abfdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abfdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/2540684338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abe2e80 msgr2=0x55c64abf2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abe2e80 0x55c64abf2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/2540684338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac017070 con 0x55c64abe37a0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf3380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00ceab0 tx=0x7fcbb000b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed30bd6b0108475d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcb96ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcb96ffd700 1 -- 172.21.15.5:0/2540684338 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb009f650 con 0x55c64abe37a0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcb96ffd700 1 -- 172.21.15.5:0/2540684338 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcbb00a3800 con 0x55c64abe37a0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.366+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c64aafeeb0 con 0x55c64abe37a0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.367+0000 7fcb96ffd700 1 -- 172.21.15.5:0/2540684338 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb00ce470 con 0x55c64abe37a0 2023-10-08T13:12:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.367+0000 7fcbca289b80 10 client.26039 fetch_fsmap learned FSMap version 48 2023-10-08T13:12:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.367+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x7fcbb81bd2b0 con 0x55c64abe37a0 2023-10-08T13:12:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.368+0000 7fcb96ffd700 1 -- 172.21.15.5:0/2540684338 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c64aafeeb0 con 0x55c64abe37a0 2023-10-08T13:12:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.368+0000 7fcb96ffd700 1 -- 172.21.15.5:0/2540684338 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 48) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fcbb009b760 con 0x55c64abe37a0 2023-10-08T13:12:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.373+0000 7fcbca289b80 10 client.26039 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T13:12:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.373+0000 7fcbca289b80 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.373+0000 7fcbca289b80 20 client.26039 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.373+0000 7fcbca289b80 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac01f90 0x55c64ac043d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.373+0000 7fcbca289b80 4 client.26039 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:12:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.373+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c64ab2fe10 con 0x55c64ac01f90 2023-10-08T13:12:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.387+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac01f90 0x55c64ac043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.410+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac01f90 0x55c64ac043d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a7a87f17afd95c6 server_cookie=fad1b2b14f124f39 in_seq=0 out_seq=0 2023-10-08T13:12:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.410+0000 7fcb96ffd700 10 client.26039 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.424+0000 7fcb96ffd700 1 -- 172.21.15.5:0/2540684338 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c64ab2fe10 con 0x55c64ac01f90 2023-10-08T13:12:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.424+0000 7fcb96ffd700 10 client.26039 handle_command_reply: tid=0 2023-10-08T13:12:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.426+0000 7fcbca289b80 1 client.26039 shutdown 2023-10-08T13:12:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.438+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 msgr2=0x55c64abf3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.438+0000 7fcbca289b80 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf3380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00ceab0 tx=0x7fcbb000b780 comp rx=0 tx=0).stop 2023-10-08T13:12:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.439+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 shutdown_connections 2023-10-08T13:12:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.439+0000 7fcbca289b80 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abfdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.439+0000 7fcbca289b80 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abe2e80 0x55c64abf2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.439+0000 7fcbca289b80 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac01f90 0x55c64ac043d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.439+0000 7fcbca289b80 1 --2- 172.21.15.5:0/2540684338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe37a0 0x55c64abf3380 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00ceab0 tx=0x7fcbb000b780 comp rx=0 tx=0).stop 2023-10-08T13:12:14.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.439+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 >> 172.21.15.5:0/2540684338 conn(0x55c64ab58260 msgr2=0x55c64abdeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:14.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.441+0000 7fcb96ffd700 0 client.26039 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.449+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 shutdown_connections 2023-10-08T13:12:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.452+0000 7fcbca289b80 1 -- 172.21.15.5:0/2540684338 wait complete. 2023-10-08T13:12:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.461+0000 7fcbca289b80 20 client.26039 trim_cache size 0 max 16384 2023-10-08T13:12:14.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.498+0000 7fcbca289b80 1 Processor -- start 2023-10-08T13:12:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 -- start start 2023-10-08T13:12:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abf7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abf2a60 0x55c64abecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 0x55c64abed460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64a9b7920 con 0x55c64abf3550 2023-10-08T13:12:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64abfee10 con 0x55c64abf2a60 2023-10-08T13:12:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.508+0000 7fcbca289b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64abdbae0 con 0x55c64abe2e80 2023-10-08T13:12:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.513+0000 7fcbb77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abf7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.513+0000 7fcbb77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abf7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49866/0 (socket says 172.21.15.5:49866) 2023-10-08T13:12:14.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.513+0000 7fcbb77fe700 1 -- 172.21.15.5:0/497980395 learned_addr learned my addr 172.21.15.5:0/497980395 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.516+0000 7fcbb77fe700 1 -- 172.21.15.5:0/497980395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abf2a60 msgr2=0x55c64abecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.516+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abf2a60 0x55c64abecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.516+0000 7fcbb77fe700 1 -- 172.21.15.5:0/497980395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 msgr2=0x55c64abed460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.516+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 0x55c64abed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.516+0000 7fcbb77fe700 1 -- 172.21.15.5:0/497980395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64abdb2a0 con 0x55c64abe2e80 2023-10-08T13:12:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.521+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abf7d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbac011be0 tx=0x7fcbac014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d10f54a74a5c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.521+0000 7fcb9e7fc700 1 -- 172.21.15.5:0/497980395 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac024040 con 0x55c64abe2e80 2023-10-08T13:12:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.521+0000 7fcb9e7fc700 1 -- 172.21.15.5:0/497980395 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbac0041e0 con 0x55c64abe2e80 2023-10-08T13:12:14.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.521+0000 7fcb9e7fc700 1 -- 172.21.15.5:0/497980395 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac01e650 con 0x55c64abe2e80 2023-10-08T13:12:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.522+0000 7fcbca289b80 1 -- 172.21.15.5:0/497980395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 msgr2=0x55c64abf7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.522+0000 7fcbca289b80 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abf7d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbac011be0 tx=0x7fcbac014000 comp rx=0 tx=0).stop 2023-10-08T13:12:14.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.523+0000 7fcbca289b80 1 -- 172.21.15.5:0/497980395 shutdown_connections 2023-10-08T13:12:14.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.523+0000 7fcbca289b80 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 0x55c64abed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.523+0000 7fcbca289b80 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abe2e80 0x55c64abf7d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.523+0000 7fcbca289b80 1 --2- 172.21.15.5:0/497980395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abf2a60 0x55c64abecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.523+0000 7fcbca289b80 1 -- 172.21.15.5:0/497980395 >> 172.21.15.5:0/497980395 conn(0x55c64ab58260 msgr2=0x55c64abf2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:14.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.524+0000 7fcbca289b80 1 -- 172.21.15.5:0/497980395 shutdown_connections 2023-10-08T13:12:14.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.524+0000 7fcbca289b80 1 -- 172.21.15.5:0/497980395 wait complete. 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.524+0000 7fcbca289b80 1 -- start start 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 Processor -- start 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe2e80 0x55c64abe99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abe9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 0x55c64abe6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64abe6710 con 0x55c64abf3550 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64abe6880 con 0x55c64abe2e80 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64abe6a40 con 0x55c64abf2a60 2023-10-08T13:12:14.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbca289b80 10 client.0 _ll_register_callbacks cb 0x7fcbac004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abe9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbb6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abe9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49874/0 (socket says 172.21.15.5:49874) 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.525+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/643330846 learned_addr learned my addr 172.21.15.5:0/643330846 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe2e80 0x55c64abe99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/643330846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe2e80 msgr2=0x55c64abe99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe2e80 0x55c64abe99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/643330846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 msgr2=0x55c64abe6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 0x55c64abe6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb6ffd700 1 -- 172.21.15.5:0/643330846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac004490 con 0x55c64abf2a60 2023-10-08T13:12:14.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.526+0000 7fcbb6ffd700 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abe9ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00059a0 tx=0x7fcbb009bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1f82a010f3dfebe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcb96ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:12:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcb96ffd700 1 -- 172.21.15.5:0/643330846 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0009ac0 con 0x55c64abf2a60 2023-10-08T13:12:14.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcb96ffd700 1 -- 172.21.15.5:0/643330846 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcbb00a3800 con 0x55c64abf2a60 2023-10-08T13:12:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbb009bc00 con 0x55c64abf2a60 2023-10-08T13:12:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcb96ffd700 1 -- 172.21.15.5:0/643330846 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb009b040 con 0x55c64abf2a60 2023-10-08T13:12:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcbca289b80 10 client.26095 fetch_fsmap learned FSMap version 48 2023-10-08T13:12:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55c64a94ac60 con 0x55c64abf2a60 2023-10-08T13:12:14.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.529+0000 7fcb96ffd700 1 -- 172.21.15.5:0/643330846 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbb009bc00 con 0x55c64abf2a60 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcb96ffd700 1 -- 172.21.15.5:0/643330846 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 48) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fcbb009b7f0 con 0x55c64abf2a60 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcbca289b80 10 client.26095 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcbca289b80 10 client.26095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcbca289b80 20 client.26095 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcbca289b80 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac5b430 0x55c64ac5d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcbca289b80 4 client.26095 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.530+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c64ab2fb30 con 0x55c64ac5b430 2023-10-08T13:12:14.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.531+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac5b430 0x55c64ac5d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.531+0000 7fcb96ffd700 10 client.26095 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.531+0000 7fcbb77fe700 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac5b430 0x55c64ac5d820 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfbfa0cfbcc4559 server_cookie=5e29a1a785c2d81a in_seq=0 out_seq=0 2023-10-08T13:12:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.531+0000 7fcb96ffd700 1 -- 172.21.15.5:0/643330846 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c64ab2fb30 con 0x55c64ac5b430 2023-10-08T13:12:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.531+0000 7fcb96ffd700 10 client.26095 handle_command_reply: tid=0 2023-10-08T13:12:14.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.531+0000 7fcbca289b80 1 client.26095 shutdown 2023-10-08T13:12:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.537+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 msgr2=0x55c64abe9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.537+0000 7fcbca289b80 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abe9ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00059a0 tx=0x7fcbb009bd70 comp rx=0 tx=0).stop 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.538+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 shutdown_connections 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.538+0000 7fcbca289b80 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64abf3550 0x55c64abe6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.538+0000 7fcbca289b80 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c64ac5b430 0x55c64ac5d820 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.538+0000 7fcbca289b80 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c64abe2e80 0x55c64abe99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.538+0000 7fcbca289b80 1 --2- 172.21.15.5:0/643330846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c64abf2a60 0x55c64abe9ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.538+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 >> 172.21.15.5:0/643330846 conn(0x55c64ab58260 msgr2=0x55c64abecf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.539+0000 7fcb96ffd700 0 client.26095 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.541+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 shutdown_connections 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.541+0000 7fcbca289b80 1 -- 172.21.15.5:0/643330846 wait complete. 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.541+0000 7fcbca289b80 20 client.26095 trim_cache size 0 max 16384 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:12:14.543 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.542+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcba00a1660 msgr2=0x7fcba00a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.542+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcba00a1660 0x7fcba00a3b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcbac011490 tx=0x7fcbac009260 comp rx=0 tx=0).stop 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.542+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 msgr2=0x7fcbb80700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.542+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 0x7fcbb80700d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0004fd0 tx=0x7fcbb000cf40 comp rx=0 tx=0).stop 2023-10-08T13:12:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 shutdown_connections 2023-10-08T13:12:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fcba00a1660 0x7fcba00a3b20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcbb8070610 0x7fcbb8070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbb8107a60 0x7fcbb80833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 --2- 172.21.15.5:0/4234222646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbb810c000 0x7fcbb80700d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 >> 172.21.15.5:0/4234222646 conn(0x7fcbb806b770 msgr2=0x7fcbb810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 shutdown_connections 2023-10-08T13:12:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:14.545+0000 7fcbbe0a0700 1 -- 172.21.15.5:0/4234222646 wait complete. 2023-10-08T13:12:14.565 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:12:14.930 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:14 smithi005 ceph-mon[99496]: pgmap v487: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.3 MiB/s wr, 582 op/s 2023-10-08T13:12:15.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:14 smithi118 ceph-mon[104234]: pgmap v487: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.3 MiB/s wr, 582 op/s 2023-10-08T13:12:15.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:14 smithi060 ceph-mon[103190]: pgmap v487: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.3 MiB/s wr, 582 op/s 2023-10-08T13:12:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 355.0 s, 614.9 tps, lat 163.479 ms stddev 184.161 2023-10-08T13:12:17.027 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:16 smithi118 ceph-mon[104234]: pgmap v488: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.5 MiB/s wr, 596 op/s 2023-10-08T13:12:17.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:16 smithi060 ceph-mon[103190]: pgmap v488: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.5 MiB/s wr, 596 op/s 2023-10-08T13:12:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:16 smithi005 ceph-mon[99496]: pgmap v488: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.5 MiB/s wr, 596 op/s 2023-10-08T13:12:19.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:18 smithi118 ceph-mon[104234]: pgmap v489: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.4 MiB/s wr, 570 op/s 2023-10-08T13:12:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:18 smithi060 ceph-mon[103190]: pgmap v489: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.4 MiB/s wr, 570 op/s 2023-10-08T13:12:19.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:18 smithi005 ceph-mon[99496]: pgmap v489: 129 pgs: 129 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.4 MiB/s wr, 570 op/s 2023-10-08T13:12:21.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:20 smithi060 ceph-mon[103190]: pgmap v490: 129 pgs: 129 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 8.3 MiB/s wr, 612 op/s 2023-10-08T13:12:21.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:20 smithi005 ceph-mon[99496]: pgmap v490: 129 pgs: 129 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 8.3 MiB/s wr, 612 op/s 2023-10-08T13:12:21.281 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:20 smithi118 ceph-mon[104234]: pgmap v490: 129 pgs: 129 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 8.3 MiB/s wr, 612 op/s 2023-10-08T13:12:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 360.0 s, 572.5 tps, lat 170.814 ms stddev 212.758 2023-10-08T13:12:23.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:22 smithi060 ceph-mon[103190]: pgmap v491: 129 pgs: 129 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.5 MiB/s wr, 526 op/s 2023-10-08T13:12:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:22 smithi005 ceph-mon[99496]: pgmap v491: 129 pgs: 129 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.5 MiB/s wr, 526 op/s 2023-10-08T13:12:23.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:22 smithi118 ceph-mon[104234]: pgmap v491: 129 pgs: 129 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.5 MiB/s wr, 526 op/s 2023-10-08T13:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.540+0000 7f3dea42d700 1 -- 172.21.15.5:0/2864124345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 msgr2=0x7f3de411c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.540+0000 7f3dea42d700 1 --2- 172.21.15.5:0/2864124345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de411c3c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40099c0 tx=0x7f3dd4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.548+0000 7f3dea42d700 1 -- 172.21.15.5:0/2864124345 shutdown_connections 2023-10-08T13:12:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.548+0000 7f3dea42d700 1 --2- 172.21.15.5:0/2864124345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de411c3c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.548+0000 7f3dea42d700 1 --2- 172.21.15.5:0/2864124345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de410eea0 0x7f3de41077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.548+0000 7f3dea42d700 1 --2- 172.21.15.5:0/2864124345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410f310 0x7f3de4107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.548+0000 7f3dea42d700 1 -- 172.21.15.5:0/2864124345 >> 172.21.15.5:0/2864124345 conn(0x7f3de406b7c0 msgr2=0x7f3de406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.556+0000 7f3dea42d700 1 -- 172.21.15.5:0/2864124345 shutdown_connections 2023-10-08T13:12:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.564+0000 7f3dea42d700 1 -- 172.21.15.5:0/2864124345 wait complete. 2023-10-08T13:12:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.564+0000 7f3dea42d700 1 Processor -- start 2023-10-08T13:12:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 -- start start 2023-10-08T13:12:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 0x7f3de41a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de410f310 0x7f3de41a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de41aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de41aa920 con 0x7f3de4119fd0 2023-10-08T13:12:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de41aaa90 con 0x7f3de410eea0 2023-10-08T13:12:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.565+0000 7f3dea42d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de41aac50 con 0x7f3de410f310 2023-10-08T13:12:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.566+0000 7f3de3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 0x7f3de41a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.566+0000 7f3de3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 0x7f3de41a5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59864/0 (socket says 172.21.15.5:59864) 2023-10-08T13:12:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.566+0000 7f3de3fff700 1 -- 172.21.15.5:0/3099032877 learned_addr learned my addr 172.21.15.5:0/3099032877 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.566+0000 7f3de89ca700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de41aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.567+0000 7f3de89ca700 1 -- 172.21.15.5:0/3099032877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de410f310 msgr2=0x7f3de41a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.567+0000 7f3de89ca700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de410f310 0x7f3de41a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.567+0000 7f3de89ca700 1 -- 172.21.15.5:0/3099032877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 msgr2=0x7f3de41a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.567+0000 7f3de89ca700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 0x7f3de41a5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.567+0000 7f3de89ca700 1 -- 172.21.15.5:0/3099032877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40095f0 con 0x7f3de4119fd0 2023-10-08T13:12:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.567+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 0x7f3de41a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:12:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.571+0000 7f3de89ca700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de41aa350 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40098e0 tx=0x7f3dd4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.576+0000 7f3de17fa700 1 -- 172.21.15.5:0/3099032877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd401d070 con 0x7f3de4119fd0 2023-10-08T13:12:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.576+0000 7f3de17fa700 1 -- 172.21.15.5:0/3099032877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd4003fc0 con 0x7f3de4119fd0 2023-10-08T13:12:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.576+0000 7f3de17fa700 1 -- 172.21.15.5:0/3099032877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400fb70 con 0x7f3de4119fd0 2023-10-08T13:12:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.576+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de41aaed0 con 0x7f3de4119fd0 2023-10-08T13:12:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.576+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de410f7b0 con 0x7f3de4119fd0 2023-10-08T13:12:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.580+0000 7f3de17fa700 1 -- 172.21.15.5:0/3099032877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3dd400fcd0 con 0x7f3de4119fd0 2023-10-08T13:12:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.580+0000 7f3de17fa700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dcc0a17f0 0x7f3dcc0a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.581+0000 7f3de17fa700 1 -- 172.21.15.5:0/3099032877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3dd40ce0d0 con 0x7f3de4119fd0 2023-10-08T13:12:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.581+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dcc0a17f0 0x7f3dcc0a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.581+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dcc0a17f0 0x7f3dcc0a3cb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009ea0 tx=0x7f3dd8009210 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.591+0000 7f3df6616b80 1 Processor -- start 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.591+0000 7f3df6616b80 1 -- start start 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 0x561303b56b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b570b0 0x561303b57510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3df6616b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303abf400 con 0x561303b5c880 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3df6616b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303ab0bc0 con 0x561303b570b0 2023-10-08T13:12:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3df6616b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303aae4e0 con 0x561303b5d1a0 2023-10-08T13:12:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3de3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3de3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36690/0 (socket says 172.21.15.5:36690) 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3de3fff700 1 -- 172.21.15.5:0/284853821 learned_addr learned my addr 172.21.15.5:0/284853821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de3fff700 1 -- 172.21.15.5:0/284853821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 msgr2=0x561303b56b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de3fff700 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 0x561303b56b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de3fff700 1 -- 172.21.15.5:0/284853821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b570b0 msgr2=0x561303b57510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.592+0000 7f3de89ca700 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b570b0 0x561303b57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de3fff700 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b570b0 0x561303b57510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de3fff700 1 -- 172.21.15.5:0/284853821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613038d4d80 con 0x561303b5c880 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de89ca700 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b570b0 0x561303b57510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:12:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3de3fff700 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5cc60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800eee0 tx=0x7f3dd8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb6b5cd0bda3c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3dca7fc700 1 -- 172.21.15.5:0/284853821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8015890 con 0x561303b5c880 2023-10-08T13:12:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3dca7fc700 1 -- 172.21.15.5:0/284853821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd8013450 con 0x561303b5c880 2023-10-08T13:12:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.593+0000 7f3dca7fc700 1 -- 172.21.15.5:0/284853821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd801f650 con 0x561303b5c880 2023-10-08T13:12:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 -- 172.21.15.5:0/284853821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 msgr2=0x561303b5cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5cc60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800eee0 tx=0x7f3dd8011000 comp rx=0 tx=0).stop 2023-10-08T13:12:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 -- 172.21.15.5:0/284853821 shutdown_connections 2023-10-08T13:12:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b570b0 0x561303b57510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5cc60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 --2- 172.21.15.5:0/284853821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 0x561303b56b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.594+0000 7f3df6616b80 1 -- 172.21.15.5:0/284853821 >> 172.21.15.5:0/284853821 conn(0x561303acb200 msgr2=0x561303b51b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.600+0000 7f3df6616b80 1 -- 172.21.15.5:0/284853821 shutdown_connections 2023-10-08T13:12:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.602+0000 7f3df6616b80 1 -- 172.21.15.5:0/284853821 wait complete. 2023-10-08T13:12:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.602+0000 7f3df6616b80 1 -- start start 2023-10-08T13:12:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.602+0000 7f3df6616b80 1 Processor -- start 2023-10-08T13:12:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b60600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b60b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5d1a0 0x561303b61080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303aa9dd0 con 0x561303b5d1a0 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303a466b0 con 0x561303b5c880 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303a46350 con 0x561303b570b0 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3df6616b80 10 client.0 _ll_register_callbacks cb 0x5613038a37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3de3fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b60600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3de37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b60b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3de37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b60b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59880/0 (socket says 172.21.15.5:59880) 2023-10-08T13:12:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.603+0000 7f3de37fe700 1 -- 172.21.15.5:0/3520022272 learned_addr learned my addr 172.21.15.5:0/3520022272 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de89ca700 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5d1a0 0x561303b61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de37fe700 1 -- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 msgr2=0x561303b60600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de37fe700 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b60600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de37fe700 1 -- 172.21.15.5:0/3520022272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5d1a0 msgr2=0x561303b61080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de37fe700 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5d1a0 0x561303b61080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de37fe700 1 -- 172.21.15.5:0/3520022272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd800ebc0 con 0x561303b5c880 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3de37fe700 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b60b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00b800 tx=0x7f3ddc00bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14e03036c17a6bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.604+0000 7f3dc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.605+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3520022272 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc010860 con 0x561303b5c880 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.605+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3520022272 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3ddc0109c0 con 0x561303b5c880 2023-10-08T13:12:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.605+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561303a71e50 con 0x561303b5c880 2023-10-08T13:12:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.609+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3520022272 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ddc010b80 con 0x561303b5c880 2023-10-08T13:12:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.612+0000 7f3df6616b80 10 client.26048 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:23.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.612+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5613038bdc00 con 0x561303b5c880 2023-10-08T13:12:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.613+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3520022272 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561303a71e50 con 0x561303b5c880 2023-10-08T13:12:23.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.613+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3520022272 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f3ddc008030 con 0x561303b5c880 2023-10-08T13:12:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3df6616b80 10 client.26048 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3df6616b80 10 client.26048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3df6616b80 20 client.26048 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303b70f10 0x561303b73330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3df6616b80 4 client.26048 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:12:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561303aa2db0 con 0x561303b70f10 2023-10-08T13:12:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303b70f10 0x561303b73330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3dc37fe700 10 client.26048 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:23.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.614+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303b70f10 0x561303b73330 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95bc62972eea6b6e server_cookie=b138c29445fcff67 in_seq=0 out_seq=0 2023-10-08T13:12:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.616+0000 7f3dc37fe700 1 -- 172.21.15.5:0/3520022272 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561303aa2db0 con 0x561303b70f10 2023-10-08T13:12:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.616+0000 7f3dc37fe700 10 client.26048 handle_command_reply: tid=0 2023-10-08T13:12:23.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.616+0000 7f3df6616b80 1 client.26048 shutdown 2023-10-08T13:12:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.616+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 msgr2=0x561303b60b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.617+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b60b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00b800 tx=0x7f3ddc00bb10 comp rx=0 tx=0).stop 2023-10-08T13:12:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 shutdown_connections 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5d1a0 0x561303b61080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b60600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303b70f10 0x561303b73330 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3520022272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b60b40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3dc37fe700 0 client.26048 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 >> 172.21.15.5:0/3520022272 conn(0x561303acb200 msgr2=0x561303b51010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 shutdown_connections 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.620+0000 7f3df6616b80 1 -- 172.21.15.5:0/3520022272 wait complete. 2023-10-08T13:12:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.621+0000 7f3df6616b80 20 client.26048 trim_cache size 0 max 16384 2023-10-08T13:12:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 Processor -- start 2023-10-08T13:12:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 -- start start 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b56b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5d1a0 0x561303b60ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130392a8c0 con 0x561303b5c880 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303b52640 con 0x561303b5d1a0 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3df6616b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303b6e3b0 con 0x561303b570b0 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3de89ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5d1a0 0x561303b60ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3de89ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5d1a0 0x561303b60ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59888/0 (socket says 172.21.15.5:59888) 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3de89ca700 1 -- 172.21.15.5:0/3765347669 learned_addr learned my addr 172.21.15.5:0/3765347669 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.646+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b56b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.647+0000 7f3de3fff700 1 -- 172.21.15.5:0/3765347669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5d1a0 msgr2=0x561303b60ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.647+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5d1a0 0x561303b60ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.647+0000 7f3de3fff700 1 -- 172.21.15.5:0/3765347669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 msgr2=0x561303b5bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.647+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.647+0000 7f3de3fff700 1 -- 172.21.15.5:0/3765347669 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613038fb1f0 con 0x561303b570b0 2023-10-08T13:12:23.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.647+0000 7f3de3fff700 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b56b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8013cf0 tx=0x7f3dd8013d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b90416b292dfe09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.664+0000 7f3dcaffd700 1 -- 172.21.15.5:0/3765347669 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd802e070 con 0x561303b570b0 2023-10-08T13:12:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.664+0000 7f3dcaffd700 1 -- 172.21.15.5:0/3765347669 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd8009bf0 con 0x561303b570b0 2023-10-08T13:12:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.664+0000 7f3dcaffd700 1 -- 172.21.15.5:0/3765347669 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8032730 con 0x561303b570b0 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 -- 172.21.15.5:0/3765347669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 msgr2=0x561303b56b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b56b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8013cf0 tx=0x7f3dd8013d20 comp rx=0 tx=0).stop 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 -- 172.21.15.5:0/3765347669 shutdown_connections 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5d1a0 0x561303b60ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b570b0 0x561303b56b70 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8013cf0 tx=0x7f3dd8013d20 comp rx=0 tx=0).stop 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 --2- 172.21.15.5:0/3765347669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b5c880 0x561303b5bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.665+0000 7f3df6616b80 1 -- 172.21.15.5:0/3765347669 >> 172.21.15.5:0/3765347669 conn(0x561303acb200 msgr2=0x561303b5eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.672+0000 7f3df6616b80 1 -- 172.21.15.5:0/3765347669 shutdown_connections 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.685+0000 7f3df6616b80 1 -- 172.21.15.5:0/3765347669 wait complete. 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.685+0000 7f3df6616b80 1 -- start start 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.685+0000 7f3df6616b80 1 Processor -- start 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b67ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 0x561303b65de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 0x561303b667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303b68260 con 0x561303b66320 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303bc4d60 con 0x561303b5c880 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561303bc4f20 con 0x561303b5d1a0 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3df6616b80 10 client.0 _ll_register_callbacks cb 0x7f3ddc009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3de89ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 0x561303b667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3de89ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 0x561303b667a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36712/0 (socket says 172.21.15.5:36712) 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.686+0000 7f3de89ca700 1 -- 172.21.15.5:0/642964726 learned_addr learned my addr 172.21.15.5:0/642964726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3de89ca700 1 -- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 msgr2=0x561303b65de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3de89ca700 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 0x561303b65de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3de89ca700 1 -- 172.21.15.5:0/642964726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 msgr2=0x561303b67ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3de89ca700 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b67ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3de89ca700 1 -- 172.21.15.5:0/642964726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613038d4d80 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3de89ca700 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 0x561303b667a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4029040 tx=0x7f3dd40cb9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660f8bbff503566f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3dc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.687+0000 7f3dc37fe700 1 -- 172.21.15.5:0/642964726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd409e070 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.688+0000 7f3dc37fe700 1 -- 172.21.15.5:0/642964726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3dd409eef0 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.688+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3dd8013450 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.688+0000 7f3dc37fe700 1 -- 172.21.15.5:0/642964726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dd40a30a0 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.688+0000 7f3df6616b80 10 client.16551 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.688+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5613038d3250 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.688+0000 7f3dc37fe700 1 -- 172.21.15.5:0/642964726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd8013450 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3dc37fe700 1 -- 172.21.15.5:0/642964726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f3dd40cbcd0 con 0x561303b66320 2023-10-08T13:12:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3df6616b80 10 client.16551 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3df6616b80 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3df6616b80 20 client.16551 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3df6616b80 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303be8630 0x561303beaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3df6616b80 4 client.16551 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:12:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.689+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561303aa2ad0 con 0x561303be8630 2023-10-08T13:12:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.693+0000 7f3de3fff700 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303be8630 0x561303beaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.712+0000 7f3de3fff700 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303be8630 0x561303beaaf0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=974050ba21e8ea74 server_cookie=f189521916b8501e in_seq=0 out_seq=0 2023-10-08T13:12:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.713+0000 7f3dc37fe700 10 client.16551 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3dc37fe700 1 -- 172.21.15.5:0/642964726 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561303aa2ad0 con 0x561303be8630 2023-10-08T13:12:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3dc37fe700 10 client.16551 handle_command_reply: tid=0 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 client.16551 shutdown 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 msgr2=0x561303b667a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 0x561303b667a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4029040 tx=0x7f3dd40cb9e0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 shutdown_connections 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561303b66320 0x561303b667a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561303be8630 0x561303beaaf0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561303b5c880 0x561303b67ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 --2- 172.21.15.5:0/642964726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561303b5d1a0 0x561303b65de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 >> 172.21.15.5:0/642964726 conn(0x561303acb200 msgr2=0x561303b5bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.760+0000 7f3dc37fe700 0 client.16551 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.761+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 shutdown_connections 2023-10-08T13:12:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.761+0000 7f3df6616b80 1 -- 172.21.15.5:0/642964726 wait complete. 2023-10-08T13:12:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.761+0000 7f3df6616b80 20 client.16551 trim_cache size 0 max 16384 2023-10-08T13:12:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:12:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:12:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:12:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:12:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dcc0a17f0 msgr2=0x7f3dcc0a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dcc0a17f0 0x7f3dcc0a3cb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009ea0 tx=0x7f3dd8009210 comp rx=0 tx=0).stop 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 msgr2=0x7f3de41aa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de41aa350 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40098e0 tx=0x7f3dd4005740 comp rx=0 tx=0).stop 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 shutdown_connections 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3dcc0a17f0 0x7f3dcc0a3cb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de4119fd0 0x7f3de41aa350 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de410eea0 0x7f3de41a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 --2- 172.21.15.5:0/3099032877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3de410f310 0x7f3de41a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.762+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 >> 172.21.15.5:0/3099032877 conn(0x7f3de406b7c0 msgr2=0x7f3de4117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.763+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 shutdown_connections 2023-10-08T13:12:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:23.763+0000 7f3dea42d700 1 -- 172.21.15.5:0/3099032877 wait complete. 2023-10-08T13:12:24.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:23 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:24.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:23 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:24.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:23 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:12:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:24 smithi060 ceph-mon[103190]: pgmap v492: 129 pgs: 129 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 6.5 MiB/s wr, 563 op/s 2023-10-08T13:12:25.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:24 smithi005 ceph-mon[99496]: pgmap v492: 129 pgs: 129 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 6.5 MiB/s wr, 563 op/s 2023-10-08T13:12:25.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:24 smithi118 ceph-mon[104234]: pgmap v492: 129 pgs: 129 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 6.5 MiB/s wr, 563 op/s 2023-10-08T13:12:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 365.0 s, 539.9 tps, lat 187.528 ms stddev 208.812 2023-10-08T13:12:26.774 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:26 smithi118 ceph-mon[104234]: pgmap v493: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 7.4 MiB/s wr, 586 op/s 2023-10-08T13:12:26.911 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:26 smithi060 ceph-mon[103190]: pgmap v493: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 7.4 MiB/s wr, 586 op/s 2023-10-08T13:12:26.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:26 smithi005 ceph-mon[99496]: pgmap v493: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 7.4 MiB/s wr, 586 op/s 2023-10-08T13:12:28.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:28 smithi060 ceph-mon[103190]: pgmap v494: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 6.4 MiB/s wr, 550 op/s 2023-10-08T13:12:28.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:28 smithi005 ceph-mon[99496]: pgmap v494: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 6.4 MiB/s wr, 550 op/s 2023-10-08T13:12:29.025 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:28 smithi118 ceph-mon[104234]: pgmap v494: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 6.4 MiB/s wr, 550 op/s 2023-10-08T13:12:30.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:30 smithi060 ceph-mon[103190]: pgmap v495: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 7.0 MiB/s wr, 580 op/s 2023-10-08T13:12:30.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:30 smithi005 ceph-mon[99496]: pgmap v495: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 7.0 MiB/s wr, 580 op/s 2023-10-08T13:12:31.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:30 smithi118 ceph-mon[104234]: pgmap v495: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 7.0 MiB/s wr, 580 op/s 2023-10-08T13:12:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 370.0 s, 546.2 tps, lat 178.450 ms stddev 205.445 2023-10-08T13:12:32.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:32 smithi060 ceph-mon[103190]: pgmap v496: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 5.4 MiB/s wr, 492 op/s 2023-10-08T13:12:32.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:32 smithi005 ceph-mon[99496]: pgmap v496: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 5.4 MiB/s wr, 492 op/s 2023-10-08T13:12:33.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:32 smithi118 ceph-mon[104234]: pgmap v496: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 5.4 MiB/s wr, 492 op/s 2023-10-08T13:12:34.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:34 smithi005 ceph-mon[99496]: pgmap v497: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 6.6 MiB/s wr, 571 op/s 2023-10-08T13:12:34.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:12:35.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:34 smithi118 ceph-mon[104234]: pgmap v497: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 6.6 MiB/s wr, 571 op/s 2023-10-08T13:12:35.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:12:35.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:34 smithi060 ceph-mon[103190]: pgmap v497: 129 pgs: 129 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 6.6 MiB/s wr, 571 op/s 2023-10-08T13:12:35.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:12:36.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:35 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:12:36.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:35 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:12:36.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:35 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:12:36.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:35 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:12:36.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:35 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:12:36.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:35 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:12:36.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:35 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:12:36.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:35 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:12:36.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:35 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:12:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 375.0 s, 547.2 tps, lat 188.847 ms stddev 227.827 2023-10-08T13:12:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.047+0000 7f9943b2c700 1 -- 172.21.15.5:0/75035803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 msgr2=0x7f993c107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.047+0000 7f9943b2c700 1 --2- 172.21.15.5:0/75035803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c107d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f992c01a9d0 tx=0x7f992c01ace0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.061+0000 7f9943b2c700 1 -- 172.21.15.5:0/75035803 shutdown_connections 2023-10-08T13:12:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.061+0000 7f9943b2c700 1 --2- 172.21.15.5:0/75035803 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f993c119fd0 0x7f993c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.061+0000 7f9943b2c700 1 --2- 172.21.15.5:0/75035803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c10eea0 0x7f993c1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.061+0000 7f9943b2c700 1 --2- 172.21.15.5:0/75035803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c107d30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.061+0000 7f9943b2c700 1 -- 172.21.15.5:0/75035803 >> 172.21.15.5:0/75035803 conn(0x7f993c06b7c0 msgr2=0x7f993c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:37.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.064+0000 7f9943b2c700 1 -- 172.21.15.5:0/75035803 shutdown_connections 2023-10-08T13:12:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.067+0000 7f9943b2c700 1 -- 172.21.15.5:0/75035803 wait complete. 2023-10-08T13:12:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.068+0000 7f9943b2c700 1 Processor -- start 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 -- start start 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f993c10eea0 0x7f993c1194e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c119fd0 0x7f993c115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c115ff0 con 0x7f993c10f310 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c116160 con 0x7f993c119fd0 2023-10-08T13:12:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.071+0000 7f9943b2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c116320 con 0x7f993c10eea0 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.073+0000 7f99418c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f993c10eea0 0x7f993c1194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.075+0000 7f99410c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c119a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.075+0000 7f99410c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c119a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36722/0 (socket says 172.21.15.5:36722) 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.075+0000 7f99410c7700 1 -- 172.21.15.5:0/1220513978 learned_addr learned my addr 172.21.15.5:0/1220513978 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.080+0000 7f99410c7700 1 -- 172.21.15.5:0/1220513978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f993c10eea0 msgr2=0x7f993c1194e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.080+0000 7f99410c7700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f993c10eea0 0x7f993c1194e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.080+0000 7f99410c7700 1 -- 172.21.15.5:0/1220513978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c119fd0 msgr2=0x7f993c115820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.080+0000 7f99410c7700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c119fd0 0x7f993c115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.080+0000 7f99410c7700 1 -- 172.21.15.5:0/1220513978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c01a600 con 0x7f993c10f310 2023-10-08T13:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.080+0000 7f99410c7700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c119a20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f992c01c590 tx=0x7f992c01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.085+0000 7f9932ffd700 1 -- 172.21.15.5:0/1220513978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c003a60 con 0x7f993c10f310 2023-10-08T13:12:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.086+0000 7f9932ffd700 1 -- 172.21.15.5:0/1220513978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992c003bc0 con 0x7f993c10f310 2023-10-08T13:12:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.086+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c1cbb90 con 0x7f993c10f310 2023-10-08T13:12:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.086+0000 7f9932ffd700 1 -- 172.21.15.5:0/1220513978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c01f650 con 0x7f993c10f310 2023-10-08T13:12:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.087+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c1cbf00 con 0x7f993c10f310 2023-10-08T13:12:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.089+0000 7f9932ffd700 1 -- 172.21.15.5:0/1220513978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f992c00f480 con 0x7f993c10f310 2023-10-08T13:12:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.090+0000 7f9932ffd700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f99280a1770 0x7f99280a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.090+0000 7f9932ffd700 1 -- 172.21.15.5:0/1220513978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f992c0ce9a0 con 0x7f993c10f310 2023-10-08T13:12:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.090+0000 7f99418c8700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f99280a1770 0x7f99280a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.091+0000 7f99418c8700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f99280a1770 0x7f99280a3c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f993400b450 tx=0x7f993400d040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 Processor -- start 2023-10-08T13:12:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 -- start start 2023-10-08T13:12:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d6423c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d64241a0 0x55e1d641db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d641e0b0 0x55e1d641e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d6386400 con 0x55e1d6423880 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d6377bc0 con 0x55e1d641e0b0 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f994fd15b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d63754e0 con 0x55e1d64241a0 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f99418c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d6423c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f99410c7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d64241a0 0x55e1d641db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f99418c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d6423c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36726/0 (socket says 172.21.15.5:36726) 2023-10-08T13:12:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.092+0000 7f99418c8700 1 -- 172.21.15.5:0/3829105604 learned_addr learned my addr 172.21.15.5:0/3829105604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99410c7700 1 -- 172.21.15.5:0/3829105604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d641e0b0 msgr2=0x55e1d641e510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:12:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99410c7700 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d641e0b0 0x55e1d641e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99410c7700 1 -- 172.21.15.5:0/3829105604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 msgr2=0x55e1d6423c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99410c7700 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d6423c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99410c7700 1 -- 172.21.15.5:0/3829105604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1d619bd80 con 0x55e1d64241a0 2023-10-08T13:12:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99418c8700 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d6423c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:12:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f99410c7700 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d64241a0 0x55e1d641db70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f992c0cbe40 tx=0x7f992c01a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e4c6009373abb1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f9927fff700 1 -- 172.21.15.5:0/3829105604 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c09b0c0 con 0x55e1d64241a0 2023-10-08T13:12:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f9927fff700 1 -- 172.21.15.5:0/3829105604 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992c09be60 con 0x55e1d64241a0 2023-10-08T13:12:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.093+0000 7f9927fff700 1 -- 172.21.15.5:0/3829105604 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c09b9c0 con 0x55e1d64241a0 2023-10-08T13:12:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.094+0000 7f994fd15b80 1 -- 172.21.15.5:0/3829105604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d64241a0 msgr2=0x55e1d641db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.094+0000 7f994fd15b80 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d64241a0 0x55e1d641db70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f992c0cbe40 tx=0x7f992c01a180 comp rx=0 tx=0).stop 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 -- 172.21.15.5:0/3829105604 shutdown_connections 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d641e0b0 0x55e1d641e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d6423c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 --2- 172.21.15.5:0/3829105604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d64241a0 0x55e1d641db70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 -- 172.21.15.5:0/3829105604 >> 172.21.15.5:0/3829105604 conn(0x55e1d6392200 msgr2=0x55e1d6418b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 -- 172.21.15.5:0/3829105604 shutdown_connections 2023-10-08T13:12:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 -- 172.21.15.5:0/3829105604 wait complete. 2023-10-08T13:12:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 -- start start 2023-10-08T13:12:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.096+0000 7f994fd15b80 1 Processor -- start 2023-10-08T13:12:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d642a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d64273c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d64241a0 0x55e1d6427960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d6370dd0 con 0x55e1d6423880 2023-10-08T13:12:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d630d6b0 con 0x55e1d64241a0 2023-10-08T13:12:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d630d350 con 0x55e1d641e0b0 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f994fd15b80 10 client.0 _ll_register_callbacks cb 0x55e1d616a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.097+0000 7f99410c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d64273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d64273c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36732/0 (socket says 172.21.15.5:36732) 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 -- 172.21.15.5:0/1254956670 learned_addr learned my addr 172.21.15.5:0/1254956670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99418c8700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d642a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 -- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 msgr2=0x55e1d642a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d642a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 -- 172.21.15.5:0/1254956670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d64241a0 msgr2=0x55e1d6427960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d64241a0 0x55e1d6427960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 -- 172.21.15.5:0/1254956670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9934016410 con 0x55e1d6423880 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99418c8700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d642a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:12:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99410c7700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d64273c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f992c01cd00 tx=0x7f992c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e9028e73ac6d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99257fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99257fa700 1 -- 172.21.15.5:0/1254956670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c09b760 con 0x55e1d6423880 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f99257fa700 1 -- 172.21.15.5:0/1254956670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f992c0b5070 con 0x55e1d6423880 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.098+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1d6338e50 con 0x55e1d6423880 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f99257fa700 1 -- 172.21.15.5:0/1254956670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f992c09f8b0 con 0x55e1d6423880 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 10 client.16563 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f993c1cbf00 con 0x55e1d6423880 2023-10-08T13:12:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f99257fa700 1 -- 172.21.15.5:0/1254956670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1d6338e50 con 0x55e1d6423880 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f99257fa700 1 -- 172.21.15.5:0/1254956670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f992c0b9bd0 con 0x55e1d6423880 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 10 client.16563 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 20 client.16563 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d64375a0 0x55e1d64399c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 4 client.16563 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:12:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.099+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1d6369db0 con 0x55e1d64375a0 2023-10-08T13:12:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.100+0000 7f99418c8700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d64375a0 0x55e1d64399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.100+0000 7f99418c8700 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d64375a0 0x55e1d64399c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=265aba3e03883a90 server_cookie=dae22fe983e9c701 in_seq=0 out_seq=0 2023-10-08T13:12:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.102+0000 7f99257fa700 10 client.16563 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.102+0000 7f99257fa700 1 -- 172.21.15.5:0/1254956670 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e1d6369db0 con 0x55e1d64375a0 2023-10-08T13:12:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.102+0000 7f99257fa700 10 client.16563 handle_command_reply: tid=0 2023-10-08T13:12:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.102+0000 7f994fd15b80 1 client.16563 shutdown 2023-10-08T13:12:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 msgr2=0x55e1d64273c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d64273c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f992c01cd00 tx=0x7f992c01ace0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 shutdown_connections 2023-10-08T13:12:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d64375a0 0x55e1d64399c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d64241a0 0x55e1d6427960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d642a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1254956670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d6423880 0x55e1d64273c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 >> 172.21.15.5:0/1254956670 conn(0x55e1d6392200 msgr2=0x55e1d6418010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f99257fa700 0 client.16563 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 shutdown_connections 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 1 -- 172.21.15.5:0/1254956670 wait complete. 2023-10-08T13:12:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.105+0000 7f994fd15b80 20 client.16563 trim_cache size 0 max 16384 2023-10-08T13:12:37.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 Processor -- start 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 -- start start 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d6427910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d642e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d61f18c0 con 0x55e1d64241a0 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d64132b0 con 0x55e1d6414ed0 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f994fd15b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d6423c60 con 0x55e1d641e0b0 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f99418c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f99418c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49942/0 (socket says 172.21.15.5:49942) 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f99418c8700 1 -- 172.21.15.5:0/2981713912 learned_addr learned my addr 172.21.15.5:0/2981713912 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.127+0000 7f99420c9700 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d642e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99410c7700 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d6427910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99420c9700 1 -- 172.21.15.5:0/2981713912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 msgr2=0x55e1d641db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99420c9700 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99420c9700 1 -- 172.21.15.5:0/2981713912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 msgr2=0x55e1d6427910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99420c9700 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d6427910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99420c9700 1 -- 172.21.15.5:0/2981713912 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1d643e5d0 con 0x55e1d6414ed0 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99410c7700 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d6427910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f99420c9700 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d642e8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9938009540 tx=0x7f9938009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1189428e4ebc7c55 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f9930d82700 1 -- 172.21.15.5:0/2981713912 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380107b0 con 0x55e1d6414ed0 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f9930d82700 1 -- 172.21.15.5:0/2981713912 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9938009e90 con 0x55e1d6414ed0 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.128+0000 7f9930d82700 1 -- 172.21.15.5:0/2981713912 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938011d80 con 0x55e1d6414ed0 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.129+0000 7f994fd15b80 1 -- 172.21.15.5:0/2981713912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 msgr2=0x55e1d642e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.129+0000 7f994fd15b80 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d642e8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9938009540 tx=0x7f9938009850 comp rx=0 tx=0).stop 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.129+0000 7f994fd15b80 1 -- 172.21.15.5:0/2981713912 shutdown_connections 2023-10-08T13:12:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d642e8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 --2- 172.21.15.5:0/2981713912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d6427910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 -- 172.21.15.5:0/2981713912 >> 172.21.15.5:0/2981713912 conn(0x55e1d6392200 msgr2=0x55e1d6425c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 -- 172.21.15.5:0/2981713912 shutdown_connections 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 -- 172.21.15.5:0/2981713912 wait complete. 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.130+0000 7f994fd15b80 1 -- start start 2023-10-08T13:12:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 Processor -- start 2023-10-08T13:12:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d641f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d641fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d6420280 con 0x55e1d64241a0 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d64203f0 con 0x55e1d6414ed0 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1d6420560 con 0x55e1d641e0b0 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f994fd15b80 10 client.0 _ll_register_callbacks cb 0x55e1d616a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f99418c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d641f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f99418c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d641f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59926/0 (socket says 172.21.15.5:59926) 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f99418c8700 1 -- 172.21.15.5:0/1891795010 learned_addr learned my addr 172.21.15.5:0/1891795010 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f99420c9700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d641fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f99410c7700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.131+0000 7f99418c8700 1 -- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 msgr2=0x55e1d641f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.132+0000 7f99418c8700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.132+0000 7f99418c8700 1 -- 172.21.15.5:0/1891795010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 msgr2=0x55e1d641fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.132+0000 7f99418c8700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d641fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.132+0000 7f99418c8700 1 -- 172.21.15.5:0/1891795010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9938009220 con 0x55e1d6414ed0 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.132+0000 7f99420c9700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d641fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.132+0000 7f99418c8700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d641f2c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9934007260 tx=0x7f9934004b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfcb2300e3a47336 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f99257fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f99257fa700 1 -- 172.21.15.5:0/1891795010 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934010040 con 0x55e1d6414ed0 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f99257fa700 1 -- 172.21.15.5:0/1891795010 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9934029570 con 0x55e1d6414ed0 2023-10-08T13:12:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f992c09be60 con 0x55e1d6414ed0 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f99257fa700 1 -- 172.21.15.5:0/1891795010 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9934032440 con 0x55e1d6414ed0 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 10 client.26057 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55e1d6184c00 con 0x55e1d6414ed0 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f99257fa700 1 -- 172.21.15.5:0/1891795010 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992c09be60 con 0x55e1d6414ed0 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f99257fa700 1 -- 172.21.15.5:0/1891795010 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9934023760 con 0x55e1d6414ed0 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 10 client.26057 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 10 client.26057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 20 client.26057 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d648bf70 0x55e1d648e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 4 client.26057 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.133+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e1d6369ad0 con 0x55e1d648bf70 2023-10-08T13:12:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.134+0000 7f99410c7700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d648bf70 0x55e1d648e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.134+0000 7f99257fa700 10 client.26057 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.134+0000 7f99410c7700 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d648bf70 0x55e1d648e390 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=832698d3295e7810 server_cookie=9ad01a0d3d7edabf in_seq=0 out_seq=0 2023-10-08T13:12:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.148+0000 7f99257fa700 1 -- 172.21.15.5:0/1891795010 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e1d6369ad0 con 0x55e1d648bf70 2023-10-08T13:12:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.148+0000 7f99257fa700 10 client.26057 handle_command_reply: tid=0 2023-10-08T13:12:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.148+0000 7f994fd15b80 1 client.26057 shutdown 2023-10-08T13:12:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.148+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 msgr2=0x55e1d641f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.148+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d641f2c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9934007260 tx=0x7f9934004b10 comp rx=0 tx=0).stop 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 shutdown_connections 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e1d64241a0 0x55e1d641fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e1d648bf70 0x55e1d648e390 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e1d6414ed0 0x55e1d641f2c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 --2- 172.21.15.5:0/1891795010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1d641e0b0 0x55e1d641f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f99257fa700 0 client.26057 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 >> 172.21.15.5:0/1891795010 conn(0x55e1d6392200 msgr2=0x55e1d6433050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 shutdown_connections 2023-10-08T13:12:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 1 -- 172.21.15.5:0/1891795010 wait complete. 2023-10-08T13:12:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.151+0000 7f994fd15b80 20 client.26057 trim_cache size 0 max 16384 2023-10-08T13:12:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:12:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:12:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:12:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:12:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f99280a1770 msgr2=0x7f99280a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f99280a1770 0x7f99280a3c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f993400b450 tx=0x7f993400d040 comp rx=0 tx=0).stop 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 msgr2=0x7f993c119a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c119a20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f992c01c590 tx=0x7f992c01cbe0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 shutdown_connections 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f99280a1770 0x7f99280a3c30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c119fd0 0x7f993c115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f993c10eea0 0x7f993c1194e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 --2- 172.21.15.5:0/1220513978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f993c10f310 0x7f993c119a20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 >> 172.21.15.5:0/1220513978 conn(0x7f993c06b7c0 msgr2=0x7f993c11a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 shutdown_connections 2023-10-08T13:12:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:37.152+0000 7f9943b2c700 1 -- 172.21.15.5:0/1220513978 wait complete. 2023-10-08T13:12:37.663 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:37 smithi060 ceph-mon[103190]: pgmap v498: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 7.4 MiB/s wr, 611 op/s 2023-10-08T13:12:37.677 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:37 smithi005 ceph-mon[99496]: pgmap v498: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 7.4 MiB/s wr, 611 op/s 2023-10-08T13:12:37.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:37 smithi118 ceph-mon[104234]: pgmap v498: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 7.4 MiB/s wr, 611 op/s 2023-10-08T13:12:38.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:38 smithi060 ceph-mon[103190]: pgmap v499: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 604 op/s 2023-10-08T13:12:38.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:38 smithi005 ceph-mon[99496]: pgmap v499: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 604 op/s 2023-10-08T13:12:38.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:38 smithi118 ceph-mon[104234]: pgmap v499: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 604 op/s 2023-10-08T13:12:39.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:39 smithi060 ceph-mon[103190]: pgmap v500: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.6 MiB/s wr, 682 op/s 2023-10-08T13:12:39.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:39 smithi005 ceph-mon[99496]: pgmap v500: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.6 MiB/s wr, 682 op/s 2023-10-08T13:12:40.027 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:39 smithi118 ceph-mon[104234]: pgmap v500: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.6 MiB/s wr, 682 op/s 2023-10-08T13:12:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 380.0 s, 539.8 tps, lat 181.172 ms stddev 178.910 2023-10-08T13:12:41.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:41 smithi060 ceph-mon[103190]: pgmap v501: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 622 op/s 2023-10-08T13:12:41.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:41 smithi005 ceph-mon[99496]: pgmap v501: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 622 op/s 2023-10-08T13:12:42.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:41 smithi118 ceph-mon[104234]: pgmap v501: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.7 MiB/s wr, 622 op/s 2023-10-08T13:12:43.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:43 smithi060 ceph-mon[103190]: pgmap v502: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.5 MiB/s wr, 682 op/s 2023-10-08T13:12:43.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:43 smithi005 ceph-mon[99496]: pgmap v502: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.5 MiB/s wr, 682 op/s 2023-10-08T13:12:44.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:43 smithi118 ceph-mon[104234]: pgmap v502: 129 pgs: 129 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.5 MiB/s wr, 682 op/s 2023-10-08T13:12:44.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:12:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.914+0000 7f78de5b7700 1 -- 172.21.15.5:0/3115342673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d81083a0 msgr2=0x7f78d811bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:44.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.914+0000 7f78de5b7700 1 --2- 172.21.15.5:0/3115342673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d81083a0 0x7f78d811bfe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78d001c0d0 tx=0x7f78d001c3e0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.922+0000 7f78de5b7700 1 -- 172.21.15.5:0/3115342673 shutdown_connections 2023-10-08T13:12:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.922+0000 7f78de5b7700 1 --2- 172.21.15.5:0/3115342673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d81083a0 0x7f78d811bfe0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.922+0000 7f78de5b7700 1 --2- 172.21.15.5:0/3115342673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d810edf0 0x7f78d810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.922+0000 7f78de5b7700 1 --2- 172.21.15.5:0/3115342673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81077f0 0x7f78d8107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.923+0000 7f78de5b7700 1 -- 172.21.15.5:0/3115342673 >> 172.21.15.5:0/3115342673 conn(0x7f78d806b770 msgr2=0x7f78d806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:44.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.934+0000 7f78de5b7700 1 -- 172.21.15.5:0/3115342673 shutdown_connections 2023-10-08T13:12:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.943+0000 7f78de5b7700 1 -- 172.21.15.5:0/3115342673 wait complete. 2023-10-08T13:12:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 Processor -- start 2023-10-08T13:12:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 -- start start 2023-10-08T13:12:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d81077f0 0x7f78d811b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81083a0 0x7f78d811bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d810edf0 0x7f78d8117970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8118110 con 0x7f78d81083a0 2023-10-08T13:12:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8118280 con 0x7f78d810edf0 2023-10-08T13:12:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.944+0000 7f78de5b7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8118440 con 0x7f78d81077f0 2023-10-08T13:12:44.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.949+0000 7f78dcb54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d810edf0 0x7f78d8117970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.955+0000 7f78d77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81083a0 0x7f78d811bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.955+0000 7f78d77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81083a0 0x7f78d811bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36760/0 (socket says 172.21.15.5:36760) 2023-10-08T13:12:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.955+0000 7f78d77fe700 1 -- 172.21.15.5:0/200244294 learned_addr learned my addr 172.21.15.5:0/200244294 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.964+0000 7f78d7fff700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d81077f0 0x7f78d811b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.967+0000 7f78d7fff700 1 -- 172.21.15.5:0/200244294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d810edf0 msgr2=0x7f78d8117970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.967+0000 7f78d7fff700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d810edf0 0x7f78d8117970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.967+0000 7f78d7fff700 1 -- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81083a0 msgr2=0x7f78d811bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.967+0000 7f78d7fff700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81083a0 0x7f78d811bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.967+0000 7f78d7fff700 1 -- 172.21.15.5:0/200244294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d001ad10 con 0x7f78d81077f0 2023-10-08T13:12:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.968+0000 7f78d7fff700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d81077f0 0x7f78d811b7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78cc006fd0 tx=0x7f78cc00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:44.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.973+0000 7f78d57fa700 1 -- 172.21.15.5:0/200244294 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc011830 con 0x7f78d81077f0 2023-10-08T13:12:44.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.973+0000 7f78d57fa700 1 -- 172.21.15.5:0/200244294 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78cc011e50 con 0x7f78d81077f0 2023-10-08T13:12:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.973+0000 7f78d57fa700 1 -- 172.21.15.5:0/200244294 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc010d70 con 0x7f78d81077f0 2023-10-08T13:12:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.973+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8118720 con 0x7f78d81077f0 2023-10-08T13:12:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.973+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d81a9d80 con 0x7f78d81077f0 2023-10-08T13:12:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.979+0000 7f78ea7a0b80 1 Processor -- start 2023-10-08T13:12:44.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.987+0000 7f78d57fa700 1 -- 172.21.15.5:0/200244294 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f78cc010410 con 0x7f78d81077f0 2023-10-08T13:12:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.988+0000 7f78d57fa700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78c00a1730 0x7f78c00a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.988+0000 7f78d57fa700 1 -- 172.21.15.5:0/200244294 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f78cc0ccc40 con 0x7f78d81077f0 2023-10-08T13:12:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.990+0000 7f78ea7a0b80 1 -- start start 2023-10-08T13:12:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37986110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a37986650 0x557a37988a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a378e4460 con 0x557a3797ae80 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a378d5c20 con 0x557a37986650 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a378d3540 con 0x557a3797b7a0 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37986110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37986110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49970/0 (socket says 172.21.15.5:49970) 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 -- 172.21.15.5:0/2863013664 learned_addr learned my addr 172.21.15.5:0/2863013664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d7fff700 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 -- 172.21.15.5:0/2863013664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a37986650 msgr2=0x557a37988a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a37986650 0x557a37988a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 -- 172.21.15.5:0/2863013664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 msgr2=0x557a3797b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.991+0000 7f78d77fe700 1 -- 172.21.15.5:0/2863013664 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a376f9de0 con 0x557a3797b7a0 2023-10-08T13:12:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.992+0000 7f78d77fe700 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37986110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78c800be90 tx=0x7f78c80106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb96a9de52809c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.994+0000 7f78be7fc700 1 -- 172.21.15.5:0/2863013664 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8010ed0 con 0x557a3797b7a0 2023-10-08T13:12:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.994+0000 7f78be7fc700 1 -- 172.21.15.5:0/2863013664 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c8015070 con 0x557a3797b7a0 2023-10-08T13:12:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.994+0000 7f78be7fc700 1 -- 172.21.15.5:0/2863013664 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8019730 con 0x557a3797b7a0 2023-10-08T13:12:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.995+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/2863013664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 msgr2=0x557a37986110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:44.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.995+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37986110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78c800be90 tx=0x7f78c80106b0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.996+0000 7f78dcb54700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78c00a1730 0x7f78c00a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.996+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/2863013664 shutdown_connections 2023-10-08T13:12:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.996+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a37986650 0x557a37988a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.996+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.996+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/2863013664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37986110 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:44.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:44.996+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/2863013664 >> 172.21.15.5:0/2863013664 conn(0x557a378f0260 msgr2=0x557a379772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:45.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.013+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/2863013664 shutdown_connections 2023-10-08T13:12:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.018+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/2863013664 wait complete. 2023-10-08T13:12:45.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.019+0000 7f78ea7a0b80 1 -- start start 2023-10-08T13:12:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.019+0000 7f78ea7a0b80 1 Processor -- start 2023-10-08T13:12:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a379860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37983450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a37983b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a378cee30 con 0x557a37986650 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3786b710 con 0x557a3797ae80 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3786b3b0 con 0x557a3797b7a0 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78ea7a0b80 10 client.0 _ll_register_callbacks cb 0x557a376c8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78dcb54700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78c00a1730 0x7f78c00a3bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f78d811c440 tx=0x7f78d001c3e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78d7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a379860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78d7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a379860d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:59954/0 (socket says 172.21.15.5:59954) 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78d7fff700 1 -- 172.21.15.5:0/1077759068 learned_addr learned my addr 172.21.15.5:0/1077759068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78dcb54700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a37983b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.020+0000 7f78d77fe700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37983450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78d77fe700 1 -- 172.21.15.5:0/1077759068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 msgr2=0x557a379860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78d77fe700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a379860d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78d77fe700 1 -- 172.21.15.5:0/1077759068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 msgr2=0x557a37983b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78d77fe700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a37983b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78d77fe700 1 -- 172.21.15.5:0/1077759068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c800ba90 con 0x557a3797b7a0 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78d77fe700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37983450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78c800ba30 tx=0x7f78c8010d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e96f5033703b4af8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78b77fe700 1 -- 172.21.15.5:0/1077759068 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8005250 con 0x557a3797b7a0 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78b77fe700 1 -- 172.21.15.5:0/1077759068 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f78c80053b0 con 0x557a3797b7a0 2023-10-08T13:12:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.021+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a37896eb0 con 0x557a3797b7a0 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78b77fe700 1 -- 172.21.15.5:0/1077759068 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c8005570 con 0x557a3797b7a0 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 10 client.26125 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x557a376e2c60 con 0x557a3797b7a0 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78b77fe700 1 -- 172.21.15.5:0/1077759068 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a37896eb0 con 0x557a3797b7a0 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78b77fe700 1 -- 172.21.15.5:0/1077759068 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f78c8021070 con 0x557a3797b7a0 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 10 client.26125 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 10 client.26125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 20 client.26125 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379960a0 0x557a379984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 4 client.26125 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:12:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.022+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a378c7e10 con 0x557a379960a0 2023-10-08T13:12:45.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.029+0000 7f78d7fff700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379960a0 0x557a379984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.041+0000 7f78d7fff700 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379960a0 0x557a379984c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00714b801a9ed88 server_cookie=430abe87e09bb508 in_seq=0 out_seq=0 2023-10-08T13:12:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.041+0000 7f78b77fe700 10 client.26125 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.042+0000 7f78b77fe700 1 -- 172.21.15.5:0/1077759068 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a378c7e10 con 0x557a379960a0 2023-10-08T13:12:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.042+0000 7f78b77fe700 10 client.26125 handle_command_reply: tid=0 2023-10-08T13:12:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.046+0000 7f78ea7a0b80 1 client.26125 shutdown 2023-10-08T13:12:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.046+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 msgr2=0x557a37983450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.046+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37983450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78c800ba30 tx=0x7f78c8010d40 comp rx=0 tx=0).stop 2023-10-08T13:12:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 shutdown_connections 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a37983b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379960a0 0x557a379984c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a379860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/1077759068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a37983450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 >> 172.21.15.5:0/1077759068 conn(0x557a378f0260 msgr2=0x557a37976ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.047+0000 7f78b77fe700 0 client.26125 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.048+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 shutdown_connections 2023-10-08T13:12:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.052+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/1077759068 wait complete. 2023-10-08T13:12:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.053+0000 7f78ea7a0b80 20 client.26125 trim_cache size 0 max 16384 2023-10-08T13:12:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.090+0000 7f78ea7a0b80 1 Processor -- start 2023-10-08T13:12:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 -- start start 2023-10-08T13:12:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797b7a0 0x557a37982d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a37986650 0x557a379806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3774f920 con 0x557a3797ae80 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a379715a0 con 0x557a3797b7a0 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37983280 con 0x557a37986650 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78dcb54700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a37986650 0x557a379806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78dcb54700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a37986650 0x557a379806b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:49984/0 (socket says 172.21.15.5:49984) 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78dcb54700 1 -- 172.21.15.5:0/705019197 learned_addr learned my addr 172.21.15.5:0/705019197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.093+0000 7f78d7fff700 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d77fe700 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797b7a0 0x557a37982d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d7fff700 1 -- 172.21.15.5:0/705019197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a37986650 msgr2=0x557a379806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d7fff700 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a37986650 0x557a379806b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d7fff700 1 -- 172.21.15.5:0/705019197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797b7a0 msgr2=0x557a37982d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d7fff700 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797b7a0 0x557a37982d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d7fff700 1 -- 172.21.15.5:0/705019197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a37720250 con 0x557a3797ae80 2023-10-08T13:12:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78d7fff700 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797dd50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0093d0 tx=0x7f78cc095cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3830fa2c4e2dd34d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.094+0000 7f78beffd700 1 -- 172.21.15.5:0/705019197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc09a090 con 0x557a3797ae80 2023-10-08T13:12:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.095+0000 7f78beffd700 1 -- 172.21.15.5:0/705019197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78cc0b7e90 con 0x557a3797ae80 2023-10-08T13:12:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.095+0000 7f78beffd700 1 -- 172.21.15.5:0/705019197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc099bf0 con 0x557a3797ae80 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.099+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/705019197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 msgr2=0x557a3797dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.099+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797dd50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0093d0 tx=0x7f78cc095cd0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.100+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/705019197 shutdown_connections 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.100+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a37986650 0x557a379806b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.100+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a3797ae80 0x557a3797dd50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.100+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/705019197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797b7a0 0x557a37982d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.100+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/705019197 >> 172.21.15.5:0/705019197 conn(0x557a378f0260 msgr2=0x557a3797e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.115+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/705019197 shutdown_connections 2023-10-08T13:12:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.118+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/705019197 wait complete. 2023-10-08T13:12:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.118+0000 7f78ea7a0b80 1 -- start start 2023-10-08T13:12:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.118+0000 7f78ea7a0b80 1 Processor -- start 2023-10-08T13:12:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a3798c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a3798c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a379e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3798ccd0 con 0x557a37986650 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a379ea440 con 0x557a3797ae80 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a379ea600 con 0x557a3797b7a0 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78ea7a0b80 10 client.0 _ll_register_callbacks cb 0x7f78cc0092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78dcb54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a379e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78dcb54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a379e9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36786/0 (socket says 172.21.15.5:36786) 2023-10-08T13:12:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.119+0000 7f78dcb54700 1 -- 172.21.15.5:0/3704069975 learned_addr learned my addr 172.21.15.5:0/3704069975 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.120+0000 7f78d77fe700 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a3798c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.121+0000 7f78d77fe700 1 -- 172.21.15.5:0/3704069975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 msgr2=0x557a3798c020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:12:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.121+0000 7f78d77fe700 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a3798c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.121+0000 7f78d77fe700 1 -- 172.21.15.5:0/3704069975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 msgr2=0x557a379e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.121+0000 7f78d77fe700 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a379e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.121+0000 7f78d77fe700 1 -- 172.21.15.5:0/3704069975 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d81a9d80 con 0x557a3797b7a0 2023-10-08T13:12:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.129+0000 7f78d77fe700 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a3798c560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78c8011010 tx=0x7f78c8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb916cdae2f2369 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.134+0000 7f78b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.140+0000 7f78b77fe700 1 -- 172.21.15.5:0/3704069975 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8011cc0 con 0x557a3797b7a0 2023-10-08T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.140+0000 7f78b77fe700 1 -- 172.21.15.5:0/3704069975 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f78c8000e40 con 0x557a3797b7a0 2023-10-08T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.142+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78c8015070 con 0x557a3797b7a0 2023-10-08T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.142+0000 7f78b77fe700 1 -- 172.21.15.5:0/3704069975 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c8005250 con 0x557a3797b7a0 2023-10-08T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.142+0000 7f78ea7a0b80 10 client.26131 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.142+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x557a376f82b0 con 0x557a3797b7a0 2023-10-08T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78b77fe700 1 -- 172.21.15.5:0/3704069975 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c8015070 con 0x557a3797b7a0 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78b77fe700 1 -- 172.21.15.5:0/3704069975 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f78c8021070 con 0x557a3797b7a0 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78ea7a0b80 10 client.26131 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78ea7a0b80 10 client.26131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78ea7a0b80 20 client.26131 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379ebbe0 0x557a379ee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78ea7a0b80 4 client.26131 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:12:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.143+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557a378c7b30 con 0x557a379ebbe0 2023-10-08T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.145+0000 7f78d7fff700 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379ebbe0 0x557a379ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.145+0000 7f78d7fff700 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379ebbe0 0x557a379ee000 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a968019b30eb271 server_cookie=7b97f32b7b5d5418 in_seq=0 out_seq=0 2023-10-08T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.145+0000 7f78b77fe700 10 client.26131 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.145+0000 7f78b77fe700 1 -- 172.21.15.5:0/3704069975 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557a378c7b30 con 0x557a379ebbe0 2023-10-08T13:12:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.145+0000 7f78b77fe700 10 client.26131 handle_command_reply: tid=0 2023-10-08T13:12:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.145+0000 7f78ea7a0b80 1 client.26131 shutdown 2023-10-08T13:12:45.152 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:12:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:12:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:12:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:12:45.152 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:12:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:12:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:12:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:12:45.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:12:45.153 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:12:45.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 msgr2=0x557a3798c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a3798c560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78c8011010 tx=0x7f78c8005f90 comp rx=0 tx=0).stop 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 shutdown_connections 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a37986650 0x557a379e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557a379ebbe0 0x557a379ee000 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a3797ae80 0x557a3798c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 --2- 172.21.15.5:0/3704069975 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557a3797b7a0 0x557a3798c560 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.148+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 >> 172.21.15.5:0/3704069975 conn(0x557a378f0260 msgr2=0x557a37984be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.149+0000 7f78b77fe700 0 client.26131 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.149+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 shutdown_connections 2023-10-08T13:12:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.151+0000 7f78ea7a0b80 1 -- 172.21.15.5:0/3704069975 wait complete. 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.151+0000 7f78ea7a0b80 20 client.26131 trim_cache size 0 max 16384 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78c00a1730 msgr2=0x7f78c00a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78c00a1730 0x7f78c00a3bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f78d811c440 tx=0x7f78d001c3e0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d81077f0 msgr2=0x7f78d811b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d81077f0 0x7f78d811b7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78cc006fd0 tx=0x7f78cc00b730 comp rx=0 tx=0).stop 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 shutdown_connections 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78c00a1730 0x7f78c00a3bf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78d810edf0 0x7f78d8117970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78d81077f0 0x7f78d811b7b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 --2- 172.21.15.5:0/200244294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78d81083a0 0x7f78d811bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.152+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 >> 172.21.15.5:0/200244294 conn(0x7f78d806b770 msgr2=0x7f78d806f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.162+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 shutdown_connections 2023-10-08T13:12:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:12:45.163+0000 7f78de5b7700 1 -- 172.21.15.5:0/200244294 wait complete. 2023-10-08T13:12:45.185 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:12:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 385.0 s, 531.6 tps, lat 190.460 ms stddev 201.112 2023-10-08T13:12:46.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:46 smithi118 ceph-mon[104234]: pgmap v503: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2023-10-08T13:12:46.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:46 smithi060 ceph-mon[103190]: pgmap v503: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2023-10-08T13:12:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:46 smithi005 ceph-mon[99496]: pgmap v503: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2023-10-08T13:12:48.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:48 smithi118 ceph-mon[104234]: pgmap v504: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.4 MiB/s wr, 617 op/s 2023-10-08T13:12:48.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:48 smithi060 ceph-mon[103190]: pgmap v504: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.4 MiB/s wr, 617 op/s 2023-10-08T13:12:48.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:48 smithi005 ceph-mon[99496]: pgmap v504: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.4 MiB/s wr, 617 op/s 2023-10-08T13:12:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.439+0000 7f5020bd2700 1 -- 172.21.15.5:0/2812094046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10eea0 msgr2=0x7f501c1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.439+0000 7f5020bd2700 1 --2- 172.21.15.5:0/2812094046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10eea0 0x7f501c1077f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f501401c100 tx=0x7f501401c410 comp rx=0 tx=0).stop 2023-10-08T13:12:50.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 -- 172.21.15.5:0/2812094046 shutdown_connections 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 --2- 172.21.15.5:0/2812094046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c119fd0 0x7f501c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 --2- 172.21.15.5:0/2812094046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10eea0 0x7f501c1077f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 --2- 172.21.15.5:0/2812094046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c10f310 0x7f501c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 -- 172.21.15.5:0/2812094046 >> 172.21.15.5:0/2812094046 conn(0x7f501c06b7c0 msgr2=0x7f501c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 -- 172.21.15.5:0/2812094046 shutdown_connections 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.440+0000 7f5020bd2700 1 -- 172.21.15.5:0/2812094046 wait complete. 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 Processor -- start 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 -- start start 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 0x7f501c119460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10f310 0x7f501c1199a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c119fd0 0x7f501c1155f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c115dc0 con 0x7f501c10eea0 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c115f30 con 0x7f501c119fd0 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.441+0000 7f5020bd2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c1160f0 con 0x7f501c10f310 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 0x7f501c119460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 0x7f501c119460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36796/0 (socket says 172.21.15.5:36796) 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 -- 172.21.15.5:0/3014527227 learned_addr learned my addr 172.21.15.5:0/3014527227 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f5019d9b700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10f310 0x7f501c1199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501ad9d700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c119fd0 0x7f501c1155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 -- 172.21.15.5:0/3014527227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10f310 msgr2=0x7f501c1199a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10f310 0x7f501c1199a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 -- 172.21.15.5:0/3014527227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c119fd0 msgr2=0x7f501c1155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c119fd0 0x7f501c1155f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.442+0000 7f501a59c700 1 -- 172.21.15.5:0/3014527227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501401ad10 con 0x7f501c10eea0 2023-10-08T13:12:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.443+0000 7f501a59c700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 0x7f501c119460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f501401c850 tx=0x7f5014004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.460+0000 7f500b7fe700 1 -- 172.21.15.5:0/3014527227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501401f040 con 0x7f501c10eea0 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.460+0000 7f500b7fe700 1 -- 172.21.15.5:0/3014527227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f501400b070 con 0x7f501c10eea0 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.460+0000 7f500b7fe700 1 -- 172.21.15.5:0/3014527227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014012700 con 0x7f501c10eea0 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.460+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c116370 con 0x7f501c10eea0 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.460+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c07ad10 con 0x7f501c10eea0 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 Processor -- start 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 -- start start 2023-10-08T13:12:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e830400 con 0x55a90e8c80b0 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e821bc0 con 0x55a90e8ce1a0 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.465+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e81f4e0 con 0x55a90e8cd880 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.466+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.471+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50008/0 (socket says 172.21.15.5:50008) 2023-10-08T13:12:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.471+0000 7f501ad9d700 1 -- 172.21.15.5:0/846810967 learned_addr learned my addr 172.21.15.5:0/846810967 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.472+0000 7f5019d9b700 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.472+0000 7f500b7fe700 1 -- 172.21.15.5:0/3014527227 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f50140182b0 con 0x7f501c10eea0 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.473+0000 7f500b7fe700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50040a17b0 0x7f50040a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.473+0000 7f500b7fe700 1 -- 172.21.15.5:0/3014527227 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f501400d070 con 0x7f501c10eea0 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.475+0000 7f5019d9b700 1 -- 172.21.15.5:0/846810967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 msgr2=0x55a90e8cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.475+0000 7f5019d9b700 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.475+0000 7f5019d9b700 1 -- 172.21.15.5:0/846810967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 msgr2=0x55a90e8c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.475+0000 7f5019d9b700 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.475+0000 7f5019d9b700 1 -- 172.21.15.5:0/846810967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a90e645d80 con 0x55a90e8c80b0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.475+0000 7f5019d9b700 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c8510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f501c116d00 tx=0x7f500c00ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3aa28fe82612ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.476+0000 7f5008ff9700 1 -- 172.21.15.5:0/846810967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0125f0 con 0x55a90e8c80b0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.476+0000 7f5008ff9700 1 -- 172.21.15.5:0/846810967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f500c012c10 con 0x55a90e8c80b0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.476+0000 7f5008ff9700 1 -- 172.21.15.5:0/846810967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c013e10 con 0x55a90e8c80b0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.477+0000 7f502cdbbb80 1 -- 172.21.15.5:0/846810967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 msgr2=0x55a90e8c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.477+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c8510 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f501c116d00 tx=0x7f500c00ba90 comp rx=0 tx=0).stop 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.479+0000 7f501ad9d700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50040a17b0 0x7f50040a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.480+0000 7f501ad9d700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50040a17b0 0x7f50040a3c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f501000b9b0 tx=0x7f5010004800 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 -- 172.21.15.5:0/846810967 shutdown_connections 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c8510 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/846810967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 -- 172.21.15.5:0/846810967 >> 172.21.15.5:0/846810967 conn(0x55a90e83c200 msgr2=0x55a90e8c2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 -- 172.21.15.5:0/846810967 shutdown_connections 2023-10-08T13:12:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 -- 172.21.15.5:0/846810967 wait complete. 2023-10-08T13:12:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.482+0000 7f502cdbbb80 1 -- start start 2023-10-08T13:12:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 Processor -- start 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 0x55a90e8d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e81add0 con 0x55a90e8cd880 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e7b76b0 con 0x55a90e8ce1a0 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e7b7350 con 0x55a90e8c80b0 2023-10-08T13:12:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.483+0000 7f502cdbbb80 10 client.0 _ll_register_callbacks cb 0x55a90e6147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.485+0000 7f501a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 0x55a90e8d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.485+0000 7f501a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 0x55a90e8d4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50014/0 (socket says 172.21.15.5:50014) 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.485+0000 7f501a59c700 1 -- 172.21.15.5:0/481557795 learned_addr learned my addr 172.21.15.5:0/481557795 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.486+0000 7f501a59c700 1 -- 172.21.15.5:0/481557795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 msgr2=0x55a90e8d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.486+0000 7f501a59c700 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.486+0000 7f501a59c700 1 -- 172.21.15.5:0/481557795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 msgr2=0x55a90e8d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.486+0000 7f501a59c700 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.486+0000 7f501a59c700 1 -- 172.21.15.5:0/481557795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c00e040 con 0x55a90e8c80b0 2023-10-08T13:12:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.487+0000 7f501a59c700 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 0x55a90e8d4220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f501401e010 tx=0x7f501409b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695aad64daf28282 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.487+0000 7f5001ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:12:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.489+0000 7f5001ffb700 1 -- 172.21.15.5:0/481557795 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140a12c0 con 0x55a90e8c80b0 2023-10-08T13:12:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.489+0000 7f5001ffb700 1 -- 172.21.15.5:0/481557795 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f501409f200 con 0x55a90e8c80b0 2023-10-08T13:12:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.489+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a90e7e2e50 con 0x55a90e8c80b0 2023-10-08T13:12:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.491+0000 7f5001ffb700 1 -- 172.21.15.5:0/481557795 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50140a33b0 con 0x55a90e8c80b0 2023-10-08T13:12:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 10 client.26143 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55a90e62ec00 con 0x55a90e8c80b0 2023-10-08T13:12:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f5001ffb700 1 -- 172.21.15.5:0/481557795 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a90e7e2e50 con 0x55a90e8c80b0 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f5001ffb700 1 -- 172.21.15.5:0/481557795 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f501409a6b0 con 0x55a90e8c80b0 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 10 client.26143 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 20 client.26143 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e8e1c30 0x55a90e8e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 4 client.26143 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:12:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.492+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a90e813db0 con 0x55a90e8e1c30 2023-10-08T13:12:50.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.502+0000 7f5019d9b700 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e8e1c30 0x55a90e8e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.503+0000 7f5019d9b700 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e8e1c30 0x55a90e8e4050 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c30843e21b239ddf server_cookie=2acf3011657d88c5 in_seq=0 out_seq=0 2023-10-08T13:12:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.506+0000 7f5001ffb700 10 client.26143 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.506+0000 7f5001ffb700 1 -- 172.21.15.5:0/481557795 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a90e813db0 con 0x55a90e8e1c30 2023-10-08T13:12:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.506+0000 7f5001ffb700 10 client.26143 handle_command_reply: tid=0 2023-10-08T13:12:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.506+0000 7f502cdbbb80 1 client.26143 shutdown 2023-10-08T13:12:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.507+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 msgr2=0x55a90e8d4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.507+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 0x55a90e8d4220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f501401e010 tx=0x7f501409b860 comp rx=0 tx=0).stop 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.511+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 shutdown_connections 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.511+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e8e1c30 0x55a90e8e4050 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.511+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.511+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8c80b0 0x55a90e8d4220 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.511+0000 7f5001ffb700 0 client.26143 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.511+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/481557795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.512+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 >> 172.21.15.5:0/481557795 conn(0x55a90e83c200 msgr2=0x55a90e8c2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.513+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 shutdown_connections 2023-10-08T13:12:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.513+0000 7f502cdbbb80 1 -- 172.21.15.5:0/481557795 wait complete. 2023-10-08T13:12:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.513+0000 7f502cdbbb80 20 client.26143 trim_cache size 0 max 16384 2023-10-08T13:12:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 Processor -- start 2023-10-08T13:12:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 -- start start 2023-10-08T13:12:50.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e69b8c0 con 0x55a90e8c80b0 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e8d2250 con 0x55a90e8ce1a0 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e8d91c0 con 0x55a90e8cd880 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f501ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60000/0 (socket says 172.21.15.5:60000) 2023-10-08T13:12:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.545+0000 7f501ad9d700 1 -- 172.21.15.5:0/50757015 learned_addr learned my addr 172.21.15.5:0/50757015 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.546+0000 7f501a59c700 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.546+0000 7f501a59c700 1 -- 172.21.15.5:0/50757015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 msgr2=0x55a90e8d8c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:12:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.546+0000 7f501a59c700 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8d8c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.546+0000 7f501a59c700 1 -- 172.21.15.5:0/50757015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 msgr2=0x55a90e8c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:12:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.546+0000 7f501a59c700 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.546+0000 7f501a59c700 1 -- 172.21.15.5:0/50757015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a90e66c1f0 con 0x55a90e8c80b0 2023-10-08T13:12:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.547+0000 7f501a59c700 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c7b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f501409adb0 tx=0x7f501401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222ba125b4136bb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.547+0000 7f50097fa700 1 -- 172.21.15.5:0/50757015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501409b130 con 0x55a90e8c80b0 2023-10-08T13:12:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.547+0000 7f50097fa700 1 -- 172.21.15.5:0/50757015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f501409f200 con 0x55a90e8c80b0 2023-10-08T13:12:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.547+0000 7f50097fa700 1 -- 172.21.15.5:0/50757015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501409b310 con 0x55a90e8c80b0 2023-10-08T13:12:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.548+0000 7f502cdbbb80 1 -- 172.21.15.5:0/50757015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 msgr2=0x55a90e8c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.548+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c7b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f501409adb0 tx=0x7f501401c410 comp rx=0 tx=0).stop 2023-10-08T13:12:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.552+0000 7f502cdbbb80 1 -- 172.21.15.5:0/50757015 shutdown_connections 2023-10-08T13:12:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.552+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8ce1a0 0x55a90e8c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.552+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8c80b0 0x55a90e8c7b70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.552+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/50757015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8cd880 0x55a90e8d8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.552+0000 7f502cdbbb80 1 -- 172.21.15.5:0/50757015 >> 172.21.15.5:0/50757015 conn(0x55a90e83c200 msgr2=0x55a90e8c4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.553+0000 7f502cdbbb80 1 -- 172.21.15.5:0/50757015 shutdown_connections 2023-10-08T13:12:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.555+0000 7f502cdbbb80 1 -- 172.21.15.5:0/50757015 wait complete. 2023-10-08T13:12:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.555+0000 7f502cdbbb80 1 -- start start 2023-10-08T13:12:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.555+0000 7f502cdbbb80 1 Processor -- start 2023-10-08T13:12:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8c80b0 0x55a90e8d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8ce1a0 0x55a90e8d76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e8d8ff0 con 0x55a90e8cd880 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e934a20 con 0x55a90e8c80b0 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90e934b60 con 0x55a90e8ce1a0 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.556+0000 7f502cdbbb80 10 client.0 _ll_register_callbacks cb 0x55a90e6147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.559+0000 7f5019d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.559+0000 7f5019d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36822/0 (socket says 172.21.15.5:36822) 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.559+0000 7f5019d9b700 1 -- 172.21.15.5:0/2398051858 learned_addr learned my addr 172.21.15.5:0/2398051858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:12:50.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5019d9b700 1 -- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8ce1a0 msgr2=0x55a90e8d76e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5019d9b700 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8ce1a0 0x55a90e8d76e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5019d9b700 1 -- 172.21.15.5:0/2398051858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8c80b0 msgr2=0x55a90e8d6c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5019d9b700 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8c80b0 0x55a90e8d6c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5019d9b700 1 -- 172.21.15.5:0/2398051858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a90e62ec00 con 0x55a90e8cd880 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5019d9b700 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d71a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b150 tx=0x7f500c013d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a007ce22446c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5001ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5001ffb700 1 -- 172.21.15.5:0/2398051858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c021070 con 0x55a90e8cd880 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f5001ffb700 1 -- 172.21.15.5:0/2398051858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f500c0234e0 con 0x55a90e8cd880 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.563+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f500c012c10 con 0x55a90e8cd880 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.564+0000 7f5001ffb700 1 -- 172.21.15.5:0/2398051858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f500c013480 con 0x55a90e8cd880 2023-10-08T13:12:50.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.564+0000 7f502cdbbb80 10 client.16596 fetch_fsmap learned FSMap version 49 2023-10-08T13:12:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.564+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55a90e644250 con 0x55a90e8cd880 2023-10-08T13:12:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f5001ffb700 1 -- 172.21.15.5:0/2398051858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f500c012c10 con 0x55a90e8cd880 2023-10-08T13:12:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f5001ffb700 1 -- 172.21.15.5:0/2398051858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f500c023950 con 0x55a90e8cd880 2023-10-08T13:12:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f502cdbbb80 10 client.16596 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:12:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f502cdbbb80 10 client.16596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:12:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f502cdbbb80 20 client.16596 populate_metadata read hostname 'smithi005' 2023-10-08T13:12:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e936470 0x55a90e938890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:12:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f502cdbbb80 4 client.16596 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:12:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.569+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a90e813ad0 con 0x55a90e936470 2023-10-08T13:12:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.577+0000 7f501a59c700 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e936470 0x55a90e938890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:12:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.614+0000 7f501a59c700 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e936470 0x55a90e938890 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c398b8fe30d2cc8b server_cookie=ab7e7fbd4df160bb in_seq=0 out_seq=0 2023-10-08T13:12:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.615+0000 7f5001ffb700 10 client.16596 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.728+0000 7f5001ffb700 1 -- 172.21.15.5:0/2398051858 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a90e813ad0 con 0x55a90e936470 2023-10-08T13:12:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.728+0000 7f5001ffb700 10 client.16596 handle_command_reply: tid=0 2023-10-08T13:12:50.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.730+0000 7f502cdbbb80 1 client.16596 shutdown 2023-10-08T13:12:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.740+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 msgr2=0x55a90e8d71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.740+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d71a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f500c00b150 tx=0x7f500c013d40 comp rx=0 tx=0).stop 2023-10-08T13:12:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 shutdown_connections 2023-10-08T13:12:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a90e8ce1a0 0x55a90e8d76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a90e936470 0x55a90e938890 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a90e8c80b0 0x55a90e8d6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f502cdbbb80 1 --2- 172.21.15.5:0/2398051858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a90e8cd880 0x55a90e8d71a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 >> 172.21.15.5:0/2398051858 conn(0x55a90e83c200 msgr2=0x55a90e8c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.744+0000 7f5001ffb700 0 client.16596 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:12:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.748+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 shutdown_connections 2023-10-08T13:12:50.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.749+0000 7f502cdbbb80 1 -- 172.21.15.5:0/2398051858 wait complete. 2023-10-08T13:12:50.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.750+0000 7f502cdbbb80 20 client.16596 trim_cache size 0 max 16384 2023-10-08T13:12:50.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:12:50.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:12:50.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:12:50.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50040a17b0 msgr2=0x7f50040a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50040a17b0 0x7f50040a3c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f501000b9b0 tx=0x7f5010004800 comp rx=0 tx=0).stop 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 msgr2=0x7f501c119460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 0x7f501c119460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f501401c850 tx=0x7f5014004d50 comp rx=0 tx=0).stop 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 shutdown_connections 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f50040a17b0 0x7f50040a3c70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c119fd0 0x7f501c1155f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f501c10eea0 0x7f501c119460 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 --2- 172.21.15.5:0/3014527227 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f501c10f310 0x7f501c1199a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:12:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 >> 172.21.15.5:0/3014527227 conn(0x7f501c06b7c0 msgr2=0x7f501c071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:12:50.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.752+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 shutdown_connections 2023-10-08T13:12:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:12:50.756+0000 7f5020bd2700 1 -- 172.21.15.5:0/3014527227 wait complete. 2023-10-08T13:12:50.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:50 smithi118 ceph-mon[104234]: pgmap v505: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 6.6 MiB/s wr, 618 op/s 2023-10-08T13:12:50.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:50 smithi060 ceph-mon[103190]: pgmap v505: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 6.6 MiB/s wr, 618 op/s 2023-10-08T13:12:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:50 smithi005 ceph-mon[99496]: pgmap v505: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 6.6 MiB/s wr, 618 op/s 2023-10-08T13:12:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 390.0 s, 649.4 tps, lat 152.281 ms stddev 171.305 2023-10-08T13:12:51.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:51 smithi060 ceph-mon[103190]: pgmap v506: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 5.4 MiB/s wr, 515 op/s 2023-10-08T13:12:51.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:51 smithi005 ceph-mon[99496]: pgmap v506: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 5.4 MiB/s wr, 515 op/s 2023-10-08T13:12:52.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:51 smithi118 ceph-mon[104234]: pgmap v506: 129 pgs: 129 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 5.4 MiB/s wr, 515 op/s 2023-10-08T13:12:53.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:53 smithi060 ceph-mon[103190]: pgmap v507: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.4 MiB/s wr, 588 op/s 2023-10-08T13:12:53.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:53 smithi005 ceph-mon[99496]: pgmap v507: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.4 MiB/s wr, 588 op/s 2023-10-08T13:12:54.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:53 smithi118 ceph-mon[104234]: pgmap v507: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 6.4 MiB/s wr, 588 op/s 2023-10-08T13:12:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 395.0 s, 536.6 tps, lat 188.154 ms stddev 297.023 2023-10-08T13:12:56.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:56 smithi118 ceph-mon[104234]: pgmap v508: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.1 MiB/s wr, 590 op/s 2023-10-08T13:12:56.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:56 smithi060 ceph-mon[103190]: pgmap v508: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.1 MiB/s wr, 590 op/s 2023-10-08T13:12:56.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:56 smithi005 ceph-mon[99496]: pgmap v508: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.1 MiB/s wr, 590 op/s 2023-10-08T13:12:57.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:57 smithi060 ceph-mon[103190]: pgmap v509: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.1 MiB/s wr, 563 op/s 2023-10-08T13:12:57.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:57 smithi005 ceph-mon[99496]: pgmap v509: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.1 MiB/s wr, 563 op/s 2023-10-08T13:12:58.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:57 smithi118 ceph-mon[104234]: pgmap v509: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.1 MiB/s wr, 563 op/s 2023-10-08T13:12:59.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:12:59 smithi060 ceph-mon[103190]: pgmap v510: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2023-10-08T13:12:59.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:12:59 smithi005 ceph-mon[99496]: pgmap v510: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2023-10-08T13:13:00.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:12:59 smithi118 ceph-mon[104234]: pgmap v510: 129 pgs: 129 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.2 MiB/s wr, 584 op/s 2023-10-08T13:13:01.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 400.0 s, 597.0 tps, lat 165.099 ms stddev 184.140 2023-10-08T13:13:01.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:01 smithi060 ceph-mon[103190]: pgmap v511: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 5.8 MiB/s wr, 533 op/s 2023-10-08T13:13:01.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:01 smithi005 ceph-mon[99496]: pgmap v511: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 5.8 MiB/s wr, 533 op/s 2023-10-08T13:13:02.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:01 smithi118 ceph-mon[104234]: pgmap v511: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 5.8 MiB/s wr, 533 op/s 2023-10-08T13:13:03.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:03 smithi060 ceph-mon[103190]: pgmap v512: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.1 MiB/s wr, 564 op/s 2023-10-08T13:13:03.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:03 smithi005 ceph-mon[99496]: pgmap v512: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.1 MiB/s wr, 564 op/s 2023-10-08T13:13:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 -- 172.21.15.5:0/420391446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800fff50 msgr2=0x7f968010c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 --2- 172.21.15.5:0/420391446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800fff50 0x7f968010c410 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f967800b0d0 tx=0x7f967800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 -- 172.21.15.5:0/420391446 shutdown_connections 2023-10-08T13:13:03.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 --2- 172.21.15.5:0/420391446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800fff50 0x7f968010c410 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 --2- 172.21.15.5:0/420391446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9680105650 0x7f9680105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 --2- 172.21.15.5:0/420391446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96800ff590 0x7f96800ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 -- 172.21.15.5:0/420391446 >> 172.21.15.5:0/420391446 conn(0x7f96800fb040 msgr2=0x7f96800fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 -- 172.21.15.5:0/420391446 shutdown_connections 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 -- 172.21.15.5:0/420391446 wait complete. 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 Processor -- start 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.959+0000 7f9687385700 1 -- start start 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 0x7f968019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96800fff50 0x7f968019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9680105650 0x7f9680195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.963 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680195f80 con 0x7f96800ff590 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96801960f0 con 0x7f9680105650 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96801962b0 con 0x7f96800fff50 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 0x7f968019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 0x7f968019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36836/0 (socket says 172.21.15.5:36836) 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 -- 172.21.15.5:0/3058857252 learned_addr learned my addr 172.21.15.5:0/3058857252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9684920700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96800fff50 0x7f968019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685922700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9680105650 0x7f9680195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 -- 172.21.15.5:0/3058857252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96800fff50 msgr2=0x7f968019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96800fff50 0x7f968019bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 -- 172.21.15.5:0/3058857252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9680105650 msgr2=0x7f9680195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9680105650 0x7f9680195920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 -- 172.21.15.5:0/3058857252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9678009d00 con 0x7f96800ff590 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9685121700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 0x7f968019b7a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e9a0 tx=0x7f967c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f96767fc700 1 -- 172.21.15.5:0/3058857252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c009790 con 0x7f96800ff590 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f96767fc700 1 -- 172.21.15.5:0/3058857252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f967c010430 con 0x7f96800ff590 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f96767fc700 1 -- 172.21.15.5:0/3058857252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c018680 con 0x7f96800ff590 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9680196590 con 0x7f96800ff590 2023-10-08T13:13:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.960+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96801a2790 con 0x7f96800ff590 2023-10-08T13:13:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.962+0000 7f96767fc700 1 -- 172.21.15.5:0/3058857252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f967c0105a0 con 0x7f96800ff590 2023-10-08T13:13:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.963+0000 7f96767fc700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f966c0a1660 0x7f966c0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.963+0000 7f96767fc700 1 -- 172.21.15.5:0/3058857252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f967c014070 con 0x7f96800ff590 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.963+0000 7f9684920700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f966c0a1660 0x7f966c0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f9684920700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f966c0a1660 0x7f966c0a3b20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9680196a90 tx=0x7f9670009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 Processor -- start 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 -- start start 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e5a90 0x55fa810e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810e0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa81046400 con 0x55fa810e63b0 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa81037bc0 con 0x55fa810e02c0 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f969356eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa810354e0 con 0x55fa810e5a90 2023-10-08T13:13:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f9685121700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e5a90 0x55fa810e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f9684920700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f9685121700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e5a90 0x55fa810e5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50048/0 (socket says 172.21.15.5:50048) 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f9685121700 1 -- 172.21.15.5:0/616076284 learned_addr learned my addr 172.21.15.5:0/616076284 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.964+0000 7f9685922700 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f9684920700 1 -- 172.21.15.5:0/616076284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e5a90 msgr2=0x55fa810e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f9684920700 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e5a90 0x55fa810e5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f9684920700 1 -- 172.21.15.5:0/616076284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 msgr2=0x55fa810e0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f9684920700 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810e0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f9684920700 1 -- 172.21.15.5:0/616076284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa80e5bd80 con 0x55fa810e63b0 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f9684920700 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810dfd80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9670011c90 tx=0x7f9670014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d83b00d6b2974a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f966b7fe700 1 -- 172.21.15.5:0/616076284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670004230 con 0x55fa810e63b0 2023-10-08T13:13:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f966b7fe700 1 -- 172.21.15.5:0/616076284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9670021070 con 0x55fa810e63b0 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.965+0000 7f966b7fe700 1 -- 172.21.15.5:0/616076284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670003b80 con 0x55fa810e63b0 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- 172.21.15.5:0/616076284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 msgr2=0x55fa810dfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810dfd80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9670011c90 tx=0x7f9670014000 comp rx=0 tx=0).stop 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- 172.21.15.5:0/616076284 shutdown_connections 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810e0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e5a90 0x55fa810e5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- 172.21.15.5:0/616076284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810dfd80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- 172.21.15.5:0/616076284 >> 172.21.15.5:0/616076284 conn(0x55fa81052200 msgr2=0x55fa810d8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- 172.21.15.5:0/616076284 shutdown_connections 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- 172.21.15.5:0/616076284 wait complete. 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- start start 2023-10-08T13:13:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 Processor -- start 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810ece80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810ed900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa81030dd0 con 0x55fa810e63b0 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa80fcd6b0 con 0x55fa810e5a90 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa80fcd350 con 0x55fa810e02c0 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.966+0000 7f969356eb80 10 client.0 _ll_register_callbacks cb 0x55fa80e2a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685121700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810ed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36854/0 (socket says 172.21.15.5:36854) 2023-10-08T13:13:03.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9684920700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685121700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810ece80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50054/0 (socket says 172.21.15.5:50054) 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 -- 172.21.15.5:0/623870168 learned_addr learned my addr 172.21.15.5:0/623870168 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 -- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 msgr2=0x55fa810ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 -- 172.21.15.5:0/623870168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 msgr2=0x55fa810ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 -- 172.21.15.5:0/623870168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670017070 con 0x55fa810e63b0 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9684920700 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9685922700 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810ed900 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9678008eb0 tx=0x7f9678008ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb3b39740d8cf63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9668ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9668ff9700 1 -- 172.21.15.5:0/623870168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800e040 con 0x55fa810e63b0 2023-10-08T13:13:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9668ff9700 1 -- 172.21.15.5:0/623870168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f96780074e0 con 0x55fa810e63b0 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa80ff8e50 con 0x55fa810e63b0 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f9668ff9700 1 -- 172.21.15.5:0/623870168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96780076a0 con 0x55fa810e63b0 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f969356eb80 10 client.16608 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.967+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55fa80e44c00 con 0x55fa810e63b0 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f9668ff9700 1 -- 172.21.15.5:0/623870168 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa80ff8e50 con 0x55fa810e63b0 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f9668ff9700 1 -- 172.21.15.5:0/623870168 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f967800b100 con 0x55fa810e63b0 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f969356eb80 10 client.16608 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f969356eb80 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f969356eb80 20 client.16608 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f969356eb80 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa810fc210 0x55fa810fe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f969356eb80 4 client.16608 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa81029db0 con 0x55fa810fc210 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f9685121700 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa810fc210 0x55fa810fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f9685121700 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa810fc210 0x55fa810fe630 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba6a1af82e7bc1bd server_cookie=509becd797461613 in_seq=0 out_seq=0 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.968+0000 7f9668ff9700 10 client.16608 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f9668ff9700 1 -- 172.21.15.5:0/623870168 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa81029db0 con 0x55fa810fc210 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f9668ff9700 10 client.16608 handle_command_reply: tid=0 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 client.16608 shutdown 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 msgr2=0x55fa810ed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810ed900 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9678008eb0 tx=0x7f9678008ee0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 shutdown_connections 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810ed900 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa810fc210 0x55fa810fe630 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 --2- 172.21.15.5:0/623870168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f9668ff9700 0 client.16608 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 >> 172.21.15.5:0/623870168 conn(0x55fa81052200 msgr2=0x55fa810d8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 shutdown_connections 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 1 -- 172.21.15.5:0/623870168 wait complete. 2023-10-08T13:13:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.969+0000 7f969356eb80 20 client.16608 trim_cache size 0 max 16384 2023-10-08T13:13:03.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 Processor -- start 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 -- start start 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa80eb18c0 con 0x55fa810e63b0 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa810d9610 con 0x55fa810e5a90 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f969356eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa810d9940 con 0x55fa810e02c0 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f9685922700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f9685922700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810d8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36862/0 (socket says 172.21.15.5:36862) 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f9685121700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f9685922700 1 -- 172.21.15.5:0/1644709578 learned_addr learned my addr 172.21.15.5:0/1644709578 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.984+0000 7f9684920700 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f9685922700 1 -- 172.21.15.5:0/1644709578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 msgr2=0x55fa810f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f9685922700 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f9685922700 1 -- 172.21.15.5:0/1644709578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 msgr2=0x55fa810e45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f9685922700 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810e45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f9685922700 1 -- 172.21.15.5:0/1644709578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa80e821f0 con 0x55fa810e63b0 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f9685922700 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810d8790 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9678009780 tx=0x7f9678009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c9782346ca963 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f966bfff700 1 -- 172.21.15.5:0/1644709578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800e070 con 0x55fa810e63b0 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f966bfff700 1 -- 172.21.15.5:0/1644709578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f967800f040 con 0x55fa810e63b0 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f966bfff700 1 -- 172.21.15.5:0/1644709578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96780074a0 con 0x55fa810e63b0 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f969356eb80 1 -- 172.21.15.5:0/1644709578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 msgr2=0x55fa810d8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.985+0000 7f969356eb80 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810d8790 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9678009780 tx=0x7f9678009c30 comp rx=0 tx=0).stop 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- 172.21.15.5:0/1644709578 shutdown_connections 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e63b0 0x55fa810d8790 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e02c0 0x55fa810f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 --2- 172.21.15.5:0/1644709578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e5a90 0x55fa810e45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- 172.21.15.5:0/1644709578 >> 172.21.15.5:0/1644709578 conn(0x55fa81052200 msgr2=0x55fa810e06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- 172.21.15.5:0/1644709578 shutdown_connections 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- 172.21.15.5:0/1644709578 wait complete. 2023-10-08T13:13:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- start start 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 Processor -- start 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 0x55fa810eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e63b0 0x55fa810ef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8114f0d0 con 0x55fa810e5a90 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8114f240 con 0x55fa810e02c0 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8114f400 con 0x55fa810e63b0 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f969356eb80 10 client.0 _ll_register_callbacks cb 0x7f9678009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f9684920700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 0x55fa810eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f9684920700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 0x55fa810eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36866/0 (socket says 172.21.15.5:36866) 2023-10-08T13:13:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f9685121700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f9684920700 1 -- 172.21.15.5:0/98556428 learned_addr learned my addr 172.21.15.5:0/98556428 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.986+0000 7f9685922700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e63b0 0x55fa810ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9684920700 1 -- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e63b0 msgr2=0x55fa810ef230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9684920700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e63b0 0x55fa810ef230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9684920700 1 -- 172.21.15.5:0/98556428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 msgr2=0x55fa810ee7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9684920700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810ee7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9684920700 1 -- 172.21.15.5:0/98556428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa80e44c00 con 0x55fa810e5a90 2023-10-08T13:13:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9685121700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810ee7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9684920700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 0x55fa810eecf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9670005950 tx=0x7f96700051a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b824fdf628a956d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9668ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9668ff9700 1 -- 172.21.15.5:0/98556428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967002c070 con 0x55fa810e5a90 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9668ff9700 1 -- 172.21.15.5:0/98556428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9670005550 con 0x55fa810e5a90 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9670021070 con 0x55fa810e5a90 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9668ff9700 1 -- 172.21.15.5:0/98556428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96700036f0 con 0x55fa810e5a90 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f969356eb80 10 client.16614 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55fa80e5a250 con 0x55fa810e5a90 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9668ff9700 1 -- 172.21.15.5:0/98556428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9670021070 con 0x55fa810e5a90 2023-10-08T13:13:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f9668ff9700 1 -- 172.21.15.5:0/98556428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9670026820 con 0x55fa810e5a90 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f969356eb80 10 client.16614 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f969356eb80 10 client.16614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.987+0000 7f969356eb80 20 client.16614 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.988+0000 7f969356eb80 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa81150ce0 0x55fa81153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.988+0000 7f969356eb80 4 client.16614 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.988+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fa81029ad0 con 0x55fa81150ce0 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.988+0000 7f9685121700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa81150ce0 0x55fa81153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.988+0000 7f9668ff9700 10 client.16614 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.988+0000 7f9685121700 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa81150ce0 0x55fa81153100 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb678b62c85adf4 server_cookie=73b103c4861a6337 in_seq=0 out_seq=0 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f9668ff9700 1 -- 172.21.15.5:0/98556428 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fa81029ad0 con 0x55fa81150ce0 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f9668ff9700 10 client.16614 handle_command_reply: tid=0 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 client.16614 shutdown 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 msgr2=0x55fa810eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 0x55fa810eecf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9670005950 tx=0x7f96700051a0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 shutdown_connections 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa810e63b0 0x55fa810ef230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa81150ce0 0x55fa81153100 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa810e02c0 0x55fa810ee7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f9668ff9700 0 client.16614 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 --2- 172.21.15.5:0/98556428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa810e5a90 0x55fa810eecf0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 >> 172.21.15.5:0/98556428 conn(0x55fa81052200 msgr2=0x55fa810ddb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 shutdown_connections 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 1 -- 172.21.15.5:0/98556428 wait complete. 2023-10-08T13:13:03.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.996+0000 7f969356eb80 20 client.16614 trim_cache size 0 max 16384 2023-10-08T13:13:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:13:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:13:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:13:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:13:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f966c0a1660 msgr2=0x7f966c0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f966c0a1660 0x7f966c0a3b20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9680196a90 tx=0x7f9670009260 comp rx=0 tx=0).stop 2023-10-08T13:13:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 msgr2=0x7f968019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 0x7f968019b7a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e9a0 tx=0x7f967c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:13:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 shutdown_connections 2023-10-08T13:13:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f966c0a1660 0x7f966c0a3b20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:04.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9680105650 0x7f9680195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:04.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96800ff590 0x7f968019b7a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:04.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 --2- 172.21.15.5:0/3058857252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96800fff50 0x7f968019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:04.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 >> 172.21.15.5:0/3058857252 conn(0x7f96800fb040 msgr2=0x7f96800fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:04.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 shutdown_connections 2023-10-08T13:13:04.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:03.997+0000 7f9687385700 1 -- 172.21.15.5:0/3058857252 wait complete. 2023-10-08T13:13:04.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:03 smithi118 ceph-mon[104234]: pgmap v512: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.1 MiB/s wr, 564 op/s 2023-10-08T13:13:06.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 405.0 s, 340.3 tps, lat 299.353 ms stddev 776.894 2023-10-08T13:13:06.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:06 smithi060 ceph-mon[103190]: pgmap v513: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 5.3 MiB/s wr, 541 op/s 2023-10-08T13:13:06.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:06 smithi005 ceph-mon[99496]: pgmap v513: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 5.3 MiB/s wr, 541 op/s 2023-10-08T13:13:07.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:06 smithi118 ceph-mon[104234]: pgmap v513: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 5.3 MiB/s wr, 541 op/s 2023-10-08T13:13:07.914 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:07 smithi060 ceph-mon[103190]: pgmap v514: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2023-10-08T13:13:07.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:07 smithi005 ceph-mon[99496]: pgmap v514: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2023-10-08T13:13:08.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:07 smithi118 ceph-mon[104234]: pgmap v514: 129 pgs: 129 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2023-10-08T13:13:10.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:10 smithi060 ceph-mon[103190]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T13:13:10.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:10 smithi060 ceph-mon[103190]: pgmap v516: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 523 op/s 2023-10-08T13:13:10.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:10 smithi005 ceph-mon[99496]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T13:13:10.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:10 smithi005 ceph-mon[99496]: pgmap v516: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 523 op/s 2023-10-08T13:13:10.527 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:10 smithi118 ceph-mon[104234]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T13:13:10.527 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:10 smithi118 ceph-mon[104234]: pgmap v516: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 523 op/s 2023-10-08T13:13:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 410.0 s, 512.4 tps, lat 193.602 ms stddev 248.725 2023-10-08T13:13:12.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:12 smithi118 ceph-mon[104234]: pgmap v517: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.1 MiB/s wr, 507 op/s 2023-10-08T13:13:12.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:12 smithi060 ceph-mon[103190]: pgmap v517: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.1 MiB/s wr, 507 op/s 2023-10-08T13:13:12.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:12 smithi005 ceph-mon[99496]: pgmap v517: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.1 MiB/s wr, 507 op/s 2023-10-08T13:13:14.775 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:14 smithi118 ceph-mon[104234]: pgmap v518: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.4 MiB/s wr, 469 op/s 2023-10-08T13:13:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:14 smithi060 ceph-mon[103190]: pgmap v518: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.4 MiB/s wr, 469 op/s 2023-10-08T13:13:14.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:14 smithi005 ceph-mon[99496]: pgmap v518: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.4 MiB/s wr, 469 op/s 2023-10-08T13:13:15.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:13:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.642+0000 7f68bd70e700 1 -- 172.21.15.5:0/1868963770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8109ab0 msgr2=0x7f68b8112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.642+0000 7f68bd70e700 1 --2- 172.21.15.5:0/1868963770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8109ab0 0x7f68b8112200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009990 tx=0x7f68ac009ca0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.643+0000 7f68bd70e700 1 -- 172.21.15.5:0/1868963770 shutdown_connections 2023-10-08T13:13:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.643+0000 7f68bd70e700 1 --2- 172.21.15.5:0/1868963770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8112740 0x7f68b8114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.643+0000 7f68bd70e700 1 --2- 172.21.15.5:0/1868963770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b8109190 0x7f68b8109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.643+0000 7f68bd70e700 1 --2- 172.21.15.5:0/1868963770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8109ab0 0x7f68b8112200 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.643+0000 7f68bd70e700 1 -- 172.21.15.5:0/1868963770 >> 172.21.15.5:0/1868963770 conn(0x7f68b806b770 msgr2=0x7f68b806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:15.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.657+0000 7f68bd70e700 1 -- 172.21.15.5:0/1868963770 shutdown_connections 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.668+0000 7f68bd70e700 1 -- 172.21.15.5:0/1868963770 wait complete. 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.668+0000 7f68bd70e700 1 Processor -- start 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 -- start start 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 0x7f68b819e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8112740 0x7f68b819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b81a2e90 0x7f68b81a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81a3910 con 0x7f68b8109ab0 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81a3a80 con 0x7f68b81a2e90 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68bd70e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81a3c40 con 0x7f68b8112740 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 0x7f68b819e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 0x7f68b819e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36876/0 (socket says 172.21.15.5:36876) 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68b6ffd700 1 -- 172.21.15.5:0/574697005 learned_addr learned my addr 172.21.15.5:0/574697005 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.669+0000 7f68b67fc700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8112740 0x7f68b819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.670+0000 7f68b6ffd700 1 -- 172.21.15.5:0/574697005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8112740 msgr2=0x7f68b819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.670+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8112740 0x7f68b819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.670+0000 7f68b6ffd700 1 -- 172.21.15.5:0/574697005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b81a2e90 msgr2=0x7f68b81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.670+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b81a2e90 0x7f68b81a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.670+0000 7f68b6ffd700 1 -- 172.21.15.5:0/574697005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0095f0 con 0x7f68b8109ab0 2023-10-08T13:13:15.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.670+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 0x7f68b819e5b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f68a800b500 tx=0x7f68a800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.685+0000 7f689ffff700 1 -- 172.21.15.5:0/574697005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8011830 con 0x7f68b8109ab0 2023-10-08T13:13:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.685+0000 7f689ffff700 1 -- 172.21.15.5:0/574697005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68a8011e50 con 0x7f68b8109ab0 2023-10-08T13:13:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.685+0000 7f689ffff700 1 -- 172.21.15.5:0/574697005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8010e50 con 0x7f68b8109ab0 2023-10-08T13:13:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.686+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b81080e0 con 0x7f68b8109ab0 2023-10-08T13:13:15.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.686+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b81084b0 con 0x7f68b8109ab0 2023-10-08T13:13:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 Processor -- start 2023-10-08T13:13:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 -- start start 2023-10-08T13:13:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b64b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b656110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b658a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b5b4460 con 0x563b2b64ae80 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b5a5c20 con 0x563b2b64b7a0 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.691+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b5a3540 con 0x563b2b656650 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.694+0000 7f68b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b64b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.694+0000 7f68b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b64b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36882/0 (socket says 172.21.15.5:36882) 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.694+0000 7f68b77fe700 1 -- 172.21.15.5:0/3650974629 learned_addr learned my addr 172.21.15.5:0/3650974629 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.694+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b656110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.694+0000 7f689ffff700 1 -- 172.21.15.5:0/574697005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f68a8010580 con 0x7f68b8109ab0 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b658a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 -- 172.21.15.5:0/3650974629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 msgr2=0x563b2b656110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b656110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 -- 172.21.15.5:0/3650974629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 msgr2=0x563b2b64b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b64b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 -- 172.21.15.5:0/3650974629 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2b3c9de0 con 0x563b2b656650 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f689ffff700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f68a00a17c0 0x7f68a00a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f68b67fc700 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b658a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f68ac006010 tx=0x7f68ac005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f303190454b65435 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.695+0000 7f689ffff700 1 -- 172.21.15.5:0/574697005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f68a80ccd60 con 0x7f68b8109ab0 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.696+0000 7f68b77fe700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f68a00a17c0 0x7f68a00a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.696+0000 7f68b77fe700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f68a00a17c0 0x7f68a00a3c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e60 tx=0x7f68b0009470 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.702+0000 7f689d7fa700 1 -- 172.21.15.5:0/3650974629 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01d070 con 0x563b2b656650 2023-10-08T13:13:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.702+0000 7f689d7fa700 1 -- 172.21.15.5:0/3650974629 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68ac01e040 con 0x563b2b656650 2023-10-08T13:13:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.702+0000 7f689d7fa700 1 -- 172.21.15.5:0/3650974629 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac004740 con 0x563b2b656650 2023-10-08T13:13:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3650974629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 msgr2=0x563b2b658a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b658a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f68ac006010 tx=0x7f68ac005e50 comp rx=0 tx=0).stop 2023-10-08T13:13:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3650974629 shutdown_connections 2023-10-08T13:13:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b658a40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b64b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3650974629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b656110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3650974629 >> 172.21.15.5:0/3650974629 conn(0x563b2b5c0260 msgr2=0x563b2b6472d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3650974629 shutdown_connections 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3650974629 wait complete. 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.703+0000 7f68c98f7b80 1 -- start start 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 Processor -- start 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 0x563b2b656060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b6533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b656650 0x563b2b653a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b59ee30 con 0x563b2b656650 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b53b710 con 0x563b2b64b7a0 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b53b3b0 con 0x563b2b64ae80 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68c98f7b80 10 client.0 _ll_register_callbacks cb 0x563b2b398800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 0x563b2b656060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b656650 0x563b2b653a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 0x563b2b656060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50094/0 (socket says 172.21.15.5:50094) 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.704+0000 7f68b6ffd700 1 -- 172.21.15.5:0/725430657 learned_addr learned my addr 172.21.15.5:0/725430657 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b6ffd700 1 -- 172.21.15.5:0/725430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 msgr2=0x563b2b6533a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b6533a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b6ffd700 1 -- 172.21.15.5:0/725430657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b656650 msgr2=0x563b2b653a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b656650 0x563b2b653a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b6ffd700 1 -- 172.21.15.5:0/725430657 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b81154b0 con 0x563b2b64ae80 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b77fe700 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b656650 0x563b2b653a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 0x563b2b656060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f68a8096470 tx=0x7f68a8099630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c87238dc66a826 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f689aff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f689aff5700 1 -- 172.21.15.5:0/725430657 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8099a00 con 0x563b2b64ae80 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f689aff5700 1 -- 172.21.15.5:0/725430657 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f68a809db50 con 0x563b2b64ae80 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.705+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b2b566eb0 con 0x563b2b64ae80 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.706+0000 7f689aff5700 1 -- 172.21.15.5:0/725430657 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68a80a1d90 con 0x563b2b64ae80 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.710+0000 7f68c98f7b80 10 client.26173 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.710+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x563b2b3b2c60 con 0x563b2b64ae80 2023-10-08T13:13:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.710+0000 7f689aff5700 1 -- 172.21.15.5:0/725430657 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68a80b6070 con 0x563b2b64ae80 2023-10-08T13:13:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f689aff5700 1 -- 172.21.15.5:0/725430657 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f68a80a1900 con 0x563b2b64ae80 2023-10-08T13:13:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f68c98f7b80 10 client.26173 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f68c98f7b80 10 client.26173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f68c98f7b80 20 client.26173 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b65c1a0 0x563b2b65e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f68c98f7b80 4 client.26173 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.711+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b2b597e10 con 0x563b2b65c1a0 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.714+0000 7f68b67fc700 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b65c1a0 0x563b2b65e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.714+0000 7f689aff5700 10 client.26173 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.714+0000 7f68b67fc700 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b65c1a0 0x563b2b65e5c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f037fad1958b7d99 server_cookie=ea41adcb52eee01a in_seq=0 out_seq=0 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f689aff5700 1 -- 172.21.15.5:0/725430657 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563b2b597e10 con 0x563b2b65c1a0 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f689aff5700 10 client.26173 handle_command_reply: tid=0 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 client.26173 shutdown 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 msgr2=0x563b2b656060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 0x563b2b656060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f68a8096470 tx=0x7f68a8099630 comp rx=0 tx=0).stop 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 shutdown_connections 2023-10-08T13:13:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b656650 0x563b2b653a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64ae80 0x563b2b656060 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b65c1a0 0x563b2b65e5c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/725430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64b7a0 0x563b2b6533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.719+0000 7f689aff5700 0 client.26173 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.720+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 >> 172.21.15.5:0/725430657 conn(0x563b2b5c0260 msgr2=0x563b2b646ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.720+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 shutdown_connections 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.720+0000 7f68c98f7b80 1 -- 172.21.15.5:0/725430657 wait complete. 2023-10-08T13:13:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.720+0000 7f68c98f7b80 20 client.26173 trim_cache size 0 max 16384 2023-10-08T13:13:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.750+0000 7f68c98f7b80 1 Processor -- start 2023-10-08T13:13:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 -- start start 2023-10-08T13:13:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b66bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64b7a0 0x563b2b650680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b656650 0x563b2b650bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b41f920 con 0x563b2b64ae80 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b66c300 con 0x563b2b656650 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b6460b0 con 0x563b2b64b7a0 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b66bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b66bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36898/0 (socket says 172.21.15.5:36898) 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.752+0000 7f68b6ffd700 1 -- 172.21.15.5:0/3772240611 learned_addr learned my addr 172.21.15.5:0/3772240611 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f68b6ffd700 1 -- 172.21.15.5:0/3772240611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64b7a0 msgr2=0x563b2b650680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64b7a0 0x563b2b650680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f68b6ffd700 1 -- 172.21.15.5:0/3772240611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b656650 msgr2=0x563b2b650bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b656650 0x563b2b650bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f68b6ffd700 1 -- 172.21.15.5:0/3772240611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2b3f0250 con 0x563b2b64ae80 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b66bdc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f68a80a1c80 tx=0x7f68a8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e40a7221437baa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.753+0000 7f689dffb700 1 -- 172.21.15.5:0/3772240611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80b93b0 con 0x563b2b64ae80 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.754+0000 7f689dffb700 1 -- 172.21.15.5:0/3772240611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68a80b6050 con 0x563b2b64ae80 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.754+0000 7f689dffb700 1 -- 172.21.15.5:0/3772240611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80b2200 con 0x563b2b64ae80 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.754+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3772240611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 msgr2=0x563b2b66bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.755+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b66bdc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f68a80a1c80 tx=0x7f68a8004790 comp rx=0 tx=0).stop 2023-10-08T13:13:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.761+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3772240611 shutdown_connections 2023-10-08T13:13:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.761+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b656650 0x563b2b650bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.761+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64ae80 0x563b2b66bdc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.761+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/3772240611 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b64b7a0 0x563b2b650680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.761+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3772240611 >> 172.21.15.5:0/3772240611 conn(0x563b2b5c0260 msgr2=0x563b2b651cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.766+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3772240611 shutdown_connections 2023-10-08T13:13:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.766+0000 7f68c98f7b80 1 -- 172.21.15.5:0/3772240611 wait complete. 2023-10-08T13:13:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.766+0000 7f68c98f7b80 1 -- start start 2023-10-08T13:13:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.766+0000 7f68c98f7b80 1 Processor -- start 2023-10-08T13:13:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 0x563b2b66bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64b7a0 0x563b2b66a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b66a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b66ade0 con 0x563b2b64b7a0 2023-10-08T13:13:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b66af50 con 0x563b2b64ae80 2023-10-08T13:13:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2b6dc470 con 0x563b2b656650 2023-10-08T13:13:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68c98f7b80 10 client.0 _ll_register_callbacks cb 0x563b2b398800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 0x563b2b66bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 0x563b2b66bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60086/0 (socket says 172.21.15.5:60086) 2023-10-08T13:13:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 -- 172.21.15.5:0/2586816146 learned_addr learned my addr 172.21.15.5:0/2586816146 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 -- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 msgr2=0x563b2b66a700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b66a700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 -- 172.21.15.5:0/2586816146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64b7a0 msgr2=0x563b2b66a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64b7a0 0x563b2b66a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.767+0000 7f68b6ffd700 1 -- 172.21.15.5:0/2586816146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b2b3b2c60 con 0x563b2b64ae80 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.768+0000 7f68b6ffd700 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 0x563b2b66bbf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68a8097d50 tx=0x7f68a8099490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97cb3f80e274cda server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.768+0000 7f689aff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:13:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.783+0000 7f689aff5700 1 -- 172.21.15.5:0/2586816146 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8099a00 con 0x563b2b64ae80 2023-10-08T13:13:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.783+0000 7f689aff5700 1 -- 172.21.15.5:0/2586816146 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f68a80a1d90 con 0x563b2b64ae80 2023-10-08T13:13:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.784+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68ac01e040 con 0x563b2b64ae80 2023-10-08T13:13:15.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.789+0000 7f689aff5700 1 -- 172.21.15.5:0/2586816146 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68a80a1900 con 0x563b2b64ae80 2023-10-08T13:13:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.791+0000 7f68c98f7b80 10 client.26096 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:15.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.791+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x563b2b3c82b0 con 0x563b2b64ae80 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f689aff5700 1 -- 172.21.15.5:0/2586816146 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68ac01e040 con 0x563b2b64ae80 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f689aff5700 1 -- 172.21.15.5:0/2586816146 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f68a8098a70 con 0x563b2b64ae80 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f68c98f7b80 10 client.26096 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f68c98f7b80 10 client.26096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f68c98f7b80 20 client.26096 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b6dd760 0x563b2b6dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f68c98f7b80 4 client.26096 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:13:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.797+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563b2b597b30 con 0x563b2b6dd760 2023-10-08T13:13:15.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.800+0000 7f68b67fc700 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b6dd760 0x563b2b6dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.842+0000 7f68b67fc700 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b6dd760 0x563b2b6dfb50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612fc4c98983aaae server_cookie=93815451518a76e8 in_seq=0 out_seq=0 2023-10-08T13:13:15.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.842+0000 7f689aff5700 10 client.26096 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.847+0000 7f689aff5700 1 -- 172.21.15.5:0/2586816146 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563b2b597b30 con 0x563b2b6dd760 2023-10-08T13:13:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.847+0000 7f689aff5700 10 client.26096 handle_command_reply: tid=0 2023-10-08T13:13:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.852+0000 7f68c98f7b80 1 client.26096 shutdown 2023-10-08T13:13:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.869+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 msgr2=0x563b2b66bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.869+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 0x563b2b66bbf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68a8097d50 tx=0x7f68a8099490 comp rx=0 tx=0).stop 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 shutdown_connections 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b2b656650 0x563b2b66a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563b2b6dd760 0x563b2b6dfb50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b2b64ae80 0x563b2b66bbf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f68c98f7b80 1 --2- 172.21.15.5:0/2586816146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563b2b64b7a0 0x563b2b66a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 >> 172.21.15.5:0/2586816146 conn(0x563b2b5c0260 msgr2=0x563b2b652940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.870+0000 7f689aff5700 0 client.26096 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.883+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 shutdown_connections 2023-10-08T13:13:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.884+0000 7f68c98f7b80 1 -- 172.21.15.5:0/2586816146 wait complete. 2023-10-08T13:13:15.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.888+0000 7f68c98f7b80 20 client.26096 trim_cache size 0 max 16384 2023-10-08T13:13:15.889 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:13:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:13:15.890 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:13:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.902+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f68a00a17c0 msgr2=0x7f68a00a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.902+0000 7f68bd70e700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f68a00a17c0 0x7f68a00a3c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e60 tx=0x7f68b0009470 comp rx=0 tx=0).stop 2023-10-08T13:13:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.902+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 msgr2=0x7f68b819e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.902+0000 7f68bd70e700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 0x7f68b819e5b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f68a800b500 tx=0x7f68a800b810 comp rx=0 tx=0).stop 2023-10-08T13:13:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.914+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 shutdown_connections 2023-10-08T13:13:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.914+0000 7f68bd70e700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f68a00a17c0 0x7f68a00a3c80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.914+0000 7f68bd70e700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b81a2e90 0x7f68b81a3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.914+0000 7f68bd70e700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68b8109ab0 0x7f68b819e5b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.914+0000 7f68bd70e700 1 --2- 172.21.15.5:0/574697005 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68b8112740 0x7f68b819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.914+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 >> 172.21.15.5:0/574697005 conn(0x7f68b806b770 msgr2=0x7f68b8112b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.917+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 shutdown_connections 2023-10-08T13:13:15.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:15.920+0000 7f68bd70e700 1 -- 172.21.15.5:0/574697005 wait complete. 2023-10-08T13:13:15.982 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:13:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 415.0 s, 679.5 tps, lat 144.178 ms stddev 167.136 2023-10-08T13:13:16.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:16 smithi118 ceph-mon[104234]: pgmap v519: 129 pgs: 129 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.6 MiB/s wr, 457 op/s 2023-10-08T13:13:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:16 smithi060 ceph-mon[103190]: pgmap v519: 129 pgs: 129 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.6 MiB/s wr, 457 op/s 2023-10-08T13:13:16.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:16 smithi005 ceph-mon[99496]: pgmap v519: 129 pgs: 129 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.6 MiB/s wr, 457 op/s 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.260+0000 7f675063d700 1 -- 172.21.15.5:0/3305575805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810f310 msgr2=0x7f6748107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.260+0000 7f675063d700 1 --2- 172.21.15.5:0/3305575805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810f310 0x7f6748107d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f674000b0d0 tx=0x7f674000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.261+0000 7f675063d700 1 -- 172.21.15.5:0/3305575805 shutdown_connections 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.261+0000 7f675063d700 1 --2- 172.21.15.5:0/3305575805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6748119fd0 0x7f674811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.261+0000 7f675063d700 1 --2- 172.21.15.5:0/3305575805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674810eea0 0x7f67481077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.261+0000 7f675063d700 1 --2- 172.21.15.5:0/3305575805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810f310 0x7f6748107d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.261+0000 7f675063d700 1 -- 172.21.15.5:0/3305575805 >> 172.21.15.5:0/3305575805 conn(0x7f674806b7c0 msgr2=0x7f674806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:17.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.272+0000 7f675063d700 1 -- 172.21.15.5:0/3305575805 shutdown_connections 2023-10-08T13:13:17.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.279+0000 7f675063d700 1 -- 172.21.15.5:0/3305575805 wait complete. 2023-10-08T13:13:17.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.279+0000 7f675063d700 1 Processor -- start 2023-10-08T13:13:17.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 -- start start 2023-10-08T13:13:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810eea0 0x7f67481ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f674810f310 0x7f67481abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 0x7f67481a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481a6220 con 0x7f674810f310 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481a6390 con 0x7f6748119fd0 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.280+0000 7f675063d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481a6550 con 0x7f674810eea0 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 0x7f67481a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 0x7f67481a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60092/0 (socket says 172.21.15.5:60092) 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 -- 172.21.15.5:0/3433089373 learned_addr learned my addr 172.21.15.5:0/3433089373 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 -- 172.21.15.5:0/3433089373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810eea0 msgr2=0x7f67481ab9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810eea0 0x7f67481ab9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 -- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f674810f310 msgr2=0x7f67481abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f674810f310 0x7f67481abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 -- 172.21.15.5:0/3433089373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009d00 con 0x7f6748119fd0 2023-10-08T13:13:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.282+0000 7f674ebda700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 0x7f67481a5a50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f674400b4a0 tx=0x7f674400b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:17.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.292+0000 7f673f7fe700 1 -- 172.21.15.5:0/3433089373 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744011830 con 0x7f6748119fd0 2023-10-08T13:13:17.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.292+0000 7f673f7fe700 1 -- 172.21.15.5:0/3433089373 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6744011e50 con 0x7f6748119fd0 2023-10-08T13:13:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.292+0000 7f673f7fe700 1 -- 172.21.15.5:0/3433089373 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744010e70 con 0x7f6748119fd0 2023-10-08T13:13:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.292+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67481a6830 con 0x7f6748119fd0 2023-10-08T13:13:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.292+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67481b2930 con 0x7f6748119fd0 2023-10-08T13:13:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.298+0000 7f675c826b80 1 Processor -- start 2023-10-08T13:13:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.299+0000 7f673f7fe700 1 -- 172.21.15.5:0/3433089373 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6744010380 con 0x7f6748119fd0 2023-10-08T13:13:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.299+0000 7f675c826b80 1 -- start start 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.299+0000 7f675c826b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273a880 0x562e8273ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.299+0000 7f675c826b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273b1a0 0x562e82734b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.299+0000 7f675c826b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e827350b0 0x562e82735510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f675c826b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8269d400 con 0x562e8273a880 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f675c826b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8268ebc0 con 0x562e827350b0 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f675c826b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8268c4e0 con 0x562e8273b1a0 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273a880 0x562e8273ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273a880 0x562e8273ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36914/0 (socket says 172.21.15.5:36914) 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f674dbd8700 1 -- 172.21.15.5:0/2626285710 learned_addr learned my addr 172.21.15.5:0/2626285710 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f674dbd8700 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e827350b0 0x562e82735510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f673f7fe700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67340a16b0 0x7f67340a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f673f7fe700 1 -- 172.21.15.5:0/3433089373 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f67440cce30 con 0x7f6748119fd0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.300+0000 7f674ebda700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67340a16b0 0x7f67340a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.301+0000 7f674dbd8700 1 -- 172.21.15.5:0/2626285710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273b1a0 msgr2=0x562e82734b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.301+0000 7f674dbd8700 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273b1a0 0x562e82734b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.301+0000 7f674dbd8700 1 -- 172.21.15.5:0/2626285710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273a880 msgr2=0x562e8273ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.301+0000 7f674dbd8700 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273a880 0x562e8273ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.301+0000 7f674dbd8700 1 -- 172.21.15.5:0/2626285710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e824b2d80 con 0x562e827350b0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.301+0000 7f674dbd8700 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e827350b0 0x562e82735510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6740009750 tx=0x7f6740000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea870f98e8098fee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.302+0000 7f674ebda700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67340a16b0 0x7f67340a3b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6744011040 tx=0x7f6744010fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.304+0000 7f673cff9700 1 -- 172.21.15.5:0/2626285710 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000e040 con 0x562e827350b0 2023-10-08T13:13:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.304+0000 7f673cff9700 1 -- 172.21.15.5:0/2626285710 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67400074e0 con 0x562e827350b0 2023-10-08T13:13:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.304+0000 7f673cff9700 1 -- 172.21.15.5:0/2626285710 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67400094e0 con 0x562e827350b0 2023-10-08T13:13:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.305+0000 7f675c826b80 1 -- 172.21.15.5:0/2626285710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e827350b0 msgr2=0x562e82735510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.305+0000 7f675c826b80 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e827350b0 0x562e82735510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6740009750 tx=0x7f6740000f40 comp rx=0 tx=0).stop 2023-10-08T13:13:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.310+0000 7f675c826b80 1 -- 172.21.15.5:0/2626285710 shutdown_connections 2023-10-08T13:13:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.310+0000 7f675c826b80 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e827350b0 0x562e82735510 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.310+0000 7f675c826b80 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273a880 0x562e8273ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.310+0000 7f675c826b80 1 --2- 172.21.15.5:0/2626285710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273b1a0 0x562e82734b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.310+0000 7f675c826b80 1 -- 172.21.15.5:0/2626285710 >> 172.21.15.5:0/2626285710 conn(0x562e826a9200 msgr2=0x562e8272fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.316+0000 7f675c826b80 1 -- 172.21.15.5:0/2626285710 shutdown_connections 2023-10-08T13:13:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.319+0000 7f675c826b80 1 -- 172.21.15.5:0/2626285710 wait complete. 2023-10-08T13:13:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.319+0000 7f675c826b80 1 -- start start 2023-10-08T13:13:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.319+0000 7f675c826b80 1 Processor -- start 2023-10-08T13:13:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e82741190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e8273e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8273eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e82687dd0 con 0x562e827350b0 2023-10-08T13:13:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e826246b0 con 0x562e8273b1a0 2023-10-08T13:13:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e82624350 con 0x562e8273a880 2023-10-08T13:13:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f675c826b80 10 client.0 _ll_register_callbacks cb 0x562e824817a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8273eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8273eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60106/0 (socket says 172.21.15.5:60106) 2023-10-08T13:13:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f674e3d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e8273e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.320+0000 7f674dbd8700 1 -- 172.21.15.5:0/4108170752 learned_addr learned my addr 172.21.15.5:0/4108170752 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.321+0000 7f674e3d9700 1 -- 172.21.15.5:0/4108170752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 msgr2=0x562e8273eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.321+0000 7f674e3d9700 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8273eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.321+0000 7f674e3d9700 1 -- 172.21.15.5:0/4108170752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 msgr2=0x562e82741190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.321+0000 7f674e3d9700 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e82741190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.321+0000 7f674e3d9700 1 -- 172.21.15.5:0/4108170752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674811cbd0 con 0x562e8273a880 2023-10-08T13:13:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.321+0000 7f674e3d9700 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e8273e480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x562e8273b600 tx=0x7f673800b3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60202b96bf9c47d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.326+0000 7f6731ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:13:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.327+0000 7f6731ffb700 1 -- 172.21.15.5:0/4108170752 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800be60 con 0x562e8273a880 2023-10-08T13:13:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.327+0000 7f6731ffb700 1 -- 172.21.15.5:0/4108170752 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f6738011420 con 0x562e8273a880 2023-10-08T13:13:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.327+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e8264fe50 con 0x562e8273a880 2023-10-08T13:13:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.333+0000 7f6731ffb700 1 -- 172.21.15.5:0/4108170752 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67380115e0 con 0x562e8273a880 2023-10-08T13:13:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.335+0000 7f675c826b80 10 client.26179 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.335+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x562e8249bc00 con 0x562e8273a880 2023-10-08T13:13:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.335+0000 7f6731ffb700 1 -- 172.21.15.5:0/4108170752 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e8264fe50 con 0x562e8273a880 2023-10-08T13:13:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f6731ffb700 1 -- 172.21.15.5:0/4108170752 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f67380198f0 con 0x562e8273a880 2023-10-08T13:13:17.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f675c826b80 10 client.26179 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:17.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f675c826b80 10 client.26179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:17.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f675c826b80 20 client.26179 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f675c826b80 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e8274ed70 0x562e82751190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f675c826b80 4 client.26179 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e82680db0 con 0x562e8274ed70 2023-10-08T13:13:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f674dbd8700 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e8274ed70 0x562e82751190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f6731ffb700 10 client.26179 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.336+0000 7f674dbd8700 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e8274ed70 0x562e82751190 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9099431e39e3e0a server_cookie=5814163bbd3188f in_seq=0 out_seq=0 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f6731ffb700 1 -- 172.21.15.5:0/4108170752 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562e82680db0 con 0x562e8274ed70 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f6731ffb700 10 client.26179 handle_command_reply: tid=0 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f675c826b80 1 client.26179 shutdown 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 msgr2=0x562e8273e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f675c826b80 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e8273e480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x562e8273b600 tx=0x7f673800b3c0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 shutdown_connections 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.337+0000 7f675c826b80 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e8274ed70 0x562e82751190 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.338+0000 7f675c826b80 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8273eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.338+0000 7f6731ffb700 0 client.26179 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.338+0000 7f675c826b80 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e82741190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.338+0000 7f675c826b80 1 --2- 172.21.15.5:0/4108170752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e8273e480 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.338+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 >> 172.21.15.5:0/4108170752 conn(0x562e826a9200 msgr2=0x562e8272f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.343+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 shutdown_connections 2023-10-08T13:13:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.345+0000 7f675c826b80 1 -- 172.21.15.5:0/4108170752 wait complete. 2023-10-08T13:13:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.347+0000 7f675c826b80 20 client.26179 trim_cache size 0 max 16384 2023-10-08T13:13:17.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.370+0000 7f675c826b80 1 Processor -- start 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 -- start start 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e827350b0 0x562e82734b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273a880 0x562e82745c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 0x562e8272f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e825088c0 con 0x562e8273b1a0 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e82731100 con 0x562e8273a880 2023-10-08T13:13:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.376+0000 7f675c826b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e82727670 con 0x562e827350b0 2023-10-08T13:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.382+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 0x562e8272f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.382+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 0x562e8272f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36932/0 (socket says 172.21.15.5:36932) 2023-10-08T13:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.382+0000 7f674dbd8700 1 -- 172.21.15.5:0/3071666081 learned_addr learned my addr 172.21.15.5:0/3071666081 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.392+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e827350b0 0x562e82734b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.395+0000 7f674dbd8700 1 -- 172.21.15.5:0/3071666081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e827350b0 msgr2=0x562e82734b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.395+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e827350b0 0x562e82734b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.395+0000 7f674dbd8700 1 -- 172.21.15.5:0/3071666081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273a880 msgr2=0x562e82745c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.395+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273a880 0x562e82745c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.395+0000 7f674dbd8700 1 -- 172.21.15.5:0/3071666081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e824d91f0 con 0x562e8273b1a0 2023-10-08T13:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.396+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 0x562e8272f790 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6740009b80 tx=0x7f67400094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9877cdd7613429e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.396+0000 7f673d7fa700 1 -- 172.21.15.5:0/3071666081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000e040 con 0x562e8273b1a0 2023-10-08T13:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.396+0000 7f673d7fa700 1 -- 172.21.15.5:0/3071666081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6740050cd0 con 0x562e8273b1a0 2023-10-08T13:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.396+0000 7f673d7fa700 1 -- 172.21.15.5:0/3071666081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740007940 con 0x562e8273b1a0 2023-10-08T13:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.397+0000 7f675c826b80 1 -- 172.21.15.5:0/3071666081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 msgr2=0x562e8272f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.397+0000 7f675c826b80 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 0x562e8272f790 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6740009b80 tx=0x7f67400094e0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.398+0000 7f675c826b80 1 -- 172.21.15.5:0/3071666081 shutdown_connections 2023-10-08T13:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.398+0000 7f675c826b80 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e8273b1a0 0x562e8272f790 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.398+0000 7f675c826b80 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e827350b0 0x562e82734b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.398+0000 7f675c826b80 1 --2- 172.21.15.5:0/3071666081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273a880 0x562e82745c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.398+0000 7f675c826b80 1 -- 172.21.15.5:0/3071666081 >> 172.21.15.5:0/3071666081 conn(0x562e826a9200 msgr2=0x562e8273cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.415+0000 7f675c826b80 1 -- 172.21.15.5:0/3071666081 shutdown_connections 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.422+0000 7f675c826b80 1 -- 172.21.15.5:0/3071666081 wait complete. 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 -- start start 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 Processor -- start 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e827374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e827379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8279db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e827460b0 con 0x562e827350b0 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8279e0b0 con 0x562e8273b1a0 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8279e270 con 0x562e8273a880 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.423+0000 7f675c826b80 10 client.0 _ll_register_callbacks cb 0x7f6738009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.426+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8279db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.426+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e827374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.426+0000 7f674e3d9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e827379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.427+0000 7f674dbd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8279db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60120/0 (socket says 172.21.15.5:60120) 2023-10-08T13:13:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.427+0000 7f674dbd8700 1 -- 172.21.15.5:0/3216718954 learned_addr learned my addr 172.21.15.5:0/3216718954 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f674dbd8700 1 -- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 msgr2=0x562e827379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e827379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f674dbd8700 1 -- 172.21.15.5:0/3216718954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 msgr2=0x562e827374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e827374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f674dbd8700 1 -- 172.21.15.5:0/3216718954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e824b2d80 con 0x562e8273b1a0 2023-10-08T13:13:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f674dbd8700 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8279db70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x562e8272fe00 tx=0x7f674000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ccd9551e700be8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.432+0000 7f6731ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:13:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.433+0000 7f6731ffb700 1 -- 172.21.15.5:0/3216718954 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740055020 con 0x562e8273b1a0 2023-10-08T13:13:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.433+0000 7f6731ffb700 1 -- 172.21.15.5:0/3216718954 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f6740050180 con 0x562e8273b1a0 2023-10-08T13:13:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.433+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67400074e0 con 0x562e8273b1a0 2023-10-08T13:13:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.433+0000 7f6731ffb700 1 -- 172.21.15.5:0/3216718954 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f674000e070 con 0x562e8273b1a0 2023-10-08T13:13:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.435+0000 7f675c826b80 10 client.26108 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:17.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.435+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x562e824b1250 con 0x562e8273b1a0 2023-10-08T13:13:17.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.439+0000 7f6731ffb700 1 -- 172.21.15.5:0/3216718954 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67400074e0 con 0x562e8273b1a0 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f6731ffb700 1 -- 172.21.15.5:0/3216718954 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6740041450 con 0x562e8273b1a0 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f675c826b80 10 client.26108 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f675c826b80 10 client.26108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f675c826b80 20 client.26108 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f675c826b80 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e82736ca0 0x562e82744c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f675c826b80 4 client.26108 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:13:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.440+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e82680ad0 con 0x562e82736ca0 2023-10-08T13:13:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.445+0000 7f674e3d9700 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e82736ca0 0x562e82744c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.448+0000 7f6731ffb700 10 client.26108 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.448+0000 7f674e3d9700 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e82736ca0 0x562e82744c20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b90d12db2e8763b server_cookie=85247505246db68f in_seq=0 out_seq=0 2023-10-08T13:13:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.498+0000 7f6731ffb700 1 -- 172.21.15.5:0/3216718954 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e82680ad0 con 0x562e82736ca0 2023-10-08T13:13:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.498+0000 7f6731ffb700 10 client.26108 handle_command_reply: tid=0 2023-10-08T13:13:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.498+0000 7f675c826b80 1 client.26108 shutdown 2023-10-08T13:13:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 msgr2=0x562e8279db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8279db70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x562e8272fe00 tx=0x7f674000b8a0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 shutdown_connections 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562e82736ca0 0x562e82744c20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e8273b1a0 0x562e8279db70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f6731ffb700 0 client.26108 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e827350b0 0x562e827374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 --2- 172.21.15.5:0/3216718954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562e8273a880 0x562e827379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 >> 172.21.15.5:0/3216718954 conn(0x562e826a9200 msgr2=0x562e8273e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 shutdown_connections 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 1 -- 172.21.15.5:0/3216718954 wait complete. 2023-10-08T13:13:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.500+0000 7f675c826b80 20 client.26108 trim_cache size 0 max 16384 2023-10-08T13:13:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:13:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:13:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:13:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67340a16b0 msgr2=0x7f67340a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67340a16b0 0x7f67340a3b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6744011040 tx=0x7f6744010fd0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 msgr2=0x7f67481a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 0x7f67481a5a50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f674400b4a0 tx=0x7f674400b860 comp rx=0 tx=0).stop 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 shutdown_connections 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f67340a16b0 0x7f67340a3b70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6748119fd0 0x7f67481a5a50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f674810eea0 0x7f67481ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 --2- 172.21.15.5:0/3433089373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f674810f310 0x7f67481abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 >> 172.21.15.5:0/3433089373 conn(0x7f674806b7c0 msgr2=0x7f6748117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 shutdown_connections 2023-10-08T13:13:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:17.501+0000 7f675063d700 1 -- 172.21.15.5:0/3433089373 wait complete. 2023-10-08T13:13:18.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:18 smithi118 ceph-mon[104234]: pgmap v520: 129 pgs: 129 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.9 MiB/s wr, 480 op/s 2023-10-08T13:13:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:18 smithi060 ceph-mon[103190]: pgmap v520: 129 pgs: 129 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.9 MiB/s wr, 480 op/s 2023-10-08T13:13:18.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:18 smithi005 ceph-mon[99496]: pgmap v520: 129 pgs: 129 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.9 MiB/s wr, 480 op/s 2023-10-08T13:13:20.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:20 smithi060 ceph-mon[103190]: pgmap v521: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 5.9 MiB/s wr, 535 op/s 2023-10-08T13:13:20.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:20 smithi005 ceph-mon[99496]: pgmap v521: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 5.9 MiB/s wr, 535 op/s 2023-10-08T13:13:21.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:20 smithi118 ceph-mon[104234]: pgmap v521: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 5.9 MiB/s wr, 535 op/s 2023-10-08T13:13:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 420.0 s, 617.4 tps, lat 163.865 ms stddev 208.052 2023-10-08T13:13:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:21 smithi060 ceph-mon[103190]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T13:13:21.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:21 smithi005 ceph-mon[99496]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T13:13:22.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:21 smithi118 ceph-mon[104234]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T13:13:22.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:22 smithi060 ceph-mon[103190]: pgmap v523: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 5.3 MiB/s wr, 510 op/s 2023-10-08T13:13:22.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:22 smithi005 ceph-mon[99496]: pgmap v523: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 5.3 MiB/s wr, 510 op/s 2023-10-08T13:13:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:22 smithi118 ceph-mon[104234]: pgmap v523: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 5.3 MiB/s wr, 510 op/s 2023-10-08T13:13:24.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:24 smithi060 ceph-mon[103190]: pgmap v524: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 5.6 MiB/s wr, 538 op/s 2023-10-08T13:13:24.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:24 smithi005 ceph-mon[99496]: pgmap v524: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 5.6 MiB/s wr, 538 op/s 2023-10-08T13:13:25.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:24 smithi118 ceph-mon[104234]: pgmap v524: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 5.6 MiB/s wr, 538 op/s 2023-10-08T13:13:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 425.0 s, 565.1 tps, lat 178.206 ms stddev 230.453 2023-10-08T13:13:26.911 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:26 smithi060 ceph-mon[103190]: pgmap v525: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 6.4 MiB/s wr, 574 op/s 2023-10-08T13:13:26.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:26 smithi005 ceph-mon[99496]: pgmap v525: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 6.4 MiB/s wr, 574 op/s 2023-10-08T13:13:27.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:26 smithi118 ceph-mon[104234]: pgmap v525: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 6.4 MiB/s wr, 574 op/s 2023-10-08T13:13:28.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:28 smithi060 ceph-mon[103190]: pgmap v526: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2023-10-08T13:13:28.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:28 smithi005 ceph-mon[99496]: pgmap v526: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2023-10-08T13:13:29.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:28 smithi118 ceph-mon[104234]: pgmap v526: 129 pgs: 129 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2023-10-08T13:13:29.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:29 smithi060 ceph-mon[103190]: pgmap v527: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 5.8 MiB/s wr, 599 op/s 2023-10-08T13:13:29.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:29 smithi005 ceph-mon[99496]: pgmap v527: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 5.8 MiB/s wr, 599 op/s 2023-10-08T13:13:30.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:29 smithi118 ceph-mon[104234]: pgmap v527: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 5.8 MiB/s wr, 599 op/s 2023-10-08T13:13:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 -- 172.21.15.5:0/2568352159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 msgr2=0x7f9d5410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/2568352159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d5410f760 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00b0a0 tx=0x7f9d4c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 -- 172.21.15.5:0/2568352159 shutdown_connections 2023-10-08T13:13:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/2568352159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d5410f760 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/2568352159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d541088a0 0x7f9d54108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/2568352159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d54102890 0x7f9d54102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 -- 172.21.15.5:0/2568352159 >> 172.21.15.5:0/2568352159 conn(0x7f9d540fe360 msgr2=0x7f9d54100780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 -- 172.21.15.5:0/2568352159 shutdown_connections 2023-10-08T13:13:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.684+0000 7f9d5c63b700 1 -- 172.21.15.5:0/2568352159 wait complete. 2023-10-08T13:13:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 Processor -- start 2023-10-08T13:13:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 -- start start 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d54102890 0x7f9d54198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d54199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d541088a0 0x7f9d5419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5419def0 con 0x7f9d54103250 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5419e060 con 0x7f9d541088a0 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5c63b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5419e220 con 0x7f9d54102890 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d59bd6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d54199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d59bd6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d54199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36952/0 (socket says 172.21.15.5:36952) 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d59bd6700 1 -- 172.21.15.5:0/1216896587 learned_addr learned my addr 172.21.15.5:0/1216896587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d54102890 0x7f9d54198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.685+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d541088a0 0x7f9d5419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d59bd6700 1 -- 172.21.15.5:0/1216896587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d54102890 msgr2=0x7f9d54198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d59bd6700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d54102890 0x7f9d54198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d59bd6700 1 -- 172.21.15.5:0/1216896587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d541088a0 msgr2=0x7f9d5419d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d59bd6700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d541088a0 0x7f9d5419d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d59bd6700 1 -- 172.21.15.5:0/1216896587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c009d00 con 0x7f9d54103250 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d541088a0 0x7f9d5419d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d54102890 0x7f9d54198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d59bd6700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d54199510 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400e9a0 tx=0x7f9d4400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d4b7fe700 1 -- 172.21.15.5:0/1216896587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44009790 con 0x7f9d54103250 2023-10-08T13:13:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d4b7fe700 1 -- 172.21.15.5:0/1216896587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d44010430 con 0x7f9d54103250 2023-10-08T13:13:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d4b7fe700 1 -- 172.21.15.5:0/1216896587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44018680 con 0x7f9d54103250 2023-10-08T13:13:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5419e500 con 0x7f9d54103250 2023-10-08T13:13:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.686+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d541a5d40 con 0x7f9d54103250 2023-10-08T13:13:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.689+0000 7f9d4b7fe700 1 -- 172.21.15.5:0/1216896587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f9d440105a0 con 0x7f9d54103250 2023-10-08T13:13:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.690+0000 7f9d4b7fe700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9d400a1660 0x7f9d400a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.690+0000 7f9d4b7fe700 1 -- 172.21.15.5:0/1216896587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f9d44014070 con 0x7f9d54103250 2023-10-08T13:13:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.690+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9d400a1660 0x7f9d400a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 Processor -- start 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 -- start start 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d126470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d120380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 0x55a02d120d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d080400 con 0x55a02d1208c0 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d071bc0 con 0x55a02d1269b0 2023-10-08T13:13:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.691+0000 7f9d68824b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d06f4e0 con 0x55a02d126090 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 0x55a02d120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 0x55a02d120d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36958/0 (socket says 172.21.15.5:36958) 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 -- 172.21.15.5:0/1937730852 learned_addr learned my addr 172.21.15.5:0/1937730852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d59bd6700 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 -- 172.21.15.5:0/1937730852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 msgr2=0x55a02d126470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d126470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 -- 172.21.15.5:0/1937730852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 msgr2=0x55a02d120380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d120380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 -- 172.21.15.5:0/1937730852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a02ce95d80 con 0x55a02d1208c0 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d59bd6700 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d120380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 0x55a02d120d20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c008f70 tx=0x7f9d4c008fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5539856d14af0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.692+0000 7f9d48ff9700 1 -- 172.21.15.5:0/1937730852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00e040 con 0x55a02d1208c0 2023-10-08T13:13:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.693+0000 7f9d48ff9700 1 -- 172.21.15.5:0/1937730852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d4c00bd30 con 0x55a02d1208c0 2023-10-08T13:13:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.693+0000 7f9d48ff9700 1 -- 172.21.15.5:0/1937730852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0052a0 con 0x55a02d1208c0 2023-10-08T13:13:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.693+0000 7f9d68824b80 1 -- 172.21.15.5:0/1937730852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 msgr2=0x55a02d120d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.693+0000 7f9d68824b80 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 0x55a02d120d20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c008f70 tx=0x7f9d4c008fa0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.696+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9d400a1660 0x7f9d400a3b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009fd0 tx=0x7f9d50009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.704+0000 7f9d68824b80 1 -- 172.21.15.5:0/1937730852 shutdown_connections 2023-10-08T13:13:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.704+0000 7f9d68824b80 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1208c0 0x55a02d120d20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.704+0000 7f9d68824b80 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d126470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.704+0000 7f9d68824b80 1 --2- 172.21.15.5:0/1937730852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d120380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.704+0000 7f9d68824b80 1 -- 172.21.15.5:0/1937730852 >> 172.21.15.5:0/1937730852 conn(0x55a02d08c200 msgr2=0x55a02d112b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.723+0000 7f9d68824b80 1 -- 172.21.15.5:0/1937730852 shutdown_connections 2023-10-08T13:13:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.725+0000 7f9d68824b80 1 -- 172.21.15.5:0/1937730852 wait complete. 2023-10-08T13:13:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.725+0000 7f9d68824b80 1 -- start start 2023-10-08T13:13:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.725+0000 7f9d68824b80 1 Processor -- start 2023-10-08T13:13:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.725+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.726+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d129d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.726+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d12a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.726+0000 7f9d68824b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d06add0 con 0x55a02d1269b0 2023-10-08T13:13:30.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.726+0000 7f9d68824b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d0076b0 con 0x55a02d1208c0 2023-10-08T13:13:30.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.726+0000 7f9d68824b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d007350 con 0x55a02d126090 2023-10-08T13:13:30.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.726+0000 7f9d68824b80 10 client.0 _ll_register_callbacks cb 0x55a02ce647a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.737+0000 7f9d5a3d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.738+0000 7f9d59bd6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d129d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.738+0000 7f9d59bd6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d129d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50170/0 (socket says 172.21.15.5:50170) 2023-10-08T13:13:30.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.738+0000 7f9d59bd6700 1 -- 172.21.15.5:0/2666112978 learned_addr learned my addr 172.21.15.5:0/2666112978 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.748+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d12a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.748+0000 7f9d5abd8700 1 -- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 msgr2=0x55a02d129d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.748+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d129d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.748+0000 7f9d5abd8700 1 -- 172.21.15.5:0/2666112978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 msgr2=0x55a02d12ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.748+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.748+0000 7f9d5abd8700 1 -- 172.21.15.5:0/2666112978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d541a5d40 con 0x55a02d1269b0 2023-10-08T13:13:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.757+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d12a430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c008f40 tx=0x7f9d4c009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e88e98ba317f082 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.757+0000 7f9d3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:13:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.761+0000 7f9d3dffb700 1 -- 172.21.15.5:0/2666112978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00e070 con 0x55a02d1269b0 2023-10-08T13:13:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.761+0000 7f9d3dffb700 1 -- 172.21.15.5:0/2666112978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f9d4c005040 con 0x55a02d1269b0 2023-10-08T13:13:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.761+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a02d032e50 con 0x55a02d1269b0 2023-10-08T13:13:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.762+0000 7f9d3dffb700 1 -- 172.21.15.5:0/2666112978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4c005200 con 0x55a02d1269b0 2023-10-08T13:13:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.762+0000 7f9d68824b80 10 client.16647 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.762+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f9d54110060 con 0x55a02d1269b0 2023-10-08T13:13:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.762+0000 7f9d3dffb700 1 -- 172.21.15.5:0/2666112978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a02d032e50 con 0x55a02d1269b0 2023-10-08T13:13:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d3dffb700 1 -- 172.21.15.5:0/2666112978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9d4c00b0d0 con 0x55a02d1269b0 2023-10-08T13:13:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d68824b80 10 client.16647 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d68824b80 10 client.16647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d68824b80 20 client.16647 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d68824b80 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d142910 0x55a02d144d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d68824b80 4 client.16647 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a02d063db0 con 0x55a02d142910 2023-10-08T13:13:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.763+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d142910 0x55a02d144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.764+0000 7f9d3dffb700 10 client.16647 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.764+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d142910 0x55a02d144d30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767b4e3ad8ae8fd5 server_cookie=1836cfe50c3aa1af in_seq=0 out_seq=0 2023-10-08T13:13:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.765+0000 7f9d3dffb700 1 -- 172.21.15.5:0/2666112978 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a02d063db0 con 0x55a02d142910 2023-10-08T13:13:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.765+0000 7f9d3dffb700 10 client.16647 handle_command_reply: tid=0 2023-10-08T13:13:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.765+0000 7f9d68824b80 1 client.16647 shutdown 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 msgr2=0x55a02d12a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d12a430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c008f40 tx=0x7f9d4c009c10 comp rx=0 tx=0).stop 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 shutdown_connections 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d12a430 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d142910 0x55a02d144d30 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 --2- 172.21.15.5:0/2666112978 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d129d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.766+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 >> 172.21.15.5:0/2666112978 conn(0x55a02d08c200 msgr2=0x55a02d112010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.769+0000 7f9d3dffb700 0 client.16647 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:30.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.780+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 shutdown_connections 2023-10-08T13:13:30.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.787+0000 7f9d68824b80 1 -- 172.21.15.5:0/2666112978 wait complete. 2023-10-08T13:13:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.800+0000 7f9d68824b80 20 client.16647 trim_cache size 0 max 16384 2023-10-08T13:13:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.830+0000 7f9d68824b80 1 Processor -- start 2023-10-08T13:13:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 -- start start 2023-10-08T13:13:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d1256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d118b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02ceeb8c0 con 0x55a02d1269b0 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d10d2d0 con 0x55a02d1208c0 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d68824b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d063de0 con 0x55a02d126090 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d5abd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d118b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d5abd8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d118b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36972/0 (socket says 172.21.15.5:36972) 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.831+0000 7f9d5abd8700 1 -- 172.21.15.5:0/512902623 learned_addr learned my addr 172.21.15.5:0/512902623 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.832+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.833+0000 7f9d5abd8700 1 -- 172.21.15.5:0/512902623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 msgr2=0x55a02d1256c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.833+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d1256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.833+0000 7f9d5abd8700 1 -- 172.21.15.5:0/512902623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 msgr2=0x55a02d12a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.833+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.833+0000 7f9d5abd8700 1 -- 172.21.15.5:0/512902623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a02ce7ec00 con 0x55a02d1269b0 2023-10-08T13:13:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.833+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d118b70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000f80 tx=0x7f9d4c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce58a165006e114 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.834+0000 7f9d497fa700 1 -- 172.21.15.5:0/512902623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00e040 con 0x55a02d1269b0 2023-10-08T13:13:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.834+0000 7f9d497fa700 1 -- 172.21.15.5:0/512902623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d4c02a070 con 0x55a02d1269b0 2023-10-08T13:13:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.834+0000 7f9d497fa700 1 -- 172.21.15.5:0/512902623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c039470 con 0x55a02d1269b0 2023-10-08T13:13:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.835+0000 7f9d68824b80 1 -- 172.21.15.5:0/512902623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 msgr2=0x55a02d118b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.835+0000 7f9d68824b80 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d118b70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000f80 tx=0x7f9d4c00b780 comp rx=0 tx=0).stop 2023-10-08T13:13:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.849+0000 7f9d68824b80 1 -- 172.21.15.5:0/512902623 shutdown_connections 2023-10-08T13:13:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.849+0000 7f9d68824b80 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d1269b0 0x55a02d118b70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.849+0000 7f9d68824b80 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1208c0 0x55a02d12a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.849+0000 7f9d68824b80 1 --2- 172.21.15.5:0/512902623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d126090 0x55a02d1256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.849+0000 7f9d68824b80 1 -- 172.21.15.5:0/512902623 >> 172.21.15.5:0/512902623 conn(0x55a02d08c200 msgr2=0x55a02d11b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.856+0000 7f9d68824b80 1 -- 172.21.15.5:0/512902623 shutdown_connections 2023-10-08T13:13:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.860+0000 7f9d68824b80 1 -- 172.21.15.5:0/512902623 wait complete. 2023-10-08T13:13:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.860+0000 7f9d68824b80 1 -- start start 2023-10-08T13:13:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.860+0000 7f9d68824b80 1 Processor -- start 2023-10-08T13:13:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d1208c0 0x55a02d122e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d126090 0x55a02d1233b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d1916d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d119030 con 0x55a02d126090 2023-10-08T13:13:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d191c10 con 0x55a02d1269b0 2023-10-08T13:13:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a02d191dd0 con 0x55a02d1208c0 2023-10-08T13:13:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d68824b80 10 client.0 _ll_register_callbacks cb 0x7f9d4c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d1916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d1916d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60160/0 (socket says 172.21.15.5:60160) 2023-10-08T13:13:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 -- 172.21.15.5:0/4045265354 learned_addr learned my addr 172.21.15.5:0/4045265354 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 -- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d1208c0 msgr2=0x55a02d122e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d1208c0 0x55a02d122e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 -- 172.21.15.5:0/4045265354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d126090 msgr2=0x55a02d1233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.861+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d126090 0x55a02d1233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d5abd8700 1 -- 172.21.15.5:0/4045265354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d54110060 con 0x55a02d1269b0 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d5abd8700 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d1916d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d010 tx=0x7f9d4c004e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b28fb79528941ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d3dffb700 1 -- 172.21.15.5:0/4045265354 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00e040 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d3dffb700 1 -- 172.21.15.5:0/4045265354 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f9d4c039e40 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d4c00bd30 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d3dffb700 1 -- 172.21.15.5:0/4045265354 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4c0074a0 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d68824b80 10 client.26126 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.862+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55a02cebc1f0 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d3dffb700 1 -- 172.21.15.5:0/4045265354 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d4c00bd30 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d3dffb700 1 -- 172.21.15.5:0/4045265354 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9d4c04b070 con 0x55a02d1269b0 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d68824b80 10 client.26126 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d68824b80 10 client.26126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d68824b80 20 client.26126 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d68824b80 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d122670 0x55a02d117b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d68824b80 4 client.26126 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:13:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.863+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a02d063ad0 con 0x55a02d122670 2023-10-08T13:13:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.875+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d122670 0x55a02d117b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.877+0000 7f9d3dffb700 10 client.26126 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.877+0000 7f9d5a3d7700 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d122670 0x55a02d117b80 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e93a317e322cdf4 server_cookie=997ec680be3bcd48 in_seq=0 out_seq=0 2023-10-08T13:13:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.888+0000 7f9d3dffb700 1 -- 172.21.15.5:0/4045265354 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a02d063ad0 con 0x55a02d122670 2023-10-08T13:13:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.888+0000 7f9d3dffb700 10 client.26126 handle_command_reply: tid=0 2023-10-08T13:13:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.888+0000 7f9d68824b80 1 client.26126 shutdown 2023-10-08T13:13:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:13:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:13:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:13:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.889+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 msgr2=0x55a02d1916d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.889+0000 7f9d68824b80 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d1916d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d010 tx=0x7f9d4c004e50 comp rx=0 tx=0).stop 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.889+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 shutdown_connections 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.889+0000 7f9d68824b80 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a02d122670 0x55a02d117b80 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a02d1269b0 0x55a02d1916d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a02d1208c0 0x55a02d122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 1 --2- 172.21.15.5:0/4045265354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a02d126090 0x55a02d1233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 >> 172.21.15.5:0/4045265354 conn(0x55a02d08c200 msgr2=0x55a02d126d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d3dffb700 0 client.26126 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 shutdown_connections 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 1 -- 172.21.15.5:0/4045265354 wait complete. 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d68824b80 20 client.26126 trim_cache size 0 max 16384 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9d400a1660 msgr2=0x7f9d400a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9d400a1660 0x7f9d400a3b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009fd0 tx=0x7f9d50009260 comp rx=0 tx=0).stop 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 msgr2=0x7f9d54199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.890+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d54199510 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400e9a0 tx=0x7f9d4400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 shutdown_connections 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9d400a1660 0x7f9d400a3b20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d541088a0 0x7f9d5419d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d54102890 0x7f9d54198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 --2- 172.21.15.5:0/1216896587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103250 0x7f9d54199510 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 >> 172.21.15.5:0/1216896587 conn(0x7f9d540fe360 msgr2=0x7f9d540fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 shutdown_connections 2023-10-08T13:13:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:30.891+0000 7f9d5c63b700 1 -- 172.21.15.5:0/1216896587 wait complete. 2023-10-08T13:13:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 430.0 s, 776.1 tps, lat 130.032 ms stddev 142.133 2023-10-08T13:13:32.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:32 smithi060 ceph-mon[103190]: pgmap v528: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 5.9 MiB/s wr, 589 op/s 2023-10-08T13:13:32.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:32 smithi005 ceph-mon[99496]: pgmap v528: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 5.9 MiB/s wr, 589 op/s 2023-10-08T13:13:33.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:32 smithi118 ceph-mon[104234]: pgmap v528: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 5.9 MiB/s wr, 589 op/s 2023-10-08T13:13:33.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:33 smithi060 ceph-mon[103190]: pgmap v529: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 6.1 MiB/s wr, 610 op/s 2023-10-08T13:13:33.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:33 smithi005 ceph-mon[99496]: pgmap v529: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 6.1 MiB/s wr, 610 op/s 2023-10-08T13:13:34.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:33 smithi118 ceph-mon[104234]: pgmap v529: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 6.1 MiB/s wr, 610 op/s 2023-10-08T13:13:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 435.0 s, 546.1 tps, lat 168.879 ms stddev 176.935 2023-10-08T13:13:36.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:36 smithi118 ceph-mon[104234]: pgmap v530: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.7 MiB/s wr, 646 op/s 2023-10-08T13:13:36.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:13:36.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:36 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:36 smithi060 ceph-mon[103190]: pgmap v530: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.7 MiB/s wr, 646 op/s 2023-10-08T13:13:36.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:13:36.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:36 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:36 smithi005 ceph-mon[99496]: pgmap v530: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.7 MiB/s wr, 646 op/s 2023-10-08T13:13:36.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:13:36.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:36.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:36 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-08T13:13:37.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T13:13:37.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi118 to 196.2M 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: Unable to set osd_memory_target on smithi118 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:13:37.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:13:37.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi118 to 196.2M 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: Unable to set osd_memory_target on smithi118 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:13:37.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:13:37.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:13:37.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi060 to 197.2M 2023-10-08T13:13:37.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: Unable to set osd_memory_target on smithi060 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T13:13:37.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi118 to 196.2M 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: Unable to set osd_memory_target on smithi118 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:13:37.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:13:38.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:38 smithi118 ceph-mon[104234]: Adjusting osd_memory_target on smithi005 to 197.2M 2023-10-08T13:13:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:38 smithi118 ceph-mon[104234]: Unable to set osd_memory_target on smithi005 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T13:13:38.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:38 smithi118 ceph-mon[104234]: pgmap v531: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 6.1 MiB/s wr, 632 op/s 2023-10-08T13:13:38.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:38 smithi060 ceph-mon[103190]: Adjusting osd_memory_target on smithi005 to 197.2M 2023-10-08T13:13:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:38 smithi060 ceph-mon[103190]: Unable to set osd_memory_target on smithi005 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T13:13:38.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:38 smithi060 ceph-mon[103190]: pgmap v531: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 6.1 MiB/s wr, 632 op/s 2023-10-08T13:13:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:38 smithi005 ceph-mon[99496]: Adjusting osd_memory_target on smithi005 to 197.2M 2023-10-08T13:13:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:38 smithi005 ceph-mon[99496]: Unable to set osd_memory_target on smithi005 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T13:13:38.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:38 smithi005 ceph-mon[99496]: pgmap v531: 129 pgs: 129 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 6.1 MiB/s wr, 632 op/s 2023-10-08T13:13:40.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:40 smithi060 ceph-mon[103190]: pgmap v532: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.3 MiB/s wr, 639 op/s 2023-10-08T13:13:40.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:40 smithi005 ceph-mon[99496]: pgmap v532: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.3 MiB/s wr, 639 op/s 2023-10-08T13:13:41.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:40 smithi118 ceph-mon[104234]: pgmap v532: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.3 MiB/s wr, 639 op/s 2023-10-08T13:13:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 440.0 s, 49.4 tps, lat 1984.842 ms stddev 1943.750 2023-10-08T13:13:42.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:42 smithi060 ceph-mon[103190]: pgmap v533: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.8 MiB/s wr, 606 op/s 2023-10-08T13:13:42.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:42 smithi005 ceph-mon[99496]: pgmap v533: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.8 MiB/s wr, 606 op/s 2023-10-08T13:13:43.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:42 smithi118 ceph-mon[104234]: pgmap v533: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.8 MiB/s wr, 606 op/s 2023-10-08T13:13:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.136+0000 7f4bf162c700 1 -- 172.21.15.5:0/749203547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 msgr2=0x7f4bec105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.136+0000 7f4bf162c700 1 --2- 172.21.15.5:0/749203547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec105990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009990 tx=0x7f4bdc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.148+0000 7f4bf162c700 1 -- 172.21.15.5:0/749203547 shutdown_connections 2023-10-08T13:13:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.148+0000 7f4bf162c700 1 --2- 172.21.15.5:0/749203547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bec0ff5b0 0x7f4bec1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.148+0000 7f4bf162c700 1 --2- 172.21.15.5:0/749203547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec105990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.148+0000 7f4bf162c700 1 --2- 172.21.15.5:0/749203547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bec0febf0 0x7f4bec0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.148+0000 7f4bf162c700 1 -- 172.21.15.5:0/749203547 >> 172.21.15.5:0/749203547 conn(0x7f4bec075b20 msgr2=0x7f4bec0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.163+0000 7f4bf162c700 1 -- 172.21.15.5:0/749203547 shutdown_connections 2023-10-08T13:13:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.164+0000 7f4bf162c700 1 -- 172.21.15.5:0/749203547 wait complete. 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 Processor -- start 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 -- start start 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bec0febf0 0x7f4bec114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bec0ff5b0 0x7f4bec114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec10e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec10eb20 con 0x7f4bec1055b0 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec10ec90 con 0x7f4bec0ff5b0 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.165+0000 7f4bf162c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec10ee50 con 0x7f4bec0febf0 2023-10-08T13:13:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec10e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec10e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37000/0 (socket says 172.21.15.5:37000) 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 -- 172.21.15.5:0/544990018 learned_addr learned my addr 172.21.15.5:0/544990018 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 -- 172.21.15.5:0/544990018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bec0febf0 msgr2=0x7f4bec114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bec0febf0 0x7f4bec114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 -- 172.21.15.5:0/544990018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bec0ff5b0 msgr2=0x7f4bec114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bec0ff5b0 0x7f4bec114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.166+0000 7f4beb7fe700 1 -- 172.21.15.5:0/544990018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0095f0 con 0x7f4bec1055b0 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.167+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec10e350 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4be000b4a0 tx=0x7f4be000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.168+0000 7f4bd3fff700 1 -- 172.21.15.5:0/544990018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0011830 con 0x7f4bec1055b0 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.168+0000 7f4bd3fff700 1 -- 172.21.15.5:0/544990018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4be0011e50 con 0x7f4bec1055b0 2023-10-08T13:13:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.168+0000 7f4bd3fff700 1 -- 172.21.15.5:0/544990018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be000f2e0 con 0x7f4bec1055b0 2023-10-08T13:13:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.168+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec06a210 con 0x7f4bec1055b0 2023-10-08T13:13:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.169+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec06a6d0 con 0x7f4bec1055b0 2023-10-08T13:13:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.179+0000 7f4bd3fff700 1 -- 172.21.15.5:0/544990018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4be000f440 con 0x7f4bec1055b0 2023-10-08T13:13:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.180+0000 7f4bd3fff700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4bd40c3800 0x7f4bd40c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.180+0000 7f4bd3fff700 1 -- 172.21.15.5:0/544990018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4be00cdd60 con 0x7f4bec1055b0 2023-10-08T13:13:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 Processor -- start 2023-10-08T13:13:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 -- start start 2023-10-08T13:13:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 0x557ae51b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 0x557ae51afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae5118400 con 0x557ae51b61a0 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae5109bc0 con 0x557ae51b00b0 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.181+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae51074e0 con 0x557ae51b5880 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 0x557ae51b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 0x557ae51b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50212/0 (socket says 172.21.15.5:50212) 2023-10-08T13:13:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 -- 172.21.15.5:0/2103667554 learned_addr learned my addr 172.21.15.5:0/2103667554 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 -- 172.21.15.5:0/2103667554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 msgr2=0x557ae51b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 -- 172.21.15.5:0/2103667554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 msgr2=0x557ae51afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 0x557ae51afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.182+0000 7f4beaffd700 1 -- 172.21.15.5:0/2103667554 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ae4f2dd80 con 0x557ae51b5880 2023-10-08T13:13:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.183+0000 7f4beaffd700 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 0x557ae51b5c60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00be30 tx=0x7f4bdc00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=576dbe6f6e2d7b02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.188+0000 7f4beaffd700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4bd40c3800 0x7f4bd40c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.188+0000 7f4bd17fa700 1 -- 172.21.15.5:0/2103667554 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00b9d0 con 0x557ae51b5880 2023-10-08T13:13:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.188+0000 7f4bd17fa700 1 -- 172.21.15.5:0/2103667554 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bdc003c80 con 0x557ae51b5880 2023-10-08T13:13:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.188+0000 7f4bd17fa700 1 -- 172.21.15.5:0/2103667554 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc023c40 con 0x557ae51b5880 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.190+0000 7f4bfd815b80 1 -- 172.21.15.5:0/2103667554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 msgr2=0x557ae51b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.190+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 0x557ae51b5c60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00be30 tx=0x7f4bdc00be60 comp rx=0 tx=0).stop 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.199+0000 7f4bfd815b80 1 -- 172.21.15.5:0/2103667554 shutdown_connections 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.199+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.199+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b5880 0x557ae51b5c60 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00be30 tx=0x7f4bdc00be60 comp rx=0 tx=0).stop 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.199+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/2103667554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 0x557ae51afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.199+0000 7f4bfd815b80 1 -- 172.21.15.5:0/2103667554 >> 172.21.15.5:0/2103667554 conn(0x557ae5124200 msgr2=0x557ae51aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.204+0000 7f4beaffd700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4bd40c3800 0x7f4bd40c5cc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc011040 tx=0x7f4bdc023f10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:44.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.208+0000 7f4bfd815b80 1 -- 172.21.15.5:0/2103667554 shutdown_connections 2023-10-08T13:13:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.209+0000 7f4bfd815b80 1 -- 172.21.15.5:0/2103667554 wait complete. 2023-10-08T13:13:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 -- start start 2023-10-08T13:13:44.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 Processor -- start 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 0x557ae51b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae5102dd0 con 0x557ae51b61a0 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae509f6b0 con 0x557ae51b00b0 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae509f350 con 0x557ae51ba170 2023-10-08T13:13:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.210+0000 7f4bfd815b80 10 client.0 _ll_register_callbacks cb 0x557ae4efc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50218/0 (socket says 172.21.15.5:50218) 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 -- 172.21.15.5:0/902365801 learned_addr learned my addr 172.21.15.5:0/902365801 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beaffd700 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 -- 172.21.15.5:0/902365801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 msgr2=0x557ae51b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 -- 172.21.15.5:0/902365801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 msgr2=0x557ae51b9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 0x557ae51b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.211+0000 7f4beb7fe700 1 -- 172.21.15.5:0/902365801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec103970 con 0x557ae51ba170 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.212+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51c5cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4be00cb230 tx=0x7f4be009ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de7ef800c99fa801 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.212+0000 7f4bceff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.212+0000 7f4bceff5700 1 -- 172.21.15.5:0/902365801 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be00b2070 con 0x557ae51ba170 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.212+0000 7f4bceff5700 1 -- 172.21.15.5:0/902365801 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4be0018520 con 0x557ae51ba170 2023-10-08T13:13:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.212+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ae50cae50 con 0x557ae51ba170 2023-10-08T13:13:44.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.213+0000 7f4bceff5700 1 -- 172.21.15.5:0/902365801 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4be00b3260 con 0x557ae51ba170 2023-10-08T13:13:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.216+0000 7f4bfd815b80 10 client.26200 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.216+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x557ae4f16c00 con 0x557ae51ba170 2023-10-08T13:13:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bceff5700 1 -- 172.21.15.5:0/902365801 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557ae50cae50 con 0x557ae51ba170 2023-10-08T13:13:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bceff5700 1 -- 172.21.15.5:0/902365801 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4be00a2960 con 0x557ae51ba170 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bfd815b80 10 client.26200 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bfd815b80 10 client.26200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bfd815b80 20 client.26200 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae51ca320 0x557ae51cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bfd815b80 4 client.26200 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.232+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ae50fbdb0 con 0x557ae51ca320 2023-10-08T13:13:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.235+0000 7f4beaffd700 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae51ca320 0x557ae51cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.237+0000 7f4beaffd700 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae51ca320 0x557ae51cc740 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2cf4004fdb18d0 server_cookie=168a23ba34371c2f in_seq=0 out_seq=0 2023-10-08T13:13:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.237+0000 7f4bceff5700 10 client.26200 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.237+0000 7f4bceff5700 1 -- 172.21.15.5:0/902365801 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557ae50fbdb0 con 0x557ae51ca320 2023-10-08T13:13:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.237+0000 7f4bceff5700 10 client.26200 handle_command_reply: tid=0 2023-10-08T13:13:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.237+0000 7f4bfd815b80 1 client.26200 shutdown 2023-10-08T13:13:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.238+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 msgr2=0x557ae51c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.238+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51c5cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4be00cb230 tx=0x7f4be009ab90 comp rx=0 tx=0).stop 2023-10-08T13:13:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 shutdown_connections 2023-10-08T13:13:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51c5cd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae51ca320 0x557ae51cc740 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b00b0 0x557ae51b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/902365801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b61a0 0x557ae51b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 >> 172.21.15.5:0/902365801 conn(0x557ae5124200 msgr2=0x557ae51aa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bceff5700 0 client.26200 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.243+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 shutdown_connections 2023-10-08T13:13:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.244+0000 7f4bfd815b80 1 -- 172.21.15.5:0/902365801 wait complete. 2023-10-08T13:13:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.244+0000 7f4bfd815b80 20 client.26200 trim_cache size 0 max 16384 2023-10-08T13:13:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.274+0000 7f4bfd815b80 1 Processor -- start 2023-10-08T13:13:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.274+0000 7f4bfd815b80 1 -- start start 2023-10-08T13:13:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.275+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.275+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 0x557ae51aa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.275+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.275+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae4f838c0 con 0x557ae51b00b0 2023-10-08T13:13:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.275+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae51a7830 con 0x557ae51b61a0 2023-10-08T13:13:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.275+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae51bc530 con 0x557ae51ba170 2023-10-08T13:13:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.278+0000 7f4bea7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 0x557ae51aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.278+0000 7f4bea7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 0x557ae51aa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60202/0 (socket says 172.21.15.5:60202) 2023-10-08T13:13:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.278+0000 7f4bea7fc700 1 -- 172.21.15.5:0/157946642 learned_addr learned my addr 172.21.15.5:0/157946642 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.287+0000 7f4beaffd700 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.289+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.289+0000 7f4bea7fc700 1 -- 172.21.15.5:0/157946642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 msgr2=0x557ae51aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.289+0000 7f4bea7fc700 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.289+0000 7f4bea7fc700 1 -- 172.21.15.5:0/157946642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 msgr2=0x557ae51b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.289+0000 7f4bea7fc700 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.289+0000 7f4bea7fc700 1 -- 172.21.15.5:0/157946642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ae4f541f0 con 0x557ae51b61a0 2023-10-08T13:13:44.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.308+0000 7f4bea7fc700 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 0x557ae51aa790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009960 tx=0x7f4be4009c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b567a2487814fed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.309+0000 7f4bd1ffb700 1 -- 172.21.15.5:0/157946642 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be400bc90 con 0x557ae51b61a0 2023-10-08T13:13:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.310+0000 7f4bd1ffb700 1 -- 172.21.15.5:0/157946642 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4be40094c0 con 0x557ae51b61a0 2023-10-08T13:13:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.310+0000 7f4bd1ffb700 1 -- 172.21.15.5:0/157946642 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be400d650 con 0x557ae51b61a0 2023-10-08T13:13:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.311+0000 7f4bfd815b80 1 -- 172.21.15.5:0/157946642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 msgr2=0x557ae51aa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.311+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 0x557ae51aa790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009960 tx=0x7f4be4009c70 comp rx=0 tx=0).stop 2023-10-08T13:13:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.312+0000 7f4bfd815b80 1 -- 172.21.15.5:0/157946642 shutdown_connections 2023-10-08T13:13:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.312+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51ba170 0x557ae51aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.312+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.312+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/157946642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51b61a0 0x557ae51aa790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.312+0000 7f4bfd815b80 1 -- 172.21.15.5:0/157946642 >> 172.21.15.5:0/157946642 conn(0x557ae5124200 msgr2=0x557ae51b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.314+0000 7f4bfd815b80 1 -- 172.21.15.5:0/157946642 shutdown_connections 2023-10-08T13:13:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.314+0000 7f4bfd815b80 1 -- 172.21.15.5:0/157946642 wait complete. 2023-10-08T13:13:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 -- start start 2023-10-08T13:13:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 Processor -- start 2023-10-08T13:13:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51bec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b61a0 0x557ae51bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51ba170 0x557ae51bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae521d150 con 0x557ae51b00b0 2023-10-08T13:13:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae521d290 con 0x557ae51ba170 2023-10-08T13:13:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ae521d3d0 con 0x557ae51b61a0 2023-10-08T13:13:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.315+0000 7f4bfd815b80 10 client.0 _ll_register_callbacks cb 0x7f4be009b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.316+0000 7f4beaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.316+0000 7f4beaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37026/0 (socket says 172.21.15.5:37026) 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.316+0000 7f4beaffd700 1 -- 172.21.15.5:0/3307139770 learned_addr learned my addr 172.21.15.5:0/3307139770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4beb7fe700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51ba170 0x557ae51bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4bea7fc700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b61a0 0x557ae51bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4beaffd700 1 -- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b61a0 msgr2=0x557ae51bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4beaffd700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b61a0 0x557ae51bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4beaffd700 1 -- 172.21.15.5:0/3307139770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51ba170 msgr2=0x557ae51bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4beaffd700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51ba170 0x557ae51bf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.317+0000 7f4beaffd700 1 -- 172.21.15.5:0/3307139770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be4009640 con 0x557ae51b00b0 2023-10-08T13:13:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.318+0000 7f4beaffd700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51bec00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00be00 tx=0x7f4bdc02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d004c58894265f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.318+0000 7f4bceff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:13:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.318+0000 7f4bceff5700 1 -- 172.21.15.5:0/3307139770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc034040 con 0x557ae51b00b0 2023-10-08T13:13:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.318+0000 7f4bceff5700 1 -- 172.21.15.5:0/3307139770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4bdc003df0 con 0x557ae51b00b0 2023-10-08T13:13:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.319+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ae50fbad0 con 0x557ae51b00b0 2023-10-08T13:13:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.319+0000 7f4bceff5700 1 -- 172.21.15.5:0/3307139770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bdc0058e0 con 0x557ae51b00b0 2023-10-08T13:13:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.319+0000 7f4bfd815b80 10 client.16662 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.319+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x557ae4f2c250 con 0x557ae51b00b0 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bceff5700 1 -- 172.21.15.5:0/3307139770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557ae50fbad0 con 0x557ae51b00b0 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bceff5700 1 -- 172.21.15.5:0/3307139770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4bdc044070 con 0x557ae51b00b0 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bfd815b80 10 client.16662 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bfd815b80 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bfd815b80 20 client.16662 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae521e770 0x557ae5220b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bfd815b80 4 client.16662 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:13:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.320+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557ae4f4ef10 con 0x557ae521e770 2023-10-08T13:13:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.324+0000 7f4bea7fc700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae521e770 0x557ae5220b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.334+0000 7f4bceff5700 10 client.16662 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.334+0000 7f4bea7fc700 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae521e770 0x557ae5220b90 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d1df9b0218afc6 server_cookie=66cee03b148cb3c1 in_seq=0 out_seq=0 2023-10-08T13:13:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bceff5700 1 -- 172.21.15.5:0/3307139770 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557ae4f4ef10 con 0x557ae521e770 2023-10-08T13:13:44.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bceff5700 10 client.16662 handle_command_reply: tid=0 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 client.16662 shutdown 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 msgr2=0x557ae51bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51bec00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00be00 tx=0x7f4bdc02b000 comp rx=0 tx=0).stop 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 shutdown_connections 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557ae521e770 0x557ae5220b90 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557ae51ba170 0x557ae51bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557ae51b00b0 0x557ae51bec00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bceff5700 0 client.16662 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 --2- 172.21.15.5:0/3307139770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557ae51b61a0 0x557ae51bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 >> 172.21.15.5:0/3307139770 conn(0x557ae5124200 msgr2=0x557ae51c5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 shutdown_connections 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.365+0000 7f4bfd815b80 1 -- 172.21.15.5:0/3307139770 wait complete. 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.366+0000 7f4bfd815b80 20 client.16662 trim_cache size 0 max 16384 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:13:44.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:13:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.368+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4bd40c3800 msgr2=0x7f4bd40c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.368+0000 7f4bf162c700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4bd40c3800 0x7f4bd40c5cc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc011040 tx=0x7f4bdc023f10 comp rx=0 tx=0).stop 2023-10-08T13:13:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.368+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 msgr2=0x7f4bec10e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:44.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.368+0000 7f4bf162c700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec10e350 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4be000b4a0 tx=0x7f4be000b860 comp rx=0 tx=0).stop 2023-10-08T13:13:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.370+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 shutdown_connections 2023-10-08T13:13:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.370+0000 7f4bf162c700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4bd40c3800 0x7f4bd40c5cc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.370+0000 7f4bf162c700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bec1055b0 0x7f4bec10e350 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.370+0000 7f4bf162c700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bec0febf0 0x7f4bec114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.370+0000 7f4bf162c700 1 --2- 172.21.15.5:0/544990018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bec0ff5b0 0x7f4bec114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.370+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 >> 172.21.15.5:0/544990018 conn(0x7f4bec075b20 msgr2=0x7f4bec100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.371+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 shutdown_connections 2023-10-08T13:13:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:44.371+0000 7f4bf162c700 1 -- 172.21.15.5:0/544990018 wait complete. 2023-10-08T13:13:44.915 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:44 smithi060 ceph-mon[103190]: pgmap v534: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 529 op/s 2023-10-08T13:13:44.927 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:44 smithi005 ceph-mon[99496]: pgmap v534: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 529 op/s 2023-10-08T13:13:45.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:44 smithi118 ceph-mon[104234]: pgmap v534: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 529 op/s 2023-10-08T13:13:45.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:13:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 -- 172.21.15.5:0/1799153475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d041083a0 msgr2=0x7f1d0411bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1799153475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d041083a0 0x7f1d0411bfe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009f90 tx=0x7f1cfc00b330 comp rx=0 tx=0).stop 2023-10-08T13:13:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 -- 172.21.15.5:0/1799153475 shutdown_connections 2023-10-08T13:13:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1799153475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d041083a0 0x7f1d0411bfe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1799153475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d0410edf0 0x7f1d0410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1799153475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041077f0 0x7f1d04107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.218+0000 7f1d0b063700 1 -- 172.21.15.5:0/1799153475 >> 172.21.15.5:0/1799153475 conn(0x7f1d0406b770 msgr2=0x7f1d0406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.221+0000 7f1d0b063700 1 -- 172.21.15.5:0/1799153475 shutdown_connections 2023-10-08T13:13:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.233+0000 7f1d0b063700 1 -- 172.21.15.5:0/1799153475 wait complete. 2023-10-08T13:13:46.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.233+0000 7f1d0b063700 1 Processor -- start 2023-10-08T13:13:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.233+0000 7f1d0b063700 1 -- start start 2023-10-08T13:13:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d0b063700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d041077f0 0x7f1d041ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d0b063700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041083a0 0x7f1d041abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d0b063700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d0410edf0 0x7f1d041a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d0b063700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041a5d60 con 0x7f1d041083a0 2023-10-08T13:13:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d0b063700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041a5ed0 con 0x7f1d0410edf0 2023-10-08T13:13:46.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d0b063700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041a6090 con 0x7f1d041077f0 2023-10-08T13:13:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041083a0 0x7f1d041abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041083a0 0x7f1d041abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37040/0 (socket says 172.21.15.5:37040) 2023-10-08T13:13:46.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d03fff700 1 -- 172.21.15.5:0/1860690222 learned_addr learned my addr 172.21.15.5:0/1860690222 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.234+0000 7f1d09600700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d0410edf0 0x7f1d041a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d09600700 1 -- 172.21.15.5:0/1860690222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d041077f0 msgr2=0x7f1d041ab5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d09600700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d041077f0 0x7f1d041ab5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d09600700 1 -- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041083a0 msgr2=0x7f1d041abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d09600700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041083a0 0x7f1d041abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d09600700 1 -- 172.21.15.5:0/1860690222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009c40 con 0x7f1d0410edf0 2023-10-08T13:13:46.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d09600700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d0410edf0 0x7f1d041a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc006070 tx=0x7f1cfc004c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.235+0000 7f1d01ffb700 1 -- 172.21.15.5:0/1860690222 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00e040 con 0x7f1d0410edf0 2023-10-08T13:13:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.236+0000 7f1d01ffb700 1 -- 172.21.15.5:0/1860690222 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cfc004e80 con 0x7f1d0410edf0 2023-10-08T13:13:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.236+0000 7f1d01ffb700 1 -- 172.21.15.5:0/1860690222 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc01b6c0 con 0x7f1d0410edf0 2023-10-08T13:13:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.239+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d041a6310 con 0x7f1d0410edf0 2023-10-08T13:13:46.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.239+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0410fa10 con 0x7f1d0410edf0 2023-10-08T13:13:46.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.246+0000 7f1d1724cb80 1 Processor -- start 2023-10-08T13:13:46.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.258+0000 7f1d01ffb700 1 -- 172.21.15.5:0/1860690222 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1cfc01d470 con 0x7f1d0410edf0 2023-10-08T13:13:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.259+0000 7f1d01ffb700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cec0a16b0 0x7f1cec0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.259+0000 7f1d01ffb700 1 -- 172.21.15.5:0/1860690222 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1cfc0ce0c0 con 0x7f1d0410edf0 2023-10-08T13:13:46.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.259+0000 7f1d03fff700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cec0a16b0 0x7f1cec0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.259+0000 7f1d1724cb80 1 -- start start 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cec0a16b0 0x7f1cec0a3b70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1d041a6e10 tx=0x7f1cf4009290 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e1b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 0x55e0c5e26110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e28a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d84460 con 0x55e0c5e1b7a0 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d75c20 con 0x55e0c5e26650 2023-10-08T13:13:46.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d73540 con 0x55e0c5e1ae80 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 0x55e0c5e26110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 0x55e0c5e26110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37046/0 (socket says 172.21.15.5:37046) 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 -- 172.21.15.5:0/2942158387 learned_addr learned my addr 172.21.15.5:0/2942158387 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d09600700 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e28a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 -- 172.21.15.5:0/2942158387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 msgr2=0x55e0c5e1b260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e1b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 -- 172.21.15.5:0/2942158387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 msgr2=0x55e0c5e28a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:46.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e28a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.260+0000 7f1d03fff700 1 -- 172.21.15.5:0/2942158387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0c5b99de0 con 0x55e0c5e1b7a0 2023-10-08T13:13:46.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.261+0000 7f1d03fff700 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 0x55e0c5e26110 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009fd0 tx=0x7f1cf4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c89bf7c3cce6e6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.267+0000 7f1ceaffd700 1 -- 172.21.15.5:0/2942158387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4015480 con 0x55e0c5e1b7a0 2023-10-08T13:13:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.267+0000 7f1ceaffd700 1 -- 172.21.15.5:0/2942158387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cf4015aa0 con 0x55e0c5e1b7a0 2023-10-08T13:13:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.267+0000 7f1ceaffd700 1 -- 172.21.15.5:0/2942158387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4013a70 con 0x55e0c5e1b7a0 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 -- 172.21.15.5:0/2942158387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 msgr2=0x55e0c5e26110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 0x55e0c5e26110 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009fd0 tx=0x7f1cf4011000 comp rx=0 tx=0).stop 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 -- 172.21.15.5:0/2942158387 shutdown_connections 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e28a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e1b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/2942158387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1b7a0 0x55e0c5e26110 secure :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009fd0 tx=0x7f1cf4011000 comp rx=0 tx=0).stop 2023-10-08T13:13:46.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.268+0000 7f1d1724cb80 1 -- 172.21.15.5:0/2942158387 >> 172.21.15.5:0/2942158387 conn(0x55e0c5d90260 msgr2=0x55e0c5e172d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.284+0000 7f1d1724cb80 1 -- 172.21.15.5:0/2942158387 shutdown_connections 2023-10-08T13:13:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.286+0000 7f1d1724cb80 1 -- 172.21.15.5:0/2942158387 wait complete. 2023-10-08T13:13:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.287+0000 7f1d1724cb80 1 -- start start 2023-10-08T13:13:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.287+0000 7f1d1724cb80 1 Processor -- start 2023-10-08T13:13:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e236e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e23c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e32290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d6ee30 con 0x55e0c5e26650 2023-10-08T13:13:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d0b710 con 0x55e0c5e24160 2023-10-08T13:13:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d0b3b0 con 0x55e0c5e1ae80 2023-10-08T13:13:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.289+0000 7f1d1724cb80 10 client.0 _ll_register_callbacks cb 0x55e0c5b68800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.292+0000 7f1d08dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.292+0000 7f1d08dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50256/0 (socket says 172.21.15.5:50256) 2023-10-08T13:13:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.292+0000 7f1d08dff700 1 -- 172.21.15.5:0/3535393129 learned_addr learned my addr 172.21.15.5:0/3535393129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.294+0000 7f1d09600700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e32290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d03fff700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e23c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d09600700 1 -- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 msgr2=0x55e0c5e236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d09600700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d09600700 1 -- 172.21.15.5:0/3535393129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 msgr2=0x55e0c5e23c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d09600700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e23c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d09600700 1 -- 172.21.15.5:0/3535393129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf400e7c0 con 0x55e0c5e24160 2023-10-08T13:13:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.302+0000 7f1d03fff700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e23c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:13:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.309+0000 7f1d09600700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e32290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0cb420 tx=0x7f1cfc09a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c699277447791fbb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.309+0000 7f1ce3fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:13:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.320+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3535393129 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc09ad40 con 0x55e0c5e24160 2023-10-08T13:13:46.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.320+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3535393129 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1cfc09ee90 con 0x55e0c5e24160 2023-10-08T13:13:46.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.320+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0c5d36eb0 con 0x55e0c5e24160 2023-10-08T13:13:46.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.323+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3535393129 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cfc0a3040 con 0x55e0c5e24160 2023-10-08T13:13:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.333+0000 7f1d1724cb80 10 client.26144 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:46.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.333+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55e0c5b82c60 con 0x55e0c5e24160 2023-10-08T13:13:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.338+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3535393129 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e0c5d36eb0 con 0x55e0c5e24160 2023-10-08T13:13:46.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.338+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3535393129 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1cfc0a2bb0 con 0x55e0c5e24160 2023-10-08T13:13:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.339+0000 7f1d1724cb80 10 client.26144 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.339+0000 7f1d1724cb80 10 client.26144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.339+0000 7f1d1724cb80 20 client.26144 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.339+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e36630 0x55e0c5e38a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.339+0000 7f1d1724cb80 4 client.26144 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:46.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.339+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0c5d67e10 con 0x55e0c5e36630 2023-10-08T13:13:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.346+0000 7f1d08dff700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e36630 0x55e0c5e38a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.377+0000 7f1d08dff700 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e36630 0x55e0c5e38a50 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79771b6b0f78bb1 server_cookie=daa94e8bd825460 in_seq=0 out_seq=0 2023-10-08T13:13:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.377+0000 7f1ce3fff700 10 client.26144 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3535393129 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e0c5d67e10 con 0x55e0c5e36630 2023-10-08T13:13:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1ce3fff700 10 client.26144 handle_command_reply: tid=0 2023-10-08T13:13:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 client.26144 shutdown 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 msgr2=0x55e0c5e32290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e32290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0cb420 tx=0x7f1cfc09a750 comp rx=0 tx=0).stop 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 shutdown_connections 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e36630 0x55e0c5e38a50 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e32290 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3535393129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e23c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.388+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 >> 172.21.15.5:0/3535393129 conn(0x55e0c5d90260 msgr2=0x55e0c5e16ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.393+0000 7f1ce3fff700 0 client.26144 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.393+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 shutdown_connections 2023-10-08T13:13:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.397+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3535393129 wait complete. 2023-10-08T13:13:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.403+0000 7f1d1724cb80 20 client.26144 trim_cache size 0 max 16384 2023-10-08T13:13:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.446+0000 7f1d1724cb80 1 Processor -- start 2023-10-08T13:13:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 -- start start 2023-10-08T13:13:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e2d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e1dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e1e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5bef920 con 0x55e0c5e26650 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e363f0 con 0x55e0c5e24160 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e11570 con 0x55e0c5e1ae80 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e1dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e1dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60242/0 (socket says 172.21.15.5:60242) 2023-10-08T13:13:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.453+0000 7f1d03fff700 1 -- 172.21.15.5:0/4090941527 learned_addr learned my addr 172.21.15.5:0/4090941527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.454+0000 7f1d03fff700 1 -- 172.21.15.5:0/4090941527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 msgr2=0x55e0c5e2d1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:13:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.454+0000 7f1d03fff700 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e2d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.454+0000 7f1d03fff700 1 -- 172.21.15.5:0/4090941527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 msgr2=0x55e0c5e1e8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.454+0000 7f1d03fff700 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e1e8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.454+0000 7f1d03fff700 1 -- 172.21.15.5:0/4090941527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0c5bc0250 con 0x55e0c5e24160 2023-10-08T13:13:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.454+0000 7f1d03fff700 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e1dd50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400eab0 tx=0x7f1cf400e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49800529c1da97e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:46.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.457+0000 7f1ceb7fe700 1 -- 172.21.15.5:0/4090941527 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4015680 con 0x55e0c5e24160 2023-10-08T13:13:46.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.457+0000 7f1ceb7fe700 1 -- 172.21.15.5:0/4090941527 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cf402d070 con 0x55e0c5e24160 2023-10-08T13:13:46.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.457+0000 7f1ceb7fe700 1 -- 172.21.15.5:0/4090941527 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4029660 con 0x55e0c5e24160 2023-10-08T13:13:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.459+0000 7f1d1724cb80 1 -- 172.21.15.5:0/4090941527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 msgr2=0x55e0c5e1dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.459+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e1dd50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400eab0 tx=0x7f1cf400e730 comp rx=0 tx=0).stop 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 -- 172.21.15.5:0/4090941527 shutdown_connections 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e26650 0x55e0c5e1e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e2d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/4090941527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e24160 0x55e0c5e1dd50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 -- 172.21.15.5:0/4090941527 >> 172.21.15.5:0/4090941527 conn(0x55e0c5d90260 msgr2=0x55e0c5e38640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 -- 172.21.15.5:0/4090941527 shutdown_connections 2023-10-08T13:13:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.462+0000 7f1d1724cb80 1 -- 172.21.15.5:0/4090941527 wait complete. 2023-10-08T13:13:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 -- start start 2023-10-08T13:13:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 Processor -- start 2023-10-08T13:13:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e2cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e24160 0x55e0c5e2d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e2b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e2b910 con 0x55e0c5e1ae80 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e2ba80 con 0x55e0c5e26650 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e2bc40 con 0x55e0c5e24160 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.463+0000 7f1d1724cb80 10 client.0 _ll_register_callbacks cb 0x55e0c5b68800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e2b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e2b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60244/0 (socket says 172.21.15.5:60244) 2023-10-08T13:13:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 -- 172.21.15.5:0/3221635798 learned_addr learned my addr 172.21.15.5:0/3221635798 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 -- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e24160 msgr2=0x55e0c5e2d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e24160 0x55e0c5e2d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 -- 172.21.15.5:0/3221635798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1ae80 msgr2=0x55e0c5e2cc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e2cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 -- 172.21.15.5:0/3221635798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0c5b99de0 con 0x55e0c5e26650 2023-10-08T13:13:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.464+0000 7f1d09600700 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e2b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc09aa40 tx=0x7f1cfc009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79603c4b54e63fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1ce3fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:13:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3221635798 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc09a430 con 0x55e0c5e26650 2023-10-08T13:13:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3221635798 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1cfc09ee90 con 0x55e0c5e26650 2023-10-08T13:13:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cf4015aa0 con 0x55e0c5e26650 2023-10-08T13:13:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3221635798 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cfc0cbb70 con 0x55e0c5e26650 2023-10-08T13:13:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1d1724cb80 10 client.26150 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55e0c5b982b0 con 0x55e0c5e26650 2023-10-08T13:13:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3221635798 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cf4015aa0 con 0x55e0c5e26650 2023-10-08T13:13:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.469+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3221635798 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1cfc01d720 con 0x55e0c5e26650 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d1724cb80 10 client.26150 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d1724cb80 10 client.26150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d1724cb80 20 client.26150 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e8b320 0x55e0c5e8d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d1724cb80 4 client.26150 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e0c5d67b30 con 0x55e0c5e8b320 2023-10-08T13:13:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d08dff700 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e8b320 0x55e0c5e8d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1ce3fff700 10 client.26150 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.470+0000 7f1d08dff700 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e8b320 0x55e0c5e8d740 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc9e21c7711a88c server_cookie=4e87518271d4ae5f in_seq=0 out_seq=0 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1ce3fff700 1 -- 172.21.15.5:0/3221635798 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e0c5d67b30 con 0x55e0c5e8b320 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1ce3fff700 10 client.26150 handle_command_reply: tid=0 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 client.26150 shutdown 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 msgr2=0x55e0c5e2b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e2b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc09aa40 tx=0x7f1cfc009f30 comp rx=0 tx=0).stop 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 shutdown_connections 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e0c5e8b320 0x55e0c5e8d740 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e0c5e26650 0x55e0c5e2b200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1ce3fff700 0 client.26150 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e0c5e1ae80 0x55e0c5e2cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 --2- 172.21.15.5:0/3221635798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e0c5e24160 0x55e0c5e2d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 >> 172.21.15.5:0/3221635798 conn(0x55e0c5d90260 msgr2=0x55e0c5e1e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 shutdown_connections 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 1 -- 172.21.15.5:0/3221635798 wait complete. 2023-10-08T13:13:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.471+0000 7f1d1724cb80 20 client.26150 trim_cache size 0 max 16384 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:13:46.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:13:46.477 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:13:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cec0a16b0 msgr2=0x7f1cec0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cec0a16b0 0x7f1cec0a3b70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1d041a6e10 tx=0x7f1cf4009290 comp rx=0 tx=0).stop 2023-10-08T13:13:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d0410edf0 msgr2=0x7f1d041a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d0410edf0 0x7f1d041a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc006070 tx=0x7f1cfc004c60 comp rx=0 tx=0).stop 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 shutdown_connections 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1cec0a16b0 0x7f1cec0a3b70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d0410edf0 0x7f1d041a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d041077f0 0x7f1d041ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 --2- 172.21.15.5:0/1860690222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d041083a0 0x7f1d041abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 >> 172.21.15.5:0/1860690222 conn(0x7f1d0406b770 msgr2=0x7f1d0406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 shutdown_connections 2023-10-08T13:13:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:13:46.472+0000 7f1d0b063700 1 -- 172.21.15.5:0/1860690222 wait complete. 2023-10-08T13:13:46.488 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:13:46.753 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 445.0 s, 515.1 tps, lat 213.661 ms stddev 390.061 2023-10-08T13:13:46.915 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:46 smithi060 ceph-mon[103190]: pgmap v535: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2023-10-08T13:13:46.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:46 smithi005 ceph-mon[99496]: pgmap v535: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2023-10-08T13:13:47.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:46 smithi118 ceph-mon[104234]: pgmap v535: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.8 MiB/s wr, 504 op/s 2023-10-08T13:13:48.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:48 smithi060 ceph-mon[103190]: pgmap v536: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2023-10-08T13:13:48.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:48 smithi005 ceph-mon[99496]: pgmap v536: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2023-10-08T13:13:49.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:48 smithi118 ceph-mon[104234]: pgmap v536: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2023-10-08T13:13:49.912 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:49 smithi060 ceph-mon[103190]: pgmap v537: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 438 op/s 2023-10-08T13:13:49.927 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:49 smithi005 ceph-mon[99496]: pgmap v537: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 438 op/s 2023-10-08T13:13:50.023 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:49 smithi118 ceph-mon[104234]: pgmap v537: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 438 op/s 2023-10-08T13:13:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 450.0 s, 514.9 tps, lat 194.738 ms stddev 208.178 2023-10-08T13:13:52.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:52 smithi060 ceph-mon[103190]: pgmap v538: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 399 op/s 2023-10-08T13:13:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:52 smithi005 ceph-mon[99496]: pgmap v538: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 399 op/s 2023-10-08T13:13:53.030 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:52 smithi118 ceph-mon[104234]: pgmap v538: 129 pgs: 129 active+clean; 4.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 399 op/s 2023-10-08T13:13:54.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:54 smithi005 ceph-mon[99496]: pgmap v539: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.7 MiB/s wr, 406 op/s 2023-10-08T13:13:55.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:54 smithi118 ceph-mon[104234]: pgmap v539: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.7 MiB/s wr, 406 op/s 2023-10-08T13:13:55.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:54 smithi060 ceph-mon[103190]: pgmap v539: 129 pgs: 129 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.7 MiB/s wr, 406 op/s 2023-10-08T13:13:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 455.0 s, 537.2 tps, lat 183.632 ms stddev 200.843 2023-10-08T13:13:56.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:56 smithi060 ceph-mon[103190]: pgmap v540: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 497 op/s 2023-10-08T13:13:56.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:56 smithi005 ceph-mon[99496]: pgmap v540: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 497 op/s 2023-10-08T13:13:57.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:56 smithi118 ceph-mon[104234]: pgmap v540: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 497 op/s 2023-10-08T13:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.544+0000 7f6fa46e2700 1 -- 172.21.15.5:0/3837217883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c10ac40 msgr2=0x7f6f9c10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.544+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/3837217883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c10d100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009f90 tx=0x7f6f9400b330 comp rx=0 tx=0).stop 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 -- 172.21.15.5:0/3837217883 shutdown_connections 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/3837217883 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c10d100 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/3837217883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c101820 0x7f6f9c101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/3837217883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c10a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 -- 172.21.15.5:0/3837217883 >> 172.21.15.5:0/3837217883 conn(0x7f6f9c0fb080 msgr2=0x7f6f9c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 -- 172.21.15.5:0/3837217883 shutdown_connections 2023-10-08T13:13:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 -- 172.21.15.5:0/3837217883 wait complete. 2023-10-08T13:13:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.545+0000 7f6fa46e2700 1 Processor -- start 2023-10-08T13:13:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 -- start start 2023-10-08T13:13:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c101820 0x7f6f9c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c19cb40 con 0x7f6f9c102140 2023-10-08T13:13:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c19ccb0 con 0x7f6f9c10ac40 2023-10-08T13:13:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa46e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c19ce70 con 0x7f6f9c101820 2023-10-08T13:13:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c101820 0x7f6f9c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa2c7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c101820 0x7f6f9c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50276/0 (socket says 172.21.15.5:50276) 2023-10-08T13:13:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37074/0 (socket says 172.21.15.5:37074) 2023-10-08T13:13:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa247e700 1 -- 172.21.15.5:0/2899546550 learned_addr learned my addr 172.21.15.5:0/2899546550 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/2899546550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c101820 msgr2=0x7f6f9c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c101820 0x7f6f9c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/2899546550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c10ac40 msgr2=0x7f6f9c19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/2899546550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009c40 con 0x7f6f9c102140 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa2c7f700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.546+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c199250 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000e9f0 tx=0x7f6f9000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.547+0000 7f6f8f7fe700 1 -- 172.21.15.5:0/2899546550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000c9c0 con 0x7f6f9c102140 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.547+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c19d150 con 0x7f6f9c102140 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.547+0000 7f6f8f7fe700 1 -- 172.21.15.5:0/2899546550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f90010430 con 0x7f6f9c102140 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.547+0000 7f6f8f7fe700 1 -- 172.21.15.5:0/2899546550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90018680 con 0x7f6f9c102140 2023-10-08T13:13:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.547+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c1a5ab0 con 0x7f6f9c102140 2023-10-08T13:13:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.549+0000 7f6f8f7fe700 1 -- 172.21.15.5:0/2899546550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6f90010860 con 0x7f6f9c102140 2023-10-08T13:13:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.549+0000 7f6f8f7fe700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f880a15e0 0x7f6f880a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.550+0000 7f6f8f7fe700 1 -- 172.21.15.5:0/2899546550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6f90014070 con 0x7f6f9c102140 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.550+0000 7f6fa247e700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f880a15e0 0x7f6f880a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.550+0000 7f6fa247e700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f880a15e0 0x7f6f880a3aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f98005950 tx=0x7f6f98009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.550+0000 7f6fb08cbb80 1 Processor -- start 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.550+0000 7f6fb08cbb80 1 -- start start 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 0x55b1a4a36c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a30b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a31510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4999400 con 0x55b1a4a310b0 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a498abc0 con 0x55b1a4a36880 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a49884e0 con 0x55b1a4a371a0 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 0x55b1a4a36c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 0x55b1a4a36c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60262/0 (socket says 172.21.15.5:60262) 2023-10-08T13:13:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 -- 172.21.15.5:0/262157255 learned_addr learned my addr 172.21.15.5:0/262157255 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a30b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 -- 172.21.15.5:0/262157255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 msgr2=0x55b1a4a30b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a30b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 -- 172.21.15.5:0/262157255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 msgr2=0x55b1a4a31510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a31510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.551+0000 7f6fa247e700 1 -- 172.21.15.5:0/262157255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1a47aed80 con 0x55b1a4a36880 2023-10-08T13:13:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.552+0000 7f6fa247e700 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 0x55b1a4a36c60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6f98004260 tx=0x7f6f98014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76572602cddded4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.552+0000 7f6f8cff9700 1 -- 172.21.15.5:0/262157255 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98003d10 con 0x55b1a4a36880 2023-10-08T13:13:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.552+0000 7f6f8cff9700 1 -- 172.21.15.5:0/262157255 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f98003e70 con 0x55b1a4a36880 2023-10-08T13:13:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.552+0000 7f6f8cff9700 1 -- 172.21.15.5:0/262157255 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9801d6c0 con 0x55b1a4a36880 2023-10-08T13:13:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/262157255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 msgr2=0x55b1a4a36c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 0x55b1a4a36c60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6f98004260 tx=0x7f6f98014000 comp rx=0 tx=0).stop 2023-10-08T13:13:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/262157255 shutdown_connections 2023-10-08T13:13:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a31510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a36880 0x55b1a4a36c60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/262157255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/262157255 >> 172.21.15.5:0/262157255 conn(0x55b1a49a5200 msgr2=0x55b1a4a2bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/262157255 shutdown_connections 2023-10-08T13:13:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.553+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/262157255 wait complete. 2023-10-08T13:13:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 -- start start 2023-10-08T13:13:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 Processor -- start 2023-10-08T13:13:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a3d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4983dd0 con 0x55b1a4a310b0 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a49206b0 con 0x55b1a4a371a0 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4920350 con 0x55b1a4a36880 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fb08cbb80 10 client.0 _ll_register_callbacks cb 0x55b1a477d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a3d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa1c7d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa2c7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a3d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37084/0 (socket says 172.21.15.5:37084) 2023-10-08T13:13:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 -- 172.21.15.5:0/2828889153 learned_addr learned my addr 172.21.15.5:0/2828889153 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa1c7d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50290/0 (socket says 172.21.15.5:50290) 2023-10-08T13:13:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 -- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 msgr2=0x55b1a4a3a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 -- 172.21.15.5:0/2828889153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 msgr2=0x55b1a4a3abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.554+0000 7f6fa247e700 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6fa247e700 1 -- 172.21.15.5:0/2828889153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f98017070 con 0x55b1a4a310b0 2023-10-08T13:13:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6fa247e700 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a3d1c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6f980093f0 tx=0x7f6f9801e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b2275ae3a64ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6f85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:13:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6f85ffb700 1 -- 172.21.15.5:0/2828889153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9802b070 con 0x55b1a4a310b0 2023-10-08T13:13:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1a494be50 con 0x55b1a4a310b0 2023-10-08T13:13:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6f85ffb700 1 -- 172.21.15.5:0/2828889153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6f9801eac0 con 0x55b1a4a310b0 2023-10-08T13:13:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6f85ffb700 1 -- 172.21.15.5:0/2828889153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f9801ec80 con 0x55b1a4a310b0 2023-10-08T13:13:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6fb08cbb80 10 client.16677 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55b1a4797c00 con 0x55b1a4a310b0 2023-10-08T13:13:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6f85ffb700 1 -- 172.21.15.5:0/2828889153 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b1a494be50 con 0x55b1a4a310b0 2023-10-08T13:13:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.555+0000 7f6f85ffb700 1 -- 172.21.15.5:0/2828889153 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6f98024020 con 0x55b1a4a310b0 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fb08cbb80 10 client.16677 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fb08cbb80 10 client.16677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fb08cbb80 20 client.16677 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a4ac80 0x55b1a4a4d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fb08cbb80 4 client.16677 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1a497cdb0 con 0x55b1a4a4ac80 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a4ac80 0x55b1a4a4d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a4ac80 0x55b1a4a4d0a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f88ed0a0f1544d server_cookie=6c86cbf25955c32a in_seq=0 out_seq=0 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.556+0000 7f6f85ffb700 10 client.16677 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6f85ffb700 1 -- 172.21.15.5:0/2828889153 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1a497cdb0 con 0x55b1a4a4ac80 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6f85ffb700 10 client.16677 handle_command_reply: tid=0 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 client.16677 shutdown 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 msgr2=0x55b1a4a3d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a3d1c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6f980093f0 tx=0x7f6f9801e650 comp rx=0 tx=0).stop 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 shutdown_connections 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a4ac80 0x55b1a4a4d0a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a3d1c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6f85ffb700 0 client.16677 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/2828889153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 >> 172.21.15.5:0/2828889153 conn(0x55b1a49a5200 msgr2=0x55b1a4a2b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 shutdown_connections 2023-10-08T13:13:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/2828889153 wait complete. 2023-10-08T13:13:57.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.557+0000 7f6fb08cbb80 20 client.16677 trim_cache size 0 max 16384 2023-10-08T13:13:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.574+0000 7f6fb08cbb80 1 Processor -- start 2023-10-08T13:13:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 -- start start 2023-10-08T13:13:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a30b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a41be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a48048c0 con 0x55b1a4a310b0 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4a28830 con 0x55b1a4a371a0 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4a236f0 con 0x55b1a4a36880 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a30b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a30b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37092/0 (socket says 172.21.15.5:37092) 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 -- 172.21.15.5:0/1325775654 learned_addr learned my addr 172.21.15.5:0/1325775654 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa2c7f700 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a41be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 -- 172.21.15.5:0/1325775654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 msgr2=0x55b1a4a3abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 -- 172.21.15.5:0/1325775654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 msgr2=0x55b1a4a41be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a41be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 -- 172.21.15.5:0/1325775654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1a47d51f0 con 0x55b1a4a310b0 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa2c7f700 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a41be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.575+0000 7f6fa247e700 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a30b70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800a010 tx=0x7f6f98003fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6967801a6ea2d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6f8d7fa700 1 -- 172.21.15.5:0/1325775654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9802b050 con 0x55b1a4a310b0 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6f8d7fa700 1 -- 172.21.15.5:0/1325775654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f98003960 con 0x55b1a4a310b0 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6f8d7fa700 1 -- 172.21.15.5:0/1325775654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980054d0 con 0x55b1a4a310b0 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/1325775654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 msgr2=0x55b1a4a30b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a30b70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800a010 tx=0x7f6f98003fe0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/1325775654 shutdown_connections 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a371a0 0x55b1a4a41be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a310b0 0x55b1a4a30b70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/1325775654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a36880 0x55b1a4a3abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/1325775654 >> 172.21.15.5:0/1325775654 conn(0x55b1a49a5200 msgr2=0x55b1a4a31490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/1325775654 shutdown_connections 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.576+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/1325775654 wait complete. 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 -- start start 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 Processor -- start 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a310b0 0x55b1a4a41c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 0x55b1a4a3dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4a3ea10 con 0x55b1a4a36880 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4a9da80 con 0x55b1a4a310b0 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1a4a9dbc0 con 0x55b1a4a371a0 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fb08cbb80 10 client.0 _ll_register_callbacks cb 0x7f6f98004130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 0x55b1a4a3dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 0x55b1a4a3dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37102/0 (socket says 172.21.15.5:37102) 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/3480053914 learned_addr learned my addr 172.21.15.5:0/3480053914 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa2c7f700 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 msgr2=0x55b1a4a3e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/3480053914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a310b0 msgr2=0x55b1a4a41c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a310b0 0x55b1a4a41c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.577+0000 7f6fa1c7d700 1 -- 172.21.15.5:0/3480053914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1a4797c00 con 0x55b1a4a36880 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fa1c7d700 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 0x55b1a4a3dbc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6f90099dd0 tx=0x7f6f900cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bc4cec25ce5875 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6f85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6f85ffb700 1 -- 172.21.15.5:0/3480053914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9009e220 con 0x55b1a4a36880 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6f85ffb700 1 -- 172.21.15.5:0/3480053914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6f900a2460 con 0x55b1a4a36880 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f98003e70 con 0x55b1a4a36880 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6f85ffb700 1 -- 172.21.15.5:0/3480053914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f900b8200 con 0x55b1a4a36880 2023-10-08T13:13:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 10 client.16683 fetch_fsmap learned FSMap version 49 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55b1a47ad250 con 0x55b1a4a36880 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6f85ffb700 1 -- 172.21.15.5:0/3480053914 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f98003e70 con 0x55b1a4a36880 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6f85ffb700 1 -- 172.21.15.5:0/3480053914 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6f9009a330 con 0x55b1a4a36880 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 10 client.16683 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 20 client.16683 populate_metadata read hostname 'smithi005' 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a9f480 0x55b1a4aa18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 4 client.16683 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.578+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b1a497cad0 con 0x55b1a4a9f480 2023-10-08T13:13:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.579+0000 7f6fa247e700 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a9f480 0x55b1a4aa18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:13:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.579+0000 7f6f85ffb700 10 client.16683 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.579+0000 7f6fa247e700 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a9f480 0x55b1a4aa18a0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7fdd4bb733f30cd server_cookie=4d6f52e7599bc372 in_seq=0 out_seq=0 2023-10-08T13:13:57.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6f85ffb700 1 -- 172.21.15.5:0/3480053914 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b1a497cad0 con 0x55b1a4a9f480 2023-10-08T13:13:57.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6f85ffb700 10 client.16683 handle_command_reply: tid=0 2023-10-08T13:13:57.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 client.16683 shutdown 2023-10-08T13:13:57.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 msgr2=0x55b1a4a3dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 0x55b1a4a3dbc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6f90099dd0 tx=0x7f6f900cc040 comp rx=0 tx=0).stop 2023-10-08T13:13:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 shutdown_connections 2023-10-08T13:13:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1a4a371a0 0x55b1a4a3e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b1a4a9f480 0x55b1a4aa18a0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b1a4a310b0 0x55b1a4a41c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 --2- 172.21.15.5:0/3480053914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b1a4a36880 0x55b1a4a3dbc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.706+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 >> 172.21.15.5:0/3480053914 conn(0x55b1a49a5200 msgr2=0x55b1a4a34600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.710+0000 7f6f85ffb700 0 client.16683 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:13:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.710+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 shutdown_connections 2023-10-08T13:13:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.711+0000 7f6fb08cbb80 1 -- 172.21.15.5:0/3480053914 wait complete. 2023-10-08T13:13:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.711+0000 7f6fb08cbb80 20 client.16683 trim_cache size 0 max 16384 2023-10-08T13:13:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:13:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:13:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:13:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:13:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.717+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f880a15e0 msgr2=0x7f6f880a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.717+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f880a15e0 0x7f6f880a3aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f98005950 tx=0x7f6f98009310 comp rx=0 tx=0).stop 2023-10-08T13:13:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.717+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 msgr2=0x7f6f9c199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:13:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.717+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c199250 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000e9f0 tx=0x7f6f9000ed00 comp rx=0 tx=0).stop 2023-10-08T13:13:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.718+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 shutdown_connections 2023-10-08T13:13:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.718+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6f880a15e0 0x7f6f880a3aa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.718+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f9c10ac40 0x7f6f9c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.718+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f9c101820 0x7f6f9c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.718+0000 7f6fa46e2700 1 --2- 172.21.15.5:0/2899546550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c102140 0x7f6f9c199250 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:13:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.718+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 >> 172.21.15.5:0/2899546550 conn(0x7f6f9c0fb080 msgr2=0x7f6f9c10beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:13:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.721+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 shutdown_connections 2023-10-08T13:13:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:13:57.721+0000 7f6fa46e2700 1 -- 172.21.15.5:0/2899546550 wait complete. 2023-10-08T13:13:58.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:13:58 smithi060 ceph-mon[103190]: pgmap v541: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 520 op/s 2023-10-08T13:13:58.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:13:58 smithi005 ceph-mon[99496]: pgmap v541: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 520 op/s 2023-10-08T13:13:59.029 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:13:58 smithi118 ceph-mon[104234]: pgmap v541: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 520 op/s 2023-10-08T13:14:00.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:00 smithi060 ceph-mon[103190]: pgmap v542: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.6 MiB/s wr, 498 op/s 2023-10-08T13:14:00.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:00 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:14:00.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:00 smithi005 ceph-mon[99496]: pgmap v542: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.6 MiB/s wr, 498 op/s 2023-10-08T13:14:00.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:00 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:14:01.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:00 smithi118 ceph-mon[104234]: pgmap v542: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.6 MiB/s wr, 498 op/s 2023-10-08T13:14:01.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:00 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:14:01.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 460.0 s, 481.9 tps, lat 197.909 ms stddev 309.200 2023-10-08T13:14:02.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:02 smithi005 ceph-mon[99496]: pgmap v543: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2023-10-08T13:14:02.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:02 smithi060 ceph-mon[103190]: pgmap v543: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2023-10-08T13:14:03.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:02 smithi118 ceph-mon[104234]: pgmap v543: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 502 op/s 2023-10-08T13:14:04.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:04 smithi060 ceph-mon[103190]: pgmap v544: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 530 op/s 2023-10-08T13:14:04.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:04 smithi005 ceph-mon[99496]: pgmap v544: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 530 op/s 2023-10-08T13:14:05.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:04 smithi118 ceph-mon[104234]: pgmap v544: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 530 op/s 2023-10-08T13:14:06.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 465.0 s, 470.0 tps, lat 219.405 ms stddev 268.649 2023-10-08T13:14:06.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:06 smithi060 ceph-mon[103190]: pgmap v545: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 566 op/s 2023-10-08T13:14:06.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:06 smithi005 ceph-mon[99496]: pgmap v545: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 566 op/s 2023-10-08T13:14:07.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:06 smithi118 ceph-mon[104234]: pgmap v545: 129 pgs: 129 active+clean; 4.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 566 op/s 2023-10-08T13:14:08.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:07 smithi118 ceph-mon[104234]: pgmap v546: 129 pgs: 129 active+clean; 4.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 548 op/s 2023-10-08T13:14:08.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:07 smithi005 ceph-mon[99496]: pgmap v546: 129 pgs: 129 active+clean; 4.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 548 op/s 2023-10-08T13:14:08.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:07 smithi060 ceph-mon[103190]: pgmap v546: 129 pgs: 129 active+clean; 4.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 548 op/s 2023-10-08T13:14:10.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:09 smithi118 ceph-mon[104234]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T13:14:10.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:09 smithi118 ceph-mon[104234]: pgmap v548: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 4.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.1 MiB/s wr, 524 op/s 2023-10-08T13:14:10.415 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:10 smithi060 ceph-mon[103190]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T13:14:10.415 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:10 smithi060 ceph-mon[103190]: pgmap v548: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 4.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.1 MiB/s wr, 524 op/s 2023-10-08T13:14:10.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:09 smithi005 ceph-mon[99496]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T13:14:10.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:09 smithi005 ceph-mon[99496]: pgmap v548: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 4.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.1 MiB/s wr, 524 op/s 2023-10-08T13:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.952+0000 7f17f6bfe700 1 -- 172.21.15.5:0/4030322391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f0119fd0 msgr2=0x7f17f011c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.952+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/4030322391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f0119fd0 0x7f17f011c3c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f17e00099c0 tx=0x7f17e0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.953+0000 7f17f6bfe700 1 -- 172.21.15.5:0/4030322391 shutdown_connections 2023-10-08T13:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.953+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/4030322391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f0119fd0 0x7f17f011c3c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.953+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/4030322391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f010eea0 0x7f17f01077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.953+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/4030322391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f010f310 0x7f17f0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.953+0000 7f17f6bfe700 1 -- 172.21.15.5:0/4030322391 >> 172.21.15.5:0/4030322391 conn(0x7f17f006b7c0 msgr2=0x7f17f006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.965+0000 7f17f6bfe700 1 -- 172.21.15.5:0/4030322391 shutdown_connections 2023-10-08T13:14:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.978+0000 7f17f6bfe700 1 -- 172.21.15.5:0/4030322391 wait complete. 2023-10-08T13:14:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.979+0000 7f17f6bfe700 1 Processor -- start 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 -- start start 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f010eea0 0x7f17f01183a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f010f310 0x7f17f0118920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0119fd0 0x7f17f0111540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0111d60 con 0x7f17f010eea0 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0111ed0 con 0x7f17f010f310 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.990+0000 7f17f6bfe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0112090 con 0x7f17f0119fd0 2023-10-08T13:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.992+0000 7f17f499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f010eea0 0x7f17f01183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.992+0000 7f17f499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f010eea0 0x7f17f01183a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37110/0 (socket says 172.21.15.5:37110) 2023-10-08T13:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.992+0000 7f17f499a700 1 -- 172.21.15.5:0/3820352789 learned_addr learned my addr 172.21.15.5:0/3820352789 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.999+0000 7f17f519b700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0119fd0 0x7f17f0111540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.999+0000 7f17f519b700 1 -- 172.21.15.5:0/3820352789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f010f310 msgr2=0x7f17f0118920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.999+0000 7f17f519b700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f010f310 0x7f17f0118920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.999+0000 7f17f519b700 1 -- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f010eea0 msgr2=0x7f17f01183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.999+0000 7f17f519b700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f010eea0 0x7f17f01183a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:10.999+0000 7f17f519b700 1 -- 172.21.15.5:0/3820352789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00095f0 con 0x7f17f0119fd0 2023-10-08T13:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.000+0000 7f17f519b700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0119fd0 0x7f17f0111540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098e0 tx=0x7f17e00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.004+0000 7f17edffb700 1 -- 172.21.15.5:0/3820352789 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e001d070 con 0x7f17f0119fd0 2023-10-08T13:14:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.004+0000 7f17edffb700 1 -- 172.21.15.5:0/3820352789 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e0003fc0 con 0x7f17f0119fd0 2023-10-08T13:14:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.004+0000 7f17edffb700 1 -- 172.21.15.5:0/3820352789 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000fc70 con 0x7f17f0119fd0 2023-10-08T13:14:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.009+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f01122b0 con 0x7f17f0119fd0 2023-10-08T13:14:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.009+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f0116170 con 0x7f17f0119fd0 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 Processor -- start 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 -- start start 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab5880 0x55985aab5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaafb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab00b0 0x55985aab0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985aa18400 con 0x55985aab61a0 2023-10-08T13:14:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985aa09bc0 con 0x55985aab00b0 2023-10-08T13:14:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.015+0000 7f1802de7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985aa074e0 con 0x55985aab5880 2023-10-08T13:14:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.018+0000 7f17edffb700 1 -- 172.21.15.5:0/3820352789 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f17e000f460 con 0x7f17f0119fd0 2023-10-08T13:14:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.019+0000 7f17edffb700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17d80a17f0 0x7f17d80a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.019+0000 7f17edffb700 1 -- 172.21.15.5:0/3820352789 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f17e00cdf60 con 0x7f17f0119fd0 2023-10-08T13:14:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.023+0000 7f17f519b700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17d80a17f0 0x7f17d80a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.024+0000 7f17f519b700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17d80a17f0 0x7f17d80a3cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f17e00cb2c0 tx=0x7f17e0009cd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.026+0000 7f17effff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab5880 0x55985aab5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.026+0000 7f17effff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab5880 0x55985aab5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50318/0 (socket says 172.21.15.5:50318) 2023-10-08T13:14:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.026+0000 7f17effff700 1 -- 172.21.15.5:0/2997383257 learned_addr learned my addr 172.21.15.5:0/2997383257 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.026+0000 7f17effff700 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab00b0 0x55985aab0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.037+0000 7f17f499a700 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaafb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.040+0000 7f17f499a700 1 -- 172.21.15.5:0/2997383257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab5880 msgr2=0x55985aab5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.040+0000 7f17f499a700 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab5880 0x55985aab5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.040+0000 7f17f499a700 1 -- 172.21.15.5:0/2997383257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab00b0 msgr2=0x55985aab0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.040+0000 7f17f499a700 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab00b0 0x55985aab0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.040+0000 7f17f499a700 1 -- 172.21.15.5:0/2997383257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55985a82dd80 con 0x55985aab61a0 2023-10-08T13:14:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.040+0000 7f17f499a700 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaafb70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f17e4007800 tx=0x7f17e4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d1d8bad2ca5ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.065+0000 7f17d6ffd700 1 -- 172.21.15.5:0/2997383257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40125f0 con 0x55985aab61a0 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.065+0000 7f17d6ffd700 1 -- 172.21.15.5:0/2997383257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e4012c10 con 0x55985aab61a0 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.065+0000 7f17d6ffd700 1 -- 172.21.15.5:0/2997383257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4013ce0 con 0x55985aab61a0 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 -- 172.21.15.5:0/2997383257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 msgr2=0x55985aaafb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaafb70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f17e4007800 tx=0x7f17e4007b10 comp rx=0 tx=0).stop 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 -- 172.21.15.5:0/2997383257 shutdown_connections 2023-10-08T13:14:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab00b0 0x55985aab0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab5880 0x55985aab5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2997383257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaafb70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.066+0000 7f1802de7b80 1 -- 172.21.15.5:0/2997383257 >> 172.21.15.5:0/2997383257 conn(0x55985aa24200 msgr2=0x55985aaaab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.068+0000 7f1802de7b80 1 -- 172.21.15.5:0/2997383257 shutdown_connections 2023-10-08T13:14:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.068+0000 7f1802de7b80 1 -- 172.21.15.5:0/2997383257 wait complete. 2023-10-08T13:14:11.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.069+0000 7f1802de7b80 1 -- start start 2023-10-08T13:14:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.069+0000 7f1802de7b80 1 Processor -- start 2023-10-08T13:14:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aab9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab5880 0x55985aab9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985aa02dd0 con 0x55985aab61a0 2023-10-08T13:14:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985a99f6b0 con 0x55985aab5880 2023-10-08T13:14:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985a99f350 con 0x55985aab00b0 2023-10-08T13:14:11.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.070+0000 7f1802de7b80 10 client.0 _ll_register_callbacks cb 0x55985a7fc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.075+0000 7f17f499a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab5880 0x55985aab9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.075+0000 7f17f499a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab5880 0x55985aab9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60304/0 (socket says 172.21.15.5:60304) 2023-10-08T13:14:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.075+0000 7f17f499a700 1 -- 172.21.15.5:0/3085806053 learned_addr learned my addr 172.21.15.5:0/3085806053 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aab9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 -- 172.21.15.5:0/3085806053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab5880 msgr2=0x55985aab9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab5880 0x55985aab9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 -- 172.21.15.5:0/3085806053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 msgr2=0x55985aaba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 -- 172.21.15.5:0/3085806053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e400e040 con 0x55985aab00b0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.076+0000 7f17effff700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aab9580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009be0 tx=0x7f17e800d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d41df67125c879bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.080+0000 7f17cffff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.080+0000 7f17cffff700 1 -- 172.21.15.5:0/3085806053 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8020070 con 0x55985aab00b0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.081+0000 7f17cffff700 1 -- 172.21.15.5:0/3085806053 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f17e8018800 con 0x55985aab00b0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.081+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55985a9cae50 con 0x55985aab00b0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.082+0000 7f17cffff700 1 -- 172.21.15.5:0/3085806053 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e8010070 con 0x55985aab00b0 2023-10-08T13:14:11.084 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.082+0000 7f1802de7b80 10 client.26236 fetch_fsmap learned FSMap version 50 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.082+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55985a816c00 con 0x55985aab00b0 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f17cffff700 1 -- 172.21.15.5:0/3085806053 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55985a9cae50 con 0x55985aab00b0 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f17cffff700 1 -- 172.21.15.5:0/3085806053 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 50) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f17e8023020 con 0x55985aab00b0 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f1802de7b80 10 client.26236 fetch_fsmap finished waiting for FSMap version 50 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f1802de7b80 10 client.26236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f1802de7b80 20 client.26236 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:11.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985aac9ce0 0x55985aacc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f1802de7b80 4 client.26236 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:14:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.083+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55985a9fbdb0 con 0x55985aac9ce0 2023-10-08T13:14:11.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.087+0000 7f17f499a700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985aac9ce0 0x55985aacc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.110+0000 7f17f499a700 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985aac9ce0 0x55985aacc100 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25fab07242c491c server_cookie=7e7f45d2b186f1fe in_seq=0 out_seq=0 2023-10-08T13:14:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.114+0000 7f17cffff700 10 client.26236 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.114+0000 7f17cffff700 1 -- 172.21.15.5:0/3085806053 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55985a9fbdb0 con 0x55985aac9ce0 2023-10-08T13:14:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.114+0000 7f17cffff700 10 client.26236 handle_command_reply: tid=0 2023-10-08T13:14:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.114+0000 7f1802de7b80 1 client.26236 shutdown 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 msgr2=0x55985aab9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aab9580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009be0 tx=0x7f17e800d040 comp rx=0 tx=0).stop 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 shutdown_connections 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985aaba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aab9580 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985aac9ce0 0x55985aacc100 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3085806053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab5880 0x55985aab9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.120+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 >> 172.21.15.5:0/3085806053 conn(0x55985aa24200 msgr2=0x55985aaaa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.122+0000 7f17cffff700 0 client.26236 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.133+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 shutdown_connections 2023-10-08T13:14:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.137+0000 7f1802de7b80 1 -- 172.21.15.5:0/3085806053 wait complete. 2023-10-08T13:14:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.146+0000 7f1802de7b80 20 client.26236 trim_cache size 0 max 16384 2023-10-08T13:14:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.180+0000 7f1802de7b80 1 Processor -- start 2023-10-08T13:14:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 -- start start 2023-10-08T13:14:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aaafb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 0x55985aac0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab61a0 0x55985aab4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985a8838c0 con 0x55985aab5880 2023-10-08T13:14:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985aab7590 con 0x55985aab61a0 2023-10-08T13:14:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.181+0000 7f1802de7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985aaab940 con 0x55985aab00b0 2023-10-08T13:14:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.182+0000 7f17effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab61a0 0x55985aab4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.189+0000 7f17f499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 0x55985aac0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.189+0000 7f17f499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 0x55985aac0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37130/0 (socket says 172.21.15.5:37130) 2023-10-08T13:14:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.189+0000 7f17f499a700 1 -- 172.21.15.5:0/3110110651 learned_addr learned my addr 172.21.15.5:0/3110110651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.189+0000 7f17effff700 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aaafb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.192+0000 7f17f499a700 1 -- 172.21.15.5:0/3110110651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 msgr2=0x55985aaafb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.192+0000 7f17f499a700 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aaafb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.192+0000 7f17f499a700 1 -- 172.21.15.5:0/3110110651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab61a0 msgr2=0x55985aab4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.192+0000 7f17f499a700 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab61a0 0x55985aab4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.192+0000 7f17f499a700 1 -- 172.21.15.5:0/3110110651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55985a8541f0 con 0x55985aab5880 2023-10-08T13:14:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.192+0000 7f17f499a700 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 0x55985aac0c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f17e4013860 tx=0x7f17e40137c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67140ecd0f60e03c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.199+0000 7f17d77fe700 1 -- 172.21.15.5:0/3110110651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4022040 con 0x55985aab5880 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.199+0000 7f17d77fe700 1 -- 172.21.15.5:0/3110110651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e4013480 con 0x55985aab5880 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.199+0000 7f17d77fe700 1 -- 172.21.15.5:0/3110110651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4027d20 con 0x55985aab5880 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 -- 172.21.15.5:0/3110110651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 msgr2=0x55985aac0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 0x55985aac0c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f17e4013860 tx=0x7f17e40137c0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 -- 172.21.15.5:0/3110110651 shutdown_connections 2023-10-08T13:14:11.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985aab61a0 0x55985aab4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985aaafb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 --2- 172.21.15.5:0/3110110651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab5880 0x55985aac0c50 secure :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f17e4013860 tx=0x7f17e40137c0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.200+0000 7f1802de7b80 1 -- 172.21.15.5:0/3110110651 >> 172.21.15.5:0/3110110651 conn(0x55985aa24200 msgr2=0x55985aab4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.218+0000 7f1802de7b80 1 -- 172.21.15.5:0/3110110651 shutdown_connections 2023-10-08T13:14:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.225+0000 7f1802de7b80 1 -- 172.21.15.5:0/3110110651 wait complete. 2023-10-08T13:14:11.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.225+0000 7f1802de7b80 1 -- start start 2023-10-08T13:14:11.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.225+0000 7f1802de7b80 1 Processor -- start 2023-10-08T13:14:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985ab11c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985ab121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985ab1ab10 0x55985ab1cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985ab1d440 con 0x55985aab61a0 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985ab1d580 con 0x55985ab1ab10 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55985ab1d6c0 con 0x55985aab00b0 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f1802de7b80 10 client.0 _ll_register_callbacks cb 0x55985a7fc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f17f499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985ab121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f17f499a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985ab121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37136/0 (socket says 172.21.15.5:37136) 2023-10-08T13:14:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.231+0000 7f17f499a700 1 -- 172.21.15.5:0/2998628506 learned_addr learned my addr 172.21.15.5:0/2998628506 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.232+0000 7f17effff700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985ab11c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.232+0000 7f17effff700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985ab1ab10 0x55985ab1cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.233+0000 7f17effff700 1 -- 172.21.15.5:0/2998628506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985ab1ab10 msgr2=0x55985ab1cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.233+0000 7f17effff700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985ab1ab10 0x55985ab1cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.233+0000 7f17effff700 1 -- 172.21.15.5:0/2998628506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 msgr2=0x55985ab121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.233+0000 7f17effff700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985ab121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.233+0000 7f17effff700 1 -- 172.21.15.5:0/2998628506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55985a82dd80 con 0x55985aab00b0 2023-10-08T13:14:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.233+0000 7f17effff700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985ab11c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17e80023c0 tx=0x7f17e8004be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0d8211d376f3290 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.243+0000 7f17cffff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:14:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.243+0000 7f17cffff700 1 -- 172.21.15.5:0/2998628506 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8020040 con 0x55985aab00b0 2023-10-08T13:14:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.243+0000 7f17cffff700 1 -- 172.21.15.5:0/2998628506 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f17e8009040 con 0x55985aab00b0 2023-10-08T13:14:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.243+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17e4012c10 con 0x55985aab00b0 2023-10-08T13:14:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.254+0000 7f17cffff700 1 -- 172.21.15.5:0/2998628506 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e8010040 con 0x55985aab00b0 2023-10-08T13:14:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.258+0000 7f1802de7b80 10 client.26242 fetch_fsmap learned FSMap version 50 2023-10-08T13:14:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.258+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55985a82c250 con 0x55985aab00b0 2023-10-08T13:14:11.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.264+0000 7f17cffff700 1 -- 172.21.15.5:0/2998628506 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e4012c10 con 0x55985aab00b0 2023-10-08T13:14:11.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f17cffff700 1 -- 172.21.15.5:0/2998628506 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 50) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f17e8009c10 con 0x55985aab00b0 2023-10-08T13:14:11.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f1802de7b80 10 client.26242 fetch_fsmap finished waiting for FSMap version 50 2023-10-08T13:14:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f1802de7b80 10 client.26242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f1802de7b80 20 client.26242 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985ab1ed90 0x55985ab211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f1802de7b80 4 client.26242 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:14:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.265+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55985a9fbad0 con 0x55985ab1ed90 2023-10-08T13:14:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.266+0000 7f17f499a700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985ab1ed90 0x55985ab211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:11.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.271+0000 7f17f499a700 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985ab1ed90 0x55985ab211b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19680b3215ce2e2a server_cookie=cecf54115ff6a62f in_seq=0 out_seq=0 2023-10-08T13:14:11.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.271+0000 7f17cffff700 10 client.26242 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.317+0000 7f17cffff700 1 -- 172.21.15.5:0/2998628506 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55985a9fbad0 con 0x55985ab1ed90 2023-10-08T13:14:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.317+0000 7f17cffff700 10 client.26242 handle_command_reply: tid=0 2023-10-08T13:14:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.317+0000 7f1802de7b80 1 client.26242 shutdown 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 msgr2=0x55985ab11c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985ab11c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17e80023c0 tx=0x7f17e8004be0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 shutdown_connections 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55985ab1ed90 0x55985ab211b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55985ab1ab10 0x55985ab1cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55985aab00b0 0x55985ab11c90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 --2- 172.21.15.5:0/2998628506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55985aab61a0 0x55985ab121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 >> 172.21.15.5:0/2998628506 conn(0x55985aa24200 msgr2=0x55985aab6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:11.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.318+0000 7f17cffff700 0 client.26242 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.326+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 shutdown_connections 2023-10-08T13:14:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.329+0000 7f1802de7b80 1 -- 172.21.15.5:0/2998628506 wait complete. 2023-10-08T13:14:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.329+0000 7f1802de7b80 20 client.26242 trim_cache size 0 max 16384 2023-10-08T13:14:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:14:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:14:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:14:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:14:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.347+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17d80a17f0 msgr2=0x7f17d80a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.347+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17d80a17f0 0x7f17d80a3cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f17e00cb2c0 tx=0x7f17e0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.347+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0119fd0 msgr2=0x7f17f0111540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.347+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0119fd0 0x7f17f0111540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098e0 tx=0x7f17e00057f0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.348+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 shutdown_connections 2023-10-08T13:14:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.348+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17d80a17f0 0x7f17d80a3cb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.348+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17f0119fd0 0x7f17f0111540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.348+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f010eea0 0x7f17f01183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.348+0000 7f17f6bfe700 1 --2- 172.21.15.5:0/3820352789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17f010f310 0x7f17f0118920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.348+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 >> 172.21.15.5:0/3820352789 conn(0x7f17f006b7c0 msgr2=0x7f17f006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.351+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 shutdown_connections 2023-10-08T13:14:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:11.352+0000 7f17f6bfe700 1 -- 172.21.15.5:0/3820352789 wait complete. 2023-10-08T13:14:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 470.0 s, 408.3 tps, lat 245.762 ms stddev 260.724 2023-10-08T13:14:12.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:12 smithi060 ceph-mon[103190]: pgmap v549: 129 pgs: 11 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 88 active+clean; 4.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 555 op/s 2023-10-08T13:14:12.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:12 smithi005 ceph-mon[99496]: pgmap v549: 129 pgs: 11 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 88 active+clean; 4.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 555 op/s 2023-10-08T13:14:13.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:12 smithi118 ceph-mon[104234]: pgmap v549: 129 pgs: 11 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 88 active+clean; 4.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 555 op/s 2023-10-08T13:14:14.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:14 smithi060 ceph-mon[103190]: pgmap v550: 129 pgs: 11 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 88 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.0 MiB/s wr, 553 op/s 2023-10-08T13:14:14.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:14 smithi005 ceph-mon[99496]: pgmap v550: 129 pgs: 11 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 88 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.0 MiB/s wr, 553 op/s 2023-10-08T13:14:15.025 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:14 smithi118 ceph-mon[104234]: pgmap v550: 129 pgs: 11 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 88 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.0 MiB/s wr, 553 op/s 2023-10-08T13:14:16.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:14:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 475.0 s, 534.8 tps, lat 184.114 ms stddev 219.195 2023-10-08T13:14:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 -- 172.21.15.5:0/4255749290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841077f0 msgr2=0x7f1784107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 --2- 172.21.15.5:0/4255749290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841077f0 0x7f1784107c70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1774009990 tx=0x7f1774009ca0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 -- 172.21.15.5:0/4255749290 shutdown_connections 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 --2- 172.21.15.5:0/4255749290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17841083a0 0x7f178411bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 --2- 172.21.15.5:0/4255749290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f178410edf0 0x7f178410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 --2- 172.21.15.5:0/4255749290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841077f0 0x7f1784107c70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.770+0000 7f178b10a700 1 -- 172.21.15.5:0/4255749290 >> 172.21.15.5:0/4255749290 conn(0x7f178406b770 msgr2=0x7f178406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.772+0000 7f178b10a700 1 -- 172.21.15.5:0/4255749290 shutdown_connections 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.772+0000 7f178b10a700 1 -- 172.21.15.5:0/4255749290 wait complete. 2023-10-08T13:14:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 Processor -- start 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 -- start start 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17841077f0 0x7f178411ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841083a0 0x7f1784114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 0x7f1784115540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178411c330 con 0x7f17841083a0 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784119610 con 0x7f1784115090 2023-10-08T13:14:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.773+0000 7f178b10a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17841197d0 con 0x7f17841077f0 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.774+0000 7f17896a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 0x7f1784115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.774+0000 7f17896a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 0x7f1784115540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60328/0 (socket says 172.21.15.5:60328) 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.774+0000 7f17896a7700 1 -- 172.21.15.5:0/1055833930 learned_addr learned my addr 172.21.15.5:0/1055833930 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.775+0000 7f17896a7700 1 -- 172.21.15.5:0/1055833930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17841077f0 msgr2=0x7f178411ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.775+0000 7f17896a7700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17841077f0 0x7f178411ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.775+0000 7f17896a7700 1 -- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841083a0 msgr2=0x7f1784114b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.775+0000 7f17896a7700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841083a0 0x7f1784114b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.775+0000 7f17896a7700 1 -- 172.21.15.5:0/1055833930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740095f0 con 0x7f1784115090 2023-10-08T13:14:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.775+0000 7f17896a7700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 0x7f1784115540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f177800b450 tx=0x7f177800b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.776+0000 7f1781ffb700 1 -- 172.21.15.5:0/1055833930 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778011830 con 0x7f1784115090 2023-10-08T13:14:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.776+0000 7f1781ffb700 1 -- 172.21.15.5:0/1055833930 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1778011e50 con 0x7f1784115090 2023-10-08T13:14:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.776+0000 7f1781ffb700 1 -- 172.21.15.5:0/1055833930 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177800f2e0 con 0x7f1784115090 2023-10-08T13:14:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.776+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784119ab0 con 0x7f1784115090 2023-10-08T13:14:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.776+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784119f70 con 0x7f1784115090 2023-10-08T13:14:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.783+0000 7f17972f3b80 1 Processor -- start 2023-10-08T13:14:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 -- start start 2023-10-08T13:14:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 0x555d00108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 0x555d00113110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00113650 0x555d00115a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d00071460 con 0x555d001087a0 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d00062c20 con 0x555d00113650 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.784+0000 7f17972f3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d00060540 con 0x555d00107e80 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1781ffb700 1 -- 172.21.15.5:0/1055833930 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f177800f440 con 0x7f1784115090 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 0x555d00113110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 0x555d00113110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37150/0 (socket says 172.21.15.5:37150) 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 -- 172.21.15.5:0/2952071194 learned_addr learned my addr 172.21.15.5:0/2952071194 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 -- 172.21.15.5:0/2952071194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 msgr2=0x555d00108260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 0x555d00108260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 -- 172.21.15.5:0/2952071194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00113650 msgr2=0x555d00115a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00113650 0x555d00115a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1788ea6700 1 -- 172.21.15.5:0/2952071194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cffe86de0 con 0x555d001087a0 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.785+0000 7f1781ffb700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f176c0a1730 0x7f176c0a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.786+0000 7f1788ea6700 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 0x555d00113110 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f177c009da0 tx=0x7f177c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d571df1878177203 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.786+0000 7f1781ffb700 1 -- 172.21.15.5:0/1055833930 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f17780cd2f0 con 0x7f1784115090 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.786+0000 7f176affd700 1 -- 172.21.15.5:0/2952071194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c013410 con 0x555d001087a0 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.786+0000 7f176affd700 1 -- 172.21.15.5:0/2952071194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f177c013a30 con 0x555d001087a0 2023-10-08T13:14:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.786+0000 7f176affd700 1 -- 172.21.15.5:0/2952071194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c012a80 con 0x555d001087a0 2023-10-08T13:14:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.787+0000 7f17972f3b80 1 -- 172.21.15.5:0/2952071194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 msgr2=0x555d00113110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.787+0000 7f17972f3b80 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 0x555d00113110 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f177c009da0 tx=0x7f177c00b730 comp rx=0 tx=0).stop 2023-10-08T13:14:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.788+0000 7f1783fff700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f176c0a1730 0x7f176c0a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 -- 172.21.15.5:0/2952071194 shutdown_connections 2023-10-08T13:14:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00113650 0x555d00115a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 0x555d00108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 --2- 172.21.15.5:0/2952071194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d001087a0 0x555d00113110 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 -- 172.21.15.5:0/2952071194 >> 172.21.15.5:0/2952071194 conn(0x555d0007d260 msgr2=0x555d001042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 -- 172.21.15.5:0/2952071194 shutdown_connections 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 -- 172.21.15.5:0/2952071194 wait complete. 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 -- start start 2023-10-08T13:14:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.790+0000 7f17972f3b80 1 Processor -- start 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 0x555d00112f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d001087a0 0x555d001101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d00110710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0005be30 con 0x555d00113650 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cffff8710 con 0x555d00107e80 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cffff83b0 con 0x555d001087a0 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17972f3b80 10 client.0 _ll_register_callbacks cb 0x555cffe55800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 0x555d00112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 0x555d00112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60336/0 (socket says 172.21.15.5:60336) 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 -- 172.21.15.5:0/277010832 learned_addr learned my addr 172.21.15.5:0/277010832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1783fff700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d001087a0 0x555d001101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17896a7700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d00110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 -- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d001087a0 msgr2=0x555d001101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d001087a0 0x555d001101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 -- 172.21.15.5:0/277010832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 msgr2=0x555d00110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d00110710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1788ea6700 1 -- 172.21.15.5:0/277010832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c0099d0 con 0x555d00107e80 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1783fff700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d001087a0 0x555d001101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f17896a7700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d00110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:14:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.791+0000 7f1783fff700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f176c0a1730 0x7f176c0a3bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17740098e0 tx=0x7f177400bf70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f1788ea6700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 0x555d00112f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f177c013fd0 tx=0x7f177c013620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=571d590db30f4801 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f1763fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f1763fff700 1 -- 172.21.15.5:0/277010832 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0138b0 con 0x555d00107e80 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f1763fff700 1 -- 172.21.15.5:0/277010832 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f177c0123b0 con 0x555d00107e80 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d00023eb0 con 0x555d00107e80 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f1763fff700 1 -- 172.21.15.5:0/277010832 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f177c012a30 con 0x555d00107e80 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f17972f3b80 10 client.26183 fetch_fsmap learned FSMap version 50 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x555cffe6fc60 con 0x555d00107e80 2023-10-08T13:14:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.792+0000 7f1763fff700 1 -- 172.21.15.5:0/277010832 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555d00023eb0 con 0x555d00107e80 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f1763fff700 1 -- 172.21.15.5:0/277010832 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f177c028bc0 con 0x555d00107e80 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f17972f3b80 10 client.26183 fetch_fsmap finished waiting for FSMap version 50 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f17972f3b80 10 client.26183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f17972f3b80 20 client.26183 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f17972f3b80 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00122fc0 0x555d001253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f17972f3b80 4 client.26183 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d00054e10 con 0x555d00122fc0 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f1783fff700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00122fc0 0x555d001253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f1763fff700 10 client.26183 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.793+0000 7f1783fff700 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00122fc0 0x555d001253e0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a1291f46a46819 server_cookie=7ae1c1730b418a88 in_seq=0 out_seq=0 2023-10-08T13:14:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f1763fff700 1 -- 172.21.15.5:0/277010832 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d00054e10 con 0x555d00122fc0 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f1763fff700 10 client.26183 handle_command_reply: tid=0 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 client.26183 shutdown 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 msgr2=0x555d00112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 0x555d00112f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f177c013fd0 tx=0x7f177c013620 comp rx=0 tx=0).stop 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 shutdown_connections 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d00110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00122fc0 0x555d001253e0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00107e80 0x555d00112f50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 --2- 172.21.15.5:0/277010832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d001087a0 0x555d001101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 >> 172.21.15.5:0/277010832 conn(0x555d0007d260 msgr2=0x555d00103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.794+0000 7f1763fff700 0 client.26183 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.795+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 shutdown_connections 2023-10-08T13:14:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.795+0000 7f17972f3b80 1 -- 172.21.15.5:0/277010832 wait complete. 2023-10-08T13:14:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.795+0000 7f17972f3b80 20 client.26183 trim_cache size 0 max 16384 2023-10-08T13:14:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.832+0000 7f17972f3b80 1 Processor -- start 2023-10-08T13:14:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.834+0000 7f17972f3b80 1 -- start start 2023-10-08T13:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 0x555d0011f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d001087a0 0x555d00112a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0010d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17972f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cffedc920 con 0x555d00113650 2023-10-08T13:14:16.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17972f3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d001090d0 con 0x555d001087a0 2023-10-08T13:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17972f3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d000fe570 con 0x555d00107e80 2023-10-08T13:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0010d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0010d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37164/0 (socket says 172.21.15.5:37164) 2023-10-08T13:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 -- 172.21.15.5:0/3223980918 learned_addr learned my addr 172.21.15.5:0/3223980918 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:16.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 -- 172.21.15.5:0/3223980918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 msgr2=0x555d0011f0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:14:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 0x555d0011f0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 -- 172.21.15.5:0/3223980918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d001087a0 msgr2=0x555d00112a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d001087a0 0x555d00112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 -- 172.21.15.5:0/3223980918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d0012a030 con 0x555d00113650 2023-10-08T13:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.835+0000 7f17896a7700 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0010d430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1778099c90 tx=0x7f177809a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff92c9f3fddeda6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.836+0000 7f176b7fe700 1 -- 172.21.15.5:0/3223980918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177809e0e0 con 0x555d00113650 2023-10-08T13:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.836+0000 7f176b7fe700 1 -- 172.21.15.5:0/3223980918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17780a2320 con 0x555d00113650 2023-10-08T13:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.836+0000 7f176b7fe700 1 -- 172.21.15.5:0/3223980918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17780996e0 con 0x555d00113650 2023-10-08T13:14:16.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 -- 172.21.15.5:0/3223980918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 msgr2=0x555d0010d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0010d430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1778099c90 tx=0x7f177809a760 comp rx=0 tx=0).stop 2023-10-08T13:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 -- 172.21.15.5:0/3223980918 shutdown_connections 2023-10-08T13:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0010d430 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00107e80 0x555d0011f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 --2- 172.21.15.5:0/3223980918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d001087a0 0x555d00112a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.837+0000 7f17972f3b80 1 -- 172.21.15.5:0/3223980918 >> 172.21.15.5:0/3223980918 conn(0x555d0007d260 msgr2=0x555d0011e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:16.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.849+0000 7f17972f3b80 1 -- 172.21.15.5:0/3223980918 shutdown_connections 2023-10-08T13:14:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.856+0000 7f17972f3b80 1 -- 172.21.15.5:0/3223980918 wait complete. 2023-10-08T13:14:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.856+0000 7f17972f3b80 1 -- start start 2023-10-08T13:14:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.856+0000 7f17972f3b80 1 Processor -- start 2023-10-08T13:14:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0011a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00118760 0x555d00118be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00119120 0x555d00176e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d00177360 con 0x555d00113650 2023-10-08T13:14:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d001774a0 con 0x555d00118760 2023-10-08T13:14:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d00177630 con 0x555d00119120 2023-10-08T13:14:16.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.857+0000 7f17972f3b80 10 client.0 _ll_register_callbacks cb 0x7f177c009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0011a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0011a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37168/0 (socket says 172.21.15.5:37168) 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 -- 172.21.15.5:0/345531639 learned_addr learned my addr 172.21.15.5:0/345531639 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 -- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00119120 msgr2=0x555d00176e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00119120 0x555d00176e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 -- 172.21.15.5:0/345531639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00118760 msgr2=0x555d00118be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00118760 0x555d00118be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 -- 172.21.15.5:0/345531639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784119f70 con 0x555d00113650 2023-10-08T13:14:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.858+0000 7f1788ea6700 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0011a310 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f177c00b770 tx=0x7f177c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6384a3a7a45331b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.860+0000 7f1763fff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:14:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.860+0000 7f1763fff700 1 -- 172.21.15.5:0/345531639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00f070 con 0x555d00113650 2023-10-08T13:14:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.860+0000 7f1763fff700 1 -- 172.21.15.5:0/345531639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f177c012c40 con 0x555d00113650 2023-10-08T13:14:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.860+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f177c013a30 con 0x555d00113650 2023-10-08T13:14:16.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.863+0000 7f1763fff700 1 -- 172.21.15.5:0/345531639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f177c01c750 con 0x555d00113650 2023-10-08T13:14:16.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.863+0000 7f17972f3b80 10 client.16716 fetch_fsmap learned FSMap version 50 2023-10-08T13:14:16.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.863+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x555cffead250 con 0x555d00113650 2023-10-08T13:14:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f1763fff700 1 -- 172.21.15.5:0/345531639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f177c013a30 con 0x555d00113650 2023-10-08T13:14:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f1763fff700 1 -- 172.21.15.5:0/345531639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 50) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f177c01ca60 con 0x555d00113650 2023-10-08T13:14:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f17972f3b80 10 client.16716 fetch_fsmap finished waiting for FSMap version 50 2023-10-08T13:14:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f17972f3b80 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f17972f3b80 20 client.16716 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f17972f3b80 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00178b40 0x555d0017af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f17972f3b80 4 client.16716 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:14:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555d00054b30 con 0x555d00178b40 2023-10-08T13:14:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.864+0000 7f1783fff700 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00178b40 0x555d0017af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.865+0000 7f1763fff700 10 client.16716 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:16.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.865+0000 7f1783fff700 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00178b40 0x555d0017af60 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6fc24e92bc99502 server_cookie=86e465855dfabd5a in_seq=0 out_seq=0 2023-10-08T13:14:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.870+0000 7f1763fff700 1 -- 172.21.15.5:0/345531639 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555d00054b30 con 0x555d00178b40 2023-10-08T13:14:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.870+0000 7f1763fff700 10 client.16716 handle_command_reply: tid=0 2023-10-08T13:14:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.870+0000 7f17972f3b80 1 client.16716 shutdown 2023-10-08T13:14:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.879+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 msgr2=0x555d0011a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.879+0000 7f17972f3b80 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0011a310 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f177c00b770 tx=0x7f177c009610 comp rx=0 tx=0).stop 2023-10-08T13:14:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 shutdown_connections 2023-10-08T13:14:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f17972f3b80 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555d00119120 0x555d00176e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f17972f3b80 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d00113650 0x555d0011a310 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f17972f3b80 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555d00178b40 0x555d0017af60 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f17972f3b80 1 --2- 172.21.15.5:0/345531639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d00118760 0x555d00118be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 >> 172.21.15.5:0/345531639 conn(0x555d0007d260 msgr2=0x555d0010fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:16.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.880+0000 7f1763fff700 0 client.16716 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:16.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.893+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 shutdown_connections 2023-10-08T13:14:16.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.893+0000 7f17972f3b80 1 -- 172.21.15.5:0/345531639 wait complete. 2023-10-08T13:14:16.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:16 smithi060 ceph-mon[103190]: pgmap v551: 129 pgs: 129 active+clean; 3.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.4 MiB/s wr, 523 op/s 2023-10-08T13:14:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.911+0000 7f17972f3b80 20 client.16716 trim_cache size 0 max 16384 2023-10-08T13:14:16.916 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:14:16.916 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:14:16.916 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:14:16.916 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:14:16.916 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:14:16.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:14:16.917 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:14:16.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:14:16.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:14:16.917 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:14:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.918+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f176c0a1730 msgr2=0x7f176c0a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.918+0000 7f178b10a700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f176c0a1730 0x7f176c0a3bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17740098e0 tx=0x7f177400bf70 comp rx=0 tx=0).stop 2023-10-08T13:14:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.918+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 msgr2=0x7f1784115540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:16.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.918+0000 7f178b10a700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 0x7f1784115540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f177800b450 tx=0x7f177800b810 comp rx=0 tx=0).stop 2023-10-08T13:14:16.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:16 smithi005 ceph-mon[99496]: pgmap v551: 129 pgs: 129 active+clean; 3.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.4 MiB/s wr, 523 op/s 2023-10-08T13:14:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.924+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 shutdown_connections 2023-10-08T13:14:16.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.924+0000 7f178b10a700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f176c0a1730 0x7f176c0a3bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.924+0000 7f178b10a700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1784115090 0x7f1784115540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.924+0000 7f178b10a700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17841077f0 0x7f178411ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.924+0000 7f178b10a700 1 --2- 172.21.15.5:0/1055833930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17841083a0 0x7f1784114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:16.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.924+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 >> 172.21.15.5:0/1055833930 conn(0x7f178406b770 msgr2=0x7f178406f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:16.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.928+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 shutdown_connections 2023-10-08T13:14:16.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:16.928+0000 7f178b10a700 1 -- 172.21.15.5:0/1055833930 wait complete. 2023-10-08T13:14:16.944 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:14:17.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:16 smithi118 ceph-mon[104234]: pgmap v551: 129 pgs: 129 active+clean; 3.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.4 MiB/s wr, 523 op/s 2023-10-08T13:14:18.904 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:18 smithi005 ceph-mon[99496]: pgmap v552: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.5 MiB/s wr, 520 op/s 2023-10-08T13:14:18.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:18 smithi060 ceph-mon[103190]: pgmap v552: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.5 MiB/s wr, 520 op/s 2023-10-08T13:14:19.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:18 smithi118 ceph-mon[104234]: pgmap v552: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.5 MiB/s wr, 520 op/s 2023-10-08T13:14:20.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:20 smithi060 ceph-mon[103190]: pgmap v553: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2023-10-08T13:14:20.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:20 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:14:20.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:20 smithi060 ceph-mon[103190]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T13:14:20.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:20 smithi005 ceph-mon[99496]: pgmap v553: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2023-10-08T13:14:20.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:20 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:14:20.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:20 smithi005 ceph-mon[99496]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T13:14:21.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:20 smithi118 ceph-mon[104234]: pgmap v553: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2023-10-08T13:14:21.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:20 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:14:21.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:20 smithi118 ceph-mon[104234]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T13:14:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 480.0 s, 644.4 tps, lat 160.946 ms stddev 192.132 2023-10-08T13:14:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:22 smithi118 ceph-mon[104234]: pgmap v555: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.8 MiB/s wr, 542 op/s 2023-10-08T13:14:23.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:22 smithi060 ceph-mon[103190]: pgmap v555: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.8 MiB/s wr, 542 op/s 2023-10-08T13:14:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:22 smithi005 ceph-mon[99496]: pgmap v555: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.8 MiB/s wr, 542 op/s 2023-10-08T13:14:24.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:23 smithi118 ceph-mon[104234]: pgmap v556: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.6 MiB/s wr, 529 op/s 2023-10-08T13:14:24.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:23 smithi060 ceph-mon[103190]: pgmap v556: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.6 MiB/s wr, 529 op/s 2023-10-08T13:14:24.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:23 smithi005 ceph-mon[99496]: pgmap v556: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.6 MiB/s wr, 529 op/s 2023-10-08T13:14:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.520+0000 7f092d42a700 1 -- 172.21.15.5:0/765775335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 msgr2=0x7f0928105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.520+0000 7f092d42a700 1 --2- 172.21.15.5:0/765775335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 0x7f0928105a40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f09180099c0 tx=0x7f0918009cd0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 -- 172.21.15.5:0/765775335 shutdown_connections 2023-10-08T13:14:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 --2- 172.21.15.5:0/765775335 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09280fff60 0x7f092810c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 --2- 172.21.15.5:0/765775335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 0x7f0928105a40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 --2- 172.21.15.5:0/765775335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f09280ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 -- 172.21.15.5:0/765775335 >> 172.21.15.5:0/765775335 conn(0x7f09280fb070 msgr2=0x7f09280fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 -- 172.21.15.5:0/765775335 shutdown_connections 2023-10-08T13:14:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 -- 172.21.15.5:0/765775335 wait complete. 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.521+0000 7f092d42a700 1 Processor -- start 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 -- start start 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f092819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09280fff60 0x7f092819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 0x7f0928196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0928196f70 con 0x7f0928105660 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09281970e0 con 0x7f09280ff5a0 2023-10-08T13:14:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f092d42a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09281972a0 con 0x7f09280fff60 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f092819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f092819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60360/0 (socket says 172.21.15.5:60360) 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f0926ffd700 1 -- 172.21.15.5:0/3133880551 learned_addr learned my addr 172.21.15.5:0/3133880551 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f09277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 0x7f0928196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f09267fc700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09280fff60 0x7f092819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.522+0000 7f0926ffd700 1 -- 172.21.15.5:0/3133880551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09280fff60 msgr2=0x7f092819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f0926ffd700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09280fff60 0x7f092819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f0926ffd700 1 -- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 msgr2=0x7f0928196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f0926ffd700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 0x7f0928196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f0926ffd700 1 -- 172.21.15.5:0/3133880551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009520 con 0x7f09280ff5a0 2023-10-08T13:14:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f0926ffd700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f092819c7e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f091800b580 tx=0x7f091800bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f090ffff700 1 -- 172.21.15.5:0/3133880551 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091801c070 con 0x7f09280ff5a0 2023-10-08T13:14:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09180095f0 con 0x7f09280ff5a0 2023-10-08T13:14:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f090ffff700 1 -- 172.21.15.5:0/3133880551 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f091800fd40 con 0x7f09280ff5a0 2023-10-08T13:14:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f090ffff700 1 -- 172.21.15.5:0/3133880551 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918022b80 con 0x7f09280ff5a0 2023-10-08T13:14:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.523+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09281a35f0 con 0x7f09280ff5a0 2023-10-08T13:14:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.526+0000 7f090ffff700 1 -- 172.21.15.5:0/3133880551 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0918020070 con 0x7f09280ff5a0 2023-10-08T13:14:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.526+0000 7f090ffff700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f09100a15e0 0x7f09100a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.527+0000 7f090ffff700 1 -- 172.21.15.5:0/3133880551 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f09180ce480 con 0x7f09280ff5a0 2023-10-08T13:14:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.527+0000 7f09267fc700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f09100a15e0 0x7f09100a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.527+0000 7f0939613b80 1 Processor -- start 2023-10-08T13:14:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.528+0000 7f0939613b80 1 -- start start 2023-10-08T13:14:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.528+0000 7f0939613b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb13037140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f0939613b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13043d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f0939613b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb130442b0 0x55fb13044710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f0939613b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12f9f400 con 0x55fb13037680 2023-10-08T13:14:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f0939613b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12f90bc0 con 0x55fb130442b0 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f0939613b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12f8e4e0 con 0x55fb13036d60 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f09267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13043d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f09267fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13043d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37188/0 (socket says 172.21.15.5:37188) 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f09267fc700 1 -- 172.21.15.5:0/4117004571 learned_addr learned my addr 172.21.15.5:0/4117004571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.529+0000 7f09267fc700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f09100a15e0 0x7f09100a3aa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0928197ad0 tx=0x7f091c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09277fe700 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb130442b0 0x55fb13044710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09267fc700 1 -- 172.21.15.5:0/4117004571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 msgr2=0x55fb13037140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09267fc700 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb13037140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09267fc700 1 -- 172.21.15.5:0/4117004571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb130442b0 msgr2=0x55fb13044710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09267fc700 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb130442b0 0x55fb13044710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09267fc700 1 -- 172.21.15.5:0/4117004571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb12db4d80 con 0x55fb13037680 2023-10-08T13:14:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.530+0000 7f09277fe700 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb130442b0 0x55fb13044710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:14:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.531+0000 7f09267fc700 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13043d70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f091c00e590 tx=0x7f091c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7891e28781189596 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.531+0000 7f090d7fa700 1 -- 172.21.15.5:0/4117004571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c004020 con 0x55fb13037680 2023-10-08T13:14:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.531+0000 7f090d7fa700 1 -- 172.21.15.5:0/4117004571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f091c021070 con 0x55fb13037680 2023-10-08T13:14:24.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.531+0000 7f090d7fa700 1 -- 172.21.15.5:0/4117004571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0266e0 con 0x55fb13037680 2023-10-08T13:14:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 -- 172.21.15.5:0/4117004571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 msgr2=0x55fb13043d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13043d70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f091c00e590 tx=0x7f091c014000 comp rx=0 tx=0).stop 2023-10-08T13:14:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 -- 172.21.15.5:0/4117004571 shutdown_connections 2023-10-08T13:14:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb130442b0 0x55fb13044710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb13037140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.540 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 --2- 172.21.15.5:0/4117004571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13043d70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.532+0000 7f0939613b80 1 -- 172.21.15.5:0/4117004571 >> 172.21.15.5:0/4117004571 conn(0x55fb12fab200 msgr2=0x55fb13031d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.533+0000 7f0939613b80 1 -- 172.21.15.5:0/4117004571 shutdown_connections 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.533+0000 7f0939613b80 1 -- 172.21.15.5:0/4117004571 wait complete. 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.533+0000 7f0939613b80 1 -- start start 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.533+0000 7f0939613b80 1 Processor -- start 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb1304ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13048dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb130442b0 0x55fb13049510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12f89dd0 con 0x55fb13037680 2023-10-08T13:14:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12f266b0 con 0x55fb13036d60 2023-10-08T13:14:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12f26350 con 0x55fb130442b0 2023-10-08T13:14:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0939613b80 10 client.0 _ll_register_callbacks cb 0x55fb12d837a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:24.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb1304ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb1304ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60372/0 (socket says 172.21.15.5:60372) 2023-10-08T13:14:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 -- 172.21.15.5:0/128080858 learned_addr learned my addr 172.21.15.5:0/128080858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f09267fc700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13048dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f09277fe700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb130442b0 0x55fb13049510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 -- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb130442b0 msgr2=0x55fb13049510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb130442b0 0x55fb13049510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 -- 172.21.15.5:0/128080858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 msgr2=0x55fb13048dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13048dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 -- 172.21.15.5:0/128080858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c017070 con 0x55fb13036d60 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f0926ffd700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb1304ba90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0918009990 tx=0x7f091809b170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c95f36c5efb24e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.534+0000 7f090aff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f090aff5700 1 -- 172.21.15.5:0/128080858 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091809ba20 con 0x55fb13036d60 2023-10-08T13:14:24.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f090aff5700 1 -- 172.21.15.5:0/128080858 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f091809b320 con 0x55fb13036d60 2023-10-08T13:14:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb12f51e50 con 0x55fb13036d60 2023-10-08T13:14:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f090aff5700 1 -- 172.21.15.5:0/128080858 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091809f470 con 0x55fb13036d60 2023-10-08T13:14:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 10 client.26192 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55fb12d9dc00 con 0x55fb13036d60 2023-10-08T13:14:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f090aff5700 1 -- 172.21.15.5:0/128080858 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb12f51e50 con 0x55fb13036d60 2023-10-08T13:14:24.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f090aff5700 1 -- 172.21.15.5:0/128080858 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f091809a8c0 con 0x55fb13036d60 2023-10-08T13:14:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 10 client.26192 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 10 client.26192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 20 client.26192 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb1306a0d0 0x55fb1306c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 4 client.26192 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:14:24.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.535+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb12f82db0 con 0x55fb1306a0d0 2023-10-08T13:14:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.536+0000 7f09267fc700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb1306a0d0 0x55fb1306c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.536+0000 7f090aff5700 10 client.26192 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.536+0000 7f09267fc700 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb1306a0d0 0x55fb1306c4c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e84de4870280d79 server_cookie=3d8e5d92a50a07ef in_seq=0 out_seq=0 2023-10-08T13:14:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f090aff5700 1 -- 172.21.15.5:0/128080858 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb12f82db0 con 0x55fb1306a0d0 2023-10-08T13:14:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f090aff5700 10 client.26192 handle_command_reply: tid=0 2023-10-08T13:14:24.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 client.26192 shutdown 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 msgr2=0x55fb1304ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb1304ba90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0918009990 tx=0x7f091809b170 comp rx=0 tx=0).stop 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 shutdown_connections 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb130442b0 0x55fb13049510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb1306a0d0 0x55fb1306c4c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb1304ba90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 --2- 172.21.15.5:0/128080858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb13037680 0x55fb13048dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 >> 172.21.15.5:0/128080858 conn(0x55fb12fab200 msgr2=0x55fb130456f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.537+0000 7f090aff5700 0 client.26192 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.538+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 shutdown_connections 2023-10-08T13:14:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.538+0000 7f0939613b80 1 -- 172.21.15.5:0/128080858 wait complete. 2023-10-08T13:14:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.538+0000 7f0939613b80 20 client.26192 trim_cache size 0 max 16384 2023-10-08T13:14:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 Processor -- start 2023-10-08T13:14:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 -- start start 2023-10-08T13:14:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb13066c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13037680 0x55fb13061480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb13030780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb12e0a8c0 con 0x55fb130442b0 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1302e830 con 0x55fb13036d60 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.561+0000 7f0939613b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb13029670 con 0x55fb13037680 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb13066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f09277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb13030780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f09267fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13037680 0x55fb13061480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb13066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60380/0 (socket says 172.21.15.5:60380) 2023-10-08T13:14:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 -- 172.21.15.5:0/950206467 learned_addr learned my addr 172.21.15.5:0/950206467 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 -- 172.21.15.5:0/950206467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13037680 msgr2=0x55fb13061480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13037680 0x55fb13061480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 -- 172.21.15.5:0/950206467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 msgr2=0x55fb13030780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb13030780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 -- 172.21.15.5:0/950206467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb12ddb1f0 con 0x55fb13036d60 2023-10-08T13:14:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f09277fe700 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb13030780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:14:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f0926ffd700 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb13066c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0918000c00 tx=0x7f0918097040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ab2fd92af99b8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f090dffb700 1 -- 172.21.15.5:0/950206467 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091809ba20 con 0x55fb13036d60 2023-10-08T13:14:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f090dffb700 1 -- 172.21.15.5:0/950206467 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f091809b320 con 0x55fb13036d60 2023-10-08T13:14:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.562+0000 7f090dffb700 1 -- 172.21.15.5:0/950206467 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180a36b0 con 0x55fb13036d60 2023-10-08T13:14:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 -- 172.21.15.5:0/950206467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 msgr2=0x55fb13066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb13066c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0918000c00 tx=0x7f0918097040 comp rx=0 tx=0).stop 2023-10-08T13:14:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 -- 172.21.15.5:0/950206467 shutdown_connections 2023-10-08T13:14:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb13030780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13036d60 0x55fb13066c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 --2- 172.21.15.5:0/950206467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13037680 0x55fb13061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 -- 172.21.15.5:0/950206467 >> 172.21.15.5:0/950206467 conn(0x55fb12fab200 msgr2=0x55fb13070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 -- 172.21.15.5:0/950206467 shutdown_connections 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.563+0000 7f0939613b80 1 -- 172.21.15.5:0/950206467 wait complete. 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 -- start start 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 Processor -- start 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb1305f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 0x55fb1305f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb1305fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb130bced0 con 0x55fb130442b0 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb130bd040 con 0x55fb13037680 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb130bd200 con 0x55fb13036d60 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0939613b80 10 client.0 _ll_register_callbacks cb 0x55fb12d837a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb1305fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb1305f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 0x55fb1305f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09277fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb1305fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37208/0 (socket says 172.21.15.5:37208) 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 0x55fb1305f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60388/0 (socket says 172.21.15.5:60388) 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f0926ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb1305f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50408/0 (socket says 172.21.15.5:50408) 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 -- 172.21.15.5:0/296628844 learned_addr learned my addr 172.21.15.5:0/296628844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 -- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 msgr2=0x55fb1305f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb1305f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 -- 172.21.15.5:0/296628844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 msgr2=0x55fb1305fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb1305fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.564+0000 7f09267fc700 1 -- 172.21.15.5:0/296628844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0920009150 con 0x55fb13037680 2023-10-08T13:14:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f09267fc700 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 0x55fb1305f9a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f091c009340 tx=0x7f091c026570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4087b30517d6973c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f090aff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:14:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f090aff5700 1 -- 172.21.15.5:0/296628844 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c02a040 con 0x55fb13037680 2023-10-08T13:14:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f090aff5700 1 -- 172.21.15.5:0/296628844 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f091c032bf0 con 0x55fb13037680 2023-10-08T13:14:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f091c021070 con 0x55fb13037680 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f090aff5700 1 -- 172.21.15.5:0/296628844 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091c032db0 con 0x55fb13037680 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f0939613b80 10 client.26198 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.565+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55fb12d9dc00 con 0x55fb13037680 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f090aff5700 1 -- 172.21.15.5:0/296628844 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f091c021070 con 0x55fb13037680 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f090aff5700 1 -- 172.21.15.5:0/296628844 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f091c003700 con 0x55fb13037680 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0939613b80 10 client.26198 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0939613b80 10 client.26198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0939613b80 20 client.26198 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0939613b80 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb130be940 0x55fb130c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0939613b80 4 client.26198 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:14:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fb12f82ad0 con 0x55fb130be940 2023-10-08T13:14:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0926ffd700 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb130be940 0x55fb130c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f090aff5700 10 client.26198 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.566+0000 7f0926ffd700 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb130be940 0x55fb130c0d60 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ec98da3e9f386 server_cookie=614fdb9b7e77b983 in_seq=0 out_seq=0 2023-10-08T13:14:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.578+0000 7f090aff5700 1 -- 172.21.15.5:0/296628844 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fb12f82ad0 con 0x55fb130be940 2023-10-08T13:14:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.578+0000 7f090aff5700 10 client.26198 handle_command_reply: tid=0 2023-10-08T13:14:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.578+0000 7f0939613b80 1 client.26198 shutdown 2023-10-08T13:14:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 msgr2=0x55fb1305f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 0x55fb1305f9a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f091c009340 tx=0x7f091c026570 comp rx=0 tx=0).stop 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 shutdown_connections 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb130442b0 0x55fb1305fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fb13036d60 0x55fb1305f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fb130be940 0x55fb130c0d60 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 --2- 172.21.15.5:0/296628844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fb13037680 0x55fb1305f9a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f090aff5700 0 client.26198 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 >> 172.21.15.5:0/296628844 conn(0x55fb12fab200 msgr2=0x55fb13048310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.579+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 shutdown_connections 2023-10-08T13:14:24.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.582+0000 7f0939613b80 1 -- 172.21.15.5:0/296628844 wait complete. 2023-10-08T13:14:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.583+0000 7f0939613b80 20 client.26198 trim_cache size 0 max 16384 2023-10-08T13:14:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:14:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:14:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:14:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f09100a15e0 msgr2=0x7f09100a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f09100a15e0 0x7f09100a3aa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0928197ad0 tx=0x7f091c009260 comp rx=0 tx=0).stop 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 msgr2=0x7f092819c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f092819c7e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f091800b580 tx=0x7f091800bfd0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 shutdown_connections 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f09100a15e0 0x7f09100a3aa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0928105660 0x7f0928196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09280ff5a0 0x7f092819c7e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 --2- 172.21.15.5:0/3133880551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09280fff60 0x7f092819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:24.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 >> 172.21.15.5:0/3133880551 conn(0x7f09280fb070 msgr2=0x7f09281063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:24.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 shutdown_connections 2023-10-08T13:14:24.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:24.584+0000 7f092d42a700 1 -- 172.21.15.5:0/3133880551 wait complete. 2023-10-08T13:14:26.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 485.0 s, 558.2 tps, lat 177.414 ms stddev 197.950 2023-10-08T13:14:26.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:26 smithi060 ceph-mon[103190]: pgmap v557: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 8.6 MiB/s wr, 536 op/s 2023-10-08T13:14:26.929 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:26 smithi005 ceph-mon[99496]: pgmap v557: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 8.6 MiB/s wr, 536 op/s 2023-10-08T13:14:27.029 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:26 smithi118 ceph-mon[104234]: pgmap v557: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 8.6 MiB/s wr, 536 op/s 2023-10-08T13:14:28.913 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:28 smithi060 ceph-mon[103190]: pgmap v558: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 8.3 MiB/s wr, 528 op/s 2023-10-08T13:14:28.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:28 smithi005 ceph-mon[99496]: pgmap v558: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 8.3 MiB/s wr, 528 op/s 2023-10-08T13:14:29.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:28 smithi118 ceph-mon[104234]: pgmap v558: 129 pgs: 129 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 8.3 MiB/s wr, 528 op/s 2023-10-08T13:14:30.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:30 smithi060 ceph-mon[103190]: pgmap v559: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 9.0 MiB/s wr, 529 op/s 2023-10-08T13:14:30.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:30 smithi005 ceph-mon[99496]: pgmap v559: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 9.0 MiB/s wr, 529 op/s 2023-10-08T13:14:31.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:30 smithi118 ceph-mon[104234]: pgmap v559: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 9.0 MiB/s wr, 529 op/s 2023-10-08T13:14:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 490.0 s, 532.3 tps, lat 185.171 ms stddev 210.983 2023-10-08T13:14:32.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:32 smithi060 ceph-mon[103190]: pgmap v560: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 8.7 MiB/s wr, 535 op/s 2023-10-08T13:14:32.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:32 smithi005 ceph-mon[99496]: pgmap v560: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 8.7 MiB/s wr, 535 op/s 2023-10-08T13:14:33.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:32 smithi118 ceph-mon[104234]: pgmap v560: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 8.7 MiB/s wr, 535 op/s 2023-10-08T13:14:34.927 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:34 smithi005 ceph-mon[99496]: pgmap v561: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 8.0 MiB/s wr, 526 op/s 2023-10-08T13:14:35.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:34 smithi118 ceph-mon[104234]: pgmap v561: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 8.0 MiB/s wr, 526 op/s 2023-10-08T13:14:35.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:34 smithi060 ceph-mon[103190]: pgmap v561: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 8.0 MiB/s wr, 526 op/s 2023-10-08T13:14:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 495.0 s, 513.7 tps, lat 195.649 ms stddev 226.382 2023-10-08T13:14:36.927 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:36 smithi005 ceph-mon[99496]: pgmap v562: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 8.5 MiB/s wr, 532 op/s 2023-10-08T13:14:37.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:36 smithi118 ceph-mon[104234]: pgmap v562: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 8.5 MiB/s wr, 532 op/s 2023-10-08T13:14:37.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:36 smithi060 ceph-mon[103190]: pgmap v562: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 8.5 MiB/s wr, 532 op/s 2023-10-08T13:14:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.851+0000 7fba41e34700 1 -- 172.21.15.5:0/2978606483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0ff570 msgr2=0x7fba3c0ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.851+0000 7fba41e34700 1 --2- 172.21.15.5:0/2978606483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0ff570 0x7fba3c0ff9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b0a0 tx=0x7fba2c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.859+0000 7fba41e34700 1 -- 172.21.15.5:0/2978606483 shutdown_connections 2023-10-08T13:14:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.859+0000 7fba41e34700 1 --2- 172.21.15.5:0/2978606483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba3c0fff30 0x7fba3c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.859+0000 7fba41e34700 1 --2- 172.21.15.5:0/2978606483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba3c105630 0x7fba3c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.859+0000 7fba41e34700 1 --2- 172.21.15.5:0/2978606483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0ff570 0x7fba3c0ff9f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.859+0000 7fba41e34700 1 -- 172.21.15.5:0/2978606483 >> 172.21.15.5:0/2978606483 conn(0x7fba3c0fb080 msgr2=0x7fba3c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.864+0000 7fba41e34700 1 -- 172.21.15.5:0/2978606483 shutdown_connections 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.864+0000 7fba41e34700 1 -- 172.21.15.5:0/2978606483 wait complete. 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.865+0000 7fba41e34700 1 Processor -- start 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 -- start start 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba3c0ff570 0x7fba3c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 0x7fba3c199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba3c105630 0x7fba3c194ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c1951e0 con 0x7fba3c0ff570 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c195320 con 0x7fba3c105630 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.866+0000 7fba41e34700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c195490 con 0x7fba3c0fff30 2023-10-08T13:14:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.867+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba3c105630 0x7fba3c194ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.867+0000 7fba3affd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 0x7fba3c199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.867+0000 7fba3affd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 0x7fba3c199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50424/0 (socket says 172.21.15.5:50424) 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.867+0000 7fba3affd700 1 -- 172.21.15.5:0/2126422216 learned_addr learned my addr 172.21.15.5:0/2126422216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.869+0000 7fba3affd700 1 -- 172.21.15.5:0/2126422216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba3c105630 msgr2=0x7fba3c194ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.869+0000 7fba3affd700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba3c105630 0x7fba3c194ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.869+0000 7fba3affd700 1 -- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba3c0ff570 msgr2=0x7fba3c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.869+0000 7fba3affd700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba3c0ff570 0x7fba3c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.869+0000 7fba3affd700 1 -- 172.21.15.5:0/2126422216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c009d00 con 0x7fba3c0fff30 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.869+0000 7fba3affd700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 0x7fba3c199d70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b070 tx=0x7fba2c007b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.870+0000 7fba38ff9700 1 -- 172.21.15.5:0/2126422216 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00e040 con 0x7fba3c0fff30 2023-10-08T13:14:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.870+0000 7fba38ff9700 1 -- 172.21.15.5:0/2126422216 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba2c003e10 con 0x7fba3c0fff30 2023-10-08T13:14:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.870+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c195710 con 0x7fba3c0fff30 2023-10-08T13:14:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.870+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c06a210 con 0x7fba3c0fff30 2023-10-08T13:14:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.870+0000 7fba38ff9700 1 -- 172.21.15.5:0/2126422216 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c012c10 con 0x7fba3c0fff30 2023-10-08T13:14:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.873+0000 7fba38ff9700 1 -- 172.21.15.5:0/2126422216 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fba2c01d480 con 0x7fba3c0fff30 2023-10-08T13:14:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.874+0000 7fba38ff9700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fba280a1770 0x7fba280a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.874+0000 7fba38ff9700 1 -- 172.21.15.5:0/2126422216 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fba2c0ce810 con 0x7fba3c0fff30 2023-10-08T13:14:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.874+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fba280a1770 0x7fba280a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 Processor -- start 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 -- start start 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30241d400 con 0x55a3024bb1a0 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30240ebc0 con 0x55a3024ba880 2023-10-08T13:14:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.875+0000 7fba4e01db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30240c4e0 con 0x55a3024b50b0 2023-10-08T13:14:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37226/0 (socket says 172.21.15.5:37226) 2023-10-08T13:14:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 -- 172.21.15.5:0/760582113 learned_addr learned my addr 172.21.15.5:0/760582113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3bfff700 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 -- 172.21.15.5:0/760582113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 msgr2=0x55a3024b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 -- 172.21.15.5:0/760582113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 msgr2=0x55a3024bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3affd700 1 -- 172.21.15.5:0/760582113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a302232d80 con 0x55a3024bb1a0 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.876+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fba280a1770 0x7fba280a3c30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fba34009d60 tx=0x7fba340124f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.877+0000 7fba3affd700 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b4b70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0979f0 tx=0x7fba2c09b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f8806e8f8f5a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.877+0000 7fba31ffb700 1 -- 172.21.15.5:0/760582113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c09bbf0 con 0x55a3024bb1a0 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.877+0000 7fba31ffb700 1 -- 172.21.15.5:0/760582113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba2c09b4f0 con 0x55a3024bb1a0 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.877+0000 7fba31ffb700 1 -- 172.21.15.5:0/760582113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0ce460 con 0x55a3024bb1a0 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.878+0000 7fba4e01db80 1 -- 172.21.15.5:0/760582113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 msgr2=0x55a3024b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.878+0000 7fba4e01db80 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b4b70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0979f0 tx=0x7fba2c09b0b0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.881+0000 7fba4e01db80 1 -- 172.21.15.5:0/760582113 shutdown_connections 2023-10-08T13:14:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.881+0000 7fba4e01db80 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.881+0000 7fba4e01db80 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.881+0000 7fba4e01db80 1 --2- 172.21.15.5:0/760582113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b4b70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.881+0000 7fba4e01db80 1 -- 172.21.15.5:0/760582113 >> 172.21.15.5:0/760582113 conn(0x55a302429200 msgr2=0x55a3024afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.882+0000 7fba4e01db80 1 -- 172.21.15.5:0/760582113 shutdown_connections 2023-10-08T13:14:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.882+0000 7fba4e01db80 1 -- 172.21.15.5:0/760582113 wait complete. 2023-10-08T13:14:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.882+0000 7fba4e01db80 1 -- start start 2023-10-08T13:14:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.882+0000 7fba4e01db80 1 Processor -- start 2023-10-08T13:14:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 0x55a3024be470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024bb1a0 0x55a3024bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a302407dd0 con 0x55a3024ba880 2023-10-08T13:14:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3023a46b0 con 0x55a3024bb1a0 2023-10-08T13:14:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3023a4350 con 0x55a3024b50b0 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba4e01db80 10 client.0 _ll_register_callbacks cb 0x55a3022017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba3affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 0x55a3024be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba3affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 0x55a3024be470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37234/0 (socket says 172.21.15.5:37234) 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.883+0000 7fba3affd700 1 -- 172.21.15.5:0/2753778862 learned_addr learned my addr 172.21.15.5:0/2753778862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba3affd700 1 -- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 msgr2=0x55a3024c1180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba3affd700 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c1180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba3affd700 1 -- 172.21.15.5:0/2753778862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024bb1a0 msgr2=0x55a3024bebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba3affd700 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024bb1a0 0x55a3024bebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba3affd700 1 -- 172.21.15.5:0/2753778862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c06a210 con 0x55a3024ba880 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba3affd700 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 0x55a3024be470 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fba2c09b1f0 tx=0x7fba2c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0641c9ad7b7beb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.884+0000 7fba1affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:14:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba1affd700 1 -- 172.21.15.5:0/2753778862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c09f640 con 0x55a3024ba880 2023-10-08T13:14:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba1affd700 1 -- 172.21.15.5:0/2753778862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fba2c0ce460 con 0x55a3024ba880 2023-10-08T13:14:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3023cfe50 con 0x55a3024ba880 2023-10-08T13:14:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba1affd700 1 -- 172.21.15.5:0/2753778862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba2c0ce620 con 0x55a3024ba880 2023-10-08T13:14:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 10 client.16740 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a30221bc00 con 0x55a3024ba880 2023-10-08T13:14:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba1affd700 1 -- 172.21.15.5:0/2753778862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a3023cfe50 con 0x55a3024ba880 2023-10-08T13:14:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba1affd700 1 -- 172.21.15.5:0/2753778862 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fba2c0a3360 con 0x55a3024ba880 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 10 client.16740 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 20 client.16740 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3024ce630 0x55a3024d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 4 client.16740 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.885+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a302400db0 con 0x55a3024ce630 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.886+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3024ce630 0x55a3024d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.886+0000 7fba1affd700 10 client.16740 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.886+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3024ce630 0x55a3024d0a50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d523f3d902361a7 server_cookie=29dce951a540d44c in_seq=0 out_seq=0 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba1affd700 1 -- 172.21.15.5:0/2753778862 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a302400db0 con 0x55a3024ce630 2023-10-08T13:14:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba1affd700 10 client.16740 handle_command_reply: tid=0 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 client.16740 shutdown 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 msgr2=0x55a3024be470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 0x55a3024be470 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fba2c09b1f0 tx=0x7fba2c0099e0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 shutdown_connections 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3024ce630 0x55a3024d0a50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024bb1a0 0x55a3024bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2753778862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024ba880 0x55a3024be470 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 >> 172.21.15.5:0/2753778862 conn(0x55a302429200 msgr2=0x55a3024af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba1affd700 0 client.16740 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 shutdown_connections 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.887+0000 7fba4e01db80 1 -- 172.21.15.5:0/2753778862 wait complete. 2023-10-08T13:14:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.888+0000 7fba4e01db80 20 client.16740 trim_cache size 0 max 16384 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 Processor -- start 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 -- start start 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024be430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3022888c0 con 0x55a3024bb1a0 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3024ac830 con 0x55a3024ba880 2023-10-08T13:14:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.911+0000 7fba4e01db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3024b1690 con 0x55a3024b50b0 2023-10-08T13:14:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024be430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024be430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60422/0 (socket says 172.21.15.5:60422) 2023-10-08T13:14:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 -- 172.21.15.5:0/2021430890 learned_addr learned my addr 172.21.15.5:0/2021430890 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 -- 172.21.15.5:0/2021430890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 msgr2=0x55a3024b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 -- 172.21.15.5:0/2021430890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 msgr2=0x55a3024c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 -- 172.21.15.5:0/2021430890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3022591f0 con 0x55a3024ba880 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.912+0000 7fba3affd700 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024be430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009fd0 tx=0x7fba2c00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce62d8273d31d476 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.913+0000 7fba327fc700 1 -- 172.21.15.5:0/2021430890 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c09a9e0 con 0x55a3024ba880 2023-10-08T13:14:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.913+0000 7fba327fc700 1 -- 172.21.15.5:0/2021430890 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba2c0a13f0 con 0x55a3024ba880 2023-10-08T13:14:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.913+0000 7fba327fc700 1 -- 172.21.15.5:0/2021430890 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0a1760 con 0x55a3024ba880 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 -- 172.21.15.5:0/2021430890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 msgr2=0x55a3024be430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024be430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009fd0 tx=0x7fba2c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 -- 172.21.15.5:0/2021430890 shutdown_connections 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 --2- 172.21.15.5:0/2021430890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024be430 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 -- 172.21.15.5:0/2021430890 >> 172.21.15.5:0/2021430890 conn(0x55a302429200 msgr2=0x55a3024bd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 -- 172.21.15.5:0/2021430890 shutdown_connections 2023-10-08T13:14:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.914+0000 7fba4e01db80 1 -- 172.21.15.5:0/2021430890 wait complete. 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 -- start start 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 Processor -- start 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3024b6fa0 con 0x55a3024bb1a0 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3024b7110 con 0x55a3024ba880 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3024b72d0 con 0x55a3024b50b0 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba4e01db80 10 client.0 _ll_register_callbacks cb 0x7fba34009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.915+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37248/0 (socket says 172.21.15.5:37248) 2023-10-08T13:14:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 -- 172.21.15.5:0/3579053810 learned_addr learned my addr 172.21.15.5:0/3579053810 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3affd700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 -- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 msgr2=0x55a3024c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 -- 172.21.15.5:0/3579053810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 msgr2=0x55a3024b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 -- 172.21.15.5:0/3579053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3400e040 con 0x55a3024bb1a0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba3bfff700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b68d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fba240149a0 tx=0x7fba240149d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38f5b81a3466ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba1affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba1affd700 1 -- 172.21.15.5:0/3579053810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240097e0 con 0x55a3024bb1a0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba1affd700 1 -- 172.21.15.5:0/3579053810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fba24015630 con 0x55a3024bb1a0 2023-10-08T13:14:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.916+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba2c09b4f0 con 0x55a3024bb1a0 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.917+0000 7fba1affd700 1 -- 172.21.15.5:0/3579053810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba240157f0 con 0x55a3024bb1a0 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.917+0000 7fba4e01db80 10 client.16746 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.917+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a30221bc00 con 0x55a3024bb1a0 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.917+0000 7fba1affd700 1 -- 172.21.15.5:0/3579053810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba2c09b4f0 con 0x55a3024bb1a0 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.917+0000 7fba1affd700 1 -- 172.21.15.5:0/3579053810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fba2401dbc0 con 0x55a3024bb1a0 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba4e01db80 10 client.16746 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba4e01db80 10 client.16746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba4e01db80 20 client.16746 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba4e01db80 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a302522ce0 0x55a302525100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba4e01db80 4 client.16746 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:14:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a302400ad0 con 0x55a302522ce0 2023-10-08T13:14:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a302522ce0 0x55a302525100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba1affd700 10 client.16746 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.918+0000 7fba3b7fe700 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a302522ce0 0x55a302525100 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f805267e543be16 server_cookie=c2a07643deea1223 in_seq=0 out_seq=0 2023-10-08T13:14:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.933+0000 7fba1affd700 1 -- 172.21.15.5:0/3579053810 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a302400ad0 con 0x55a302522ce0 2023-10-08T13:14:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.933+0000 7fba1affd700 10 client.16746 handle_command_reply: tid=0 2023-10-08T13:14:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.935+0000 7fba4e01db80 1 client.16746 shutdown 2023-10-08T13:14:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.939+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 msgr2=0x55a3024b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.939+0000 7fba4e01db80 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b68d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fba240149a0 tx=0x7fba240149d0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 shutdown_connections 2023-10-08T13:14:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba4e01db80 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3024bb1a0 0x55a3024b68d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba4e01db80 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3024b50b0 0x55a3024c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba4e01db80 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a302522ce0 0x55a302525100 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba4e01db80 1 --2- 172.21.15.5:0/3579053810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3024ba880 0x55a3024b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 >> 172.21.15.5:0/3579053810 conn(0x55a302429200 msgr2=0x55a3024bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.949+0000 7fba1affd700 0 client.16746 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.954+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 shutdown_connections 2023-10-08T13:14:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.966+0000 7fba4e01db80 1 -- 172.21.15.5:0/3579053810 wait complete. 2023-10-08T13:14:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:14:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:14:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:14:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:14:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.966+0000 7fba4e01db80 20 client.16746 trim_cache size 0 max 16384 2023-10-08T13:14:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.983+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fba280a1770 msgr2=0x7fba280a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.983+0000 7fba41e34700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fba280a1770 0x7fba280a3c30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fba34009d60 tx=0x7fba340124f0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.983+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 msgr2=0x7fba3c199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.983+0000 7fba41e34700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 0x7fba3c199d70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b070 tx=0x7fba2c007b60 comp rx=0 tx=0).stop 2023-10-08T13:14:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.986+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 shutdown_connections 2023-10-08T13:14:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.986+0000 7fba41e34700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fba280a1770 0x7fba280a3c30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.986+0000 7fba41e34700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba3c105630 0x7fba3c194ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.986+0000 7fba41e34700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba3c0ff570 0x7fba3c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.986+0000 7fba41e34700 1 --2- 172.21.15.5:0/2126422216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba3c0fff30 0x7fba3c199d70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.986+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 >> 172.21.15.5:0/2126422216 conn(0x7fba3c0fb080 msgr2=0x7fba3c0fb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.989+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 shutdown_connections 2023-10-08T13:14:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:37.989+0000 7fba41e34700 1 -- 172.21.15.5:0/2126422216 wait complete. 2023-10-08T13:14:38.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:37 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:14:38.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:37 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:14:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:37 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:14:39.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:38 smithi118 ceph-mon[104234]: pgmap v563: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 7.6 MiB/s wr, 521 op/s 2023-10-08T13:14:39.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:38 smithi060 ceph-mon[103190]: pgmap v563: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 7.6 MiB/s wr, 521 op/s 2023-10-08T13:14:39.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:38 smithi005 ceph-mon[99496]: pgmap v563: 129 pgs: 129 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 7.6 MiB/s wr, 521 op/s 2023-10-08T13:14:40.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:14:40.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:14:40.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:14:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:14:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:14:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:14:40.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:14:40.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:14:40.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:14:41.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:40 smithi118 ceph-mon[104234]: pgmap v564: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 488 op/s 2023-10-08T13:14:41.165 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:40 smithi060 ceph-mon[103190]: pgmap v564: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 488 op/s 2023-10-08T13:14:41.178 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:40 smithi005 ceph-mon[99496]: pgmap v564: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 488 op/s 2023-10-08T13:14:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 500.0 s, 453.6 tps, lat 214.247 ms stddev 257.398 2023-10-08T13:14:42.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:41 smithi060 ceph-mon[103190]: pgmap v565: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 511 op/s 2023-10-08T13:14:42.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:41 smithi005 ceph-mon[99496]: pgmap v565: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 511 op/s 2023-10-08T13:14:42.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:41 smithi118 ceph-mon[104234]: pgmap v565: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 511 op/s 2023-10-08T13:14:45.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:44 smithi118 ceph-mon[104234]: pgmap v566: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 496 op/s 2023-10-08T13:14:45.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:44 smithi060 ceph-mon[103190]: pgmap v566: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 496 op/s 2023-10-08T13:14:45.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:44 smithi005 ceph-mon[99496]: pgmap v566: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 496 op/s 2023-10-08T13:14:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 505.0 s, 484.4 tps, lat 204.785 ms stddev 225.611 2023-10-08T13:14:46.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:46 smithi060 ceph-mon[103190]: pgmap v567: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 488 op/s 2023-10-08T13:14:46.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:46 smithi005 ceph-mon[99496]: pgmap v567: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 488 op/s 2023-10-08T13:14:46.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:14:47.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:46 smithi118 ceph-mon[104234]: pgmap v567: 129 pgs: 129 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 488 op/s 2023-10-08T13:14:47.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.376+0000 7f6fbc523700 1 -- 172.21.15.5:0/3315528364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41077f0 msgr2=0x7f6fb4107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.376+0000 7f6fbc523700 1 --2- 172.21.15.5:0/3315528364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41077f0 0x7f6fb4107c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00098f0 tx=0x7f6fb0009c00 comp rx=0 tx=0).stop 2023-10-08T13:14:47.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.380+0000 7f6fbc523700 1 -- 172.21.15.5:0/3315528364 shutdown_connections 2023-10-08T13:14:47.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.380+0000 7f6fbc523700 1 --2- 172.21.15.5:0/3315528364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb41083a0 0x7f6fb411bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.380+0000 7f6fbc523700 1 --2- 172.21.15.5:0/3315528364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb410edf0 0x7f6fb410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.380+0000 7f6fbc523700 1 --2- 172.21.15.5:0/3315528364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41077f0 0x7f6fb4107c70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.380+0000 7f6fbc523700 1 -- 172.21.15.5:0/3315528364 >> 172.21.15.5:0/3315528364 conn(0x7f6fb406b770 msgr2=0x7f6fb406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.397+0000 7f6fbc523700 1 -- 172.21.15.5:0/3315528364 shutdown_connections 2023-10-08T13:14:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.398+0000 7f6fbc523700 1 -- 172.21.15.5:0/3315528364 wait complete. 2023-10-08T13:14:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.399+0000 7f6fbc523700 1 Processor -- start 2023-10-08T13:14:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 -- start start 2023-10-08T13:14:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb41077f0 0x7f6fb411b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 0x7f6fb411be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb410edf0 0x7f6fb4114a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4115220 con 0x7f6fb410edf0 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4115390 con 0x7f6fb41083a0 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fbc523700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4115550 con 0x7f6fb41077f0 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fb9abe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 0x7f6fb411be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fb9abe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 0x7f6fb411be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60442/0 (socket says 172.21.15.5:60442) 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.400+0000 7f6fb9abe700 1 -- 172.21.15.5:0/969948137 learned_addr learned my addr 172.21.15.5:0/969948137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fb9abe700 1 -- 172.21.15.5:0/969948137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb41077f0 msgr2=0x7f6fb411b8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb41077f0 0x7f6fb411b8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fb9abe700 1 -- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb410edf0 msgr2=0x7f6fb4114a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb410edf0 0x7f6fb4114a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fb9abe700 1 -- 172.21.15.5:0/969948137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0009520 con 0x7f6fb41083a0 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 0x7f6fb411be30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0005d90 tx=0x7f6fb000b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fab7fe700 1 -- 172.21.15.5:0/969948137 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb001c070 con 0x7f6fb41083a0 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fab7fe700 1 -- 172.21.15.5:0/969948137 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fb0005500 con 0x7f6fb41083a0 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.401+0000 7f6fab7fe700 1 -- 172.21.15.5:0/969948137 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0004af0 con 0x7f6fb41083a0 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.402+0000 7f6fbc523700 1 -- 172.21.15.5:0/969948137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb41157d0 con 0x7f6fb41083a0 2023-10-08T13:14:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.402+0000 7f6fbc523700 1 -- 172.21.15.5:0/969948137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb41196e0 con 0x7f6fb41083a0 2023-10-08T13:14:47.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.406+0000 7f6fc870cb80 1 Processor -- start 2023-10-08T13:14:47.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.408+0000 7f6fab7fe700 1 -- 172.21.15.5:0/969948137 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6fb0004cf0 con 0x7f6fb41083a0 2023-10-08T13:14:47.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.409+0000 7f6fab7fe700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6fa00a16b0 0x7f6fa00a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.409+0000 7f6fab7fe700 1 -- 172.21.15.5:0/969948137 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6fb00ce1f0 con 0x7f6fb41083a0 2023-10-08T13:14:47.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.409+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6fa00a16b0 0x7f6fa00a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.409+0000 7f6fc870cb80 1 -- start start 2023-10-08T13:14:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8ca3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8c0c460 con 0x561df8cae880 2023-10-08T13:14:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8bfdc20 con 0x561df8ca39c0 2023-10-08T13:14:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8bfb540 con 0x561df8ca30a0 2023-10-08T13:14:47.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fb9abe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fb9abe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60450/0 (socket says 172.21.15.5:60450) 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fb9abe700 1 -- 172.21.15.5:0/639912916 learned_addr learned my addr 172.21.15.5:0/639912916 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.410+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6fa00a16b0 0x7f6fa00a3b70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6fb41087d0 tx=0x7f6fac00b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.411+0000 7f6fbaac0700 1 -- 172.21.15.5:0/639912916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 msgr2=0x561df8ca3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.411+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8ca3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.411+0000 7f6fbaac0700 1 -- 172.21.15.5:0/639912916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 msgr2=0x561df8cae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.411+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.411+0000 7f6fbaac0700 1 -- 172.21.15.5:0/639912916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561df8a21de0 con 0x561df8cae880 2023-10-08T13:14:47.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.411+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00ea70 tx=0x7f6fac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785972e18fa65d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:47.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.412+0000 7f6fbc523700 1 -- 172.21.15.5:0/639912916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00ee70 con 0x561df8cae880 2023-10-08T13:14:47.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.412+0000 7f6fbc523700 1 -- 172.21.15.5:0/639912916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fac00f040 con 0x561df8cae880 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.412+0000 7f6fbc523700 1 -- 172.21.15.5:0/639912916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac01e640 con 0x561df8cae880 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 -- 172.21.15.5:0/639912916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 msgr2=0x561df8cb0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00ea70 tx=0x7f6fac011000 comp rx=0 tx=0).stop 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 -- 172.21.15.5:0/639912916 shutdown_connections 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8ca3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/639912916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.413+0000 7f6fc870cb80 1 -- 172.21.15.5:0/639912916 >> 172.21.15.5:0/639912916 conn(0x561df8c18260 msgr2=0x561df8c9f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:47.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.414+0000 7f6fc870cb80 1 -- 172.21.15.5:0/639912916 shutdown_connections 2023-10-08T13:14:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.414+0000 7f6fc870cb80 1 -- 172.21.15.5:0/639912916 wait complete. 2023-10-08T13:14:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.414+0000 7f6fc870cb80 1 -- start start 2023-10-08T13:14:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.414+0000 7f6fc870cb80 1 Processor -- start 2023-10-08T13:14:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca39c0 0x561df8cabc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8cae880 0x561df8cac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8bf6e30 con 0x561df8ca39c0 2023-10-08T13:14:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8b93710 con 0x561df8cae880 2023-10-08T13:14:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8b933b0 con 0x561df8ca30a0 2023-10-08T13:14:47.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fc870cb80 10 client.0 _ll_register_callbacks cb 0x561df89f0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:47.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fba2bf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fbaac0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8cae880 0x561df8cac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fba2bf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50478/0 (socket says 172.21.15.5:50478) 2023-10-08T13:14:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.415+0000 7f6fba2bf700 1 -- 172.21.15.5:0/3253201534 learned_addr learned my addr 172.21.15.5:0/3253201534 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.418+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca39c0 0x561df8cabc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.418+0000 7f6fb9abe700 1 -- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 msgr2=0x561df8cab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.418+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.418+0000 7f6fb9abe700 1 -- 172.21.15.5:0/3253201534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8cae880 msgr2=0x561df8cac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:47.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.418+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8cae880 0x561df8cac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.418+0000 7f6fb9abe700 1 -- 172.21.15.5:0/3253201534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac01a040 con 0x561df8ca39c0 2023-10-08T13:14:47.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.419+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca39c0 0x561df8cabc70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009810 tx=0x7f6fb00972e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e3700a401584bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:47.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.419+0000 7f6f9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:14:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.419+0000 7f6f9dffb700 1 -- 172.21.15.5:0/3253201534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb009ae70 con 0x561df8ca39c0 2023-10-08T13:14:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.419+0000 7f6f9dffb700 1 -- 172.21.15.5:0/3253201534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6fb009efc0 con 0x561df8ca39c0 2023-10-08T13:14:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.425+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561df8bbeeb0 con 0x561df8ca39c0 2023-10-08T13:14:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.425+0000 7f6f9dffb700 1 -- 172.21.15.5:0/3253201534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb00a3170 con 0x561df8ca39c0 2023-10-08T13:14:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.425+0000 7f6fc870cb80 10 client.16755 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.425+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561df8a0ac60 con 0x561df8ca39c0 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6f9dffb700 1 -- 172.21.15.5:0/3253201534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561df8bbeeb0 con 0x561df8ca39c0 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6f9dffb700 1 -- 172.21.15.5:0/3253201534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6fb009b1b0 con 0x561df8ca39c0 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fc870cb80 10 client.16755 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fc870cb80 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fc870cb80 20 client.16755 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8cbdf90 0x561df8cc03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fc870cb80 4 client.16755 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561df8befe10 con 0x561df8cbdf90 2023-10-08T13:14:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.426+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8cbdf90 0x561df8cc03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.427+0000 7f6f9dffb700 10 client.16755 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.427+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8cbdf90 0x561df8cc03b0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=692913a56aef1274 server_cookie=5a601a63cd4a3035 in_seq=0 out_seq=0 2023-10-08T13:14:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6f9dffb700 1 -- 172.21.15.5:0/3253201534 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561df8befe10 con 0x561df8cbdf90 2023-10-08T13:14:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6f9dffb700 10 client.16755 handle_command_reply: tid=0 2023-10-08T13:14:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 client.16755 shutdown 2023-10-08T13:14:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca39c0 msgr2=0x561df8cabc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca39c0 0x561df8cabc70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009810 tx=0x7f6fb00972e0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 shutdown_connections 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8cbdf90 0x561df8cc03b0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8cae880 0x561df8cac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/3253201534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca39c0 0x561df8cabc70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 >> 172.21.15.5:0/3253201534 conn(0x561df8c18260 msgr2=0x561df8ca5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6f9dffb700 0 client.16755 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 shutdown_connections 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 1 -- 172.21.15.5:0/3253201534 wait complete. 2023-10-08T13:14:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.428+0000 7f6fc870cb80 20 client.16755 trim_cache size 0 max 16384 2023-10-08T13:14:47.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.465+0000 7f6fc870cb80 1 Processor -- start 2023-10-08T13:14:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 -- start start 2023-10-08T13:14:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 0x561df8cb2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8caa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8cae880 0x561df8caa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8a77920 con 0x561df8ca30a0 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8cae700 con 0x561df8ca39c0 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.482+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8c9bae0 con 0x561df8cae880 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.483+0000 7f6fba2bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 0x561df8cb2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.483+0000 7f6fba2bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 0x561df8cb2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37284/0 (socket says 172.21.15.5:37284) 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.483+0000 7f6fba2bf700 1 -- 172.21.15.5:0/2616931670 learned_addr learned my addr 172.21.15.5:0/2616931670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.483+0000 7f6fb9abe700 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8caa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.496+0000 7f6fba2bf700 1 -- 172.21.15.5:0/2616931670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8cae880 msgr2=0x561df8caa540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.496+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8cae880 0x561df8caa540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.496+0000 7f6fba2bf700 1 -- 172.21.15.5:0/2616931670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 msgr2=0x561df8caa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.496+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8caa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.496+0000 7f6fba2bf700 1 -- 172.21.15.5:0/2616931670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561df8a48250 con 0x561df8ca30a0 2023-10-08T13:14:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.499+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 0x561df8cb2c90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4005b50 tx=0x7f6fa40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcb09337668626d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.499+0000 7f6fa8ff9700 1 -- 172.21.15.5:0/2616931670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4016040 con 0x561df8ca30a0 2023-10-08T13:14:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.499+0000 7f6fa8ff9700 1 -- 172.21.15.5:0/2616931670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fa4018570 con 0x561df8ca30a0 2023-10-08T13:14:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.499+0000 7f6fa8ff9700 1 -- 172.21.15.5:0/2616931670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4018a70 con 0x561df8ca30a0 2023-10-08T13:14:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.500+0000 7f6fc870cb80 1 -- 172.21.15.5:0/2616931670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 msgr2=0x561df8cb2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.500+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 0x561df8cb2c90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4005b50 tx=0x7f6fa40095c0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 -- 172.21.15.5:0/2616931670 shutdown_connections 2023-10-08T13:14:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8cae880 0x561df8caa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8ca30a0 0x561df8cb2c90 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/2616931670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8caa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 -- 172.21.15.5:0/2616931670 >> 172.21.15.5:0/2616931670 conn(0x561df8c18260 msgr2=0x561df8ca6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 -- 172.21.15.5:0/2616931670 shutdown_connections 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 -- 172.21.15.5:0/2616931670 wait complete. 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 -- start start 2023-10-08T13:14:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.501+0000 7f6fc870cb80 1 Processor -- start 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cb2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cb2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8cb1370 con 0x561df8cae880 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8cb14e0 con 0x561df8ca39c0 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df8cb16a0 con 0x561df8ca30a0 2023-10-08T13:14:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fc870cb80 10 client.0 _ll_register_callbacks cb 0x7f6fb009ad10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fbaac0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fbaac0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37286/0 (socket says 172.21.15.5:37286) 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.502+0000 7f6fbaac0700 1 -- 172.21.15.5:0/1854509234 learned_addr learned my addr 172.21.15.5:0/1854509234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6fbaac0700 1 -- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 msgr2=0x561df8cb2670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cb2670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6fbaac0700 1 -- 172.21.15.5:0/1854509234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 msgr2=0x561df8cb2bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cb2bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6fbaac0700 1 -- 172.21.15.5:0/1854509234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa4009950 con 0x561df8cae880 2023-10-08T13:14:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6fbaac0700 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00ea70 tx=0x7f6fac020710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8313143026dab7de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6f9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:14:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.503+0000 7f6f9dffb700 1 -- 172.21.15.5:0/1854509234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac020b40 con 0x561df8cae880 2023-10-08T13:14:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.504+0000 7f6f9dffb700 1 -- 172.21.15.5:0/1854509234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6fac020ca0 con 0x561df8cae880 2023-10-08T13:14:47.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.504+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fac00f040 con 0x561df8cae880 2023-10-08T13:14:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.510+0000 7f6f9dffb700 1 -- 172.21.15.5:0/1854509234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fac020e60 con 0x561df8cae880 2023-10-08T13:14:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.510+0000 7f6fc870cb80 10 client.16761 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.510+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561df8a202b0 con 0x561df8cae880 2023-10-08T13:14:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6f9dffb700 1 -- 172.21.15.5:0/1854509234 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fac00f040 con 0x561df8cae880 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6f9dffb700 1 -- 172.21.15.5:0/1854509234 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6fac029490 con 0x561df8cae880 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fc870cb80 10 client.16761 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fc870cb80 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fc870cb80 20 client.16761 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8d12f80 0x561df8d153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fc870cb80 4 client.16761 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561df8befb30 con 0x561df8d12f80 2023-10-08T13:14:47.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.511+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8d12f80 0x561df8d153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.512+0000 7f6fba2bf700 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8d12f80 0x561df8d153e0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704360f96e1b7005 server_cookie=5066abb0478a4b97 in_seq=0 out_seq=0 2023-10-08T13:14:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.512+0000 7f6f9dffb700 10 client.16761 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.517+0000 7f6f9dffb700 1 -- 172.21.15.5:0/1854509234 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561df8befb30 con 0x561df8d12f80 2023-10-08T13:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.517+0000 7f6f9dffb700 10 client.16761 handle_command_reply: tid=0 2023-10-08T13:14:47.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.521+0000 7f6fc870cb80 1 client.16761 shutdown 2023-10-08T13:14:47.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.527+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 msgr2=0x561df8cb0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.527+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00ea70 tx=0x7f6fac020710 comp rx=0 tx=0).stop 2023-10-08T13:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.538+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 shutdown_connections 2023-10-08T13:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.538+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561df8cae880 0x561df8cb0c90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.538+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561df8ca30a0 0x561df8cb2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.538+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561df8d12f80 0x561df8d153e0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.538+0000 7f6fc870cb80 1 --2- 172.21.15.5:0/1854509234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561df8ca39c0 0x561df8cb2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.538+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 >> 172.21.15.5:0/1854509234 conn(0x561df8c18260 msgr2=0x561df8c9efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.541+0000 7f6f9dffb700 0 client.16761 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:47.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.548+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 shutdown_connections 2023-10-08T13:14:47.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.550+0000 7f6fc870cb80 1 -- 172.21.15.5:0/1854509234 wait complete. 2023-10-08T13:14:47.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.550+0000 7f6fc870cb80 20 client.16761 trim_cache size 0 max 16384 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:14:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:14:47.557 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:14:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 -- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6fa00a16b0 msgr2=0x7f6fa00a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6fa00a16b0 0x7f6fa00a3b70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6fb41087d0 tx=0x7f6fac00b040 comp rx=0 tx=0).stop 2023-10-08T13:14:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 -- 172.21.15.5:0/969948137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 msgr2=0x7f6fb411be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 0x7f6fb411be30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0005d90 tx=0x7f6fb000b560 comp rx=0 tx=0).stop 2023-10-08T13:14:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 -- 172.21.15.5:0/969948137 shutdown_connections 2023-10-08T13:14:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6fa00a16b0 0x7f6fa00a3b70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb410edf0 0x7f6fb4114a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fb41077f0 0x7f6fb411b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 --2- 172.21.15.5:0/969948137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fb41083a0 0x7f6fb411be30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.561+0000 7f6fa97fa700 1 -- 172.21.15.5:0/969948137 >> 172.21.15.5:0/969948137 conn(0x7f6fb406b770 msgr2=0x7f6fb406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.576+0000 7f6fa97fa700 1 -- 172.21.15.5:0/969948137 shutdown_connections 2023-10-08T13:14:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:14:47.578+0000 7f6fa97fa700 1 -- 172.21.15.5:0/969948137 wait complete. 2023-10-08T13:14:47.602 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:14:48.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:48 smithi060 ceph-mon[103190]: pgmap v568: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 489 op/s 2023-10-08T13:14:48.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:48 smithi005 ceph-mon[99496]: pgmap v568: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 489 op/s 2023-10-08T13:14:49.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:48 smithi118 ceph-mon[104234]: pgmap v568: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 489 op/s 2023-10-08T13:14:50.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:50 smithi005 ceph-mon[99496]: pgmap v569: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 439 op/s 2023-10-08T13:14:51.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:50 smithi118 ceph-mon[104234]: pgmap v569: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 439 op/s 2023-10-08T13:14:51.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:50 smithi060 ceph-mon[103190]: pgmap v569: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 439 op/s 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.190+0000 7f01d8460700 1 -- 172.21.15.5:0/3349931517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010f310 msgr2=0x7f01d0107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.190+0000 7f01d8460700 1 --2- 172.21.15.5:0/3349931517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010f310 0x7f01d0107d30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0099c0 tx=0x7f01cc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.191+0000 7f01d8460700 1 -- 172.21.15.5:0/3349931517 shutdown_connections 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.191+0000 7f01d8460700 1 --2- 172.21.15.5:0/3349931517 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.191+0000 7f01d8460700 1 --2- 172.21.15.5:0/3349931517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010eea0 0x7f01d01077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.191+0000 7f01d8460700 1 --2- 172.21.15.5:0/3349931517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010f310 0x7f01d0107d30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.191+0000 7f01d8460700 1 -- 172.21.15.5:0/3349931517 >> 172.21.15.5:0/3349931517 conn(0x7f01d006b7c0 msgr2=0x7f01d006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.192+0000 7f01d8460700 1 -- 172.21.15.5:0/3349931517 shutdown_connections 2023-10-08T13:14:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.192+0000 7f01d8460700 1 -- 172.21.15.5:0/3349931517 wait complete. 2023-10-08T13:14:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 Processor -- start 2023-10-08T13:14:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 -- start start 2023-10-08T13:14:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010eea0 0x7f01d01ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010f310 0x7f01d01abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d01a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01a5db0 con 0x7f01d010eea0 2023-10-08T13:14:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01a5f20 con 0x7f01d010f310 2023-10-08T13:14:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d8460700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d01a60e0 con 0x7f01d0119fd0 2023-10-08T13:14:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.193+0000 7f01d69fd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d01a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d01a5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50502/0 (socket says 172.21.15.5:50502) 2023-10-08T13:14:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 -- 172.21.15.5:0/3651687495 learned_addr learned my addr 172.21.15.5:0/3651687495 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d61fc700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010eea0 0x7f01d01ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d59fb700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010f310 0x7f01d01abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 -- 172.21.15.5:0/3651687495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010f310 msgr2=0x7f01d01abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010f310 0x7f01d01abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 -- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010eea0 msgr2=0x7f01d01ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010eea0 0x7f01d01ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 -- 172.21.15.5:0/3651687495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0095f0 con 0x7f01d0119fd0 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d59fb700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010f310 0x7f01d01abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d61fc700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010eea0 0x7f01d01ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01d69fd700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d01a5750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01c000b550 tx=0x7f01c000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.194+0000 7f01c77fe700 1 -- 172.21.15.5:0/3651687495 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0011830 con 0x7f01d0119fd0 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.195+0000 7f01c77fe700 1 -- 172.21.15.5:0/3651687495 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01c0011e50 con 0x7f01d0119fd0 2023-10-08T13:14:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.195+0000 7f01c77fe700 1 -- 172.21.15.5:0/3651687495 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0010e70 con 0x7f01d0119fd0 2023-10-08T13:14:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.195+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d01a63c0 con 0x7f01d0119fd0 2023-10-08T13:14:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.195+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d01b2610 con 0x7f01d0119fd0 2023-10-08T13:14:51.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.199+0000 7f01e4649b80 1 Processor -- start 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.199+0000 7f01e4649b80 1 -- start start 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.199+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070823880 0x55b070823c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b07081e0b0 0x55b07081e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01e4649b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070786400 con 0x55b070823880 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01e4649b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070777bc0 con 0x55b07081e0b0 2023-10-08T13:14:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01e4649b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0707754e0 con 0x55b0708241a0 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50506/0 (socket says 172.21.15.5:50506) 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 -- 172.21.15.5:0/272353867 learned_addr learned my addr 172.21.15.5:0/272353867 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 -- 172.21.15.5:0/272353867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b07081e0b0 msgr2=0x55b07081e510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b07081e0b0 0x55b07081e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 -- 172.21.15.5:0/272353867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070823880 msgr2=0x55b070823c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:14:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070823880 0x55b070823c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.200+0000 7f01d61fc700 1 -- 172.21.15.5:0/272353867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b07059bd80 con 0x55b0708241a0 2023-10-08T13:14:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.204+0000 7f01d61fc700 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009f70 tx=0x7f01c80077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a2f5a558ceba2ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.207+0000 7f01c4d82700 1 -- 172.21.15.5:0/272353867 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8013780 con 0x55b0708241a0 2023-10-08T13:14:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.207+0000 7f01c4d82700 1 -- 172.21.15.5:0/272353867 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01c800f050 con 0x55b0708241a0 2023-10-08T13:14:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.207+0000 7f01c4d82700 1 -- 172.21.15.5:0/272353867 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8014cd0 con 0x55b0708241a0 2023-10-08T13:14:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.208+0000 7f01e4649b80 1 -- 172.21.15.5:0/272353867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 msgr2=0x55b07081db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.208+0000 7f01e4649b80 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009f70 tx=0x7f01c80077e0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.209+0000 7f01c77fe700 1 -- 172.21.15.5:0/3651687495 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f01c0010510 con 0x7f01d0119fd0 2023-10-08T13:14:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.209+0000 7f01c77fe700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01bc0a16e0 0x7f01bc0a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01c77fe700 1 -- 172.21.15.5:0/3651687495 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f01c00cce90 con 0x7f01d0119fd0 2023-10-08T13:14:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01e4649b80 1 -- 172.21.15.5:0/272353867 shutdown_connections 2023-10-08T13:14:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01e4649b80 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b07081e0b0 0x55b07081e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01e4649b80 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070823880 0x55b070823c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01e4649b80 1 --2- 172.21.15.5:0/272353867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01e4649b80 1 -- 172.21.15.5:0/272353867 >> 172.21.15.5:0/272353867 conn(0x55b070792200 msgr2=0x55b070818b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.210+0000 7f01d59fb700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01bc0a16e0 0x7f01bc0a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.211+0000 7f01d59fb700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01bc0a16e0 0x7f01bc0a3ba0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55b07081ea70 tx=0x7f01cc005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.212+0000 7f01e4649b80 1 -- 172.21.15.5:0/272353867 shutdown_connections 2023-10-08T13:14:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.212+0000 7f01e4649b80 1 -- 172.21.15.5:0/272353867 wait complete. 2023-10-08T13:14:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.212+0000 7f01e4649b80 1 -- start start 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.212+0000 7f01e4649b80 1 Processor -- start 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 0x55b070827820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070827d60 0x55b0708281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070842cc0 0x55b0708450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070770dd0 con 0x55b0708241a0 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07070d6b0 con 0x55b070827d60 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07070d350 con 0x55b070842cc0 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01e4649b80 10 client.0 _ll_register_callbacks cb 0x55b07056a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 0x55b070827820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 0x55b070827820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37306/0 (socket says 172.21.15.5:37306) 2023-10-08T13:14:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 -- 172.21.15.5:0/1867333694 learned_addr learned my addr 172.21.15.5:0/1867333694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070827d60 0x55b0708281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d69fd700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070842cc0 0x55b0708450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 -- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070842cc0 msgr2=0x55b0708450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070842cc0 0x55b0708450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 -- 172.21.15.5:0/1867333694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070827d60 msgr2=0x55b0708281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070827d60 0x55b0708281e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.213+0000 7f01d61fc700 1 -- 172.21.15.5:0/1867333694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8009bd0 con 0x55b0708241a0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01d61fc700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 0x55b070827820 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f01c8006040 tx=0x7f01c80148b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60be6b906817731a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01b9ffb700 1 -- 172.21.15.5:0/1867333694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8003c00 con 0x55b0708241a0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b070738e50 con 0x55b0708241a0 2023-10-08T13:14:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01b9ffb700 1 -- 172.21.15.5:0/1867333694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f01c8003d60 con 0x55b0708241a0 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01b9ffb700 1 -- 172.21.15.5:0/1867333694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01c8014670 con 0x55b0708241a0 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01e4649b80 10 client.16770 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55b070584c00 con 0x55b0708241a0 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.214+0000 7f01b9ffb700 1 -- 172.21.15.5:0/1867333694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b070738e50 con 0x55b0708241a0 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01b9ffb700 1 -- 172.21.15.5:0/1867333694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01c80041b0 con 0x55b0708241a0 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01e4649b80 10 client.16770 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01e4649b80 10 client.16770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01e4649b80 20 client.16770 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b07082d9d0 0x55b07082fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01e4649b80 4 client.16770 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b070769db0 con 0x55b07082d9d0 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b07082d9d0 0x55b07082fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01b9ffb700 10 client.16770 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.215+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b07082d9d0 0x55b07082fdf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9078e8c82214018c server_cookie=cbbd586a48fd2e1d in_seq=0 out_seq=0 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.216+0000 7f01b9ffb700 1 -- 172.21.15.5:0/1867333694 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b070769db0 con 0x55b07082d9d0 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.216+0000 7f01b9ffb700 10 client.16770 handle_command_reply: tid=0 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.216+0000 7f01e4649b80 1 client.16770 shutdown 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 msgr2=0x55b070827820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 0x55b070827820 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f01c8006040 tx=0x7f01c80148b0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 shutdown_connections 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070842cc0 0x55b0708450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0708241a0 0x55b070827820 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b07082d9d0 0x55b07082fdf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1867333694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070827d60 0x55b0708281e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01b9ffb700 0 client.16770 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.217+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 >> 172.21.15.5:0/1867333694 conn(0x55b070792200 msgr2=0x55b070818010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.220+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 shutdown_connections 2023-10-08T13:14:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.220+0000 7f01e4649b80 1 -- 172.21.15.5:0/1867333694 wait complete. 2023-10-08T13:14:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.221+0000 7f01e4649b80 20 client.16770 trim_cache size 0 max 16384 2023-10-08T13:14:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.248+0000 7f01e4649b80 1 Processor -- start 2023-10-08T13:14:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.248+0000 7f01e4649b80 1 -- start start 2023-10-08T13:14:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070827d60 0x55b0708456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070842cc0 0x55b07083fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01e4649b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0705f18c0 con 0x55b070827d60 2023-10-08T13:14:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01e4649b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070840150 con 0x55b070842cc0 2023-10-08T13:14:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01e4649b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070822440 con 0x55b0708241a0 2023-10-08T13:14:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50520/0 (socket says 172.21.15.5:50520) 2023-10-08T13:14:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d61fc700 1 -- 172.21.15.5:0/1980059540 learned_addr learned my addr 172.21.15.5:0/1980059540 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070827d60 0x55b0708456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d69fd700 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070842cc0 0x55b07083fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d59fb700 1 -- 172.21.15.5:0/1980059540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 msgr2=0x55b07081db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d59fb700 1 -- 172.21.15.5:0/1980059540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070842cc0 msgr2=0x55b07083fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070842cc0 0x55b07083fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d59fb700 1 -- 172.21.15.5:0/1980059540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0705c21f0 con 0x55b070827d60 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.249+0000 7f01d61fc700 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.250+0000 7f01d59fb700 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070827d60 0x55b0708456e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f01d01a6e60 tx=0x7f01cc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55436167a0537c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.250+0000 7f01c5583700 1 -- 172.21.15.5:0/1980059540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0314e0 con 0x55b070827d60 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.250+0000 7f01c5583700 1 -- 172.21.15.5:0/1980059540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01cc01d040 con 0x55b070827d60 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.250+0000 7f01c5583700 1 -- 172.21.15.5:0/1980059540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00b9f0 con 0x55b070827d60 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 -- 172.21.15.5:0/1980059540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070827d60 msgr2=0x55b0708456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070827d60 0x55b0708456e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f01d01a6e60 tx=0x7f01cc01e000 comp rx=0 tx=0).stop 2023-10-08T13:14:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 -- 172.21.15.5:0/1980059540 shutdown_connections 2023-10-08T13:14:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b070842cc0 0x55b07083fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0708241a0 0x55b07081db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 --2- 172.21.15.5:0/1980059540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070827d60 0x55b0708456e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 -- 172.21.15.5:0/1980059540 >> 172.21.15.5:0/1980059540 conn(0x55b070792200 msgr2=0x55b070834730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 -- 172.21.15.5:0/1980059540 shutdown_connections 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 -- 172.21.15.5:0/1980059540 wait complete. 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 -- start start 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.251+0000 7f01e4649b80 1 Processor -- start 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 0x55b0708664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070827d60 0x55b070866a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070842cc0 0x55b070866f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070867570 con 0x55b070842cc0 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0708676b0 con 0x55b0708241a0 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b070867870 con 0x55b070827d60 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01e4649b80 10 client.0 _ll_register_callbacks cb 0x7f01c8009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d69fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070842cc0 0x55b070866f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 0x55b0708664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 0x55b0708664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60502/0 (socket says 172.21.15.5:60502) 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d69fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070842cc0 0x55b070866f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37322/0 (socket says 172.21.15.5:37322) 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 -- 172.21.15.5:0/2525094261 learned_addr learned my addr 172.21.15.5:0/2525094261 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:14:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d59fb700 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070827d60 0x55b070866a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 -- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070827d60 msgr2=0x55b070866a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070827d60 0x55b070866a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 -- 172.21.15.5:0/2525094261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070842cc0 msgr2=0x55b070866f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070842cc0 0x55b070866f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.252+0000 7f01d61fc700 1 -- 172.21.15.5:0/2525094261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b070584c00 con 0x55b0708241a0 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01d61fc700 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 0x55b0708664d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009f70 tx=0x7f01c8007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1fd43268ccf584 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01b9ffb700 1 -- 172.21.15.5:0/2525094261 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8013ba0 con 0x55b0708241a0 2023-10-08T13:14:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01c800f050 con 0x55b0708241a0 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01b9ffb700 1 -- 172.21.15.5:0/2525094261 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f01c8013d00 con 0x55b0708241a0 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01b9ffb700 1 -- 172.21.15.5:0/2525094261 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01c80146a0 con 0x55b0708241a0 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 10 client.26234 fetch_fsmap learned FSMap version 51 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f01d011cbd0 con 0x55b0708241a0 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01b9ffb700 1 -- 172.21.15.5:0/2525094261 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01c803d080 con 0x55b0708241a0 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01b9ffb700 1 -- 172.21.15.5:0/2525094261 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01c8025430 con 0x55b0708241a0 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 10 client.26234 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 10 client.26234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:14:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 20 client.26234 populate_metadata read hostname 'smithi005' 2023-10-08T13:14:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0708d0e80 0x55b0708d3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:14:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 4 client.26234 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:14:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.253+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b070769ad0 con 0x55b0708d0e80 2023-10-08T13:14:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.254+0000 7f01d59fb700 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0708d0e80 0x55b0708d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:14:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.255+0000 7f01b9ffb700 10 client.26234 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.255+0000 7f01d59fb700 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0708d0e80 0x55b0708d3270 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bc3f9cdef92642 server_cookie=dc35e838bd6dbdd9 in_seq=0 out_seq=0 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.262+0000 7f01b9ffb700 1 -- 172.21.15.5:0/2525094261 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b070769ad0 con 0x55b0708d0e80 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.262+0000 7f01b9ffb700 10 client.26234 handle_command_reply: tid=0 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.262+0000 7f01e4649b80 1 client.26234 shutdown 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 msgr2=0x55b0708664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 0x55b0708664d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009f70 tx=0x7f01c8007d20 comp rx=0 tx=0).stop 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 shutdown_connections 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b070842cc0 0x55b070866f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0708d0e80 0x55b0708d3270 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0708241a0 0x55b0708664d0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009f70 tx=0x7f01c8007d20 comp rx=0 tx=0).stop 2023-10-08T13:14:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 --2- 172.21.15.5:0/2525094261 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b070827d60 0x55b070866a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 >> 172.21.15.5:0/2525094261 conn(0x55b070792200 msgr2=0x55b0708228f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01b9ffb700 0 client.26234 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 shutdown_connections 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.263+0000 7f01e4649b80 1 -- 172.21.15.5:0/2525094261 wait complete. 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.264+0000 7f01e4649b80 20 client.26234 trim_cache size 0 max 16384 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:14:51.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:14:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:14:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:14:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.264+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01bc0a16e0 msgr2=0x7f01bc0a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.264+0000 7f01d8460700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01bc0a16e0 0x7f01bc0a3ba0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55b07081ea70 tx=0x7f01cc005fd0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.264+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 msgr2=0x7f01d01a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.264+0000 7f01d8460700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d01a5750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01c000b550 tx=0x7f01c000b910 comp rx=0 tx=0).stop 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 shutdown_connections 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01bc0a16e0 0x7f01bc0a3ba0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f01d0119fd0 0x7f01d01a5750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d010eea0 0x7f01d01ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 --2- 172.21.15.5:0/3651687495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01d010f310 0x7f01d01abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:14:51.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 >> 172.21.15.5:0/3651687495 conn(0x7f01d006b7c0 msgr2=0x7f01d0117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:14:51.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 shutdown_connections 2023-10-08T13:14:51.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:14:51.265+0000 7f01d8460700 1 -- 172.21.15.5:0/3651687495 wait complete. 2023-10-08T13:14:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 510.0 s, 523.4 tps, lat 199.510 ms stddev 212.914 2023-10-08T13:14:52.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:52 smithi005 ceph-mon[99496]: pgmap v570: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.0 MiB/s wr, 514 op/s 2023-10-08T13:14:53.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:52 smithi118 ceph-mon[104234]: pgmap v570: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.0 MiB/s wr, 514 op/s 2023-10-08T13:14:53.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:52 smithi060 ceph-mon[103190]: pgmap v570: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.0 MiB/s wr, 514 op/s 2023-10-08T13:14:54.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:54 smithi005 ceph-mon[99496]: pgmap v571: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 496 op/s 2023-10-08T13:14:55.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:54 smithi118 ceph-mon[104234]: pgmap v571: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 496 op/s 2023-10-08T13:14:55.169 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:54 smithi060 ceph-mon[103190]: pgmap v571: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 496 op/s 2023-10-08T13:14:56.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 515.0 s, 502.7 tps, lat 199.652 ms stddev 229.971 2023-10-08T13:14:56.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:56 smithi060 ceph-mon[103190]: pgmap v572: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 486 op/s 2023-10-08T13:14:56.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:56 smithi005 ceph-mon[99496]: pgmap v572: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 486 op/s 2023-10-08T13:14:57.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:56 smithi118 ceph-mon[104234]: pgmap v572: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 486 op/s 2023-10-08T13:14:58.924 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:14:58 smithi005 ceph-mon[99496]: pgmap v573: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 457 op/s 2023-10-08T13:14:59.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:14:58 smithi118 ceph-mon[104234]: pgmap v573: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 457 op/s 2023-10-08T13:14:59.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:14:58 smithi060 ceph-mon[103190]: pgmap v573: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 457 op/s 2023-10-08T13:15:01.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:00 smithi118 ceph-mon[104234]: pgmap v574: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 481 op/s 2023-10-08T13:15:01.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:00 smithi060 ceph-mon[103190]: pgmap v574: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 481 op/s 2023-10-08T13:15:01.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:00 smithi005 ceph-mon[99496]: pgmap v574: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 481 op/s 2023-10-08T13:15:01.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 520.0 s, 473.4 tps, lat 198.425 ms stddev 228.885 2023-10-08T13:15:03.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:02 smithi118 ceph-mon[104234]: pgmap v575: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.4 MiB/s wr, 546 op/s 2023-10-08T13:15:03.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:02 smithi060 ceph-mon[103190]: pgmap v575: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.4 MiB/s wr, 546 op/s 2023-10-08T13:15:03.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:02 smithi005 ceph-mon[99496]: pgmap v575: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.4 MiB/s wr, 546 op/s 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.434+0000 7fd733d5c700 1 -- 172.21.15.5:0/3947926612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0fff60 msgr2=0x7fd72c104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.434+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3947926612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0fff60 0x7fd72c104420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009990 tx=0x7fd71c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.435+0000 7fd733d5c700 1 -- 172.21.15.5:0/3947926612 shutdown_connections 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.435+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3947926612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c104a40 0x7fd72c104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.435+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3947926612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0ff640 0x7fd72c0ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.435+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3947926612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0fff60 0x7fd72c104420 secure :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009990 tx=0x7fd71c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.435+0000 7fd733d5c700 1 -- 172.21.15.5:0/3947926612 >> 172.21.15.5:0/3947926612 conn(0x7fd72c0fb070 msgr2=0x7fd72c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:04.448 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.447+0000 7fd733d5c700 1 -- 172.21.15.5:0/3947926612 shutdown_connections 2023-10-08T13:15:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.452+0000 7fd733d5c700 1 -- 172.21.15.5:0/3947926612 wait complete. 2023-10-08T13:15:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.453+0000 7fd733d5c700 1 Processor -- start 2023-10-08T13:15:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 -- start start 2023-10-08T13:15:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 0x7fd72c10af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c104a40 0x7fd72c10b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c106070 0x7fd72c106520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c106c30 con 0x7fd72c0ff640 2023-10-08T13:15:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c106da0 con 0x7fd72c104a40 2023-10-08T13:15:04.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.456+0000 7fd733d5c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c112ca0 con 0x7fd72c106070 2023-10-08T13:15:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 0x7fd72c10af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 0x7fd72c10af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37334/0 (socket says 172.21.15.5:37334) 2023-10-08T13:15:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 -- 172.21.15.5:0/3474120364 learned_addr learned my addr 172.21.15.5:0/3474120364 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 -- 172.21.15.5:0/3474120364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c106070 msgr2=0x7fd72c106520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:15:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c106070 0x7fd72c106520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 -- 172.21.15.5:0/3474120364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c104a40 msgr2=0x7fd72c10b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c104a40 0x7fd72c10b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.458+0000 7fd731af8700 1 -- 172.21.15.5:0/3474120364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0095f0 con 0x7fd72c0ff640 2023-10-08T13:15:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.459+0000 7fd731af8700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 0x7fd72c10af10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b530 tx=0x7fd72800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.459+0000 7fd722ffd700 1 -- 172.21.15.5:0/3474120364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728011830 con 0x7fd72c0ff640 2023-10-08T13:15:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.459+0000 7fd722ffd700 1 -- 172.21.15.5:0/3474120364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd728011e50 con 0x7fd72c0ff640 2023-10-08T13:15:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.459+0000 7fd722ffd700 1 -- 172.21.15.5:0/3474120364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72800f2e0 con 0x7fd72c0ff640 2023-10-08T13:15:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.459+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c112f80 con 0x7fd72c0ff640 2023-10-08T13:15:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.460+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c113440 con 0x7fd72c0ff640 2023-10-08T13:15:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.468+0000 7fd73ff45b80 1 Processor -- start 2023-10-08T13:15:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.468+0000 7fd722ffd700 1 -- 172.21.15.5:0/3474120364 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd72800f440 con 0x7fd72c0ff640 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.468+0000 7fd73ff45b80 1 -- start start 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.470+0000 7fd722ffd700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7180a16b0 0x7fd7180a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.470+0000 7fd722ffd700 1 -- 172.21.15.5:0/3474120364 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd7280cd460 con 0x7fd72c0ff640 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.476+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c55506c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.476+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555071a0 0x556c55500b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.476+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555010b0 0x556c55501510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.476+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c55469400 con 0x556c555071a0 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.476+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5545abc0 con 0x556c555010b0 2023-10-08T13:15:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.476+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c554584e0 con 0x556c55506880 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c55506c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c55506c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50548/0 (socket says 172.21.15.5:50548) 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 -- 172.21.15.5:0/1759111811 learned_addr learned my addr 172.21.15.5:0/1759111811 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 -- 172.21.15.5:0/1759111811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555010b0 msgr2=0x556c55501510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555010b0 0x556c55501510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 -- 172.21.15.5:0/1759111811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555071a0 msgr2=0x556c55500b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555071a0 0x556c55500b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.477+0000 7fd731af8700 1 -- 172.21.15.5:0/1759111811 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5527ed80 con 0x556c55506880 2023-10-08T13:15:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.478+0000 7fd731af8700 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c55506c60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd728097040 tx=0x7fd728008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b123c46c81f35f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.490+0000 7fd717fff700 1 -- 172.21.15.5:0/1759111811 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72809ab40 con 0x556c55506880 2023-10-08T13:15:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.490+0000 7fd717fff700 1 -- 172.21.15.5:0/1759111811 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd72809ec90 con 0x556c55506880 2023-10-08T13:15:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.490+0000 7fd717fff700 1 -- 172.21.15.5:0/1759111811 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7280cd300 con 0x556c55506880 2023-10-08T13:15:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.491+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1759111811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 msgr2=0x556c55506c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.491+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c55506c60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd728097040 tx=0x7fd728008030 comp rx=0 tx=0).stop 2023-10-08T13:15:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.497+0000 7fd7322f9700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7180a16b0 0x7fd7180a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.501+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1759111811 shutdown_connections 2023-10-08T13:15:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.501+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555010b0 0x556c55501510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.501+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c55506c60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.501+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1759111811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555071a0 0x556c55500b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.501+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1759111811 >> 172.21.15.5:0/1759111811 conn(0x556c55475200 msgr2=0x556c554fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.501+0000 7fd7322f9700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7180a16b0 0x7fd7180a3b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd7240094f0 tx=0x7fd724009050 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.503+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1759111811 shutdown_connections 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.503+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1759111811 wait complete. 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.503+0000 7fd73ff45b80 1 -- start start 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.503+0000 7fd73ff45b80 1 Processor -- start 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c5550a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c5550ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5550b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c55453dd0 con 0x556c555010b0 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c553f06b0 con 0x556c555071a0 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c553f0350 con 0x556c55506880 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd73ff45b80 10 client.0 _ll_register_callbacks cb 0x556c5524d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd731af8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c5550a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd731af8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c5550a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37346/0 (socket says 172.21.15.5:37346) 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.504+0000 7fd731af8700 1 -- 172.21.15.5:0/2115589956 learned_addr learned my addr 172.21.15.5:0/2115589956 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.505+0000 7fd731af8700 1 -- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 msgr2=0x556c5550ab50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:15:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.505+0000 7fd731af8700 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c5550ab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.505+0000 7fd731af8700 1 -- 172.21.15.5:0/2115589956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 msgr2=0x556c5550b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.505+0000 7fd731af8700 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5550b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.505+0000 7fd731af8700 1 -- 172.21.15.5:0/2115589956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c113440 con 0x556c555010b0 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.506+0000 7fd731af8700 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c5550a610 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd728000c00 tx=0x7fd728004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abcfc120f9fc8ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.506+0000 7fd7157fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.506+0000 7fd7157fa700 1 -- 172.21.15.5:0/2115589956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7280cd150 con 0x556c555010b0 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.506+0000 7fd7157fa700 1 -- 172.21.15.5:0/2115589956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd7280b2050 con 0x556c555010b0 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.506+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c5541be50 con 0x556c555010b0 2023-10-08T13:15:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.507+0000 7fd7157fa700 1 -- 172.21.15.5:0/2115589956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7280cd2b0 con 0x556c555010b0 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.513+0000 7fd73ff45b80 10 client.16785 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.513+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x556c55267c00 con 0x556c555010b0 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd7157fa700 1 -- 172.21.15.5:0/2115589956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c5541be50 con 0x556c555010b0 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd7157fa700 1 -- 172.21.15.5:0/2115589956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd7280b81b0 con 0x556c555010b0 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd73ff45b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd73ff45b80 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd73ff45b80 20 client.16785 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c5553c930 0x556c5553ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd73ff45b80 4 client.16785 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.516+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c5544cdb0 con 0x556c5553c930 2023-10-08T13:15:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.532+0000 7fd7312f7700 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c5553c930 0x556c5553ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.543+0000 7fd7312f7700 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c5553c930 0x556c5553ed50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c02bcc30f6292d20 server_cookie=8c71f128e75a0c75 in_seq=0 out_seq=0 2023-10-08T13:15:04.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.543+0000 7fd7157fa700 10 client.16785 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.544+0000 7fd7157fa700 1 -- 172.21.15.5:0/2115589956 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556c5544cdb0 con 0x556c5553c930 2023-10-08T13:15:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.544+0000 7fd7157fa700 10 client.16785 handle_command_reply: tid=0 2023-10-08T13:15:04.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.544+0000 7fd73ff45b80 1 client.16785 shutdown 2023-10-08T13:15:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.564+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 msgr2=0x556c5550a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.564+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c5550a610 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd728000c00 tx=0x7fd728004860 comp rx=0 tx=0).stop 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.566+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 shutdown_connections 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.566+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c5553c930 0x556c5553ed50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.566+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5550b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.566+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c5550a610 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.566+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/2115589956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c5550ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.566+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 >> 172.21.15.5:0/2115589956 conn(0x556c55475200 msgr2=0x556c554fb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.567+0000 7fd7157fa700 0 client.16785 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.581+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 shutdown_connections 2023-10-08T13:15:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.584+0000 7fd73ff45b80 1 -- 172.21.15.5:0/2115589956 wait complete. 2023-10-08T13:15:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.589+0000 7fd73ff45b80 20 client.16785 trim_cache size 0 max 16384 2023-10-08T13:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.614+0000 7fd73ff45b80 1 Processor -- start 2023-10-08T13:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 -- start start 2023-10-08T13:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c55500b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c554fb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c554fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c552d48c0 con 0x556c555010b0 2023-10-08T13:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c554fc940 con 0x556c555071a0 2023-10-08T13:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.615+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5550d180 con 0x556c55506880 2023-10-08T13:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c554fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7322f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c554fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c554fb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50558/0 (socket says 172.21.15.5:50558) 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 -- 172.21.15.5:0/1343641820 learned_addr learned my addr 172.21.15.5:0/1343641820 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd731af8700 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c55500b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 -- 172.21.15.5:0/1343641820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 msgr2=0x556c554fbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c554fbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 -- 172.21.15.5:0/1343641820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 msgr2=0x556c55500b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c55500b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.616+0000 7fd7312f7700 1 -- 172.21.15.5:0/1343641820 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c552a51f0 con 0x556c55506880 2023-10-08T13:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.617+0000 7fd7312f7700 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c554fb790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd72c068ae0 tx=0x7fd71c00b540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c2387e5b10871a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.617+0000 7fd720ff9700 1 -- 172.21.15.5:0/1343641820 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c01d040 con 0x556c55506880 2023-10-08T13:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.618+0000 7fd720ff9700 1 -- 172.21.15.5:0/1343641820 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd71c003680 con 0x556c55506880 2023-10-08T13:15:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.618+0000 7fd720ff9700 1 -- 172.21.15.5:0/1343641820 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c021730 con 0x556c55506880 2023-10-08T13:15:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1343641820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 msgr2=0x556c554fb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c554fb790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd72c068ae0 tx=0x7fd71c00b540 comp rx=0 tx=0).stop 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1343641820 shutdown_connections 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c554fbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c555010b0 0x556c55500b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/1343641820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c55506880 0x556c554fb790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1343641820 >> 172.21.15.5:0/1343641820 conn(0x556c55475200 msgr2=0x556c555014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1343641820 shutdown_connections 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.619+0000 7fd73ff45b80 1 -- 172.21.15.5:0/1343641820 wait complete. 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 -- start start 2023-10-08T13:15:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 Processor -- start 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c555010b0 0x556c5550fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 0x556c55510140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5558f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c555108d0 con 0x556c55506880 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c55510a40 con 0x556c555071a0 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5558fca0 con 0x556c555010b0 2023-10-08T13:15:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.620+0000 7fd73ff45b80 10 client.0 _ll_register_callbacks cb 0x556c5524d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 0x556c55510140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 0x556c55510140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37362/0 (socket says 172.21.15.5:37362) 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 -- 172.21.15.5:0/3323476897 learned_addr learned my addr 172.21.15.5:0/3323476897 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7322f9700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5558f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 -- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c555010b0 msgr2=0x556c5550fc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c555010b0 0x556c5550fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 -- 172.21.15.5:0/3323476897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 msgr2=0x556c5558f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5558f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 -- 172.21.15.5:0/3323476897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c1143f0 con 0x556c55506880 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7322f9700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5558f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7312f7700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 0x556c55510140 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e227a756aa1b5c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.621+0000 7fd7157fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.622+0000 7fd7157fa700 1 -- 172.21.15.5:0/3323476897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c01d070 con 0x556c55506880 2023-10-08T13:15:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.622+0000 7fd7157fa700 1 -- 172.21.15.5:0/3323476897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd71c000e40 con 0x556c55506880 2023-10-08T13:15:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.622+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd72809ec90 con 0x556c55506880 2023-10-08T13:15:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.634+0000 7fd7157fa700 1 -- 172.21.15.5:0/3323476897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd71c00bb20 con 0x556c55506880 2023-10-08T13:15:04.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.637+0000 7fd73ff45b80 10 client.16791 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:04.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.637+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x556c5527d250 con 0x556c55506880 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd7157fa700 1 -- 172.21.15.5:0/3323476897 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd72809ec90 con 0x556c55506880 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd7157fa700 1 -- 172.21.15.5:0/3323476897 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd71c033070 con 0x556c55506880 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd73ff45b80 10 client.16791 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd73ff45b80 10 client.16791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd73ff45b80 20 client.16791 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c55591140 0x556c55593560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd73ff45b80 4 client.16791 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.652+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556c5544cad0 con 0x556c55591140 2023-10-08T13:15:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.653+0000 7fd731af8700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c55591140 0x556c55593560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.654+0000 7fd731af8700 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c55591140 0x556c55593560 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6dddabec3136eeb server_cookie=bb641d0365cbfaeb in_seq=0 out_seq=0 2023-10-08T13:15:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.654+0000 7fd7157fa700 10 client.16791 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.747+0000 7fd7157fa700 1 -- 172.21.15.5:0/3323476897 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556c5544cad0 con 0x556c55591140 2023-10-08T13:15:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.747+0000 7fd7157fa700 10 client.16791 handle_command_reply: tid=0 2023-10-08T13:15:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.747+0000 7fd73ff45b80 1 client.16791 shutdown 2023-10-08T13:15:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.747+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 msgr2=0x556c55510140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.747+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 0x556c55510140 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c00be90 comp rx=0 tx=0).stop 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 shutdown_connections 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556c55591140 0x556c55593560 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c555071a0 0x556c5558f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556c555010b0 0x556c5550fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd7157fa700 0 client.16791 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 --2- 172.21.15.5:0/3323476897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c55506880 0x556c55510140 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 >> 172.21.15.5:0/3323476897 conn(0x556c55475200 msgr2=0x556c55508e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:04.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 shutdown_connections 2023-10-08T13:15:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 1 -- 172.21.15.5:0/3323476897 wait complete. 2023-10-08T13:15:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd73ff45b80 20 client.16791 trim_cache size 0 max 16384 2023-10-08T13:15:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:15:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:15:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:15:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:15:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7180a16b0 msgr2=0x7fd7180a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7180a16b0 0x7fd7180a3b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd7240094f0 tx=0x7fd724009050 comp rx=0 tx=0).stop 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 msgr2=0x7fd72c10af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 0x7fd72c10af10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b530 tx=0x7fd72800b8f0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 shutdown_connections 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7180a16b0 0x7fd7180a3b70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd72c106070 0x7fd72c106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c0ff640 0x7fd72c10af10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 --2- 172.21.15.5:0/3474120364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c104a40 0x7fd72c10b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 >> 172.21.15.5:0/3474120364 conn(0x7fd72c0fb070 msgr2=0x7fd72c0fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.748+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 shutdown_connections 2023-10-08T13:15:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:04.749+0000 7fd733d5c700 1 -- 172.21.15.5:0/3474120364 wait complete. 2023-10-08T13:15:05.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:04 smithi118 ceph-mon[104234]: pgmap v576: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 478 op/s 2023-10-08T13:15:05.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:04 smithi060 ceph-mon[103190]: pgmap v576: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 478 op/s 2023-10-08T13:15:05.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:04 smithi005 ceph-mon[99496]: pgmap v576: 129 pgs: 129 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 478 op/s 2023-10-08T13:15:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 525.0 s, 552.4 tps, lat 190.234 ms stddev 219.454 2023-10-08T13:15:06.910 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:06 smithi060 ceph-mon[103190]: pgmap v577: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.3 MiB/s wr, 516 op/s 2023-10-08T13:15:06.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:06 smithi005 ceph-mon[99496]: pgmap v577: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.3 MiB/s wr, 516 op/s 2023-10-08T13:15:07.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:06 smithi118 ceph-mon[104234]: pgmap v577: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.3 MiB/s wr, 516 op/s 2023-10-08T13:15:08.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:08 smithi005 ceph-mon[99496]: pgmap v578: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.2 MiB/s wr, 490 op/s 2023-10-08T13:15:09.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:08 smithi118 ceph-mon[104234]: pgmap v578: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.2 MiB/s wr, 490 op/s 2023-10-08T13:15:09.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:08 smithi060 ceph-mon[103190]: pgmap v578: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.2 MiB/s wr, 490 op/s 2023-10-08T13:15:10.929 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:10 smithi005 ceph-mon[99496]: pgmap v579: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.0 MiB/s wr, 572 op/s 2023-10-08T13:15:10.929 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:10 smithi005 ceph-mon[99496]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T13:15:11.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:10 smithi118 ceph-mon[104234]: pgmap v579: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.0 MiB/s wr, 572 op/s 2023-10-08T13:15:11.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:10 smithi118 ceph-mon[104234]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T13:15:11.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:10 smithi060 ceph-mon[103190]: pgmap v579: 129 pgs: 129 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 7.0 MiB/s wr, 572 op/s 2023-10-08T13:15:11.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:10 smithi060 ceph-mon[103190]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T13:15:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 530.0 s, 412.1 tps, lat 229.038 ms stddev 324.187 2023-10-08T13:15:13.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:12 smithi118 ceph-mon[104234]: pgmap v581: 129 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 103 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.4 MiB/s wr, 555 op/s 2023-10-08T13:15:13.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:12 smithi060 ceph-mon[103190]: pgmap v581: 129 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 103 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.4 MiB/s wr, 555 op/s 2023-10-08T13:15:13.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:12 smithi005 ceph-mon[99496]: pgmap v581: 129 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 103 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.4 MiB/s wr, 555 op/s 2023-10-08T13:15:15.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:14 smithi118 ceph-mon[104234]: pgmap v582: 129 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 103 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.6 MiB/s wr, 545 op/s 2023-10-08T13:15:15.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:14 smithi060 ceph-mon[103190]: pgmap v582: 129 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 103 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.6 MiB/s wr, 545 op/s 2023-10-08T13:15:15.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:14 smithi005 ceph-mon[99496]: pgmap v582: 129 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 103 active+clean; 3.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.6 MiB/s wr, 545 op/s 2023-10-08T13:15:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 535.0 s, 460.3 tps, lat 224.267 ms stddev 311.787 2023-10-08T13:15:17.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:16 smithi118 ceph-mon[104234]: pgmap v583: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 3.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 6.0 MiB/s wr, 496 op/s 2023-10-08T13:15:17.163 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:16 smithi060 ceph-mon[103190]: pgmap v583: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 3.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 6.0 MiB/s wr, 496 op/s 2023-10-08T13:15:17.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:16 smithi005 ceph-mon[99496]: pgmap v583: 129 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 113 active+clean; 3.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 6.0 MiB/s wr, 496 op/s 2023-10-08T13:15:17.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:15:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.995+0000 7f78f20fb700 1 -- 172.21.15.5:0/1284665350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10f310 msgr2=0x7f78ec107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.995+0000 7f78f20fb700 1 --2- 172.21.15.5:0/1284665350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10f310 0x7f78ec107d30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78dc01aa00 tx=0x7f78dc01ad10 comp rx=0 tx=0).stop 2023-10-08T13:15:17.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.999+0000 7f78f20fb700 1 -- 172.21.15.5:0/1284665350 shutdown_connections 2023-10-08T13:15:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.999+0000 7f78f20fb700 1 --2- 172.21.15.5:0/1284665350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec119fd0 0x7f78ec11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.999+0000 7f78f20fb700 1 --2- 172.21.15.5:0/1284665350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec10eea0 0x7f78ec1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.999+0000 7f78f20fb700 1 --2- 172.21.15.5:0/1284665350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10f310 0x7f78ec107d30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:17.999+0000 7f78f20fb700 1 -- 172.21.15.5:0/1284665350 >> 172.21.15.5:0/1284665350 conn(0x7f78ec06b7c0 msgr2=0x7f78ec06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.010+0000 7f78f20fb700 1 -- 172.21.15.5:0/1284665350 shutdown_connections 2023-10-08T13:15:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.012+0000 7f78f20fb700 1 -- 172.21.15.5:0/1284665350 wait complete. 2023-10-08T13:15:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.012+0000 7f78f20fb700 1 Processor -- start 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 -- start start 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10eea0 0x7f78ec115780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec10f310 0x7f78ec115cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec119fd0 0x7f78ec1a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1a2240 con 0x7f78ec119fd0 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1a23b0 con 0x7f78ec10eea0 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.014+0000 7f78f20fb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1a2570 con 0x7f78ec10f310 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.015+0000 7f78ebfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec119fd0 0x7f78ec1a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.015+0000 7f78ebfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec119fd0 0x7f78ec1a1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37384/0 (socket says 172.21.15.5:37384) 2023-10-08T13:15:18.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.015+0000 7f78eaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec10f310 0x7f78ec115cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.015+0000 7f78ebfff700 1 -- 172.21.15.5:0/881129454 learned_addr learned my addr 172.21.15.5:0/881129454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.015+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10eea0 0x7f78ec115780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.016+0000 7f78eaffd700 1 -- 172.21.15.5:0/881129454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10eea0 msgr2=0x7f78ec115780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.016+0000 7f78eaffd700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10eea0 0x7f78ec115780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.016+0000 7f78eaffd700 1 -- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec119fd0 msgr2=0x7f78ec1a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.016+0000 7f78eaffd700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec119fd0 0x7f78ec1a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.016+0000 7f78eaffd700 1 -- 172.21.15.5:0/881129454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc01a600 con 0x7f78ec10f310 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.016+0000 7f78eaffd700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec10f310 0x7f78ec115cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78dc01a8f0 tx=0x7f78dc01cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.020+0000 7f78e8ff9700 1 -- 172.21.15.5:0/881129454 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc02d070 con 0x7f78ec10f310 2023-10-08T13:15:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.020+0000 7f78e8ff9700 1 -- 172.21.15.5:0/881129454 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78dc003680 con 0x7f78ec10f310 2023-10-08T13:15:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.020+0000 7f78e8ff9700 1 -- 172.21.15.5:0/881129454 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc031bd0 con 0x7f78ec10f310 2023-10-08T13:15:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.020+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec1a27f0 con 0x7f78ec10f310 2023-10-08T13:15:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.020+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec1a9dd0 con 0x7f78ec10f310 2023-10-08T13:15:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.024+0000 7f78e8ff9700 1 -- 172.21.15.5:0/881129454 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f78dc01f3f0 con 0x7f78ec10f310 2023-10-08T13:15:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.025+0000 7f78e8ff9700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78d40a17f0 0x7f78d40a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.025+0000 7f78e8ff9700 1 -- 172.21.15.5:0/881129454 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f78dc0dfd30 con 0x7f78ec10f310 2023-10-08T13:15:18.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.025+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78d40a17f0 0x7f78d40a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.062+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78d40a17f0 0x7f78d40a3cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f78e0006fd0 tx=0x7f78e0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 Processor -- start 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 -- start start 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38d880 0x55c4ec38dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec387b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec388510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec2f0400 con 0x55c4ec3880b0 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec2e1bc0 con 0x55c4ec38d880 2023-10-08T13:15:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.064+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec2df4e0 con 0x55c4ec38e1a0 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec388510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38d880 0x55c4ec38dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec388510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37394/0 (socket says 172.21.15.5:37394) 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 -- 172.21.15.5:0/2973429951 learned_addr learned my addr 172.21.15.5:0/2973429951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78eaffd700 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec387b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 -- 172.21.15.5:0/2973429951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 msgr2=0x55c4ec387b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec387b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 -- 172.21.15.5:0/2973429951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38d880 msgr2=0x55c4ec38dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38d880 0x55c4ec38dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 -- 172.21.15.5:0/2973429951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4ec105d80 con 0x55c4ec3880b0 2023-10-08T13:15:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38d880 0x55c4ec38dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78ebfff700 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec388510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f78e400a730 tx=0x7f78e4007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61dbf0e455d9fa87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78d1ffb700 1 -- 172.21.15.5:0/2973429951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4018070 con 0x55c4ec3880b0 2023-10-08T13:15:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78d1ffb700 1 -- 172.21.15.5:0/2973429951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78e4010040 con 0x55c4ec3880b0 2023-10-08T13:15:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.065+0000 7f78d1ffb700 1 -- 172.21.15.5:0/2973429951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e400f050 con 0x55c4ec3880b0 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2973429951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 msgr2=0x55c4ec388510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec388510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f78e400a730 tx=0x7f78e4007990 comp rx=0 tx=0).stop 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2973429951 shutdown_connections 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec388510 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38d880 0x55c4ec38dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2973429951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec387b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2973429951 >> 172.21.15.5:0/2973429951 conn(0x55c4ec2fc200 msgr2=0x55c4ec382b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2973429951 shutdown_connections 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.066+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2973429951 wait complete. 2023-10-08T13:15:18.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 -- start start 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 Processor -- start 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec3941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec391490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec391af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec2dadd0 con 0x55c4ec38d880 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec2776b0 con 0x55c4ec3880b0 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec277350 con 0x55c4ec38e1a0 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78fe2e4b80 10 client.0 _ll_register_callbacks cb 0x55c4ec0d47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec3941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec3941a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60578/0 (socket says 172.21.15.5:60578) 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.067+0000 7f78eb7fe700 1 -- 172.21.15.5:0/1847865884 learned_addr learned my addr 172.21.15.5:0/1847865884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78ebfff700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec391af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eaffd700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec391490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eb7fe700 1 -- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 msgr2=0x55c4ec391af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec391af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eb7fe700 1 -- 172.21.15.5:0/1847865884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 msgr2=0x55c4ec391490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec391490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eb7fe700 1 -- 172.21.15.5:0/1847865884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e000e040 con 0x55c4ec3880b0 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eaffd700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec391490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:15:18.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec3941a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78e000de80 tx=0x7f78e0004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5951ab5d1c4dc3bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78caffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78caffd700 1 -- 172.21.15.5:0/1847865884 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e000d6d0 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4ec2a2e50 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78caffd700 1 -- 172.21.15.5:0/1847865884 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f78e00203f0 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.068+0000 7f78caffd700 1 -- 172.21.15.5:0/1847865884 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78e000deb0 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.069+0000 7f78fe2e4b80 10 client.26252 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.069+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f78e400a410 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.069+0000 7f78caffd700 1 -- 172.21.15.5:0/1847865884 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c4ec2a2e50 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.069+0000 7f78caffd700 1 -- 172.21.15.5:0/1847865884 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f78e001f070 con 0x55c4ec3880b0 2023-10-08T13:15:18.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.069+0000 7f78fe2e4b80 10 client.26252 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.069+0000 7f78fe2e4b80 10 client.26252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.070+0000 7f78fe2e4b80 20 client.26252 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.070+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3a1d10 0x55c4ec3a4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.070+0000 7f78fe2e4b80 4 client.26252 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.070+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4ec2d3db0 con 0x55c4ec3a1d10 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.070+0000 7f78eaffd700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3a1d10 0x55c4ec3a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.071+0000 7f78eaffd700 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3a1d10 0x55c4ec3a4130 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f84fe976ad44c9 server_cookie=f952214898c98a55 in_seq=0 out_seq=0 2023-10-08T13:15:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.071+0000 7f78caffd700 10 client.26252 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78caffd700 1 -- 172.21.15.5:0/1847865884 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c4ec2d3db0 con 0x55c4ec3a1d10 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78caffd700 10 client.26252 handle_command_reply: tid=0 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 client.26252 shutdown 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 msgr2=0x55c4ec3941a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec3941a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78e000de80 tx=0x7f78e0004860 comp rx=0 tx=0).stop 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 shutdown_connections 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec391af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3a1d10 0x55c4ec3a4130 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec3941a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/1847865884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec391490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78caffd700 0 client.26252 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 >> 172.21.15.5:0/1847865884 conn(0x55c4ec2fc200 msgr2=0x55c4ec382010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 shutdown_connections 2023-10-08T13:15:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/1847865884 wait complete. 2023-10-08T13:15:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.072+0000 7f78fe2e4b80 20 client.26252 trim_cache size 0 max 16384 2023-10-08T13:15:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 Processor -- start 2023-10-08T13:15:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 -- start start 2023-10-08T13:15:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec387b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38d880 0x55c4ec398be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38e1a0 0x55c4ec382790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec15b8c0 con 0x55c4ec3880b0 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec384100 con 0x55c4ec38e1a0 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec38e000 con 0x55c4ec38d880 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec387b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38e1a0 0x55c4ec382790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec387b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37404/0 (socket says 172.21.15.5:37404) 2023-10-08T13:15:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.095+0000 7f78eb7fe700 1 -- 172.21.15.5:0/304554532 learned_addr learned my addr 172.21.15.5:0/304554532 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78eb7fe700 1 -- 172.21.15.5:0/304554532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38d880 msgr2=0x55c4ec398be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38d880 0x55c4ec398be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78eb7fe700 1 -- 172.21.15.5:0/304554532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38e1a0 msgr2=0x55c4ec382790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38e1a0 0x55c4ec382790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78eb7fe700 1 -- 172.21.15.5:0/304554532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4ec0eec00 con 0x55c4ec3880b0 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78ebfff700 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38e1a0 0x55c4ec382790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec387b70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f78e00090f0 tx=0x7f78e0009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d88db9491ee1e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78d27fc700 1 -- 172.21.15.5:0/304554532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0014aa0 con 0x55c4ec3880b0 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78d27fc700 1 -- 172.21.15.5:0/304554532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78e0012de0 con 0x55c4ec3880b0 2023-10-08T13:15:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.096+0000 7f78d27fc700 1 -- 172.21.15.5:0/304554532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e00559c0 con 0x55c4ec3880b0 2023-10-08T13:15:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/304554532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 msgr2=0x55c4ec387b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec387b70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f78e00090f0 tx=0x7f78e0009620 comp rx=0 tx=0).stop 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/304554532 shutdown_connections 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec38e1a0 0x55c4ec382790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec3880b0 0x55c4ec387b70 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/304554532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38d880 0x55c4ec398be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/304554532 >> 172.21.15.5:0/304554532 conn(0x55c4ec2fc200 msgr2=0x55c4ec38fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/304554532 shutdown_connections 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.097+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/304554532 wait complete. 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 -- start start 2023-10-08T13:15:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 Processor -- start 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec394bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec395100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec395680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec3f4d00 con 0x55c4ec38d880 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec3f4e70 con 0x55c4ec3880b0 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4ec3f5030 con 0x55c4ec38e1a0 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78fe2e4b80 10 client.0 _ll_register_callbacks cb 0x7f78e000d830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec394bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78eaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec395100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78ebfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec395680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78eaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec395100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37410/0 (socket says 172.21.15.5:37410) 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78eaffd700 1 -- 172.21.15.5:0/2074810695 learned_addr learned my addr 172.21.15.5:0/2074810695 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.098+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec394bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60592/0 (socket says 172.21.15.5:60592) 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eaffd700 1 -- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 msgr2=0x55c4ec395680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eaffd700 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec395680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eaffd700 1 -- 172.21.15.5:0/2074810695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 msgr2=0x55c4ec394bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eaffd700 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec394bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eaffd700 1 -- 172.21.15.5:0/2074810695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4ec105d80 con 0x55c4ec38d880 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec394bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78eaffd700 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec395100 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0ac650 tx=0x7f78dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5284fe07e8ac600 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78caffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78caffd700 1 -- 172.21.15.5:0/2074810695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0dd4b0 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78caffd700 1 -- 172.21.15.5:0/2074810695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f78dc0acbb0 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78e4010040 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.099+0000 7f78caffd700 1 -- 172.21.15.5:0/2074810695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78dc0caba0 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 10 client.16806 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f78e400a410 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78caffd700 1 -- 172.21.15.5:0/2074810695 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78e4010040 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78caffd700 1 -- 172.21.15.5:0/2074810695 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f78dc0b47c0 con 0x55c4ec38d880 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 10 client.16806 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 10 client.16806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 20 client.16806 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:18.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3f6460 0x55c4ec3f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 4 client.16806 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:15:18.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c4ec2d3ad0 con 0x55c4ec3f6460 2023-10-08T13:15:18.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.100+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3f6460 0x55c4ec3f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.101+0000 7f78caffd700 10 client.16806 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.101+0000 7f78eb7fe700 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3f6460 0x55c4ec3f8850 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbef1643eb84adbe server_cookie=d024002c1681f6b5 in_seq=0 out_seq=0 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78caffd700 1 -- 172.21.15.5:0/2074810695 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c4ec2d3ad0 con 0x55c4ec3f6460 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78caffd700 10 client.16806 handle_command_reply: tid=0 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 client.16806 shutdown 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 msgr2=0x55c4ec395100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec395100 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0ac650 tx=0x7f78dc000bc0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 shutdown_connections 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4ec38e1a0 0x55c4ec395680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4ec3f6460 0x55c4ec3f8850 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4ec3880b0 0x55c4ec394bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 --2- 172.21.15.5:0/2074810695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4ec38d880 0x55c4ec395100 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78caffd700 0 client.16806 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 >> 172.21.15.5:0/2074810695 conn(0x55c4ec2fc200 msgr2=0x55c4ec38c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.111+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 shutdown_connections 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78fe2e4b80 1 -- 172.21.15.5:0/2074810695 wait complete. 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78fe2e4b80 20 client.16806 trim_cache size 0 max 16384 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:15:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:15:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:15:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:15:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78d40a17f0 msgr2=0x7f78d40a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78d40a17f0 0x7f78d40a3cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f78e0006fd0 tx=0x7f78e0008040 comp rx=0 tx=0).stop 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec10f310 msgr2=0x7f78ec115cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec10f310 0x7f78ec115cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78dc01a8f0 tx=0x7f78dc01cf10 comp rx=0 tx=0).stop 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 shutdown_connections 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f78d40a17f0 0x7f78d40a3cb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78ec119fd0 0x7f78ec1a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ec10eea0 0x7f78ec115780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 --2- 172.21.15.5:0/881129454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78ec10f310 0x7f78ec115cc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.112+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 >> 172.21.15.5:0/881129454 conn(0x7f78ec06b7c0 msgr2=0x7f78ec071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.113+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 shutdown_connections 2023-10-08T13:15:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:18.113+0000 7f78f20fb700 1 -- 172.21.15.5:0/881129454 wait complete. 2023-10-08T13:15:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 -- 172.21.15.5:0/2454585974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d300ffce0 msgr2=0x7f7d30100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 --2- 172.21.15.5:0/2454585974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d300ffce0 0x7f7d30100160 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0099c0 tx=0x7f7d1c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 -- 172.21.15.5:0/2454585974 shutdown_connections 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 --2- 172.21.15.5:0/2454585974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d301006a0 0x7f7d3010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 --2- 172.21.15.5:0/2454585974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301056f0 0x7f7d30105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 --2- 172.21.15.5:0/2454585974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d300ffce0 0x7f7d30100160 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 -- 172.21.15.5:0/2454585974 >> 172.21.15.5:0/2454585974 conn(0x7f7d30075aa0 msgr2=0x7f7d300fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 -- 172.21.15.5:0/2454585974 shutdown_connections 2023-10-08T13:15:18.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.505+0000 7f7d36ced700 1 -- 172.21.15.5:0/2454585974 wait complete. 2023-10-08T13:15:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 Processor -- start 2023-10-08T13:15:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 -- start start 2023-10-08T13:15:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d300ffce0 0x7f7d30197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 0x7f7d30197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301056f0 0x7f7d301a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301986e0 con 0x7f7d301006a0 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301a2ef0 con 0x7f7d300ffce0 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d36ced700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301a3030 con 0x7f7d301056f0 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 0x7f7d30197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.506+0000 7f7d2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 0x7f7d30197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37426/0 (socket says 172.21.15.5:37426) 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 -- 172.21.15.5:0/4035941144 learned_addr learned my addr 172.21.15.5:0/4035941144 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d34a89700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d300ffce0 0x7f7d30197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d3528a700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301056f0 0x7f7d301a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 -- 172.21.15.5:0/4035941144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301056f0 msgr2=0x7f7d301a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301056f0 0x7f7d301a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 -- 172.21.15.5:0/4035941144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d300ffce0 msgr2=0x7f7d30197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d300ffce0 0x7f7d30197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 -- 172.21.15.5:0/4035941144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0095f0 con 0x7f7d301006a0 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d34a89700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d300ffce0 0x7f7d30197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 0x7f7d30197e70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00b580 tx=0x7f7d1c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2dffb700 1 -- 172.21.15.5:0/4035941144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c01c070 con 0x7f7d301006a0 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2dffb700 1 -- 172.21.15.5:0/4035941144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d1c00fd80 con 0x7f7d301006a0 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d2dffb700 1 -- 172.21.15.5:0/4035941144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c022c40 con 0x7f7d301006a0 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d301a3260 con 0x7f7d301006a0 2023-10-08T13:15:18.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.507+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301a3630 con 0x7f7d301006a0 2023-10-08T13:15:18.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.513+0000 7f7d42ed6b80 1 Processor -- start 2023-10-08T13:15:18.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.513+0000 7f7d42ed6b80 1 -- start start 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3bdd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3beaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3b46460 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3b37c20 con 0x55f0c3be8650 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3b35540 con 0x55f0c3bdce80 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d34a89700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d34a89700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37430/0 (socket says 172.21.15.5:37430) 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d34a89700 1 -- 172.21.15.5:0/3476681487 learned_addr learned my addr 172.21.15.5:0/3476681487 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d3528a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3bdd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3beaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d3528a700 1 -- 172.21.15.5:0/3476681487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 msgr2=0x55f0c3beaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d3528a700 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3beaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d3528a700 1 -- 172.21.15.5:0/3476681487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 msgr2=0x55f0c3be8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d3528a700 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d3528a700 1 -- 172.21.15.5:0/3476681487 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c395bde0 con 0x55f0c3bdce80 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.514+0000 7f7d34a89700 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.515+0000 7f7d3528a700 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3bdd260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d280115b0 tx=0x7f7d28009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3492444c0db3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.521+0000 7f7d1affd700 1 -- 172.21.15.5:0/3476681487 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800e040 con 0x55f0c3bdce80 2023-10-08T13:15:18.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.521+0000 7f7d1affd700 1 -- 172.21.15.5:0/3476681487 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d2800f040 con 0x55f0c3bdce80 2023-10-08T13:15:18.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.521+0000 7f7d1affd700 1 -- 172.21.15.5:0/3476681487 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28004430 con 0x55f0c3bdce80 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.522+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/3476681487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 msgr2=0x55f0c3bdd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.522+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3bdd260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d280115b0 tx=0x7f7d28009920 comp rx=0 tx=0).stop 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d2dffb700 1 -- 172.21.15.5:0/4035941144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7d1c020070 con 0x7f7d301006a0 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/3476681487 shutdown_connections 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3beaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3bdd260 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/3476681487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/3476681487 >> 172.21.15.5:0/3476681487 conn(0x55f0c3b52260 msgr2=0x55f0c3bd92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.524+0000 7f7d2dffb700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7d200a1670 0x7f7d200a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.525+0000 7f7d2dffb700 1 -- 172.21.15.5:0/4035941144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f7d1c0ce520 con 0x7f7d301006a0 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.526+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/3476681487 shutdown_connections 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.526+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/3476681487 wait complete. 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 -- start start 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 Processor -- start 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdce80 0x55f0c3be7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3be1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3b30e30 con 0x55f0c3be8650 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3acd710 con 0x55f0c3bdce80 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3acd3b0 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.527+0000 7f7d42ed6b80 10 client.0 _ll_register_callbacks cb 0x55f0c392a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.528+0000 7f7d34a89700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7d200a1670 0x7f7d200a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.534+0000 7f7d34a89700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7d200a1670 0x7f7d200a3b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7d24013870 tx=0x7f7d24007ed0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.535+0000 7f7d3528a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3be1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.535+0000 7f7d3528a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3be1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37440/0 (socket says 172.21.15.5:37440) 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.535+0000 7f7d3528a700 1 -- 172.21.15.5:0/186569859 learned_addr learned my addr 172.21.15.5:0/186569859 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.536+0000 7f7d34a89700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdce80 0x55f0c3be7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.539+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.542+0000 7f7d3528a700 1 -- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 msgr2=0x55f0c3be0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.542+0000 7f7d3528a700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.542+0000 7f7d3528a700 1 -- 172.21.15.5:0/186569859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdce80 msgr2=0x55f0c3be7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.542+0000 7f7d3528a700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdce80 0x55f0c3be7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.542+0000 7f7d3528a700 1 -- 172.21.15.5:0/186569859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d24007cc0 con 0x55f0c3be8650 2023-10-08T13:15:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.550+0000 7f7d3528a700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3be1520 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009510 tx=0x7f7d28011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed3cf1aec4d7d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.553+0000 7f7d0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.553+0000 7f7d0ffff700 1 -- 172.21.15.5:0/186569859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800e040 con 0x55f0c3be8650 2023-10-08T13:15:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.553+0000 7f7d0ffff700 1 -- 172.21.15.5:0/186569859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f7d280040d0 con 0x55f0c3be8650 2023-10-08T13:15:18.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.553+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0c3af8eb0 con 0x55f0c3be8650 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.569+0000 7f7d0ffff700 1 -- 172.21.15.5:0/186569859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d28004290 con 0x55f0c3be8650 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 10 client.16818 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f7d28011230 con 0x55f0c3be8650 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d0ffff700 1 -- 172.21.15.5:0/186569859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d2802e030 con 0x55f0c3be8650 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d0ffff700 1 -- 172.21.15.5:0/186569859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d2801b020 con 0x55f0c3be8650 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 10 client.16818 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:18.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 20 client.16818 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3bf81c0 0x55f0c3bfa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 4 client.16818 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.577+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0c3b29e10 con 0x55f0c3bf81c0 2023-10-08T13:15:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.584+0000 7f7d34a89700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3bf81c0 0x55f0c3bfa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.590+0000 7f7d0ffff700 10 client.16818 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.590+0000 7f7d34a89700 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3bf81c0 0x55f0c3bfa5e0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1730877c8e9b8 server_cookie=fef1c230e8450ccf in_seq=0 out_seq=0 2023-10-08T13:15:18.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.608+0000 7f7d0ffff700 1 -- 172.21.15.5:0/186569859 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f0c3b29e10 con 0x55f0c3bf81c0 2023-10-08T13:15:18.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.608+0000 7f7d0ffff700 10 client.16818 handle_command_reply: tid=0 2023-10-08T13:15:18.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.611+0000 7f7d42ed6b80 1 client.16818 shutdown 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.621+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 msgr2=0x55f0c3be1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.621+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3be1520 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009510 tx=0x7f7d28011f20 comp rx=0 tx=0).stop 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 shutdown_connections 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3be1520 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3bf81c0 0x55f0c3bfa5e0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdce80 0x55f0c3be7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/186569859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3be0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d0ffff700 0 client.16818 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 >> 172.21.15.5:0/186569859 conn(0x55f0c3b52260 msgr2=0x55f0c3bd8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.623+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 shutdown_connections 2023-10-08T13:15:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.625+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/186569859 wait complete. 2023-10-08T13:15:18.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.625+0000 7f7d42ed6b80 20 client.16818 trim_cache size 0 max 16384 2023-10-08T13:15:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.659+0000 7f7d42ed6b80 1 Processor -- start 2023-10-08T13:15:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 -- start start 2023-10-08T13:15:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdce80 0x55f0c3be79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3beb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3bebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c39b1920 con 0x55f0c3bdce80 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3bd8be0 con 0x55f0c3be8650 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.660+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3be5fa0 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3bebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3bebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60630/0 (socket says 172.21.15.5:60630) 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 -- 172.21.15.5:0/1906847349 learned_addr learned my addr 172.21.15.5:0/1906847349 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 -- 172.21.15.5:0/1906847349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 msgr2=0x55f0c3beb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3beb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 -- 172.21.15.5:0/1906847349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdce80 msgr2=0x55f0c3be79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdce80 0x55f0c3be79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 -- 172.21.15.5:0/1906847349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c3944c60 con 0x55f0c3be8650 2023-10-08T13:15:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.661+0000 7f7d3528a700 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3bebad0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7d28000f80 tx=0x7f7d28004de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e02a78768b0504 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.662+0000 7f7d1b7fe700 1 -- 172.21.15.5:0/1906847349 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28009920 con 0x55f0c3be8650 2023-10-08T13:15:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.662+0000 7f7d1b7fe700 1 -- 172.21.15.5:0/1906847349 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d2802e070 con 0x55f0c3be8650 2023-10-08T13:15:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.662+0000 7f7d1b7fe700 1 -- 172.21.15.5:0/1906847349 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28027d20 con 0x55f0c3be8650 2023-10-08T13:15:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.662+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/1906847349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 msgr2=0x55f0c3bebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.662+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3bebad0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7d28000f80 tx=0x7f7d28004de0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/1906847349 shutdown_connections 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3be8650 0x55f0c3bebad0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3bdce80 0x55f0c3be79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/1906847349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3beb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/1906847349 >> 172.21.15.5:0/1906847349 conn(0x55f0c3b52260 msgr2=0x55f0c3bd84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/1906847349 shutdown_connections 2023-10-08T13:15:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/1906847349 wait complete. 2023-10-08T13:15:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 -- start start 2023-10-08T13:15:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.663+0000 7f7d42ed6b80 1 Processor -- start 2023-10-08T13:15:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3c05e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3c063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3c068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3c7f0b0 con 0x55f0c3be8650 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3c7f1f0 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c3c7f330 con 0x55f0c3bdce80 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d42ed6b80 10 client.0 _ll_register_callbacks cb 0x7f7d24007b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d2ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3c063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d2ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3c063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60636/0 (socket says 172.21.15.5:60636) 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.667+0000 7f7d2ffff700 1 -- 172.21.15.5:0/2568013578 learned_addr learned my addr 172.21.15.5:0/2568013578 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d34a89700 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3c05e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d2ffff700 1 -- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 msgr2=0x55f0c3c05e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3c05e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d2ffff700 1 -- 172.21.15.5:0/2568013578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 msgr2=0x55f0c3c068e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3c068e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d2ffff700 1 -- 172.21.15.5:0/2568013578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d28011230 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d2ffff700 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3c063a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c097760 tx=0x7f7d1c0cbd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d05c2d1565ceb13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d0ffff700 1 -- 172.21.15.5:0/2568013578 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0975a0 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d0ffff700 1 -- 172.21.15.5:0/2568013578 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f7d1c09b960 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.668+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d2800f040 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.669+0000 7f7d0ffff700 1 -- 172.21.15.5:0/2568013578 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1c09b030 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.669+0000 7f7d42ed6b80 10 client.26276 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.669+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55f0c3982250 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.670+0000 7f7d0ffff700 1 -- 172.21.15.5:0/2568013578 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d2800f040 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.670+0000 7f7d0ffff700 1 -- 172.21.15.5:0/2568013578 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d1c0ce170 con 0x55f0c3bdd7a0 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d42ed6b80 10 client.26276 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d42ed6b80 10 client.26276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d42ed6b80 20 client.26276 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3c80720 0x55f0c3c82b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d42ed6b80 4 client.26276 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f0c3b29b30 con 0x55f0c3c80720 2023-10-08T13:15:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.673+0000 7f7d34a89700 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3c80720 0x55f0c3c82b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.685+0000 7f7d34a89700 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3c80720 0x55f0c3c82b40 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=818620d513948b6 server_cookie=cf02e5bed26a8b0b in_seq=0 out_seq=0 2023-10-08T13:15:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.685+0000 7f7d0ffff700 10 client.26276 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.685+0000 7f7d0ffff700 1 -- 172.21.15.5:0/2568013578 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f0c3b29b30 con 0x55f0c3c80720 2023-10-08T13:15:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.685+0000 7f7d0ffff700 10 client.26276 handle_command_reply: tid=0 2023-10-08T13:15:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.685+0000 7f7d42ed6b80 1 client.26276 shutdown 2023-10-08T13:15:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 msgr2=0x55f0c3c063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3c063a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c097760 tx=0x7f7d1c0cbd80 comp rx=0 tx=0).stop 2023-10-08T13:15:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 shutdown_connections 2023-10-08T13:15:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0c3be8650 0x55f0c3c068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f0c3bdce80 0x55f0c3c05e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55f0c3c80720 0x55f0c3c82b40 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 --2- 172.21.15.5:0/2568013578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0c3bdd7a0 0x55f0c3c063a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 >> 172.21.15.5:0/2568013578 conn(0x55f0c3b52260 msgr2=0x55f0c3be0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d0ffff700 0 client.26276 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 shutdown_connections 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 1 -- 172.21.15.5:0/2568013578 wait complete. 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.686+0000 7f7d42ed6b80 20 client.26276 trim_cache size 0 max 16384 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:15:18.688 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:15:18.689 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:15:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7d200a1670 msgr2=0x7f7d200a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7d200a1670 0x7f7d200a3b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7d24013870 tx=0x7f7d24007ed0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 msgr2=0x7f7d30197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 0x7f7d30197e70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00b580 tx=0x7f7d1c00f690 comp rx=0 tx=0).stop 2023-10-08T13:15:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 shutdown_connections 2023-10-08T13:15:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7d200a1670 0x7f7d200a3b30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d301056f0 0x7f7d301a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d300ffce0 0x7f7d30197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 --2- 172.21.15.5:0/4035941144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d301006a0 0x7f7d30197e70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 >> 172.21.15.5:0/4035941144 conn(0x7f7d30075aa0 msgr2=0x7f7d300fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 shutdown_connections 2023-10-08T13:15:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:18.687+0000 7f7d36ced700 1 -- 172.21.15.5:0/4035941144 wait complete. 2023-10-08T13:15:18.713 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:15:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:18 smithi060 ceph-mon[103190]: pgmap v584: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2023-10-08T13:15:19.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:18 smithi005 ceph-mon[99496]: pgmap v584: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2023-10-08T13:15:19.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:18 smithi118 ceph-mon[104234]: pgmap v584: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2023-10-08T13:15:20.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:19 smithi060 ceph-mon[103190]: pgmap v585: 129 pgs: 129 active+clean; 3.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 470 op/s 2023-10-08T13:15:20.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:19 smithi005 ceph-mon[99496]: pgmap v585: 129 pgs: 129 active+clean; 3.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 470 op/s 2023-10-08T13:15:20.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:19 smithi118 ceph-mon[104234]: pgmap v585: 129 pgs: 129 active+clean; 3.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 470 op/s 2023-10-08T13:15:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 540.0 s, 569.8 tps, lat 183.686 ms stddev 217.450 2023-10-08T13:15:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:21 smithi060 ceph-mon[103190]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T13:15:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:21 smithi005 ceph-mon[99496]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T13:15:22.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:21 smithi118 ceph-mon[104234]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T13:15:23.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:22 smithi118 ceph-mon[104234]: pgmap v587: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.7 MiB/s wr, 473 op/s 2023-10-08T13:15:23.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:22 smithi060 ceph-mon[103190]: pgmap v587: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.7 MiB/s wr, 473 op/s 2023-10-08T13:15:23.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:22 smithi005 ceph-mon[99496]: pgmap v587: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.7 MiB/s wr, 473 op/s 2023-10-08T13:15:25.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:24 smithi118 ceph-mon[104234]: pgmap v588: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.3 MiB/s wr, 500 op/s 2023-10-08T13:15:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:24 smithi060 ceph-mon[103190]: pgmap v588: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.3 MiB/s wr, 500 op/s 2023-10-08T13:15:25.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:24 smithi005 ceph-mon[99496]: pgmap v588: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.3 MiB/s wr, 500 op/s 2023-10-08T13:15:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 545.0 s, 514.7 tps, lat 187.579 ms stddev 194.578 2023-10-08T13:15:27.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:26 smithi118 ceph-mon[104234]: pgmap v589: 129 pgs: 129 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.0 MiB/s wr, 518 op/s 2023-10-08T13:15:27.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:26 smithi060 ceph-mon[103190]: pgmap v589: 129 pgs: 129 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.0 MiB/s wr, 518 op/s 2023-10-08T13:15:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:26 smithi005 ceph-mon[99496]: pgmap v589: 129 pgs: 129 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.0 MiB/s wr, 518 op/s 2023-10-08T13:15:29.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:28 smithi060 ceph-mon[103190]: pgmap v590: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2023-10-08T13:15:29.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:28 smithi005 ceph-mon[99496]: pgmap v590: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2023-10-08T13:15:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:28 smithi118 ceph-mon[104234]: pgmap v590: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2023-10-08T13:15:31.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:30 smithi060 ceph-mon[103190]: pgmap v591: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.0 MiB/s wr, 515 op/s 2023-10-08T13:15:31.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:30 smithi005 ceph-mon[99496]: pgmap v591: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.0 MiB/s wr, 515 op/s 2023-10-08T13:15:31.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:30 smithi118 ceph-mon[104234]: pgmap v591: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.0 MiB/s wr, 515 op/s 2023-10-08T13:15:31.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 -- 172.21.15.5:0/2305990452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e80107a60 msgr2=0x7f4e80107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2305990452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e80107a60 0x7f4e80107e40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009990 tx=0x7f4e70009ca0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 -- 172.21.15.5:0/2305990452 shutdown_connections 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2305990452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e8010c400 0x7f4e80113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2305990452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e80107a60 0x7f4e80107e40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2305990452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e80108410 0x7f4e8010bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 -- 172.21.15.5:0/2305990452 >> 172.21.15.5:0/2305990452 conn(0x7f4e8006bc20 msgr2=0x7f4e8006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 -- 172.21.15.5:0/2305990452 shutdown_connections 2023-10-08T13:15:31.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.350+0000 7f4e8661b700 1 -- 172.21.15.5:0/2305990452 wait complete. 2023-10-08T13:15:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 Processor -- start 2023-10-08T13:15:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 -- start start 2023-10-08T13:15:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e80107a60 0x7f4e8019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e8010c400 0x7f4e8019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 0x7f4e801a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e801a0000 con 0x7f4e8010c400 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e801a45e0 con 0x7f4e80107a60 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.351+0000 7f4e8661b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e801a4750 con 0x7f4e801a3c20 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 0x7f4e801a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 0x7f4e801a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50670/0 (socket says 172.21.15.5:50670) 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 -- 172.21.15.5:0/2566918007 learned_addr learned my addr 172.21.15.5:0/2566918007 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e80107a60 0x7f4e8019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 -- 172.21.15.5:0/2566918007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e80107a60 msgr2=0x7f4e8019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e80107a60 0x7f4e8019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 -- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e8010c400 msgr2=0x7f4e8019f8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:15:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e8010c400 0x7f4e8019f8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 -- 172.21.15.5:0/2566918007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78009c40 con 0x7f4e801a3c20 2023-10-08T13:15:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.352+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 0x7f4e801a40a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c370 tx=0x7f4e7800c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.353+0000 7f4e7d7fa700 1 -- 172.21.15.5:0/2566918007 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78017070 con 0x7f4e801a3c20 2023-10-08T13:15:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.353+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e700095f0 con 0x7f4e801a3c20 2023-10-08T13:15:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.353+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e801aa0a0 con 0x7f4e801a3c20 2023-10-08T13:15:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.353+0000 7f4e7d7fa700 1 -- 172.21.15.5:0/2566918007 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e7800f040 con 0x7f4e801a3c20 2023-10-08T13:15:31.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.353+0000 7f4e7d7fa700 1 -- 172.21.15.5:0/2566918007 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800e050 con 0x7f4e801a3c20 2023-10-08T13:15:31.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.356+0000 7f4e7d7fa700 1 -- 172.21.15.5:0/2566918007 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4e780090d0 con 0x7f4e801a3c20 2023-10-08T13:15:31.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.356+0000 7f4e7d7fa700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e680a1730 0x7f4e680a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.357+0000 7f4e7d7fa700 1 -- 172.21.15.5:0/2566918007 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4e780ccc00 con 0x7f4e801a3c20 2023-10-08T13:15:31.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.357+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e680a1730 0x7f4e680a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.357+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e680a1730 0x7f4e680a3bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000b2e0 tx=0x7f4e70005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 Processor -- start 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 -- start start 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 0x55b884017c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b884011b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b884012510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883f7a400 con 0x55b884017880 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883f6bbc0 con 0x55b8840120b0 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e92804b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883f694e0 con 0x55b8840181a0 2023-10-08T13:15:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e7ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 0x55b884017c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e7ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 0x55b884017c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37470/0 (socket says 172.21.15.5:37470) 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e7ffff700 1 -- 172.21.15.5:0/3109291243 learned_addr learned my addr 172.21.15.5:0/3109291243 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.358+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b884011b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b884012510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e7ffff700 1 -- 172.21.15.5:0/3109291243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 msgr2=0x55b884011b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b884011b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e7ffff700 1 -- 172.21.15.5:0/3109291243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 msgr2=0x55b884012510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b884012510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e7ffff700 1 -- 172.21.15.5:0/3109291243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b883d8fd80 con 0x55b884017880 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b884012510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 0x55b884017c60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009990 tx=0x7f4e70020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e08a71d5c06308d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e667fc700 1 -- 172.21.15.5:0/3109291243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000be90 con 0x55b884017880 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e667fc700 1 -- 172.21.15.5:0/3109291243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e7001e040 con 0x55b884017880 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.359+0000 7f4e667fc700 1 -- 172.21.15.5:0/3109291243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000f800 con 0x55b884017880 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 -- 172.21.15.5:0/3109291243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 msgr2=0x55b884017c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 0x55b884017c60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009990 tx=0x7f4e70020000 comp rx=0 tx=0).stop 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 -- 172.21.15.5:0/3109291243 shutdown_connections 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b884012510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b884017880 0x55b884017c60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3109291243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b884011b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 -- 172.21.15.5:0/3109291243 >> 172.21.15.5:0/3109291243 conn(0x55b883f86200 msgr2=0x55b88400cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 -- 172.21.15.5:0/3109291243 shutdown_connections 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 -- 172.21.15.5:0/3109291243 wait complete. 2023-10-08T13:15:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.360+0000 7f4e92804b80 1 -- start start 2023-10-08T13:15:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 Processor -- start 2023-10-08T13:15:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b88401b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b884017880 0x55b88401ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840181a0 0x55b88401bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883f64dd0 con 0x55b8840181a0 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883f016b0 con 0x55b8840120b0 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883f01350 con 0x55b884017880 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e92804b80 10 client.0 _ll_register_callbacks cb 0x55b883d5e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b88401b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b88401b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60658/0 (socket says 172.21.15.5:60658) 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b884017880 0x55b88401ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 -- 172.21.15.5:0/426048699 learned_addr learned my addr 172.21.15.5:0/426048699 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840181a0 0x55b88401bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 -- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b884017880 msgr2=0x55b88401ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b884017880 0x55b88401ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 -- 172.21.15.5:0/426048699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840181a0 msgr2=0x55b88401bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840181a0 0x55b88401bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7ffff700 1 -- 172.21.15.5:0/426048699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e801aa0a0 con 0x55b8840120b0 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.361+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b884017880 0x55b88401ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b88401b530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ce0 tx=0x7f4e7000f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6c755bed6b7228 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/426048699 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000be90 con 0x55b8840120b0 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/426048699 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4e70004710 con 0x55b8840120b0 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b883f2ce50 con 0x55b8840120b0 2023-10-08T13:15:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/426048699 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e700048d0 con 0x55b8840120b0 2023-10-08T13:15:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e92804b80 10 client.26288 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.362+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f4e80114510 con 0x55b8840120b0 2023-10-08T13:15:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/426048699 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b883f2ce50 con 0x55b8840120b0 2023-10-08T13:15:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/426048699 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e7002fc70 con 0x55b8840120b0 2023-10-08T13:15:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e92804b80 10 client.26288 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e92804b80 10 client.26288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e92804b80 20 client.26288 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e92804b80 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b88402b850 0x55b88402dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e92804b80 4 client.26288 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b883f5ddb0 con 0x55b88402b850 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b88402b850 0x55b88402dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e5f7fe700 10 client.26288 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.363+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b88402b850 0x55b88402dc70 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee52c5873f3f2ad server_cookie=6a85bb7a399954c6 in_seq=0 out_seq=0 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/426048699 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b883f5ddb0 con 0x55b88402b850 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e5f7fe700 10 client.26288 handle_command_reply: tid=0 2023-10-08T13:15:31.372 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 client.26288 shutdown 2023-10-08T13:15:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 msgr2=0x55b88401b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b88401b530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009ce0 tx=0x7f4e7000f740 comp rx=0 tx=0).stop 2023-10-08T13:15:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 shutdown_connections 2023-10-08T13:15:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840181a0 0x55b88401bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b88402b850 0x55b88402dc70 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8840120b0 0x55b88401b530 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 --2- 172.21.15.5:0/426048699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b884017880 0x55b88401ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e5f7fe700 0 client.26288 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.364+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 >> 172.21.15.5:0/426048699 conn(0x55b883f86200 msgr2=0x55b88400c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.365+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 shutdown_connections 2023-10-08T13:15:31.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.365+0000 7f4e92804b80 1 -- 172.21.15.5:0/426048699 wait complete. 2023-10-08T13:15:31.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.365+0000 7f4e92804b80 20 client.26288 trim_cache size 0 max 16384 2023-10-08T13:15:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 Processor -- start 2023-10-08T13:15:31.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 -- start start 2023-10-08T13:15:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884016ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b88401a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b88401bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b883de58c0 con 0x55b8840120b0 2023-10-08T13:15:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88400d610 con 0x55b884017880 2023-10-08T13:15:31.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e92804b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88400e330 con 0x55b8840181a0 2023-10-08T13:15:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e84bb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b88401bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e84bb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b88401bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50688/0 (socket says 172.21.15.5:50688) 2023-10-08T13:15:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.381+0000 7f4e84bb8700 1 -- 172.21.15.5:0/3090329671 learned_addr learned my addr 172.21.15.5:0/3090329671 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884016ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b88401a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e84bb8700 1 -- 172.21.15.5:0/3090329671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 msgr2=0x55b88401a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b88401a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e84bb8700 1 -- 172.21.15.5:0/3090329671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 msgr2=0x55b884016ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884016ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e84bb8700 1 -- 172.21.15.5:0/3090329671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b883d78c00 con 0x55b8840181a0 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b88401a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:15:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b88401bdd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800ca80 tx=0x7f4e780cc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f07c23ef0a9a41 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e66ffd700 1 -- 172.21.15.5:0/3090329671 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800ce20 con 0x55b8840181a0 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e66ffd700 1 -- 172.21.15.5:0/3090329671 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e78099f50 con 0x55b8840181a0 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.382+0000 7f4e66ffd700 1 -- 172.21.15.5:0/3090329671 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78099ab0 con 0x55b8840181a0 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 -- 172.21.15.5:0/3090329671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 msgr2=0x55b88401bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b88401bdd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800ca80 tx=0x7f4e780cc040 comp rx=0 tx=0).stop 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 -- 172.21.15.5:0/3090329671 shutdown_connections 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b88401bdd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884016ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 --2- 172.21.15.5:0/3090329671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b88401a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 -- 172.21.15.5:0/3090329671 >> 172.21.15.5:0/3090329671 conn(0x55b883f86200 msgr2=0x55b884019e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 -- 172.21.15.5:0/3090329671 shutdown_connections 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.383+0000 7f4e92804b80 1 -- 172.21.15.5:0/3090329671 wait complete. 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 -- start start 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 Processor -- start 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884022900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b884020da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b8840212e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8840231e0 con 0x55b8840120b0 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b884021820 con 0x55b884017880 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8840219e0 con 0x55b8840181a0 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884022900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e92804b80 10 client.0 _ll_register_callbacks cb 0x7f4e74009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884022900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37490/0 (socket says 172.21.15.5:37490) 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 -- 172.21.15.5:0/1380327194 learned_addr learned my addr 172.21.15.5:0/1380327194 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:31.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e84bb8700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b8840212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b884020da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 -- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 msgr2=0x55b8840212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b8840212e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 -- 172.21.15.5:0/1380327194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 msgr2=0x55b884020da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b884020da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.384+0000 7f4e7ffff700 1 -- 172.21.15.5:0/1380327194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e78021070 con 0x55b8840120b0 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e7ffff700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884022900 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009350 tx=0x7f4e70009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1047255b2086a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/1380327194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70024680 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e7001e040 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/1380327194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4e7000f860 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/1380327194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e7000bd10 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 10 client.16833 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55b883db61f0 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/1380327194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e7001e040 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/1380327194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e7002f560 con 0x55b8840120b0 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 10 client.16833 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 10 client.16833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 20 client.16833 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8840805a0 0x55b8840829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 4 client.16833 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:15:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.385+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b883f5dad0 con 0x55b8840805a0 2023-10-08T13:15:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.386+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8840805a0 0x55b8840829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.386+0000 7f4e5f7fe700 10 client.16833 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.386+0000 7f4e7f7fe700 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8840805a0 0x55b8840829c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=671166f8b2ba9f4c server_cookie=abd03a2bb7f7d080 in_seq=0 out_seq=0 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e5f7fe700 1 -- 172.21.15.5:0/1380327194 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b883f5dad0 con 0x55b8840805a0 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e5f7fe700 10 client.16833 handle_command_reply: tid=0 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 client.16833 shutdown 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 msgr2=0x55b884022900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884022900 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009350 tx=0x7f4e70009910 comp rx=0 tx=0).stop 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 shutdown_connections 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b8840181a0 0x55b8840212e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b8840120b0 0x55b884022900 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b8840805a0 0x55b8840829c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 --2- 172.21.15.5:0/1380327194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b884017880 0x55b884020da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e5f7fe700 0 client.16833 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 >> 172.21.15.5:0/1380327194 conn(0x55b883f86200 msgr2=0x55b884018630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 shutdown_connections 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 1 -- 172.21.15.5:0/1380327194 wait complete. 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.397+0000 7f4e92804b80 20 client.16833 trim_cache size 0 max 16384 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:15:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:15:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:15:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e680a1730 msgr2=0x7f4e680a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e680a1730 0x7f4e680a3bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000b2e0 tx=0x7f4e70005960 comp rx=0 tx=0).stop 2023-10-08T13:15:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 msgr2=0x7f4e801a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 0x7f4e801a40a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800c370 tx=0x7f4e7800c680 comp rx=0 tx=0).stop 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 shutdown_connections 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e680a1730 0x7f4e680a3bf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e801a3c20 0x7f4e801a40a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e80107a60 0x7f4e8019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 --2- 172.21.15.5:0/2566918007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e8010c400 0x7f4e8019f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 >> 172.21.15.5:0/2566918007 conn(0x7f4e8006bc20 msgr2=0x7f4e80070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 shutdown_connections 2023-10-08T13:15:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:31.398+0000 7f4e8661b700 1 -- 172.21.15.5:0/2566918007 wait complete. 2023-10-08T13:15:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 550.0 s, 519.6 tps, lat 194.256 ms stddev 210.742 2023-10-08T13:15:33.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:32 smithi060 ceph-mon[103190]: pgmap v592: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2023-10-08T13:15:33.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:32 smithi005 ceph-mon[99496]: pgmap v592: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2023-10-08T13:15:33.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:32 smithi118 ceph-mon[104234]: pgmap v592: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2023-10-08T13:15:35.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:34 smithi060 ceph-mon[103190]: pgmap v593: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 504 op/s 2023-10-08T13:15:35.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:34 smithi005 ceph-mon[99496]: pgmap v593: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 504 op/s 2023-10-08T13:15:35.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:34 smithi118 ceph-mon[104234]: pgmap v593: 129 pgs: 129 active+clean; 3.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 504 op/s 2023-10-08T13:15:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 555.0 s, 523.4 tps, lat 194.304 ms stddev 231.710 2023-10-08T13:15:37.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:36 smithi060 ceph-mon[103190]: pgmap v594: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 538 op/s 2023-10-08T13:15:37.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:36 smithi005 ceph-mon[99496]: pgmap v594: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 538 op/s 2023-10-08T13:15:37.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:36 smithi118 ceph-mon[104234]: pgmap v594: 129 pgs: 129 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 538 op/s 2023-10-08T13:15:38.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:37 smithi060 ceph-mon[103190]: pgmap v595: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.8 MiB/s wr, 490 op/s 2023-10-08T13:15:38.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:37 smithi005 ceph-mon[99496]: pgmap v595: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.8 MiB/s wr, 490 op/s 2023-10-08T13:15:38.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:37 smithi118 ceph-mon[104234]: pgmap v595: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.8 MiB/s wr, 490 op/s 2023-10-08T13:15:39.923 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:39 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:15:39.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:39 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:15:40.050 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:39 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:15:40.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:40 smithi060 ceph-mon[103190]: pgmap v596: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 527 op/s 2023-10-08T13:15:40.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:40 smithi005 ceph-mon[99496]: pgmap v596: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 527 op/s 2023-10-08T13:15:41.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:40 smithi118 ceph-mon[104234]: pgmap v596: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 527 op/s 2023-10-08T13:15:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 560.0 s, 538.1 tps, lat 185.533 ms stddev 210.425 2023-10-08T13:15:41.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:15:41.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:15:41.925 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:15:42.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:15:42.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:15:42.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:15:42.170 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:15:42.170 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:15:42.170 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:15:43.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:42 smithi118 ceph-mon[104234]: pgmap v597: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2023-10-08T13:15:43.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:42 smithi060 ceph-mon[103190]: pgmap v597: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2023-10-08T13:15:43.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:42 smithi005 ceph-mon[99496]: pgmap v597: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 536 op/s 2023-10-08T13:15:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 -- 172.21.15.5:0/3972081785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c10c510 msgr2=0x7f173c10c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 --2- 172.21.15.5:0/3972081785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c10c510 0x7f173c10c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1738009990 tx=0x7f1738009ca0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 -- 172.21.15.5:0/3972081785 shutdown_connections 2023-10-08T13:15:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 --2- 172.21.15.5:0/3972081785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108a40 0x7f173c1143a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 --2- 172.21.15.5:0/3972081785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c10c510 0x7f173c10c8f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 --2- 172.21.15.5:0/3972081785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f173c108080 0x7f173c108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 -- 172.21.15.5:0/3972081785 >> 172.21.15.5:0/3972081785 conn(0x7f173c06b7c0 msgr2=0x7f173c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 -- 172.21.15.5:0/3972081785 shutdown_connections 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.750+0000 7f1743944700 1 -- 172.21.15.5:0/3972081785 wait complete. 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 Processor -- start 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 -- start start 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108080 0x7f173c19f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 0x7f173c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f173c10c510 0x7f173c1a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c1a41a0 con 0x7f173c108a40 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c1a4310 con 0x7f173c10c510 2023-10-08T13:15:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1743944700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c1a44d0 con 0x7f173c108080 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.751+0000 7f1740edf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 0x7f173c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f17416e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108080 0x7f173c19f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 0x7f173c19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37508/0 (socket says 172.21.15.5:37508) 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 -- 172.21.15.5:0/1093516482 learned_addr learned my addr 172.21.15.5:0/1093516482 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1741ee1700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f173c10c510 0x7f173c1a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 -- 172.21.15.5:0/1093516482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108080 msgr2=0x7f173c19f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108080 0x7f173c19f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 -- 172.21.15.5:0/1093516482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f173c10c510 msgr2=0x7f173c1a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f173c10c510 0x7f173c1a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 -- 172.21.15.5:0/1093516482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380095f0 con 0x7f173c108a40 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f17416e0700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108080 0x7f173c19f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:44.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1740edf700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 0x7f173c19f810 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f172c00e9a0 tx=0x7f172c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f17327fc700 1 -- 172.21.15.5:0/1093516482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c009790 con 0x7f173c108a40 2023-10-08T13:15:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f17327fc700 1 -- 172.21.15.5:0/1093516482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f172c010430 con 0x7f173c108a40 2023-10-08T13:15:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c1a47b0 con 0x7f173c108a40 2023-10-08T13:15:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f17327fc700 1 -- 172.21.15.5:0/1093516482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c018680 con 0x7f173c108a40 2023-10-08T13:15:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.752+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c1abff0 con 0x7f173c108a40 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.757+0000 7f174fb2db80 1 Processor -- start 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 -- start start 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 0x562f3def5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3deefb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3def0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3de58400 con 0x562f3def5880 2023-10-08T13:15:44.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3de49bc0 con 0x562f3def00b0 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f174fb2db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3de474e0 con 0x562f3def61a0 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f1741ee1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 0x562f3def5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f1741ee1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 0x562f3def5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37514/0 (socket says 172.21.15.5:37514) 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.759+0000 7f1741ee1700 1 -- 172.21.15.5:0/298629339 learned_addr learned my addr 172.21.15.5:0/298629339 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f17416e0700 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3deefb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f1741ee1700 1 -- 172.21.15.5:0/298629339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 msgr2=0x562f3deefb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f1741ee1700 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3deefb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f1741ee1700 1 -- 172.21.15.5:0/298629339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 msgr2=0x562f3def0510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f1741ee1700 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3def0510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f1741ee1700 1 -- 172.21.15.5:0/298629339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f3dc6dd80 con 0x562f3def5880 2023-10-08T13:15:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f1741ee1700 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 0x562f3def5c60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1734033690 tx=0x7f1734009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220d5dd02edf345a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f17277fe700 1 -- 172.21.15.5:0/298629339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173400e040 con 0x562f3def5880 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f17277fe700 1 -- 172.21.15.5:0/298629339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f173400f040 con 0x562f3def5880 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.760+0000 7f17277fe700 1 -- 172.21.15.5:0/298629339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734004820 con 0x562f3def5880 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.761+0000 7f174fb2db80 1 -- 172.21.15.5:0/298629339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 msgr2=0x562f3def5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.761+0000 7f174fb2db80 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 0x562f3def5c60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1734033690 tx=0x7f1734009920 comp rx=0 tx=0).stop 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.762+0000 7f17327fc700 1 -- 172.21.15.5:0/1093516482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f172c0105a0 con 0x7f173c108a40 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.763+0000 7f17327fc700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17280a16e0 0x7f17280a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.763+0000 7f17327fc700 1 -- 172.21.15.5:0/1093516482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f172c014070 con 0x7f173c108a40 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.764+0000 7f174fb2db80 1 -- 172.21.15.5:0/298629339 shutdown_connections 2023-10-08T13:15:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.764+0000 7f174fb2db80 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3def0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.764+0000 7f174fb2db80 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def5880 0x562f3def5c60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.764+0000 7f174fb2db80 1 --2- 172.21.15.5:0/298629339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3deefb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.764+0000 7f174fb2db80 1 -- 172.21.15.5:0/298629339 >> 172.21.15.5:0/298629339 conn(0x562f3de64200 msgr2=0x562f3deeab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:44.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.769+0000 7f1741ee1700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17280a16e0 0x7f17280a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.769+0000 7f1741ee1700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17280a16e0 0x7f17280a3ba0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f173400b010 tx=0x7f1734004340 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:44.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.769+0000 7f174fb2db80 1 -- 172.21.15.5:0/298629339 shutdown_connections 2023-10-08T13:15:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.770+0000 7f174fb2db80 1 -- 172.21.15.5:0/298629339 wait complete. 2023-10-08T13:15:44.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.770+0000 7f174fb2db80 1 -- start start 2023-10-08T13:15:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 Processor -- start 2023-10-08T13:15:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3defc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3def9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def61a0 0x562f3def9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3de42dd0 con 0x562f3def00b0 2023-10-08T13:15:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3dddf6b0 con 0x562f3def61a0 2023-10-08T13:15:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3dddf350 con 0x562f3def5880 2023-10-08T13:15:44.773 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.771+0000 7f174fb2db80 10 client.0 _ll_register_callbacks cb 0x562f3dc3c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.772+0000 7f17416e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3defc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.772+0000 7f17416e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3defc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37518/0 (socket says 172.21.15.5:37518) 2023-10-08T13:15:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.772+0000 7f17416e0700 1 -- 172.21.15.5:0/3436674478 learned_addr learned my addr 172.21.15.5:0/3436674478 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.773+0000 7f17416e0700 1 -- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 msgr2=0x562f3def9450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:15:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.773+0000 7f17416e0700 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3def9450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.773+0000 7f17416e0700 1 -- 172.21.15.5:0/3436674478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def61a0 msgr2=0x562f3def9b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:15:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.773+0000 7f17416e0700 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def61a0 0x562f3def9b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.773+0000 7f17416e0700 1 -- 172.21.15.5:0/3436674478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734033340 con 0x562f3def00b0 2023-10-08T13:15:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.773+0000 7f17416e0700 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3defc160 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1738015000 tx=0x7f1738005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886d2910cb93a7c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:44.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.774+0000 7f1724ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.779+0000 7f1724ff9700 1 -- 172.21.15.5:0/3436674478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173801d070 con 0x562f3def00b0 2023-10-08T13:15:44.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.779+0000 7f1724ff9700 1 -- 172.21.15.5:0/3436674478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1738025ac0 con 0x562f3def00b0 2023-10-08T13:15:44.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.782+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f3de0ae50 con 0x562f3def00b0 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.782+0000 7f1724ff9700 1 -- 172.21.15.5:0/3436674478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17380056f0 con 0x562f3def00b0 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.782+0000 7f174fb2db80 10 client.16845 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.782+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x562f3dc56c00 con 0x562f3def00b0 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f1724ff9700 1 -- 172.21.15.5:0/3436674478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1738034030 con 0x562f3def00b0 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f1724ff9700 1 -- 172.21.15.5:0/3436674478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f173800f460 con 0x562f3def00b0 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f174fb2db80 10 client.16845 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f174fb2db80 10 client.16845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f174fb2db80 20 client.16845 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df09c60 0x562f3df0c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f174fb2db80 4 client.16845 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f3de3bdb0 con 0x562f3df09c60 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.783+0000 7f1740edf700 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df09c60 0x562f3df0c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.784+0000 7f1724ff9700 10 client.16845 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.784+0000 7f1740edf700 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df09c60 0x562f3df0c080 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140ebeb2d7d90ef8 server_cookie=b4607398ff0b7b70 in_seq=0 out_seq=0 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f1724ff9700 1 -- 172.21.15.5:0/3436674478 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f3de3bdb0 con 0x562f3df09c60 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f1724ff9700 10 client.16845 handle_command_reply: tid=0 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 client.16845 shutdown 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 msgr2=0x562f3defc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3defc160 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1738015000 tx=0x7f1738005bc0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 shutdown_connections 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df09c60 0x562f3df0c080 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def61a0 0x562f3def9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3defc160 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3436674478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3def9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 >> 172.21.15.5:0/3436674478 conn(0x562f3de64200 msgr2=0x562f3deea010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:44.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.785+0000 7f1724ff9700 0 client.16845 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:44.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.792+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 shutdown_connections 2023-10-08T13:15:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.799+0000 7f174fb2db80 1 -- 172.21.15.5:0/3436674478 wait complete. 2023-10-08T13:15:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.801+0000 7f174fb2db80 20 client.16845 trim_cache size 0 max 16384 2023-10-08T13:15:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 Processor -- start 2023-10-08T13:15:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 -- start start 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3deefb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def5880 0x562f3def9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3df00c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3dcc38c0 con 0x562f3def00b0 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3df06760 con 0x562f3def5880 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.828+0000 7f174fb2db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3deec100 con 0x562f3def61a0 2023-10-08T13:15:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.829+0000 7f17416e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3deefb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.829+0000 7f17416e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3deefb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37528/0 (socket says 172.21.15.5:37528) 2023-10-08T13:15:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.829+0000 7f17416e0700 1 -- 172.21.15.5:0/3591847676 learned_addr learned my addr 172.21.15.5:0/3591847676 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.830+0000 7f17416e0700 1 -- 172.21.15.5:0/3591847676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 msgr2=0x562f3df00c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.830+0000 7f17416e0700 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3df00c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.830+0000 7f17416e0700 1 -- 172.21.15.5:0/3591847676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def5880 msgr2=0x562f3def9b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:15:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.830+0000 7f17416e0700 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def5880 0x562f3def9b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.830+0000 7f17416e0700 1 -- 172.21.15.5:0/3591847676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f3dc941f0 con 0x562f3def00b0 2023-10-08T13:15:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.830+0000 7f17416e0700 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3deefb70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1738005aa0 tx=0x7f1738009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a4ee92efc5afb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.838+0000 7f1727fff700 1 -- 172.21.15.5:0/3591847676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173801d070 con 0x562f3def00b0 2023-10-08T13:15:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.838+0000 7f1727fff700 1 -- 172.21.15.5:0/3591847676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1738034040 con 0x562f3def00b0 2023-10-08T13:15:44.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.838+0000 7f1727fff700 1 -- 172.21.15.5:0/3591847676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380047d0 con 0x562f3def00b0 2023-10-08T13:15:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 -- 172.21.15.5:0/3591847676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 msgr2=0x562f3deefb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3deefb70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1738005aa0 tx=0x7f1738009290 comp rx=0 tx=0).stop 2023-10-08T13:15:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 -- 172.21.15.5:0/3591847676 shutdown_connections 2023-10-08T13:15:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def61a0 0x562f3df00c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def00b0 0x562f3deefb70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 --2- 172.21.15.5:0/3591847676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def5880 0x562f3def9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.842+0000 7f174fb2db80 1 -- 172.21.15.5:0/3591847676 >> 172.21.15.5:0/3591847676 conn(0x562f3de64200 msgr2=0x562f3def04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.860+0000 7f174fb2db80 1 -- 172.21.15.5:0/3591847676 shutdown_connections 2023-10-08T13:15:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.861+0000 7f174fb2db80 1 -- 172.21.15.5:0/3591847676 wait complete. 2023-10-08T13:15:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.861+0000 7f174fb2db80 1 -- start start 2023-10-08T13:15:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.861+0000 7f174fb2db80 1 Processor -- start 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3defedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3deff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def61a0 0x562f3df56ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3df57010 con 0x562f3def61a0 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3df57180 con 0x562f3def00b0 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3df57340 con 0x562f3def5880 2023-10-08T13:15:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.862+0000 7f174fb2db80 10 client.0 _ll_register_callbacks cb 0x7f173800be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.871+0000 7f1740edf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3deff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.875+0000 7f1741ee1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def61a0 0x562f3df56ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.875+0000 7f1741ee1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def61a0 0x562f3df56ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37530/0 (socket says 172.21.15.5:37530) 2023-10-08T13:15:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.875+0000 7f1741ee1700 1 -- 172.21.15.5:0/403303390 learned_addr learned my addr 172.21.15.5:0/403303390 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.886+0000 7f17416e0700 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3defedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.886+0000 7f1740edf700 1 -- 172.21.15.5:0/403303390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 msgr2=0x562f3defedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.886+0000 7f1740edf700 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3defedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.886+0000 7f1740edf700 1 -- 172.21.15.5:0/403303390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def61a0 msgr2=0x562f3df56ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.886+0000 7f1740edf700 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def61a0 0x562f3df56ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.886+0000 7f1740edf700 1 -- 172.21.15.5:0/403303390 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f3dc56c00 con 0x562f3def5880 2023-10-08T13:15:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.899+0000 7f1740edf700 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3deff330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ca980 tx=0x7f172c0092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d88323e5b14a8110 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.901+0000 7f1724ff9700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:15:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.901+0000 7f1724ff9700 1 -- 172.21.15.5:0/403303390 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c09e170 con 0x562f3def5880 2023-10-08T13:15:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.901+0000 7f1724ff9700 1 -- 172.21.15.5:0/403303390 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f172c09e360 con 0x562f3def5880 2023-10-08T13:15:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.901+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f173400f040 con 0x562f3def5880 2023-10-08T13:15:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f1724ff9700 1 -- 172.21.15.5:0/403303390 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f172c0a25a0 con 0x562f3def5880 2023-10-08T13:15:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 10 client.26359 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x562f3dc6c250 con 0x562f3def5880 2023-10-08T13:15:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f1724ff9700 1 -- 172.21.15.5:0/403303390 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f173400f040 con 0x562f3def5880 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f1724ff9700 1 -- 172.21.15.5:0/403303390 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f172c099700 con 0x562f3def5880 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 10 client.26359 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 10 client.26359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 20 client.26359 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df5ec10 0x562f3df61030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 4 client.26359 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:15:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.922+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562f3de3bad0 con 0x562f3df5ec10 2023-10-08T13:15:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.938+0000 7f17416e0700 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df5ec10 0x562f3df61030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.951+0000 7f17416e0700 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df5ec10 0x562f3df61030 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c4f570ec88198b server_cookie=6a0ffcf0570fa269 in_seq=0 out_seq=0 2023-10-08T13:15:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.952+0000 7f1724ff9700 10 client.26359 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.969+0000 7f1724ff9700 1 -- 172.21.15.5:0/403303390 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562f3de3bad0 con 0x562f3df5ec10 2023-10-08T13:15:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.969+0000 7f1724ff9700 10 client.26359 handle_command_reply: tid=0 2023-10-08T13:15:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.977+0000 7f174fb2db80 1 client.26359 shutdown 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.978+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 msgr2=0x562f3deff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.978+0000 7f174fb2db80 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3deff330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ca980 tx=0x7f172c0092d0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 shutdown_connections 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f174fb2db80 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f3def61a0 0x562f3df56ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f174fb2db80 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x562f3df5ec10 0x562f3df61030 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f174fb2db80 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562f3def00b0 0x562f3defedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f174fb2db80 1 --2- 172.21.15.5:0/403303390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562f3def5880 0x562f3deff330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 >> 172.21.15.5:0/403303390 conn(0x562f3de64200 msgr2=0x562f3def3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.979+0000 7f1724ff9700 0 client.26359 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.986+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 shutdown_connections 2023-10-08T13:15:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.986+0000 7f174fb2db80 1 -- 172.21.15.5:0/403303390 wait complete. 2023-10-08T13:15:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:44.993+0000 7f174fb2db80 20 client.26359 trim_cache size 0 max 16384 2023-10-08T13:15:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:15:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:15:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:15:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:15:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.006+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17280a16e0 msgr2=0x7f17280a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:45.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.006+0000 7f1743944700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17280a16e0 0x7f17280a3ba0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f173400b010 tx=0x7f1734004340 comp rx=0 tx=0).stop 2023-10-08T13:15:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.006+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 msgr2=0x7f173c19f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.006+0000 7f1743944700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 0x7f173c19f810 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f172c00e9a0 tx=0x7f172c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:15:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.007+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 shutdown_connections 2023-10-08T13:15:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.007+0000 7f1743944700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f17280a16e0 0x7f17280a3ba0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.007+0000 7f1743944700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f173c10c510 0x7f173c1a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.007+0000 7f1743944700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f173c108080 0x7f173c19f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.007+0000 7f1743944700 1 --2- 172.21.15.5:0/1093516482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f173c108a40 0x7f173c19f810 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.007+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 >> 172.21.15.5:0/1093516482 conn(0x7f173c06b7c0 msgr2=0x7f173c06ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.013+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 shutdown_connections 2023-10-08T13:15:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:45.013+0000 7f1743944700 1 -- 172.21.15.5:0/1093516482 wait complete. 2023-10-08T13:15:45.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:44 smithi118 ceph-mon[104234]: pgmap v598: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2023-10-08T13:15:45.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:44 smithi060 ceph-mon[103190]: pgmap v598: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2023-10-08T13:15:45.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:44 smithi005 ceph-mon[99496]: pgmap v598: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 496 op/s 2023-10-08T13:15:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 565.0 s, 532.0 tps, lat 186.690 ms stddev 189.358 2023-10-08T13:15:47.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:46 smithi118 ceph-mon[104234]: pgmap v599: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 504 op/s 2023-10-08T13:15:47.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:46 smithi060 ceph-mon[103190]: pgmap v599: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 504 op/s 2023-10-08T13:15:47.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:46 smithi005 ceph-mon[99496]: pgmap v599: 129 pgs: 129 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 504 op/s 2023-10-08T13:15:48.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:15:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 -- 172.21.15.5:0/1803441437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 msgr2=0x7f6e64107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 --2- 172.21.15.5:0/1803441437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64107c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c01c0d0 tx=0x7f6e5c01c3e0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 -- 172.21.15.5:0/1803441437 shutdown_connections 2023-10-08T13:15:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 --2- 172.21.15.5:0/1803441437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e641083a0 0x7f6e6411bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 --2- 172.21.15.5:0/1803441437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e6410edf0 0x7f6e6410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 --2- 172.21.15.5:0/1803441437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64107c70 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.130+0000 7f6e6b745700 1 -- 172.21.15.5:0/1803441437 >> 172.21.15.5:0/1803441437 conn(0x7f6e6406b770 msgr2=0x7f6e6406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:49.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.139+0000 7f6e6b745700 1 -- 172.21.15.5:0/1803441437 shutdown_connections 2023-10-08T13:15:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.142+0000 7f6e6b745700 1 -- 172.21.15.5:0/1803441437 wait complete. 2023-10-08T13:15:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.143+0000 7f6e6b745700 1 Processor -- start 2023-10-08T13:15:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 -- start start 2023-10-08T13:15:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64117d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e641083a0 0x7f6e64118280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e6410edf0 0x7f6e641a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e641a2150 con 0x7f6e641077f0 2023-10-08T13:15:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e641a2290 con 0x7f6e6410edf0 2023-10-08T13:15:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.146+0000 7f6e6b745700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e641a2450 con 0x7f6e641083a0 2023-10-08T13:15:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.147+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64117d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.147+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64117d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37542/0 (socket says 172.21.15.5:37542) 2023-10-08T13:15:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.147+0000 7f6e694e1700 1 -- 172.21.15.5:0/2649166034 learned_addr learned my addr 172.21.15.5:0/2649166034 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.147+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e641083a0 0x7f6e64118280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.148+0000 7f6e69ce2700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e6410edf0 0x7f6e641a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.148+0000 7f6e68ce0700 1 -- 172.21.15.5:0/2649166034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e6410edf0 msgr2=0x7f6e641a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.148+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e6410edf0 0x7f6e641a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.148+0000 7f6e68ce0700 1 -- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 msgr2=0x7f6e64117d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.148+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64117d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.148+0000 7f6e68ce0700 1 -- 172.21.15.5:0/2649166034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c01ad10 con 0x7f6e641083a0 2023-10-08T13:15:49.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.153+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e641083a0 0x7f6e64118280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c01c0d0 tx=0x7f6e5c004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:49.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.155+0000 7f6e5a7fc700 1 -- 172.21.15.5:0/2649166034 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c01f040 con 0x7f6e641083a0 2023-10-08T13:15:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.155+0000 7f6e5a7fc700 1 -- 172.21.15.5:0/2649166034 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5c01de60 con 0x7f6e641083a0 2023-10-08T13:15:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.155+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e641a26d0 con 0x7f6e641083a0 2023-10-08T13:15:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.155+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e641cbec0 con 0x7f6e641083a0 2023-10-08T13:15:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.156+0000 7f6e5a7fc700 1 -- 172.21.15.5:0/2649166034 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0052a0 con 0x7f6e641083a0 2023-10-08T13:15:49.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:48 smithi060 ceph-mon[103190]: pgmap v600: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.1 MiB/s wr, 465 op/s 2023-10-08T13:15:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.159+0000 7f6e5a7fc700 1 -- 172.21.15.5:0/2649166034 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6e5c0182b0 con 0x7f6e641083a0 2023-10-08T13:15:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e5a7fc700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6e500a16b0 0x7f6e500a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e5a7fc700 1 -- 172.21.15.5:0/2649166034 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6e5c00d030 con 0x7f6e641083a0 2023-10-08T13:15:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 Processor -- start 2023-10-08T13:15:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 -- start start 2023-10-08T13:15:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e694e1700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6e500a16b0 0x7f6e500a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c993b460 con 0x5594c99d1e80 2023-10-08T13:15:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c992cc20 con 0x5594c99dd650 2023-10-08T13:15:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.160+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c992a540 con 0x5594c99d27a0 2023-10-08T13:15:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e68ce0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37550/0 (socket says 172.21.15.5:37550) 2023-10-08T13:15:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e694e1700 1 -- 172.21.15.5:0/3243930825 learned_addr learned my addr 172.21.15.5:0/3243930825 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e69ce2700 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e694e1700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6e500a16b0 0x7f6e500a3b70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e540135a0 tx=0x7f6e54013960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e68ce0700 1 -- 172.21.15.5:0/3243930825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 msgr2=0x5594c99dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e68ce0700 1 -- 172.21.15.5:0/3243930825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 msgr2=0x5594c99d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e68ce0700 1 -- 172.21.15.5:0/3243930825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594c9750de0 con 0x5594c99d27a0 2023-10-08T13:15:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.161+0000 7f6e694e1700 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.162+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dd110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0cb750 tx=0x7f6e5c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97dec217e3b8ca43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.162+0000 7f6e4f7fe700 1 -- 172.21.15.5:0/3243930825 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c09bbc0 con 0x5594c99d27a0 2023-10-08T13:15:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.162+0000 7f6e4f7fe700 1 -- 172.21.15.5:0/3243930825 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5c09fd10 con 0x5594c99d27a0 2023-10-08T13:15:49.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.162+0000 7f6e4f7fe700 1 -- 172.21.15.5:0/3243930825 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c09be20 con 0x5594c99d27a0 2023-10-08T13:15:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 -- 172.21.15.5:0/3243930825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 msgr2=0x5594c99dd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dd110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0cb750 tx=0x7f6e5c01c3e0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 -- 172.21.15.5:0/3243930825 shutdown_connections 2023-10-08T13:15:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/3243930825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dd110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 -- 172.21.15.5:0/3243930825 >> 172.21.15.5:0/3243930825 conn(0x5594c9947260 msgr2=0x5594c99ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 -- 172.21.15.5:0/3243930825 shutdown_connections 2023-10-08T13:15:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 -- 172.21.15.5:0/3243930825 wait complete. 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 -- start start 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 Processor -- start 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 0x5594c99dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.163+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 0x5594c99da340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99dd650 0x5594c99da900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c9925e30 con 0x5594c99d27a0 2023-10-08T13:15:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c98c2710 con 0x5594c99d1e80 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c98c23b0 con 0x5594c99dd650 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e7792eb80 10 client.0 _ll_register_callbacks cb 0x5594c971f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 0x5594c99dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 0x5594c99da340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e69ce2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99dd650 0x5594c99da900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 0x5594c99dd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60738/0 (socket says 172.21.15.5:60738) 2023-10-08T13:15:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e69ce2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99dd650 0x5594c99da900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50764/0 (socket says 172.21.15.5:50764) 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 0x5594c99da340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37558/0 (socket says 172.21.15.5:37558) 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e694e1700 1 -- 172.21.15.5:0/4060604688 learned_addr learned my addr 172.21.15.5:0/4060604688 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 -- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99dd650 msgr2=0x5594c99da900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99dd650 0x5594c99da900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 -- 172.21.15.5:0/4060604688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 msgr2=0x5594c99dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 0x5594c99dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 -- 172.21.15.5:0/4060604688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5400f3d0 con 0x5594c99d27a0 2023-10-08T13:15:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e694e1700 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 0x5594c99dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 0x5594c99da340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c099f10 tx=0x7f6e5c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8a798fe83f33df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e4cff9700 1 -- 172.21.15.5:0/4060604688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0a3f40 con 0x5594c99d27a0 2023-10-08T13:15:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e4cff9700 1 -- 172.21.15.5:0/4060604688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6e5c09b0b0 con 0x5594c99d27a0 2023-10-08T13:15:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.164+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594c98edeb0 con 0x5594c99d27a0 2023-10-08T13:15:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e4cff9700 1 -- 172.21.15.5:0/4060604688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e5c09b2b0 con 0x5594c99d27a0 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 10 client.16863 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f6e641cbec0 con 0x5594c99d27a0 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e4cff9700 1 -- 172.21.15.5:0/4060604688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5594c98edeb0 con 0x5594c99d27a0 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e4cff9700 1 -- 172.21.15.5:0/4060604688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e5c0a3a30 con 0x5594c99d27a0 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 10 client.16863 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 20 client.16863 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c99eca40 0x5594c99eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 4 client.16863 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594c991ee10 con 0x5594c99eca40 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.165+0000 7f6e694e1700 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c99eca40 0x5594c99eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.166+0000 7f6e4cff9700 10 client.16863 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.166+0000 7f6e694e1700 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c99eca40 0x5594c99eee60 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a38765718e0f1c3d server_cookie=b6fe0754633124d2 in_seq=0 out_seq=0 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.166+0000 7f6e4cff9700 1 -- 172.21.15.5:0/4060604688 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594c991ee10 con 0x5594c99eca40 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e4cff9700 10 client.16863 handle_command_reply: tid=0 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 client.16863 shutdown 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 msgr2=0x5594c99da340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 0x5594c99da340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c099f10 tx=0x7f6e5c01c960 comp rx=0 tx=0).stop 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 shutdown_connections 2023-10-08T13:15:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99dd650 0x5594c99da900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c99eca40 0x5594c99eee60 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d1e80 0x5594c99dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e4cff9700 0 client.16863 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/4060604688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d27a0 0x5594c99da340 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 >> 172.21.15.5:0/4060604688 conn(0x5594c9947260 msgr2=0x5594c99cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 shutdown_connections 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 1 -- 172.21.15.5:0/4060604688 wait complete. 2023-10-08T13:15:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.167+0000 7f6e7792eb80 20 client.16863 trim_cache size 0 max 16384 2023-10-08T13:15:49.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:48 smithi005 ceph-mon[99496]: pgmap v600: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.1 MiB/s wr, 465 op/s 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 Processor -- start 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 -- start start 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99e4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99d8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c97a6920 con 0x5594c99d1e80 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c99e45b0 con 0x5594c99dd650 2023-10-08T13:15:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c99d8890 con 0x5594c99d27a0 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37564/0 (socket says 172.21.15.5:37564) 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 -- 172.21.15.5:0/1155474613 learned_addr learned my addr 172.21.15.5:0/1155474613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e69ce2700 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99d8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 -- 172.21.15.5:0/1155474613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 msgr2=0x5594c99dcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 -- 172.21.15.5:0/1155474613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 msgr2=0x5594c99d8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99d8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.185+0000 7f6e694e1700 1 -- 172.21.15.5:0/1155474613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594c9739c60 con 0x5594c99d1e80 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e694e1700 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99e4040 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6e54013fd0 tx=0x7f6e5401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbcb2d57e10a9ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e4ffff700 1 -- 172.21.15.5:0/1155474613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54025040 con 0x5594c99d1e80 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e4ffff700 1 -- 172.21.15.5:0/1155474613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e54027040 con 0x5594c99d1e80 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e4ffff700 1 -- 172.21.15.5:0/1155474613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54018040 con 0x5594c99d1e80 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1155474613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 msgr2=0x5594c99e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99e4040 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6e54013fd0 tx=0x7f6e5401e000 comp rx=0 tx=0).stop 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1155474613 shutdown_connections 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99dd650 0x5594c99d8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99d1e80 0x5594c99e4040 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1155474613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d27a0 0x5594c99dcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.186+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1155474613 >> 172.21.15.5:0/1155474613 conn(0x5594c9947260 msgr2=0x5594c99d5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1155474613 shutdown_connections 2023-10-08T13:15:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1155474613 wait complete. 2023-10-08T13:15:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 -- start start 2023-10-08T13:15:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 Processor -- start 2023-10-08T13:15:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d1e80 0x5594c99e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d27a0 0x5594c99e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 0x5594c99e2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c99e2c40 con 0x5594c99dd650 2023-10-08T13:15:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c99e2db0 con 0x5594c99d27a0 2023-10-08T13:15:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c99e2f70 con 0x5594c99d1e80 2023-10-08T13:15:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e69ce2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 0x5594c99e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e7792eb80 10 client.0 _ll_register_callbacks cb 0x7f6e54009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d1e80 0x5594c99e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e69ce2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 0x5594c99e2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37574/0 (socket says 172.21.15.5:37574) 2023-10-08T13:15:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e69ce2700 1 -- 172.21.15.5:0/1573752658 learned_addr learned my addr 172.21.15.5:0/1573752658 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e694e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d1e80 0x5594c99e3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50774/0 (socket says 172.21.15.5:50774) 2023-10-08T13:15:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.187+0000 7f6e68ce0700 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d27a0 0x5594c99e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e69ce2700 1 -- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d1e80 msgr2=0x5594c99e3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e69ce2700 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d1e80 0x5594c99e3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e69ce2700 1 -- 172.21.15.5:0/1573752658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d27a0 msgr2=0x5594c99e2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e69ce2700 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d27a0 0x5594c99e2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e69ce2700 1 -- 172.21.15.5:0/1573752658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5400faf0 con 0x5594c99dd650 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e69ce2700 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 0x5594c99e2670 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6e60015670 tx=0x7f6e60015980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaa6a401ba489f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e4cff9700 1 -- 172.21.15.5:0/1573752658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000b800 con 0x5594c99dd650 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e4cff9700 1 -- 172.21.15.5:0/1573752658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6e60016430 con 0x5594c99dd650 2023-10-08T13:15:49.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e5c09fd10 con 0x5594c99dd650 2023-10-08T13:15:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e4cff9700 1 -- 172.21.15.5:0/1573752658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e60016630 con 0x5594c99dd650 2023-10-08T13:15:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e7792eb80 10 client.16869 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x5594c9777250 con 0x5594c99dd650 2023-10-08T13:15:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e4cff9700 1 -- 172.21.15.5:0/1573752658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e5c09fd10 con 0x5594c99dd650 2023-10-08T13:15:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.188+0000 7f6e4cff9700 1 -- 172.21.15.5:0/1573752658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e6001fa30 con 0x5594c99dd650 2023-10-08T13:15:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 10 client.16869 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 20 client.16869 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c9a41fd0 0x5594c9a443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 4 client.16869 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:15:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5594c991eb30 con 0x5594c9a41fd0 2023-10-08T13:15:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e694e1700 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c9a41fd0 0x5594c9a443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e4cff9700 10 client.16869 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e694e1700 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c9a41fd0 0x5594c9a443f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc96c28cc9258475 server_cookie=44cc4bcf6dda65a6 in_seq=0 out_seq=0 2023-10-08T13:15:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e4cff9700 1 -- 172.21.15.5:0/1573752658 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5594c991eb30 con 0x5594c9a41fd0 2023-10-08T13:15:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e4cff9700 10 client.16869 handle_command_reply: tid=0 2023-10-08T13:15:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 1 client.16869 shutdown 2023-10-08T13:15:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 msgr2=0x5594c99e2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.189+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 0x5594c99e2670 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6e60015670 tx=0x7f6e60015980 comp rx=0 tx=0).stop 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 shutdown_connections 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594c99dd650 0x5594c99e2670 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5594c99d1e80 0x5594c99e3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5594c9a41fd0 0x5594c9a443f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 --2- 172.21.15.5:0/1573752658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5594c99d27a0 0x5594c99e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e4cff9700 0 client.16869 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 >> 172.21.15.5:0/1573752658 conn(0x5594c9947260 msgr2=0x5594c99d8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 shutdown_connections 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 1 -- 172.21.15.5:0/1573752658 wait complete. 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e7792eb80 20 client.16869 trim_cache size 0 max 16384 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:15:49.203 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:15:49.204 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6e500a16b0 msgr2=0x7f6e500a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6e500a16b0 0x7f6e500a3b70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e540135a0 tx=0x7f6e54013960 comp rx=0 tx=0).stop 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e641083a0 msgr2=0x7f6e64118280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e641083a0 0x7f6e64118280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c01c0d0 tx=0x7f6e5c004cf0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 shutdown_connections 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f6e500a16b0 0x7f6e500a3b70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e6410edf0 0x7f6e641a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e641077f0 0x7f6e64117d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 --2- 172.21.15.5:0/2649166034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e641083a0 0x7f6e64118280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:49.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.190+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 >> 172.21.15.5:0/2649166034 conn(0x7f6e6406b770 msgr2=0x7f6e6406f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:49.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.192+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 shutdown_connections 2023-10-08T13:15:49.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:15:49.192+0000 7f6e6b745700 1 -- 172.21.15.5:0/2649166034 wait complete. 2023-10-08T13:15:49.214 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:15:49.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:48 smithi118 ceph-mon[104234]: pgmap v600: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.1 MiB/s wr, 465 op/s 2023-10-08T13:15:51.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:50 smithi060 ceph-mon[103190]: pgmap v601: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.6 MiB/s wr, 500 op/s 2023-10-08T13:15:51.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:50 smithi005 ceph-mon[99496]: pgmap v601: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.6 MiB/s wr, 500 op/s 2023-10-08T13:15:51.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:50 smithi118 ceph-mon[104234]: pgmap v601: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 5.6 MiB/s wr, 500 op/s 2023-10-08T13:15:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 570.0 s, 421.3 tps, lat 234.975 ms stddev 510.143 2023-10-08T13:15:53.164 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:52 smithi060 ceph-mon[103190]: pgmap v602: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.5 MiB/s wr, 492 op/s 2023-10-08T13:15:53.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:52 smithi005 ceph-mon[99496]: pgmap v602: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.5 MiB/s wr, 492 op/s 2023-10-08T13:15:53.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:52 smithi118 ceph-mon[104234]: pgmap v602: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.5 MiB/s wr, 492 op/s 2023-10-08T13:15:55.167 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:54 smithi060 ceph-mon[103190]: pgmap v603: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 5.2 MiB/s wr, 458 op/s 2023-10-08T13:15:55.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:54 smithi005 ceph-mon[99496]: pgmap v603: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 5.2 MiB/s wr, 458 op/s 2023-10-08T13:15:55.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:54 smithi118 ceph-mon[104234]: pgmap v603: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 5.2 MiB/s wr, 458 op/s 2023-10-08T13:15:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 575.0 s, 490.7 tps, lat 202.986 ms stddev 219.848 2023-10-08T13:15:57.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:56 smithi118 ceph-mon[104234]: pgmap v604: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 5.2 MiB/s wr, 469 op/s 2023-10-08T13:15:57.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:56 smithi060 ceph-mon[103190]: pgmap v604: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 5.2 MiB/s wr, 469 op/s 2023-10-08T13:15:57.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:56 smithi005 ceph-mon[99496]: pgmap v604: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 5.2 MiB/s wr, 469 op/s 2023-10-08T13:15:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 -- 172.21.15.5:0/1582300872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c0ffde0 msgr2=0x7f4e9c10ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1582300872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c10ca10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009990 tx=0x7f4e98009ca0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 -- 172.21.15.5:0/1582300872 shutdown_connections 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1582300872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c10cfe0 0x7f4e9c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1582300872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 0x7f4e9c0ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1582300872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c10ca10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 -- 172.21.15.5:0/1582300872 >> 172.21.15.5:0/1582300872 conn(0x7f4e9c0fb080 msgr2=0x7f4e9c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 -- 172.21.15.5:0/1582300872 shutdown_connections 2023-10-08T13:15:58.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.283+0000 7f4ea429b700 1 -- 172.21.15.5:0/1582300872 wait complete. 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 Processor -- start 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 -- start start 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 0x7f4e9c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c10cfe0 0x7f4e9c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19dcc0 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19de30 con 0x7f4e9c0ff430 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.284+0000 7f4ea429b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19dff0 con 0x7f4e9c10cfe0 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea2838700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c10cfe0 0x7f4e9c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37586/0 (socket says 172.21.15.5:37586) 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 -- 172.21.15.5:0/1328363645 learned_addr learned my addr 172.21.15.5:0/1328363645 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 0x7f4e9c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 -- 172.21.15.5:0/1328363645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c10cfe0 msgr2=0x7f4e9c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c10cfe0 0x7f4e9c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 -- 172.21.15.5:0/1328363645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 msgr2=0x7f4e9c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 0x7f4e9c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 -- 172.21.15.5:0/1328363645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980095f0 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 0x7f4e9c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c1992e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4e98005910 tx=0x7f4e98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4e937fe700 1 -- 172.21.15.5:0/1328363645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9801d070 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4e937fe700 1 -- 172.21.15.5:0/1328363645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e98022470 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c19e270 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4e937fe700 1 -- 172.21.15.5:0/1328363645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98017650 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.285+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c1a5b10 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.288+0000 7f4e937fe700 1 -- 172.21.15.5:0/1328363645 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4e980177b0 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.288+0000 7f4e937fe700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e880a15e0 0x7f4e880a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.288+0000 7f4e937fe700 1 -- 172.21.15.5:0/1328363645 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4e980ce690 con 0x7f4e9c0ffde0 2023-10-08T13:15:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.289+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e880a15e0 0x7f4e880a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.289+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e880a15e0 0x7f4e880a3aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009480 tx=0x7f4e9400b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.289+0000 7f4eb0484b80 1 Processor -- start 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.289+0000 7f4eb0484b80 1 -- start start 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5342c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f533cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f533d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f52a5400 con 0x55b5f533d0b0 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f5296bc0 con 0x55b5f5342880 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f52944e0 con 0x55b5f53431a0 2023-10-08T13:15:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f533d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f533d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37596/0 (socket says 172.21.15.5:37596) 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5342c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 -- 172.21.15.5:0/3854456781 learned_addr learned my addr 172.21.15.5:0/3854456781 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea1836700 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f533cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 -- 172.21.15.5:0/3854456781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 msgr2=0x55b5f533cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f533cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 -- 172.21.15.5:0/3854456781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 msgr2=0x55b5f5342c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5342c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 -- 172.21.15.5:0/3854456781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5f50bad80 con 0x55b5f533d0b0 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.290+0000 7f4ea2838700 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f533d510 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009c10 tx=0x7f4e8c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ce179cc3aa8f97 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4e90d82700 1 -- 172.21.15.5:0/3854456781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c011cb0 con 0x55b5f533d0b0 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4e90d82700 1 -- 172.21.15.5:0/3854456781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e8c011e10 con 0x55b5f533d0b0 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4e90d82700 1 -- 172.21.15.5:0/3854456781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0193e0 con 0x55b5f533d0b0 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 -- 172.21.15.5:0/3854456781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 msgr2=0x55b5f533d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f533d510 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009c10 tx=0x7f4e8c009f20 comp rx=0 tx=0).stop 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 -- 172.21.15.5:0/3854456781 shutdown_connections 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f533d510 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5342c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/3854456781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f533cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 -- 172.21.15.5:0/3854456781 >> 172.21.15.5:0/3854456781 conn(0x55b5f52b1200 msgr2=0x55b5f5337b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 -- 172.21.15.5:0/3854456781 shutdown_connections 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.291+0000 7f4eb0484b80 1 -- 172.21.15.5:0/3854456781 wait complete. 2023-10-08T13:15:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 -- start start 2023-10-08T13:15:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 Processor -- start 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f533d0b0 0x55b5f53464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 0x55b5f5346a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f5346f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f528fdd0 con 0x55b5f5342880 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f522c6b0 con 0x55b5f533d0b0 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f522c350 con 0x55b5f53431a0 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4eb0484b80 10 client.0 _ll_register_callbacks cb 0x55b5f50897a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4ea1836700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 0x55b5f5346a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4ea1836700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 0x55b5f5346a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37600/0 (socket says 172.21.15.5:37600) 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4ea1836700 1 -- 172.21.15.5:0/1347588223 learned_addr learned my addr 172.21.15.5:0/1347588223 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f533d0b0 0x55b5f53464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.292+0000 7f4ea2838700 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f5346f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4ea1836700 1 -- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 msgr2=0x55b5f5346f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f5346f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4ea1836700 1 -- 172.21.15.5:0/1347588223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f533d0b0 msgr2=0x55b5f53464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f533d0b0 0x55b5f53464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4ea1836700 1 -- 172.21.15.5:0/1347588223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c0098c0 con 0x55b5f5342880 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 0x55b5f5346a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e9809b300 tx=0x7f4e98097d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499ffe48275faaee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4e85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1347588223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9809ba70 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1347588223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4e9809b370 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5f5257e50 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1347588223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e9809f4c0 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4eb0484b80 10 client.16881 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55b5f50a3c00 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1347588223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e980b7080 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.293+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1347588223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e980ce2c0 con 0x55b5f5342880 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4eb0484b80 10 client.16881 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4eb0484b80 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4eb0484b80 20 client.16881 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f5356900 0x55b5f5358cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4eb0484b80 4 client.16881 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5f5288db0 con 0x55b5f5356900 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f5356900 0x55b5f5358cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4e85ffb700 10 client.16881 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.294+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f5356900 0x55b5f5358cf0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a135ed37b1fcab18 server_cookie=4adb786bf211669a in_seq=0 out_seq=0 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1347588223 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b5f5288db0 con 0x55b5f5356900 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4e85ffb700 10 client.16881 handle_command_reply: tid=0 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 client.16881 shutdown 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 msgr2=0x55b5f5346a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 0x55b5f5346a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e9809b300 tx=0x7f4e98097d80 comp rx=0 tx=0).stop 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 shutdown_connections 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f5346f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f5356900 0x55b5f5358cf0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f533d0b0 0x55b5f53464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4e85ffb700 0 client.16881 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1347588223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f5342880 0x55b5f5346a30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 >> 172.21.15.5:0/1347588223 conn(0x55b5f52b1200 msgr2=0x55b5f5337010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 shutdown_connections 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1347588223 wait complete. 2023-10-08T13:15:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.295+0000 7f4eb0484b80 20 client.16881 trim_cache size 0 max 16384 2023-10-08T13:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.310+0000 7f4eb0484b80 1 Processor -- start 2023-10-08T13:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.310+0000 7f4eb0484b80 1 -- start start 2023-10-08T13:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 0x55b5f533cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5337790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f53431a0 0x55b5f5337cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f51108c0 con 0x55b5f53431a0 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f5334830 con 0x55b5f5342880 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f5347b60 con 0x55b5f533d0b0 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2838700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f53431a0 0x55b5f5337cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 0x55b5f533cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 0x55b5f533cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50810/0 (socket says 172.21.15.5:50810) 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2838700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f53431a0 0x55b5f5337cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37610/0 (socket says 172.21.15.5:37610) 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 -- 172.21.15.5:0/231008519 learned_addr learned my addr 172.21.15.5:0/231008519 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea1836700 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5337790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 -- 172.21.15.5:0/231008519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 msgr2=0x55b5f5337790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5337790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 -- 172.21.15.5:0/231008519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f53431a0 msgr2=0x55b5f5337cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f53431a0 0x55b5f5337cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 -- 172.21.15.5:0/231008519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5f50e11f0 con 0x55b5f533d0b0 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.311+0000 7f4ea2037700 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 0x55b5f533cb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55b5f5359600 tx=0x7f4e94014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce39fdefc9b89b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4e91583700 1 -- 172.21.15.5:0/231008519 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9400ee50 con 0x55b5f533d0b0 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4e91583700 1 -- 172.21.15.5:0/231008519 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e9400f040 con 0x55b5f533d0b0 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4e91583700 1 -- 172.21.15.5:0/231008519 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9402ad50 con 0x55b5f533d0b0 2023-10-08T13:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 -- 172.21.15.5:0/231008519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 msgr2=0x55b5f533cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 0x55b5f533cb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55b5f5359600 tx=0x7f4e94014000 comp rx=0 tx=0).stop 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 -- 172.21.15.5:0/231008519 shutdown_connections 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f53431a0 0x55b5f5337cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f533d0b0 0x55b5f533cb70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/231008519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f5337790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 -- 172.21.15.5:0/231008519 >> 172.21.15.5:0/231008519 conn(0x55b5f52b1200 msgr2=0x55b5f533d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 -- 172.21.15.5:0/231008519 shutdown_connections 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.312+0000 7f4eb0484b80 1 -- 172.21.15.5:0/231008519 wait complete. 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 -- start start 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 Processor -- start 2023-10-08T13:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f534bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f534c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f53a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f534c8a0 con 0x55b5f533d0b0 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f534ca10 con 0x55b5f5342880 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5f53a9c40 con 0x55b5f53431a0 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4eb0484b80 10 client.0 _ll_register_callbacks cb 0x7f4e9809aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f534bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4ea2037700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f534bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37612/0 (socket says 172.21.15.5:37612) 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4ea2037700 1 -- 172.21.15.5:0/1301210312 learned_addr learned my addr 172.21.15.5:0/1301210312 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:15:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4ea2838700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f53a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.313+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f534c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea2037700 1 -- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 msgr2=0x55b5f53a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f53a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea2037700 1 -- 172.21.15.5:0/1301210312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 msgr2=0x55b5f534c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f534c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea2037700 1 -- 172.21.15.5:0/1301210312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9400eb50 con 0x55b5f533d0b0 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f534c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:15:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4ea2037700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f534bbd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4e9402a990 tx=0x7f4e94004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f6207403c30e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4e85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1301210312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94017e90 con 0x55b5f533d0b0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1301210312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4e9401c040 con 0x55b5f533d0b0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e8c011e10 con 0x55b5f533d0b0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1301210312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e9402a310 con 0x55b5f533d0b0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4eb0484b80 10 client.16887 fetch_fsmap learned FSMap version 51 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55b5f50b9250 con 0x55b5f533d0b0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1301210312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e8c011e10 con 0x55b5f533d0b0 2023-10-08T13:15:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.314+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1301210312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e94039070 con 0x55b5f533d0b0 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4eb0484b80 10 client.16887 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4eb0484b80 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4eb0484b80 20 client.16887 populate_metadata read hostname 'smithi005' 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f53ab260 0x55b5f53ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4eb0484b80 4 client.16887 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b5f5288ad0 con 0x55b5f53ab260 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f53ab260 0x55b5f53ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4e85ffb700 10 client.16887 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.315+0000 7f4ea1836700 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f53ab260 0x55b5f53ad680 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45704bf50955a1a5 server_cookie=3825026b2af07277 in_seq=0 out_seq=0 2023-10-08T13:15:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4e85ffb700 1 -- 172.21.15.5:0/1301210312 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b5f5288ad0 con 0x55b5f53ab260 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4e85ffb700 10 client.16887 handle_command_reply: tid=0 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 client.16887 shutdown 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 msgr2=0x55b5f534bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f534bbd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4e9402a990 tx=0x7f4e94004d80 comp rx=0 tx=0).stop 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 shutdown_connections 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b5f53431a0 0x55b5f53a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5f533d0b0 0x55b5f534bbd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b5f53ab260 0x55b5f53ad680 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 --2- 172.21.15.5:0/1301210312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5f5342880 0x55b5f534c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4e85ffb700 0 client.16887 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:15:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 >> 172.21.15.5:0/1301210312 conn(0x55b5f52b1200 msgr2=0x55b5f5344a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 shutdown_connections 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 1 -- 172.21.15.5:0/1301210312 wait complete. 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.324+0000 7f4eb0484b80 20 client.16887 trim_cache size 0 max 16384 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:15:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:15:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e880a15e0 msgr2=0x7f4e880a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e880a15e0 0x7f4e880a3aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009480 tx=0x7f4e9400b040 comp rx=0 tx=0).stop 2023-10-08T13:15:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 msgr2=0x7f4e9c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:15:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c1992e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4e98005910 tx=0x7f4e98004730 comp rx=0 tx=0).stop 2023-10-08T13:15:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 shutdown_connections 2023-10-08T13:15:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4e880a15e0 0x7f4e880a3aa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e9c10cfe0 0x7f4e9c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e9c0ff430 0x7f4e9c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 --2- 172.21.15.5:0/1328363645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e9c0ffde0 0x7f4e9c1992e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:15:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 >> 172.21.15.5:0/1328363645 conn(0x7f4e9c0fb080 msgr2=0x7f4e9c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:15:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 shutdown_connections 2023-10-08T13:15:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:15:58.325+0000 7f4ea429b700 1 -- 172.21.15.5:0/1328363645 wait complete. 2023-10-08T13:15:59.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:15:58 smithi118 ceph-mon[104234]: pgmap v605: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.8 MiB/s wr, 444 op/s 2023-10-08T13:15:59.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:15:58 smithi060 ceph-mon[103190]: pgmap v605: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.8 MiB/s wr, 444 op/s 2023-10-08T13:15:59.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:15:58 smithi005 ceph-mon[99496]: pgmap v605: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.8 MiB/s wr, 444 op/s 2023-10-08T13:16:01.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:00 smithi118 ceph-mon[104234]: pgmap v606: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.9 MiB/s wr, 461 op/s 2023-10-08T13:16:01.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:00 smithi060 ceph-mon[103190]: pgmap v606: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.9 MiB/s wr, 461 op/s 2023-10-08T13:16:01.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:00 smithi005 ceph-mon[99496]: pgmap v606: 129 pgs: 129 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.9 MiB/s wr, 461 op/s 2023-10-08T13:16:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 580.0 s, 416.0 tps, lat 235.267 ms stddev 334.957 2023-10-08T13:16:03.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:02 smithi118 ceph-mon[104234]: pgmap v607: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.3 MiB/s wr, 467 op/s 2023-10-08T13:16:03.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:02 smithi060 ceph-mon[103190]: pgmap v607: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.3 MiB/s wr, 467 op/s 2023-10-08T13:16:03.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:02 smithi005 ceph-mon[99496]: pgmap v607: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.3 MiB/s wr, 467 op/s 2023-10-08T13:16:05.019 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:04 smithi118 ceph-mon[104234]: pgmap v608: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 4.7 MiB/s wr, 457 op/s 2023-10-08T13:16:05.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:04 smithi060 ceph-mon[103190]: pgmap v608: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 4.7 MiB/s wr, 457 op/s 2023-10-08T13:16:05.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:04 smithi005 ceph-mon[99496]: pgmap v608: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 4.7 MiB/s wr, 457 op/s 2023-10-08T13:16:06.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 585.0 s, 489.2 tps, lat 205.980 ms stddev 242.141 2023-10-08T13:16:07.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:06 smithi060 ceph-mon[103190]: pgmap v609: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2023-10-08T13:16:07.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:06 smithi005 ceph-mon[99496]: pgmap v609: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2023-10-08T13:16:07.278 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:06 smithi118 ceph-mon[104234]: pgmap v609: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.5 MiB/s wr, 468 op/s 2023-10-08T13:16:09.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:08 smithi060 ceph-mon[103190]: pgmap v610: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2023-10-08T13:16:09.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:08 smithi005 ceph-mon[99496]: pgmap v610: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2023-10-08T13:16:09.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:08 smithi118 ceph-mon[104234]: pgmap v610: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2023-10-08T13:16:11.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:10 smithi060 ceph-mon[103190]: pgmap v611: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 4.9 MiB/s wr, 495 op/s 2023-10-08T13:16:11.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:10 smithi060 ceph-mon[103190]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T13:16:11.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:10 smithi005 ceph-mon[99496]: pgmap v611: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 4.9 MiB/s wr, 495 op/s 2023-10-08T13:16:11.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:10 smithi005 ceph-mon[99496]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T13:16:11.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:10 smithi118 ceph-mon[104234]: pgmap v611: 129 pgs: 129 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 4.9 MiB/s wr, 495 op/s 2023-10-08T13:16:11.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:10 smithi118 ceph-mon[104234]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T13:16:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 590.0 s, 395.9 tps, lat 255.874 ms stddev 343.998 2023-10-08T13:16:11.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.887+0000 7f58ce89b700 1 -- 172.21.15.5:0/2007735802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810eea0 msgr2=0x7f58c81077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.887+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2007735802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810eea0 0x7f58c81077f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f58b801a9d0 tx=0x7f58b801ace0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.888+0000 7f58ce89b700 1 -- 172.21.15.5:0/2007735802 shutdown_connections 2023-10-08T13:16:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.888+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2007735802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8119fd0 0x7f58c811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.888+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2007735802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810eea0 0x7f58c81077f0 secure :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f58b801a9d0 tx=0x7f58b801ace0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.888+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2007735802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58c810f310 0x7f58c8107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.888+0000 7f58ce89b700 1 -- 172.21.15.5:0/2007735802 >> 172.21.15.5:0/2007735802 conn(0x7f58c806b7c0 msgr2=0x7f58c806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.891+0000 7f58ce89b700 1 -- 172.21.15.5:0/2007735802 shutdown_connections 2023-10-08T13:16:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.893+0000 7f58ce89b700 1 -- 172.21.15.5:0/2007735802 wait complete. 2023-10-08T13:16:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.894+0000 7f58ce89b700 1 Processor -- start 2023-10-08T13:16:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.894+0000 7f58ce89b700 1 -- start start 2023-10-08T13:16:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.895+0000 7f58ce89b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 0x7f58c81195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.895+0000 7f58ce89b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8119fd0 0x7f58c8115650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.895+0000 7f58ce89b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58c8115b90 0x7f58c8116040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.895+0000 7f58ce89b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8119d90 con 0x7f58c810f310 2023-10-08T13:16:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.895+0000 7f58ce89b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81a9b80 con 0x7f58c8115b90 2023-10-08T13:16:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.895+0000 7f58ce89b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81a9cc0 con 0x7f58c8119fd0 2023-10-08T13:16:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.900+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 0x7f58c81195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.900+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 0x7f58c81195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37628/0 (socket says 172.21.15.5:37628) 2023-10-08T13:16:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.900+0000 7f58c7fff700 1 -- 172.21.15.5:0/2633469186 learned_addr learned my addr 172.21.15.5:0/2633469186 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.901+0000 7f58c7fff700 1 -- 172.21.15.5:0/2633469186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8119fd0 msgr2=0x7f58c8115650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:16:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.901+0000 7f58c7fff700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8119fd0 0x7f58c8115650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.901+0000 7f58c7fff700 1 -- 172.21.15.5:0/2633469186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58c8115b90 msgr2=0x7f58c8116040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:16:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.901+0000 7f58c7fff700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58c8115b90 0x7f58c8116040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.901+0000 7f58c7fff700 1 -- 172.21.15.5:0/2633469186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b801a600 con 0x7f58c810f310 2023-10-08T13:16:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.902+0000 7f58c7fff700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 0x7f58c81195e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f58b801c590 tx=0x7f58b8028a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.905+0000 7f58c57fa700 1 -- 172.21.15.5:0/2633469186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b802d070 con 0x7f58c810f310 2023-10-08T13:16:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.905+0000 7f58c57fa700 1 -- 172.21.15.5:0/2633469186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58b801a040 con 0x7f58c810f310 2023-10-08T13:16:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.905+0000 7f58c57fa700 1 -- 172.21.15.5:0/2633469186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8004c10 con 0x7f58c810f310 2023-10-08T13:16:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.906+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c81a9ef0 con 0x7f58c810f310 2023-10-08T13:16:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.906+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c81aa260 con 0x7f58c810f310 2023-10-08T13:16:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.911+0000 7f58daa84b80 1 Processor -- start 2023-10-08T13:16:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.911+0000 7f58c57fa700 1 -- 172.21.15.5:0/2633469186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f58b8005030 con 0x7f58c810f310 2023-10-08T13:16:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.912+0000 7f58c57fa700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f58b00a17f0 0x7f58b00a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.913+0000 7f58c57fa700 1 -- 172.21.15.5:0/2633469186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f58b80df0f0 con 0x7f58c810f310 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 -- start start 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e50c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e4ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44db3400 con 0x55dc44e511a0 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44da4bc0 con 0x55dc44e50880 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58daa84b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44da24e0 con 0x55dc44e4b0b0 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.919+0000 7f58cce38700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f58b00a17f0 0x7f58b00a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.920+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e4ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.920+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e4ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37634/0 (socket says 172.21.15.5:37634) 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.920+0000 7f58c77fe700 1 -- 172.21.15.5:0/1772126376 learned_addr learned my addr 172.21.15.5:0/1772126376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.921+0000 7f58cce38700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f58b00a17f0 0x7f58b00a3cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009c20 tx=0x7f58bc009680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.921+0000 7f58c77fe700 1 -- 172.21.15.5:0/1772126376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 msgr2=0x55dc44e4b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.921+0000 7f58c77fe700 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.921+0000 7f58c77fe700 1 -- 172.21.15.5:0/1772126376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 msgr2=0x55dc44e50c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.921+0000 7f58c77fe700 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e50c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.921+0000 7f58c77fe700 1 -- 172.21.15.5:0/1772126376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc44bc8d80 con 0x55dc44e511a0 2023-10-08T13:16:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.922+0000 7f58c77fe700 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e4ab70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009d70 tx=0x7f58c000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5005921ffc0608 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.931+0000 7f58ae7fc700 1 -- 172.21.15.5:0/1772126376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0013410 con 0x55dc44e511a0 2023-10-08T13:16:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.931+0000 7f58ae7fc700 1 -- 172.21.15.5:0/1772126376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58c0013a30 con 0x55dc44e511a0 2023-10-08T13:16:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.931+0000 7f58ae7fc700 1 -- 172.21.15.5:0/1772126376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0012a90 con 0x55dc44e511a0 2023-10-08T13:16:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 -- 172.21.15.5:0/1772126376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 msgr2=0x55dc44e4ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:11.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e4ab70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009d70 tx=0x7f58c000b700 comp rx=0 tx=0).stop 2023-10-08T13:16:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 -- 172.21.15.5:0/1772126376 shutdown_connections 2023-10-08T13:16:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e50c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 --2- 172.21.15.5:0/1772126376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e4ab70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.932+0000 7f58daa84b80 1 -- 172.21.15.5:0/1772126376 >> 172.21.15.5:0/1772126376 conn(0x55dc44dbf200 msgr2=0x55dc44e45b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.938+0000 7f58daa84b80 1 -- 172.21.15.5:0/1772126376 shutdown_connections 2023-10-08T13:16:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.938+0000 7f58daa84b80 1 -- 172.21.15.5:0/1772126376 wait complete. 2023-10-08T13:16:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 -- start start 2023-10-08T13:16:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 Processor -- start 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e545e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e50880 0x55dc44e54b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e55060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44d9ddd0 con 0x55dc44e511a0 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44d3a6b0 con 0x55dc44e4b0b0 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.939+0000 7f58daa84b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44d3a350 con 0x55dc44e50880 2023-10-08T13:16:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.940+0000 7f58daa84b80 10 client.0 _ll_register_callbacks cb 0x55dc44b977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.941+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.941+0000 7f58cce38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e55060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.941+0000 7f58cce38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e55060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37638/0 (socket says 172.21.15.5:37638) 2023-10-08T13:16:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.941+0000 7f58cce38700 1 -- 172.21.15.5:0/3713690918 learned_addr learned my addr 172.21.15.5:0/3713690918 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.942+0000 7f58cce38700 1 -- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e50880 msgr2=0x55dc44e54b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.942+0000 7f58cce38700 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e50880 0x55dc44e54b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.942+0000 7f58cce38700 1 -- 172.21.15.5:0/3713690918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 msgr2=0x55dc44e545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.942+0000 7f58cce38700 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.942+0000 7f58cce38700 1 -- 172.21.15.5:0/3713690918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c00099a0 con 0x55dc44e511a0 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.943+0000 7f58cce38700 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e55060 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0094d0 tx=0x7f58bc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb02c2377831578f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.943+0000 7f58a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.943+0000 7f58a77fe700 1 -- 172.21.15.5:0/3713690918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc01e450 con 0x55dc44e511a0 2023-10-08T13:16:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.943+0000 7f58a77fe700 1 -- 172.21.15.5:0/3713690918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f58bc01e5b0 con 0x55dc44e511a0 2023-10-08T13:16:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.943+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc44d65e50 con 0x55dc44e511a0 2023-10-08T13:16:11.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.944+0000 7f58a77fe700 1 -- 172.21.15.5:0/3713690918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58bc01e770 con 0x55dc44e511a0 2023-10-08T13:16:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.945+0000 7f58daa84b80 10 client.16899 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.945+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55dc44bb1c00 con 0x55dc44e511a0 2023-10-08T13:16:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58a77fe700 1 -- 172.21.15.5:0/3713690918 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc44d65e50 con 0x55dc44e511a0 2023-10-08T13:16:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58a77fe700 1 -- 172.21.15.5:0/3713690918 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f58bc031a30 con 0x55dc44e511a0 2023-10-08T13:16:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58daa84b80 10 client.16899 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58daa84b80 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58daa84b80 20 client.16899 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58daa84b80 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44e64d40 0x55dc44e671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58daa84b80 4 client.16899 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:16:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.960+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc44d96db0 con 0x55dc44e64d40 2023-10-08T13:16:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.971+0000 7f58c7fff700 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44e64d40 0x55dc44e671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.974+0000 7f58c7fff700 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44e64d40 0x55dc44e671a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799c25b38e6f855f server_cookie=4afbc682035d3b17 in_seq=0 out_seq=0 2023-10-08T13:16:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.974+0000 7f58a77fe700 10 client.16899 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.983+0000 7f58a77fe700 1 -- 172.21.15.5:0/3713690918 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc44d96db0 con 0x55dc44e64d40 2023-10-08T13:16:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.983+0000 7f58a77fe700 10 client.16899 handle_command_reply: tid=0 2023-10-08T13:16:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.986+0000 7f58daa84b80 1 client.16899 shutdown 2023-10-08T13:16:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.994+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 msgr2=0x55dc44e55060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:11.994+0000 7f58daa84b80 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e55060 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0094d0 tx=0x7f58bc0047c0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.007+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 shutdown_connections 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.007+0000 7f58daa84b80 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44e55060 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.007+0000 7f58daa84b80 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44e64d40 0x55dc44e671a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.007+0000 7f58daa84b80 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.007+0000 7f58daa84b80 1 --2- 172.21.15.5:0/3713690918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e50880 0x55dc44e54b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.007+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 >> 172.21.15.5:0/3713690918 conn(0x55dc44dbf200 msgr2=0x55dc44e45010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:12.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.008+0000 7f58a77fe700 0 client.16899 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:12.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.011+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 shutdown_connections 2023-10-08T13:16:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.015+0000 7f58daa84b80 1 -- 172.21.15.5:0/3713690918 wait complete. 2023-10-08T13:16:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.018+0000 7f58daa84b80 20 client.16899 trim_cache size 0 max 16384 2023-10-08T13:16:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 Processor -- start 2023-10-08T13:16:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 -- start start 2023-10-08T13:16:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e50880 0x55dc44e45790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e511a0 0x55dc44e45cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44c1e8c0 con 0x55dc44e50880 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44e42830 con 0x55dc44e4b0b0 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.050+0000 7f58daa84b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44e55b90 con 0x55dc44e511a0 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.051+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.051+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e50880 0x55dc44e45790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.051+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e50880 0x55dc44e45790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37650/0 (socket says 172.21.15.5:37650) 2023-10-08T13:16:12.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.051+0000 7f58c77fe700 1 -- 172.21.15.5:0/2779013257 learned_addr learned my addr 172.21.15.5:0/2779013257 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:12.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.051+0000 7f58cce38700 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e511a0 0x55dc44e45cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:12.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58cce38700 1 -- 172.21.15.5:0/2779013257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 msgr2=0x55dc44e4fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:12.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58cce38700 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58cce38700 1 -- 172.21.15.5:0/2779013257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e50880 msgr2=0x55dc44e45790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58cce38700 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e50880 0x55dc44e45790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58cce38700 1 -- 172.21.15.5:0/2779013257 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc44bef1f0 con 0x55dc44e511a0 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58cce38700 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e511a0 0x55dc44e45cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58bc012bc0 tx=0x7f58bc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be607bbe6752744 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58aeffd700 1 -- 172.21.15.5:0/2779013257 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc004830 con 0x55dc44e511a0 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58aeffd700 1 -- 172.21.15.5:0/2779013257 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58bc004e50 con 0x55dc44e511a0 2023-10-08T13:16:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.052+0000 7f58aeffd700 1 -- 172.21.15.5:0/2779013257 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc031680 con 0x55dc44e511a0 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 -- 172.21.15.5:0/2779013257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e511a0 msgr2=0x55dc44e45cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e511a0 0x55dc44e45cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58bc012bc0 tx=0x7f58bc000bc0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 -- 172.21.15.5:0/2779013257 shutdown_connections 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e511a0 0x55dc44e45cd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e4b0b0 0x55dc44e4fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 --2- 172.21.15.5:0/2779013257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e50880 0x55dc44e45790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 -- 172.21.15.5:0/2779013257 >> 172.21.15.5:0/2779013257 conn(0x55dc44dbf200 msgr2=0x55dc44e4f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.053+0000 7f58daa84b80 1 -- 172.21.15.5:0/2779013257 shutdown_connections 2023-10-08T13:16:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.054+0000 7f58daa84b80 1 -- 172.21.15.5:0/2779013257 wait complete. 2023-10-08T13:16:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.054+0000 7f58daa84b80 1 -- start start 2023-10-08T13:16:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.054+0000 7f58daa84b80 1 Processor -- start 2023-10-08T13:16:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 0x55dc44e59e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e5a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44eb1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44eb2170 con 0x55dc44e511a0 2023-10-08T13:16:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44eb22e0 con 0x55dc44e50880 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc44eb24a0 con 0x55dc44e4b0b0 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58daa84b80 10 client.0 _ll_register_callbacks cb 0x7f58bc010c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e5a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58c77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e5a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60836/0 (socket says 172.21.15.5:60836) 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58c77fe700 1 -- 172.21.15.5:0/848065144 learned_addr learned my addr 172.21.15.5:0/848065144 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.058+0000 7f58cce38700 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44eb1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58c77fe700 1 -- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 msgr2=0x55dc44e59e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58c77fe700 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 0x55dc44e59e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58c77fe700 1 -- 172.21.15.5:0/848065144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 msgr2=0x55dc44eb1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58c77fe700 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44eb1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58c77fe700 1 -- 172.21.15.5:0/848065144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc44bb1c00 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58c77fe700 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e5a380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55dc44e4be70 tx=0x7f58c0003cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1192a7d123cdc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58a77fe700 1 -- 172.21.15.5:0/848065144 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00093a0 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58c0013a30 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58a77fe700 1 -- 172.21.15.5:0/848065144 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f58c0013620 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.059+0000 7f58a77fe700 1 -- 172.21.15.5:0/848065144 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c00137e0 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 10 client.26339 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55dc44bc7250 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58a77fe700 1 -- 172.21.15.5:0/848065144 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58c0013a30 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58a77fe700 1 -- 172.21.15.5:0/848065144 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f58c0022020 con 0x55dc44e50880 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 10 client.26339 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 10 client.26339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 20 client.26339 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44eb9ca0 0x55dc44ebc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 4 client.26339 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc44d96ad0 con 0x55dc44eb9ca0 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.060+0000 7f58c7fff700 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44eb9ca0 0x55dc44ebc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.061+0000 7f58a77fe700 10 client.26339 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.061+0000 7f58c7fff700 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44eb9ca0 0x55dc44ebc0c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fafdd0286ef828f server_cookie=99d063f999683d96 in_seq=0 out_seq=0 2023-10-08T13:16:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58a77fe700 1 -- 172.21.15.5:0/848065144 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc44d96ad0 con 0x55dc44eb9ca0 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58a77fe700 10 client.26339 handle_command_reply: tid=0 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 client.26339 shutdown 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 msgr2=0x55dc44e5a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e5a380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55dc44e4be70 tx=0x7f58c0003cf0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 shutdown_connections 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc44e511a0 0x55dc44eb1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc44e4b0b0 0x55dc44e59e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc44eb9ca0 0x55dc44ebc0c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 --2- 172.21.15.5:0/848065144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc44e50880 0x55dc44e5a380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58a77fe700 0 client.26339 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 >> 172.21.15.5:0/848065144 conn(0x55dc44dbf200 msgr2=0x55dc44e53740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 shutdown_connections 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 1 -- 172.21.15.5:0/848065144 wait complete. 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.076+0000 7f58daa84b80 20 client.26339 trim_cache size 0 max 16384 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:16:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:16:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f58b00a17f0 msgr2=0x7f58b00a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f58b00a17f0 0x7f58b00a3cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009c20 tx=0x7f58bc009680 comp rx=0 tx=0).stop 2023-10-08T13:16:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 msgr2=0x7f58c81195e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 0x7f58c81195e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f58b801c590 tx=0x7f58b8028a40 comp rx=0 tx=0).stop 2023-10-08T13:16:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 shutdown_connections 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f58b00a17f0 0x7f58b00a3cb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58c8115b90 0x7f58c8116040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c810f310 0x7f58c81195e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 --2- 172.21.15.5:0/2633469186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58c8119fd0 0x7f58c8115650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 >> 172.21.15.5:0/2633469186 conn(0x7f58c806b7c0 msgr2=0x7f58c810b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 shutdown_connections 2023-10-08T13:16:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:12.077+0000 7f58ce89b700 1 -- 172.21.15.5:0/2633469186 wait complete. 2023-10-08T13:16:13.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:12 smithi060 ceph-mon[103190]: pgmap v613: 129 pgs: 8 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 93 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.7 MiB/s wr, 489 op/s 2023-10-08T13:16:13.187 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:12 smithi005 ceph-mon[99496]: pgmap v613: 129 pgs: 8 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 93 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.7 MiB/s wr, 489 op/s 2023-10-08T13:16:13.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:12 smithi118 ceph-mon[104234]: pgmap v613: 129 pgs: 8 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 93 active+clean; 3.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.7 MiB/s wr, 489 op/s 2023-10-08T13:16:14.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:13 smithi118 ceph-mon[104234]: pgmap v614: 129 pgs: 8 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 93 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 497 op/s 2023-10-08T13:16:14.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:13 smithi060 ceph-mon[103190]: pgmap v614: 129 pgs: 8 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 93 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 497 op/s 2023-10-08T13:16:14.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:13 smithi005 ceph-mon[99496]: pgmap v614: 129 pgs: 8 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 93 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 497 op/s 2023-10-08T13:16:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 595.0 s, 545.8 tps, lat 182.953 ms stddev 262.059 2023-10-08T13:16:17.025 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:16 smithi118 ceph-mon[104234]: pgmap v615: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.3 MiB/s wr, 493 op/s 2023-10-08T13:16:17.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:16 smithi060 ceph-mon[103190]: pgmap v615: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.3 MiB/s wr, 493 op/s 2023-10-08T13:16:17.177 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:16 smithi005 ceph-mon[99496]: pgmap v615: 129 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 121 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.3 MiB/s wr, 493 op/s 2023-10-08T13:16:19.024 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:18 smithi118 ceph-mon[104234]: pgmap v616: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 4.8 MiB/s wr, 475 op/s 2023-10-08T13:16:19.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:18 smithi060 ceph-mon[103190]: pgmap v616: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 4.8 MiB/s wr, 475 op/s 2023-10-08T13:16:19.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:18 smithi005 ceph-mon[99496]: pgmap v616: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 4.8 MiB/s wr, 475 op/s 2023-10-08T13:16:19.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 -- 172.21.15.5:0/21980166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 msgr2=0x7fc4fc10bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 --2- 172.21.15.5:0/21980166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc10bc90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00aaa0 tx=0x7fc4ec00adb0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 -- 172.21.15.5:0/21980166 shutdown_connections 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 --2- 172.21.15.5:0/21980166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc10bc90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 --2- 172.21.15.5:0/21980166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4fc0ff290 0x7fc4fc0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 --2- 172.21.15.5:0/21980166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ffc40 0x7fc4fc103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 -- 172.21.15.5:0/21980166 >> 172.21.15.5:0/21980166 conn(0x7fc4fc0748d0 msgr2=0x7fc4fc074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 -- 172.21.15.5:0/21980166 shutdown_connections 2023-10-08T13:16:19.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.535+0000 7fc50141f700 1 -- 172.21.15.5:0/21980166 wait complete. 2023-10-08T13:16:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 Processor -- start 2023-10-08T13:16:19.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 -- start start 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ff290 0x7fc4fc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4fc1947d0 0x7fc4fc194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc195250 con 0x7fc4fc104100 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc195390 con 0x7fc4fc0ff290 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc50141f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc195550 con 0x7fc4fc1947d0 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc4fa7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc4fa7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37664/0 (socket says 172.21.15.5:37664) 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/3509640482 learned_addr learned my addr 172.21.15.5:0/3509640482 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ff290 0x7fc4fc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.536+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4fc1947d0 0x7fc4fc194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/3509640482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4fc1947d0 msgr2=0x7fc4fc194c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4fc1947d0 0x7fc4fc194c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/3509640482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ff290 msgr2=0x7fc4fc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ff290 0x7fc4fc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/3509640482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec00a700 con 0x7fc4fc104100 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4faffd700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ff290 0x7fc4fc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc19abe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e940 tx=0x7fc4f000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4e3fff700 1 -- 172.21.15.5:0/3509640482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0009730 con 0x7fc4fc104100 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4e3fff700 1 -- 172.21.15.5:0/3509640482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f0010430 con 0x7fc4fc104100 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc1a1510 con 0x7fc4fc104100 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc4e3fff700 1 -- 172.21.15.5:0/3509640482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000cea0 con 0x7fc4fc104100 2023-10-08T13:16:19.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.537+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc1a1a20 con 0x7fc4fc104100 2023-10-08T13:16:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.539+0000 7fc4e3fff700 1 -- 172.21.15.5:0/3509640482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc4f0010810 con 0x7fc4fc104100 2023-10-08T13:16:19.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.540+0000 7fc4e3fff700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4e40a3800 0x7fc4e40a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.540+0000 7fc4e3fff700 1 -- 172.21.15.5:0/3509640482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fc4f0014070 con 0x7fc4fc104100 2023-10-08T13:16:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.540+0000 7fc4faffd700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4e40a3800 0x7fc4e40a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.540+0000 7fc4faffd700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4e40a3800 0x7fc4e40a5cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400b820 tx=0x7fc4f400d040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:19.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.541+0000 7fc50d608b80 1 Processor -- start 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.541+0000 7fc50d608b80 1 -- start start 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532bfbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532bfc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc50d608b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532b65460 con 0x563532bfda40 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc50d608b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532b56c20 con 0x563532bfc3c0 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc50d608b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532b54540 con 0x563532c0fcf0 2023-10-08T13:16:19.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532bfbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532bfbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37670/0 (socket says 172.21.15.5:37670) 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 -- 172.21.15.5:0/857709021 learned_addr learned my addr 172.21.15.5:0/857709021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532bfc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 -- 172.21.15.5:0/857709021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 msgr2=0x563532c120e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c120e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 -- 172.21.15.5:0/857709021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 msgr2=0x563532bfc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532bfc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 -- 172.21.15.5:0/857709021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56353297ade0 con 0x563532bfda40 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:19.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532bfc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:19.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.542+0000 7fc4faffd700 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532bfbe80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400aa50 tx=0x7fc4f4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adc456f7b358487 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:19.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc4e17fa700 1 -- 172.21.15.5:0/857709021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4010040 con 0x563532bfda40 2023-10-08T13:16:19.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc4e17fa700 1 -- 172.21.15.5:0/857709021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f4042400 con 0x563532bfda40 2023-10-08T13:16:19.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc4e17fa700 1 -- 172.21.15.5:0/857709021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40155d0 con 0x563532bfda40 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 -- 172.21.15.5:0/857709021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 msgr2=0x563532bfbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532bfbe80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400aa50 tx=0x7fc4f4011000 comp rx=0 tx=0).stop 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 -- 172.21.15.5:0/857709021 shutdown_connections 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532bfbe80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 --2- 172.21.15.5:0/857709021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532bfc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.543+0000 7fc50d608b80 1 -- 172.21.15.5:0/857709021 >> 172.21.15.5:0/857709021 conn(0x563532b71260 msgr2=0x563532bf82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 -- 172.21.15.5:0/857709021 shutdown_connections 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 -- 172.21.15.5:0/857709021 wait complete. 2023-10-08T13:16:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 -- start start 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 Processor -- start 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c06d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532c07280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532b4fe30 con 0x563532bfda40 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532aec710 con 0x563532bfc3c0 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.544+0000 7fc50d608b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532aec3b0 con 0x563532c0fcf0 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc50d608b80 10 client.0 _ll_register_callbacks cb 0x563532949800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532c07280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c06d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532c07280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37678/0 (socket says 172.21.15.5:37678) 2023-10-08T13:16:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/1353253302 learned_addr learned my addr 172.21.15.5:0/1353253302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 msgr2=0x563532c077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c077c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/1353253302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 msgr2=0x563532c06d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c06d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 -- 172.21.15.5:0/1353253302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc1a1a20 con 0x563532bfda40 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4faffd700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c06d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532c07280 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00caa50 tx=0x7fc4f009a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480c3f3b17e8528 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4deff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4deff5700 1 -- 172.21.15.5:0/1353253302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0099920 con 0x563532bfda40 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc4deff5700 1 -- 172.21.15.5:0/1353253302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fc4f0094e40 con 0x563532bfda40 2023-10-08T13:16:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.545+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563532b17eb0 con 0x563532bfda40 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc4deff5700 1 -- 172.21.15.5:0/1353253302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4f009e170 con 0x563532bfda40 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 10 client.16917 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7fc4ec01a040 con 0x563532bfda40 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc4deff5700 1 -- 172.21.15.5:0/1353253302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563532b17eb0 con 0x563532bfda40 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc4deff5700 1 -- 172.21.15.5:0/1353253302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc4f0096020 con 0x563532bfda40 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 10 client.16917 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 10 client.16917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 20 client.16917 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c172f0 0x563532c19710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 4 client.16917 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563532b48e10 con 0x563532c172f0 2023-10-08T13:16:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.546+0000 7fc4faffd700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c172f0 0x563532c19710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.547+0000 7fc4deff5700 10 client.16917 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.547+0000 7fc4faffd700 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c172f0 0x563532c19710 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a233f7ec7ae6636f server_cookie=2342968344453255 in_seq=0 out_seq=0 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.547+0000 7fc4deff5700 1 -- 172.21.15.5:0/1353253302 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563532b48e10 con 0x563532c172f0 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.547+0000 7fc4deff5700 10 client.16917 handle_command_reply: tid=0 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.547+0000 7fc50d608b80 1 client.16917 shutdown 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 msgr2=0x563532c07280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532c07280 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00caa50 tx=0x7fc4f009a2b0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 shutdown_connections 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532c0fcf0 0x563532c077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c172f0 0x563532c19710 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c06d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc4deff5700 0 client.16917 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1353253302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532bfda40 0x563532c07280 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 >> 172.21.15.5:0/1353253302 conn(0x563532b71260 msgr2=0x563532bf7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 shutdown_connections 2023-10-08T13:16:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 1 -- 172.21.15.5:0/1353253302 wait complete. 2023-10-08T13:16:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.548+0000 7fc50d608b80 20 client.16917 trim_cache size 0 max 16384 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 Processor -- start 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 -- start start 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfda40 0x563532bf74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635329d0920 con 0x563532c0fcf0 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532bfef00 con 0x563532bfc3c0 2023-10-08T13:16:19.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc50d608b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532c08340 con 0x563532bfda40 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4fb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4fa7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfda40 0x563532bf74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4fb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c017a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37688/0 (socket says 172.21.15.5:37688) 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c048c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60866/0 (socket says 172.21.15.5:60866) 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4fa7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfda40 0x563532bf74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50890/0 (socket says 172.21.15.5:50890) 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.571+0000 7fc4fb7fe700 1 -- 172.21.15.5:0/400573300 learned_addr learned my addr 172.21.15.5:0/400573300 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4faffd700 1 -- 172.21.15.5:0/400573300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfda40 msgr2=0x563532bf74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4faffd700 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfda40 0x563532bf74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4faffd700 1 -- 172.21.15.5:0/400573300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 msgr2=0x563532c017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4faffd700 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4faffd700 1 -- 172.21.15.5:0/400573300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f400a730 con 0x563532bfc3c0 2023-10-08T13:16:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4faffd700 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c048c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400d010 tx=0x7fc4f4042cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae38ec6f7daee02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4e1ffb700 1 -- 172.21.15.5:0/400573300 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4010050 con 0x563532bfc3c0 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4e1ffb700 1 -- 172.21.15.5:0/400573300 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f4007000 con 0x563532bfc3c0 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.572+0000 7fc4e1ffb700 1 -- 172.21.15.5:0/400573300 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4055a80 con 0x563532bfc3c0 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 -- 172.21.15.5:0/400573300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 msgr2=0x563532c048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c048c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400d010 tx=0x7fc4f4042cb0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 -- 172.21.15.5:0/400573300 shutdown_connections 2023-10-08T13:16:19.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfc3c0 0x563532c048c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 --2- 172.21.15.5:0/400573300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfda40 0x563532bf74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 -- 172.21.15.5:0/400573300 >> 172.21.15.5:0/400573300 conn(0x563532b71260 msgr2=0x563532bfc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 -- 172.21.15.5:0/400573300 shutdown_connections 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 -- 172.21.15.5:0/400573300 wait complete. 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 -- start start 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.573+0000 7fc50d608b80 1 Processor -- start 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 0x563532c24ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfda40 0x563532c25420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c25960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532c6a900 con 0x563532c0fcf0 2023-10-08T13:16:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532c6aa40 con 0x563532bfda40 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563532c6ac00 con 0x563532bfc3c0 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc50d608b80 10 client.0 _ll_register_callbacks cb 0x7fc4f009a9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 0x563532c24ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c25960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 0x563532c24ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50894/0 (socket says 172.21.15.5:50894) 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4faffd700 1 -- 172.21.15.5:0/1832178262 learned_addr learned my addr 172.21.15.5:0/1832178262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfda40 0x563532c25420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 -- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 msgr2=0x563532c24ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 0x563532c24ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 -- 172.21.15.5:0/1832178262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfda40 msgr2=0x563532c25420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfda40 0x563532c25420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 -- 172.21.15.5:0/1832178262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56353297ade0 con 0x563532c0fcf0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4faffd700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 0x563532c24ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fa7fc700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfda40 0x563532c25420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4fb7fe700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c25960 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005fd0 tx=0x7fc4ec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a059026fe96ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.574+0000 7fc4deff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc4deff5700 1 -- 172.21.15.5:0/1832178262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec005280 con 0x563532c0fcf0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc4deff5700 1 -- 172.21.15.5:0/1832178262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fc4ec012070 con 0x563532c0fcf0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4f4042400 con 0x563532c0fcf0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc4deff5700 1 -- 172.21.15.5:0/1832178262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4ec0053e0 con 0x563532c0fcf0 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 10 client.16923 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:19.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x563532963c60 con 0x563532c0fcf0 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc4deff5700 1 -- 172.21.15.5:0/1832178262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f4042400 con 0x563532c0fcf0 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc4deff5700 1 -- 172.21.15.5:0/1832178262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc4ec023440 con 0x563532c0fcf0 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 10 client.16923 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 20 client.16923 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c6c400 0x563532c6e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 4 client.16923 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563532b48b30 con 0x563532c6c400 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.575+0000 7fc4faffd700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c6c400 0x563532c6e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc4faffd700 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c6c400 0x563532c6e820 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80d320c946d2706 server_cookie=9392cf92c8aa9c69 in_seq=0 out_seq=0 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc4deff5700 10 client.16923 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc4deff5700 1 -- 172.21.15.5:0/1832178262 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563532b48b30 con 0x563532c6c400 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc4deff5700 10 client.16923 handle_command_reply: tid=0 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 client.16923 shutdown 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 msgr2=0x563532c25960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c25960 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005fd0 tx=0x7fc4ec00cc50 comp rx=0 tx=0).stop 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 shutdown_connections 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563532c0fcf0 0x563532c25960 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563532bfc3c0 0x563532c24ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x563532c6c400 0x563532c6e820 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 --2- 172.21.15.5:0/1832178262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563532bfda40 0x563532c25420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc4deff5700 0 client.16923 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 >> 172.21.15.5:0/1832178262 conn(0x563532b71260 msgr2=0x563532bf74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 shutdown_connections 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.576+0000 7fc50d608b80 1 -- 172.21.15.5:0/1832178262 wait complete. 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50d608b80 20 client.16923 trim_cache size 0 max 16384 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:16:19.585 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:16:19.586 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:16:19.586 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:16:19.586 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:16:19.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:16:19.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:16:19.586 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4e40a3800 msgr2=0x7fc4e40a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4e40a3800 0x7fc4e40a5cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400b820 tx=0x7fc4f400d040 comp rx=0 tx=0).stop 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 msgr2=0x7fc4fc19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc19abe0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e940 tx=0x7fc4f000ec50 comp rx=0 tx=0).stop 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 shutdown_connections 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc4e40a3800 0x7fc4e40a5cc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4fc1947d0 0x7fc4fc194c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4fc0ff290 0x7fc4fc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 --2- 172.21.15.5:0/3509640482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4fc104100 0x7fc4fc19abe0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:19.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 >> 172.21.15.5:0/3509640482 conn(0x7fc4fc0748d0 msgr2=0x7fc4fc0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:19.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 shutdown_connections 2023-10-08T13:16:19.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:19.577+0000 7fc50141f700 1 -- 172.21.15.5:0/3509640482 wait complete. 2023-10-08T13:16:19.601 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:16:21.026 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:20 smithi118 ceph-mon[104234]: pgmap v617: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 5.7 MiB/s wr, 501 op/s 2023-10-08T13:16:21.026 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:20 smithi118 ceph-mon[104234]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T13:16:21.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:20 smithi060 ceph-mon[103190]: pgmap v617: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 5.7 MiB/s wr, 501 op/s 2023-10-08T13:16:21.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:20 smithi060 ceph-mon[103190]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T13:16:21.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:20 smithi005 ceph-mon[99496]: pgmap v617: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 5.7 MiB/s wr, 501 op/s 2023-10-08T13:16:21.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:20 smithi005 ceph-mon[99496]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T13:16:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 600.0 s, 499.7 tps, lat 200.963 ms stddev 225.640 2023-10-08T13:16:23.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:22 smithi118 ceph-mon[104234]: pgmap v619: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 5.3 MiB/s wr, 489 op/s 2023-10-08T13:16:23.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:22 smithi060 ceph-mon[103190]: pgmap v619: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 5.3 MiB/s wr, 489 op/s 2023-10-08T13:16:23.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:22 smithi005 ceph-mon[99496]: pgmap v619: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 5.3 MiB/s wr, 489 op/s 2023-10-08T13:16:25.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:24 smithi060 ceph-mon[103190]: pgmap v620: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.5 MiB/s wr, 511 op/s 2023-10-08T13:16:25.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:24 smithi005 ceph-mon[99496]: pgmap v620: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.5 MiB/s wr, 511 op/s 2023-10-08T13:16:25.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:24 smithi118 ceph-mon[104234]: pgmap v620: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.5 MiB/s wr, 511 op/s 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.268+0000 7f134cd5e700 1 -- 172.21.15.5:0/2170320920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13480fff20 msgr2=0x7f134810c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.268+0000 7f134cd5e700 1 --2- 172.21.15.5:0/2170320920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13480fff20 0x7f134810c3e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f134000b0d0 tx=0x7f134000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.269+0000 7f134cd5e700 1 -- 172.21.15.5:0/2170320920 shutdown_connections 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.269+0000 7f134cd5e700 1 --2- 172.21.15.5:0/2170320920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13480fff20 0x7f134810c3e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.269+0000 7f134cd5e700 1 --2- 172.21.15.5:0/2170320920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1348105620 0x7f1348105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.269+0000 7f134cd5e700 1 --2- 172.21.15.5:0/2170320920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13480ff560 0x7f13480ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.269+0000 7f134cd5e700 1 -- 172.21.15.5:0/2170320920 >> 172.21.15.5:0/2170320920 conn(0x7f13480fb070 msgr2=0x7f13480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.277+0000 7f134cd5e700 1 -- 172.21.15.5:0/2170320920 shutdown_connections 2023-10-08T13:16:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.288+0000 7f134cd5e700 1 -- 172.21.15.5:0/2170320920 wait complete. 2023-10-08T13:16:25.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.288+0000 7f134cd5e700 1 Processor -- start 2023-10-08T13:16:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 -- start start 2023-10-08T13:16:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 0x7f13481ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13480fff20 0x7f13481abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1348105620 0x7f13481a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13481a5e20 con 0x7f1348105620 2023-10-08T13:16:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13481a5f90 con 0x7f13480fff20 2023-10-08T13:16:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.291+0000 7f134cd5e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13481a6150 con 0x7f13480ff560 2023-10-08T13:16:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.298+0000 7f134659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 0x7f13481ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.298+0000 7f134659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 0x7f13481ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50906/0 (socket says 172.21.15.5:50906) 2023-10-08T13:16:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.298+0000 7f134659c700 1 -- 172.21.15.5:0/1479919245 learned_addr learned my addr 172.21.15.5:0/1479919245 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.305+0000 7f1346d9d700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1348105620 0x7f13481a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.306+0000 7f134659c700 1 -- 172.21.15.5:0/1479919245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13480fff20 msgr2=0x7f13481abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.306+0000 7f134659c700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13480fff20 0x7f13481abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.306+0000 7f134659c700 1 -- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1348105620 msgr2=0x7f13481a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.306+0000 7f134659c700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1348105620 0x7f13481a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.306+0000 7f134659c700 1 -- 172.21.15.5:0/1479919245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340009d00 con 0x7f13480ff560 2023-10-08T13:16:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.318+0000 7f134659c700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 0x7f13481ab680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f133c00c920 tx=0x7f133c00cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.322+0000 7f13377fe700 1 -- 172.21.15.5:0/1479919245 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c007b00 con 0x7f13480ff560 2023-10-08T13:16:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.322+0000 7f13377fe700 1 -- 172.21.15.5:0/1479919245 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f133c004cf0 con 0x7f13480ff560 2023-10-08T13:16:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.322+0000 7f13377fe700 1 -- 172.21.15.5:0/1479919245 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c005610 con 0x7f13480ff560 2023-10-08T13:16:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.330+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13481a6430 con 0x7f13480ff560 2023-10-08T13:16:25.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.330+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13481b2670 con 0x7f13480ff560 2023-10-08T13:16:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.337+0000 7f1358f47b80 1 Processor -- start 2023-10-08T13:16:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 -- start start 2023-10-08T13:16:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fb1a0 0x559a729f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729f50b0 0x559a729f5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a7295d400 con 0x559a729fb1a0 2023-10-08T13:16:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a7294ebc0 con 0x559a729f50b0 2023-10-08T13:16:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.341+0000 7f1358f47b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a7294c4e0 con 0x559a729fa880 2023-10-08T13:16:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.343+0000 7f13377fe700 1 -- 172.21.15.5:0/1479919245 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f133c004750 con 0x7f13480ff560 2023-10-08T13:16:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.344+0000 7f13377fe700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f13300a17f0 0x7f13300a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.344+0000 7f13377fe700 1 -- 172.21.15.5:0/1479919245 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f133c0cd350 con 0x7f13480ff560 2023-10-08T13:16:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.348+0000 7f1346d9d700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f13300a17f0 0x7f13300a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.349+0000 7f1346d9d700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f13300a17f0 0x7f13300a3cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f13400060b0 tx=0x7f1340006000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1346d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1345d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729f50b0 0x559a729f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1346d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50914/0 (socket says 172.21.15.5:50914) 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1346d9d700 1 -- 172.21.15.5:0/1038198215 learned_addr learned my addr 172.21.15.5:0/1038198215 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f134659c700 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fb1a0 0x559a729f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1345d9b700 1 -- 172.21.15.5:0/1038198215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 msgr2=0x559a729fac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1345d9b700 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1345d9b700 1 -- 172.21.15.5:0/1038198215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fb1a0 msgr2=0x559a729f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1345d9b700 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fb1a0 0x559a729f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.352+0000 7f1345d9b700 1 -- 172.21.15.5:0/1038198215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a72772d80 con 0x559a729f50b0 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.363+0000 7f1345d9b700 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729f50b0 0x559a729f5510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1338009780 tx=0x7f1338009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d1d9adbd0cf202d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.367+0000 7f1334ff9700 1 -- 172.21.15.5:0/1038198215 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338011830 con 0x559a729f50b0 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.367+0000 7f1334ff9700 1 -- 172.21.15.5:0/1038198215 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1338011e50 con 0x559a729f50b0 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.367+0000 7f1334ff9700 1 -- 172.21.15.5:0/1038198215 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800b360 con 0x559a729f50b0 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.368+0000 7f1358f47b80 1 -- 172.21.15.5:0/1038198215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729f50b0 msgr2=0x559a729f5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.368+0000 7f1358f47b80 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729f50b0 0x559a729f5510 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1338009780 tx=0x7f1338009a90 comp rx=0 tx=0).stop 2023-10-08T13:16:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 -- 172.21.15.5:0/1038198215 shutdown_connections 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729f50b0 0x559a729f5510 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 --2- 172.21.15.5:0/1038198215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fb1a0 0x559a729f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 -- 172.21.15.5:0/1038198215 >> 172.21.15.5:0/1038198215 conn(0x559a72969200 msgr2=0x559a729efb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 -- 172.21.15.5:0/1038198215 shutdown_connections 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.370+0000 7f1358f47b80 1 -- 172.21.15.5:0/1038198215 wait complete. 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 -- start start 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 Processor -- start 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a01230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a729fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a72947dd0 con 0x559a729f50b0 2023-10-08T13:16:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a728e46b0 con 0x559a729fb1a0 2023-10-08T13:16:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a728e4350 con 0x559a729fa880 2023-10-08T13:16:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.371+0000 7f1358f47b80 10 client.0 _ll_register_callbacks cb 0x559a727417a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.373+0000 7f134659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a01230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.373+0000 7f134659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a01230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37716/0 (socket says 172.21.15.5:37716) 2023-10-08T13:16:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.373+0000 7f134659c700 1 -- 172.21.15.5:0/3358928426 learned_addr learned my addr 172.21.15.5:0/3358928426 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.373+0000 7f1346d9d700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a729fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.374+0000 7f1345d9b700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fe520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.374+0000 7f1346d9d700 1 -- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 msgr2=0x559a729fe520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.374+0000 7f1346d9d700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fe520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.374+0000 7f1346d9d700 1 -- 172.21.15.5:0/3358928426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 msgr2=0x559a72a01230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.374+0000 7f1346d9d700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a01230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.374+0000 7f1346d9d700 1 -- 172.21.15.5:0/3358928426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13380093e0 con 0x559a729fb1a0 2023-10-08T13:16:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.390+0000 7f1346d9d700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a729fec60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1340009fd0 tx=0x7f134000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd75a4bff77cbd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.397+0000 7f132dffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:16:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.398+0000 7f132dffb700 1 -- 172.21.15.5:0/3358928426 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000e040 con 0x559a729fb1a0 2023-10-08T13:16:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.398+0000 7f132dffb700 1 -- 172.21.15.5:0/3358928426 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f134001ca80 con 0x559a729fb1a0 2023-10-08T13:16:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.398+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a7290fe50 con 0x559a729fb1a0 2023-10-08T13:16:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.403+0000 7f132dffb700 1 -- 172.21.15.5:0/3358928426 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f134001cc40 con 0x559a729fb1a0 2023-10-08T13:16:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.403+0000 7f1358f47b80 10 client.26363 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.403+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x559a7275bc00 con 0x559a729fb1a0 2023-10-08T13:16:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.404+0000 7f132dffb700 1 -- 172.21.15.5:0/3358928426 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a7290fe50 con 0x559a729fb1a0 2023-10-08T13:16:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.404+0000 7f132dffb700 1 -- 172.21.15.5:0/3358928426 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1340025050 con 0x559a729fb1a0 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f1358f47b80 10 client.26363 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f1358f47b80 10 client.26363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f1358f47b80 20 client.26363 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a0eca0 0x559a72a110c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f1358f47b80 4 client.26363 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a72940db0 con 0x559a72a0eca0 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.405+0000 7f134659c700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a0eca0 0x559a72a110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.406+0000 7f132dffb700 10 client.26363 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:25.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.406+0000 7f134659c700 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a0eca0 0x559a72a110c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19f9fed86facd061 server_cookie=ee66c22b7f13a68 in_seq=0 out_seq=0 2023-10-08T13:16:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.408+0000 7f132dffb700 1 -- 172.21.15.5:0/3358928426 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a72940db0 con 0x559a72a0eca0 2023-10-08T13:16:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.408+0000 7f132dffb700 10 client.26363 handle_command_reply: tid=0 2023-10-08T13:16:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.408+0000 7f1358f47b80 1 client.26363 shutdown 2023-10-08T13:16:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.413+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 msgr2=0x559a729fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.413+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a729fec60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1340009fd0 tx=0x7f134000b040 comp rx=0 tx=0).stop 2023-10-08T13:16:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.416+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 shutdown_connections 2023-10-08T13:16:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.416+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a0eca0 0x559a72a110c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.416+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a729fec60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.416+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a01230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.416+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3358928426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fa880 0x559a729fe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.416+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 >> 172.21.15.5:0/3358928426 conn(0x559a72969200 msgr2=0x559a729ef010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.418+0000 7f132dffb700 0 client.26363 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.424+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 shutdown_connections 2023-10-08T13:16:25.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.428+0000 7f1358f47b80 1 -- 172.21.15.5:0/3358928426 wait complete. 2023-10-08T13:16:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.437+0000 7f1358f47b80 20 client.26363 trim_cache size 0 max 16384 2023-10-08T13:16:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.464+0000 7f1358f47b80 1 Processor -- start 2023-10-08T13:16:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 -- start start 2023-10-08T13:16:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729f50b0 0x559a729fe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 0x559a72a05c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a72a00d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a727c88c0 con 0x559a729fa880 2023-10-08T13:16:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a729ec860 con 0x559a729fb1a0 2023-10-08T13:16:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.465+0000 7f1358f47b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a729fc590 con 0x559a729f50b0 2023-10-08T13:16:25.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.467+0000 7f1345d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 0x559a72a05c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.467+0000 7f1345d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 0x559a72a05c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37728/0 (socket says 172.21.15.5:37728) 2023-10-08T13:16:25.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.467+0000 7f1345d9b700 1 -- 172.21.15.5:0/3200871542 learned_addr learned my addr 172.21.15.5:0/3200871542 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:25.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.472+0000 7f134659c700 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729f50b0 0x559a729fe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.475+0000 7f1345d9b700 1 -- 172.21.15.5:0/3200871542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729f50b0 msgr2=0x559a729fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.475+0000 7f1345d9b700 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729f50b0 0x559a729fe4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.475+0000 7f1345d9b700 1 -- 172.21.15.5:0/3200871542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 msgr2=0x559a72a00d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.475+0000 7f1345d9b700 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a72a00d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.475+0000 7f1345d9b700 1 -- 172.21.15.5:0/3200871542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a727991f0 con 0x559a729fa880 2023-10-08T13:16:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.476+0000 7f1345d9b700 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 0x559a72a05c20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1338010a60 tx=0x7f1338004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3227b9c6d3c9c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.477+0000 7f13357fa700 1 -- 172.21.15.5:0/3200871542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133801f070 con 0x559a729fa880 2023-10-08T13:16:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.477+0000 7f13357fa700 1 -- 172.21.15.5:0/3200871542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1338010380 con 0x559a729fa880 2023-10-08T13:16:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.477+0000 7f13357fa700 1 -- 172.21.15.5:0/3200871542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380043c0 con 0x559a729fa880 2023-10-08T13:16:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.478+0000 7f1358f47b80 1 -- 172.21.15.5:0/3200871542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 msgr2=0x559a72a05c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.478+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 0x559a72a05c20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1338010a60 tx=0x7f1338004800 comp rx=0 tx=0).stop 2023-10-08T13:16:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.479+0000 7f1358f47b80 1 -- 172.21.15.5:0/3200871542 shutdown_connections 2023-10-08T13:16:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.479+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a729fb1a0 0x559a72a00d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.479+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729f50b0 0x559a729fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.479+0000 7f1358f47b80 1 --2- 172.21.15.5:0/3200871542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729fa880 0x559a72a05c20 secure :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1338010a60 tx=0x7f1338004800 comp rx=0 tx=0).stop 2023-10-08T13:16:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.479+0000 7f1358f47b80 1 -- 172.21.15.5:0/3200871542 >> 172.21.15.5:0/3200871542 conn(0x559a72969200 msgr2=0x559a729fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.489+0000 7f1358f47b80 1 -- 172.21.15.5:0/3200871542 shutdown_connections 2023-10-08T13:16:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.496+0000 7f1358f47b80 1 -- 172.21.15.5:0/3200871542 wait complete. 2023-10-08T13:16:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.496+0000 7f1358f47b80 1 -- start start 2023-10-08T13:16:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.496+0000 7f1358f47b80 1 Processor -- start 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a5def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fb1a0 0x559a72a5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a72a05460 0x559a72a058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a72a05fa0 con 0x559a729f50b0 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a72a06110 con 0x559a72a05460 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a72a03c20 con 0x559a729fb1a0 2023-10-08T13:16:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.497+0000 7f1358f47b80 10 client.0 _ll_register_callbacks cb 0x7f13400077f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.500+0000 7f134659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a5def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.500+0000 7f134659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a5def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37732/0 (socket says 172.21.15.5:37732) 2023-10-08T13:16:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.500+0000 7f134659c700 1 -- 172.21.15.5:0/995880507 learned_addr learned my addr 172.21.15.5:0/995880507 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f134659c700 1 -- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fb1a0 msgr2=0x559a72a5e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f134659c700 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fb1a0 0x559a72a5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f134659c700 1 -- 172.21.15.5:0/995880507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a72a05460 msgr2=0x559a72a058c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:16:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f134659c700 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a72a05460 0x559a72a058c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f134659c700 1 -- 172.21.15.5:0/995880507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a72772d80 con 0x559a729f50b0 2023-10-08T13:16:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f134659c700 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a5def0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f133c005950 tx=0x7f133c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbfeec924affb38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f132dffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f132dffb700 1 -- 172.21.15.5:0/995880507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c09e110 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.501+0000 7f132dffb700 1 -- 172.21.15.5:0/995880507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f133c0a2350 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1338011e50 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f132dffb700 1 -- 172.21.15.5:0/995880507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f133c098360 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 10 client.16941 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x559a72771250 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f132dffb700 1 -- 172.21.15.5:0/995880507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1338011e50 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f132dffb700 1 -- 172.21.15.5:0/995880507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f133c0ca930 con 0x559a729f50b0 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 10 client.16941 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 20 client.16941 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a5b2b0 0x559a72a77af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 4 client.16941 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:16:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.502+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559a72940ad0 con 0x559a72a5b2b0 2023-10-08T13:16:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.503+0000 7f1345d9b700 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a5b2b0 0x559a72a77af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.505+0000 7f1345d9b700 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a5b2b0 0x559a72a77af0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bd064a92dc13a46 server_cookie=6a40604fa7e63ab6 in_seq=0 out_seq=0 2023-10-08T13:16:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.506+0000 7f132dffb700 10 client.16941 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:16:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:16:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:16:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.547+0000 7f132dffb700 1 -- 172.21.15.5:0/995880507 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559a72940ad0 con 0x559a72a5b2b0 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.547+0000 7f132dffb700 10 client.16941 handle_command_reply: tid=0 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.547+0000 7f1358f47b80 1 client.16941 shutdown 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.550+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 msgr2=0x559a72a5def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.550+0000 7f1358f47b80 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a5def0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f133c005950 tx=0x7f133c0cc040 comp rx=0 tx=0).stop 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 shutdown_connections 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559a72a5b2b0 0x559a72a77af0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559a72a05460 0x559a72a058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a729f50b0 0x559a72a5def0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 --2- 172.21.15.5:0/995880507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559a729fb1a0 0x559a72a5e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 >> 172.21.15.5:0/995880507 conn(0x559a72969200 msgr2=0x559a729fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f132dffb700 0 client.16941 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 shutdown_connections 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.551+0000 7f1358f47b80 1 -- 172.21.15.5:0/995880507 wait complete. 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f1358f47b80 20 client.16941 trim_cache size 0 max 16384 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f13300a17f0 msgr2=0x7f13300a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f13300a17f0 0x7f13300a3cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f13400060b0 tx=0x7f1340006000 comp rx=0 tx=0).stop 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 msgr2=0x7f13481ab680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 0x7f13481ab680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f133c00c920 tx=0x7f133c00cce0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 shutdown_connections 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f13300a17f0 0x7f13300a3cb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1348105620 0x7f13481a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13480ff560 0x7f13481ab680 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 --2- 172.21.15.5:0/1479919245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13480fff20 0x7f13481abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.552+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 >> 172.21.15.5:0/1479919245 conn(0x7f13480fb070 msgr2=0x7f13480fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.553+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 shutdown_connections 2023-10-08T13:16:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:25.553+0000 7f134cd5e700 1 -- 172.21.15.5:0/1479919245 wait complete. 2023-10-08T13:16:26.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 605.0 s, 434.8 tps, lat 230.829 ms stddev 474.845 2023-10-08T13:16:27.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:26 smithi060 ceph-mon[103190]: pgmap v621: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.5 MiB/s wr, 511 op/s 2023-10-08T13:16:27.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:26 smithi005 ceph-mon[99496]: pgmap v621: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.5 MiB/s wr, 511 op/s 2023-10-08T13:16:27.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:26 smithi118 ceph-mon[104234]: pgmap v621: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.5 MiB/s wr, 511 op/s 2023-10-08T13:16:29.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:28 smithi060 ceph-mon[103190]: pgmap v622: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 5.3 MiB/s wr, 497 op/s 2023-10-08T13:16:29.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:28 smithi005 ceph-mon[99496]: pgmap v622: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 5.3 MiB/s wr, 497 op/s 2023-10-08T13:16:29.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:28 smithi118 ceph-mon[104234]: pgmap v622: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 5.3 MiB/s wr, 497 op/s 2023-10-08T13:16:31.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:30 smithi060 ceph-mon[103190]: pgmap v623: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 4.8 MiB/s wr, 485 op/s 2023-10-08T13:16:31.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:30 smithi005 ceph-mon[99496]: pgmap v623: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 4.8 MiB/s wr, 485 op/s 2023-10-08T13:16:31.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:30 smithi118 ceph-mon[104234]: pgmap v623: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 4.8 MiB/s wr, 485 op/s 2023-10-08T13:16:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 610.0 s, 565.7 tps, lat 178.522 ms stddev 221.324 2023-10-08T13:16:33.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:32 smithi060 ceph-mon[103190]: pgmap v624: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 4.8 MiB/s wr, 484 op/s 2023-10-08T13:16:33.177 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:32 smithi005 ceph-mon[99496]: pgmap v624: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 4.8 MiB/s wr, 484 op/s 2023-10-08T13:16:33.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:32 smithi118 ceph-mon[104234]: pgmap v624: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 4.8 MiB/s wr, 484 op/s 2023-10-08T13:16:35.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:34 smithi060 ceph-mon[103190]: pgmap v625: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 5.1 MiB/s wr, 518 op/s 2023-10-08T13:16:35.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:34 smithi005 ceph-mon[99496]: pgmap v625: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 5.1 MiB/s wr, 518 op/s 2023-10-08T13:16:35.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:34 smithi118 ceph-mon[104234]: pgmap v625: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 5.1 MiB/s wr, 518 op/s 2023-10-08T13:16:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 615.0 s, 519.3 tps, lat 194.767 ms stddev 214.743 2023-10-08T13:16:37.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:36 smithi005 ceph-mon[99496]: pgmap v626: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-08T13:16:37.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:36 smithi118 ceph-mon[104234]: pgmap v626: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-08T13:16:37.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:36 smithi060 ceph-mon[103190]: pgmap v626: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-08T13:16:39.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:38 smithi005 ceph-mon[99496]: pgmap v627: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 5.1 MiB/s wr, 505 op/s 2023-10-08T13:16:39.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 -- 172.21.15.5:0/1582900578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51680ff930 msgr2=0x7f5168103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 --2- 172.21.15.5:0/1582900578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51680ff930 0x7f5168103970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f51580098f0 tx=0x7f5158009c00 comp rx=0 tx=0).stop 2023-10-08T13:16:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 -- 172.21.15.5:0/1582900578 shutdown_connections 2023-10-08T13:16:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 --2- 172.21.15.5:0/1582900578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51681040a0 0x7f516810bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 --2- 172.21.15.5:0/1582900578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f51680ff360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 --2- 172.21.15.5:0/1582900578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51680ff930 0x7f5168103970 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.243+0000 7f516e64d700 1 -- 172.21.15.5:0/1582900578 >> 172.21.15.5:0/1582900578 conn(0x7f5168075ad0 msgr2=0x7f51680fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.252+0000 7f516e64d700 1 -- 172.21.15.5:0/1582900578 shutdown_connections 2023-10-08T13:16:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.252+0000 7f516e64d700 1 -- 172.21.15.5:0/1582900578 wait complete. 2023-10-08T13:16:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.253+0000 7f516e64d700 1 Processor -- start 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.253+0000 7f516e64d700 1 -- start start 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f516e64d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f516810a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f516e64d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51681040a0 0x7f5168072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f516e64d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f516810ab20 0x7f51681b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f516e64d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516810b0f0 con 0x7f51680fef80 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f516e64d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516810b260 con 0x7f516810ab20 2023-10-08T13:16:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f516e64d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5168111840 con 0x7f51681040a0 2023-10-08T13:16:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f5167fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f516810a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f5167fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f516810a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37748/0 (socket says 172.21.15.5:37748) 2023-10-08T13:16:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.254+0000 7f5167fff700 1 -- 172.21.15.5:0/1473906300 learned_addr learned my addr 172.21.15.5:0/1473906300 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.255+0000 7f5167fff700 1 -- 172.21.15.5:0/1473906300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51681040a0 msgr2=0x7f5168072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.255+0000 7f5167fff700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51681040a0 0x7f5168072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.255+0000 7f5167fff700 1 -- 172.21.15.5:0/1473906300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f516810ab20 msgr2=0x7f51681b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.255+0000 7f5167fff700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f516810ab20 0x7f51681b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.255+0000 7f5167fff700 1 -- 172.21.15.5:0/1473906300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5158009520 con 0x7f51680fef80 2023-10-08T13:16:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.255+0000 7f5167fff700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f516810a5e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f515c00ddf0 tx=0x7f515c00a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.258+0000 7f51657fa700 1 -- 172.21.15.5:0/1473906300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00e450 con 0x7f51680fef80 2023-10-08T13:16:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.258+0000 7f51657fa700 1 -- 172.21.15.5:0/1473906300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f515c00ea70 con 0x7f51680fef80 2023-10-08T13:16:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.259+0000 7f51657fa700 1 -- 172.21.15.5:0/1473906300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c016b40 con 0x7f51680fef80 2023-10-08T13:16:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.259+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5168111b20 con 0x7f51680fef80 2023-10-08T13:16:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.259+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5168111fe0 con 0x7f51680fef80 2023-10-08T13:16:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 Processor -- start 2023-10-08T13:16:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 -- start start 2023-10-08T13:16:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 0x55dc0228bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228c1a0 0x55dc02285b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc02286510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc021ee400 con 0x55dc0228b880 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc021dfbc0 con 0x55dc0228c1a0 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.265+0000 7f517a836b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc021dd4e0 con 0x55dc022860b0 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f51677fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc02286510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 0x55dc0228bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 0x55dc0228bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37750/0 (socket says 172.21.15.5:37750) 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 -- 172.21.15.5:0/1291406816 learned_addr learned my addr 172.21.15.5:0/1291406816 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f5167fff700 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228c1a0 0x55dc02285b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 -- 172.21.15.5:0/1291406816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 msgr2=0x55dc02286510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc02286510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 -- 172.21.15.5:0/1291406816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228c1a0 msgr2=0x55dc02285b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228c1a0 0x55dc02285b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.268+0000 7f516cbea700 1 -- 172.21.15.5:0/1291406816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc02003d80 con 0x55dc0228b880 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.269+0000 7f516cbea700 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 0x55dc0228bc60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5160007f60 tx=0x7f5160007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3250557fa72fc82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.269+0000 7f514e7fc700 1 -- 172.21.15.5:0/1291406816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160031070 con 0x55dc0228b880 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.269+0000 7f514e7fc700 1 -- 172.21.15.5:0/1291406816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5160007a90 con 0x55dc0228b880 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.269+0000 7f514e7fc700 1 -- 172.21.15.5:0/1291406816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516002a660 con 0x55dc0228b880 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 -- 172.21.15.5:0/1291406816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 msgr2=0x55dc0228bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 0x55dc0228bc60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5160007f60 tx=0x7f5160007f90 comp rx=0 tx=0).stop 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 -- 172.21.15.5:0/1291406816 shutdown_connections 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc02286510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228b880 0x55dc0228bc60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 --2- 172.21.15.5:0/1291406816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228c1a0 0x55dc02285b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 -- 172.21.15.5:0/1291406816 >> 172.21.15.5:0/1291406816 conn(0x55dc021fa200 msgr2=0x55dc02280b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 -- 172.21.15.5:0/1291406816 shutdown_connections 2023-10-08T13:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.270+0000 7f517a836b80 1 -- 172.21.15.5:0/1291406816 wait complete. 2023-10-08T13:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.271+0000 7f51657fa700 1 -- 172.21.15.5:0/1473906300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f515c00ebe0 con 0x7f51680fef80 2023-10-08T13:16:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.271+0000 7f517a836b80 1 -- start start 2023-10-08T13:16:39.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:38 smithi118 ceph-mon[104234]: pgmap v627: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 5.1 MiB/s wr, 505 op/s 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.271+0000 7f517a836b80 1 Processor -- start 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.272+0000 7f51657fa700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51500a16c0 0x7f51500a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.272+0000 7f51657fa700 1 -- 172.21.15.5:0/1473906300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f515c0cd0b0 con 0x7f51680fef80 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc0228f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc0228faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc021d8dd0 con 0x55dc0228c1a0 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc021756b0 con 0x55dc0228b880 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc02175350 con 0x55dc022860b0 2023-10-08T13:16:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.273+0000 7f517a836b80 10 client.0 _ll_register_callbacks cb 0x55dc01fd27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.274+0000 7f5167fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc0228f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.274+0000 7f5167fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc0228f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:50966/0 (socket says 172.21.15.5:50966) 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.274+0000 7f5167fff700 1 -- 172.21.15.5:0/1144472788 learned_addr learned my addr 172.21.15.5:0/1144472788 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.274+0000 7f51677fe700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc0228faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.275+0000 7f516cbea700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51500a16c0 0x7f51500a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.275+0000 7f516cbea700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.276+0000 7f516cbea700 1 -- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 msgr2=0x55dc0228f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.276+0000 7f516cbea700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc0228f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.276+0000 7f516cbea700 1 -- 172.21.15.5:0/1144472788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 msgr2=0x55dc0228faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.276+0000 7f516cbea700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc0228faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.276+0000 7f516cbea700 1 -- 172.21.15.5:0/1144472788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5160007c10 con 0x55dc0228c1a0 2023-10-08T13:16:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.277+0000 7f516cbea700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228ffe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5160007f30 tx=0x7f5160000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e6ca702e50ddcc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.277+0000 7f516cbea700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51500a16c0 0x7f51500a3b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5160035c00 tx=0x7f5160035c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.289+0000 7f51477fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.289+0000 7f51477fe700 1 -- 172.21.15.5:0/1144472788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160031040 con 0x55dc0228c1a0 2023-10-08T13:16:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.289+0000 7f51477fe700 1 -- 172.21.15.5:0/1144472788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f5160003e10 con 0x55dc0228c1a0 2023-10-08T13:16:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.289+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc021d1db0 con 0x55dc0228c1a0 2023-10-08T13:16:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.293+0000 7f51477fe700 1 -- 172.21.15.5:0/1144472788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5160004050 con 0x55dc0228c1a0 2023-10-08T13:16:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.300+0000 7f517a836b80 10 client.16953 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.300+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55dc01fecc00 con 0x55dc0228c1a0 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f51477fe700 1 -- 172.21.15.5:0/1144472788 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc021d1db0 con 0x55dc0228c1a0 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f51477fe700 1 -- 172.21.15.5:0/1144472788 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5160057580 con 0x55dc0228c1a0 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f517a836b80 10 client.16953 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f517a836b80 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f517a836b80 20 client.16953 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f517a836b80 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc0229fc70 0x55dc022a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f517a836b80 4 client.16953 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:16:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.312+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc021d1ad0 con 0x55dc0229fc70 2023-10-08T13:16:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.324+0000 7f5167fff700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc0229fc70 0x55dc022a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.342+0000 7f5167fff700 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc0229fc70 0x55dc022a2090 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54db270eac8d2f3 server_cookie=7c2f7d40b2d43f6b in_seq=0 out_seq=0 2023-10-08T13:16:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.342+0000 7f51477fe700 10 client.16953 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.343+0000 7f51477fe700 1 -- 172.21.15.5:0/1144472788 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc021d1ad0 con 0x55dc0229fc70 2023-10-08T13:16:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.343+0000 7f51477fe700 10 client.16953 handle_command_reply: tid=0 2023-10-08T13:16:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.343+0000 7f517a836b80 1 client.16953 shutdown 2023-10-08T13:16:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.346+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 msgr2=0x55dc0228ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.346+0000 7f517a836b80 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228ffe0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5160007f30 tx=0x7f5160000f40 comp rx=0 tx=0).stop 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 shutdown_connections 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f517a836b80 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228ffe0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f517a836b80 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc022860b0 0x55dc0228f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f517a836b80 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc0229fc70 0x55dc022a2090 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f517a836b80 1 --2- 172.21.15.5:0/1144472788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc0228faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 >> 172.21.15.5:0/1144472788 conn(0x55dc021fa200 msgr2=0x55dc02280010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.350+0000 7f51477fe700 0 client.16953 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.356+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 shutdown_connections 2023-10-08T13:16:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.358+0000 7f517a836b80 1 -- 172.21.15.5:0/1144472788 wait complete. 2023-10-08T13:16:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.361+0000 7f517a836b80 20 client.16953 trim_cache size 0 max 16384 2023-10-08T13:16:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.399+0000 7f517a836b80 1 Processor -- start 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.399+0000 7f517a836b80 1 -- start start 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.400+0000 7f517a836b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc022860b0 0x55dc02285b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.400+0000 7f517a836b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228b880 0x55dc0228aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.400+0000 7f517a836b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.400+0000 7f517a836b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc020598c0 con 0x55dc0228c1a0 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.400+0000 7f517a836b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc021d1b00 con 0x55dc022860b0 2023-10-08T13:16:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.400+0000 7f517a836b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0227b2b0 con 0x55dc0228b880 2023-10-08T13:16:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.401+0000 7f516cbea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.401+0000 7f516cbea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37766/0 (socket says 172.21.15.5:37766) 2023-10-08T13:16:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.401+0000 7f516cbea700 1 -- 172.21.15.5:0/3072943235 learned_addr learned my addr 172.21.15.5:0/3072943235 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f516cbea700 1 -- 172.21.15.5:0/3072943235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228b880 msgr2=0x55dc0228aec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:16:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f516cbea700 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228b880 0x55dc0228aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f516cbea700 1 -- 172.21.15.5:0/3072943235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc022860b0 msgr2=0x55dc02285b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:16:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f516cbea700 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc022860b0 0x55dc02285b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f516cbea700 1 -- 172.21.15.5:0/3072943235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc02286760 con 0x55dc0228c1a0 2023-10-08T13:16:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f516cbea700 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228fe00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5160057960 tx=0x7f5160006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9449a0248a6e984 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f514effd700 1 -- 172.21.15.5:0/3072943235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160031040 con 0x55dc0228c1a0 2023-10-08T13:16:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f514effd700 1 -- 172.21.15.5:0/3072943235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5160057b50 con 0x55dc0228c1a0 2023-10-08T13:16:39.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.402+0000 7f514effd700 1 -- 172.21.15.5:0/3072943235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516004dd10 con 0x55dc0228c1a0 2023-10-08T13:16:39.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.403+0000 7f517a836b80 1 -- 172.21.15.5:0/3072943235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 msgr2=0x55dc0228fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.403+0000 7f517a836b80 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228fe00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5160057960 tx=0x7f5160006060 comp rx=0 tx=0).stop 2023-10-08T13:16:39.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:38 smithi060 ceph-mon[103190]: pgmap v627: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 5.1 MiB/s wr, 505 op/s 2023-10-08T13:16:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.412+0000 7f517a836b80 1 -- 172.21.15.5:0/3072943235 shutdown_connections 2023-10-08T13:16:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.412+0000 7f517a836b80 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc0228c1a0 0x55dc0228fe00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.412+0000 7f517a836b80 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc022860b0 0x55dc02285b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.412+0000 7f517a836b80 1 --2- 172.21.15.5:0/3072943235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228b880 0x55dc0228aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.412+0000 7f517a836b80 1 -- 172.21.15.5:0/3072943235 >> 172.21.15.5:0/3072943235 conn(0x55dc021fa200 msgr2=0x55dc0228dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:39.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.421+0000 7f517a836b80 1 -- 172.21.15.5:0/3072943235 shutdown_connections 2023-10-08T13:16:39.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.421+0000 7f517a836b80 1 -- 172.21.15.5:0/3072943235 wait complete. 2023-10-08T13:16:39.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.421+0000 7f517a836b80 1 -- start start 2023-10-08T13:16:39.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.421+0000 7f517a836b80 1 Processor -- start 2023-10-08T13:16:39.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 0x55dc02294c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc022951a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228c1a0 0x55dc02295700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc022f2c80 con 0x55dc022860b0 2023-10-08T13:16:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc022f2df0 con 0x55dc0228b880 2023-10-08T13:16:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc022f2fb0 con 0x55dc0228c1a0 2023-10-08T13:16:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f517a836b80 10 client.0 _ll_register_callbacks cb 0x7f5160035800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f5167fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 0x55dc02294c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f5167fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 0x55dc02294c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37772/0 (socket says 172.21.15.5:37772) 2023-10-08T13:16:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.422+0000 7f5167fff700 1 -- 172.21.15.5:0/1937903719 learned_addr learned my addr 172.21.15.5:0/1937903719 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f5167fff700 1 -- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228c1a0 msgr2=0x55dc02295700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f5167fff700 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228c1a0 0x55dc02295700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f5167fff700 1 -- 172.21.15.5:0/1937903719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 msgr2=0x55dc022951a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f5167fff700 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc022951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f5167fff700 1 -- 172.21.15.5:0/1937903719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc01fecc00 con 0x55dc022860b0 2023-10-08T13:16:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f5167fff700 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 0x55dc02294c60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f515c096820 tx=0x7f515c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5424537169349037 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f51477fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f51477fe700 1 -- 172.21.15.5:0/1937903719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c099db0 con 0x55dc022860b0 2023-10-08T13:16:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.423+0000 7f51477fe700 1 -- 172.21.15.5:0/1937903719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f515c09df00 con 0x55dc022860b0 2023-10-08T13:16:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.431+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc021a0e50 con 0x55dc022860b0 2023-10-08T13:16:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.442+0000 7f51477fe700 1 -- 172.21.15.5:0/1937903719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f515c0a2140 con 0x55dc022860b0 2023-10-08T13:16:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.442+0000 7f517a836b80 10 client.16959 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.442+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55dc0202a1f0 con 0x55dc022860b0 2023-10-08T13:16:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.445+0000 7f51477fe700 1 -- 172.21.15.5:0/1937903719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f515c0a8030 con 0x55dc022860b0 2023-10-08T13:16:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.445+0000 7f51477fe700 1 -- 172.21.15.5:0/1937903719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f515c0cf180 con 0x55dc022860b0 2023-10-08T13:16:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.446+0000 7f517a836b80 10 client.16959 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.446+0000 7f517a836b80 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.446+0000 7f517a836b80 20 client.16959 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.446+0000 7f517a836b80 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc022f47b0 0x55dc022f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.446+0000 7f517a836b80 4 client.16959 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:16:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.446+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc02024f10 con 0x55dc022f47b0 2023-10-08T13:16:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.448+0000 7f51677fe700 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc022f47b0 0x55dc022f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.464+0000 7f51677fe700 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc022f47b0 0x55dc022f6c10 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58524c9d25001f39 server_cookie=e580d9bb46ad5e9a in_seq=0 out_seq=0 2023-10-08T13:16:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.467+0000 7f51477fe700 10 client.16959 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f51477fe700 1 -- 172.21.15.5:0/1937903719 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc02024f10 con 0x55dc022f47b0 2023-10-08T13:16:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f51477fe700 10 client.16959 handle_command_reply: tid=0 2023-10-08T13:16:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 client.16959 shutdown 2023-10-08T13:16:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 msgr2=0x55dc02294c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 0x55dc02294c60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f515c096820 tx=0x7f515c000bc0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 shutdown_connections 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dc0228c1a0 0x55dc02295700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc022860b0 0x55dc02294c60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dc022f47b0 0x55dc022f6c10 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 --2- 172.21.15.5:0/1937903719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dc0228b880 0x55dc022951a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 >> 172.21.15.5:0/1937903719 conn(0x55dc021fa200 msgr2=0x55dc0228dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f51477fe700 0 client.16959 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.487+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 shutdown_connections 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f517a836b80 1 -- 172.21.15.5:0/1937903719 wait complete. 2023-10-08T13:16:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f517a836b80 20 client.16959 trim_cache size 0 max 16384 2023-10-08T13:16:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:16:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:16:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:16:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51500a16c0 msgr2=0x7f51500a3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51500a16c0 0x7f51500a3b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5160035c00 tx=0x7f5160035c60 comp rx=0 tx=0).stop 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 msgr2=0x7f516810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f516810a5e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f515c00ddf0 tx=0x7f515c00a530 comp rx=0 tx=0).stop 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 shutdown_connections 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51500a16c0 0x7f51500a3b80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f516810ab20 0x7f51681b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51680fef80 0x7f516810a5e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 --2- 172.21.15.5:0/1473906300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51681040a0 0x7f5168072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.488+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 >> 172.21.15.5:0/1473906300 conn(0x7f5168075ad0 msgr2=0x7f516810fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.489+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 shutdown_connections 2023-10-08T13:16:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:39.489+0000 7f516e64d700 1 -- 172.21.15.5:0/1473906300 wait complete. 2023-10-08T13:16:41.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:40 smithi118 ceph-mon[104234]: pgmap v628: 129 pgs: 129 active+clean; 3.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2023-10-08T13:16:41.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:40 smithi060 ceph-mon[103190]: pgmap v628: 129 pgs: 129 active+clean; 3.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2023-10-08T13:16:41.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:40 smithi005 ceph-mon[99496]: pgmap v628: 129 pgs: 129 active+clean; 3.4 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2023-10-08T13:16:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 620.0 s, 481.5 tps, lat 195.213 ms stddev 199.197 2023-10-08T13:16:42.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:41 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:16:42.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:41 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:16:42.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:41 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:16:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:42 smithi118 ceph-mon[104234]: pgmap v629: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 5.6 MiB/s wr, 531 op/s 2023-10-08T13:16:43.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:43 smithi060 ceph-mon[103190]: pgmap v629: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 5.6 MiB/s wr, 531 op/s 2023-10-08T13:16:43.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:42 smithi005 ceph-mon[99496]: pgmap v629: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 5.6 MiB/s wr, 531 op/s 2023-10-08T13:16:44.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:43 smithi118 ceph-mon[104234]: pgmap v630: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 550 op/s 2023-10-08T13:16:44.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:43 smithi060 ceph-mon[103190]: pgmap v630: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 550 op/s 2023-10-08T13:16:44.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:43 smithi005 ceph-mon[99496]: pgmap v630: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.6 MiB/s wr, 550 op/s 2023-10-08T13:16:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 625.0 s, 480.8 tps, lat 215.451 ms stddev 257.534 2023-10-08T13:16:47.030 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: pgmap v631: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 521 op/s 2023-10-08T13:16:47.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.031 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:46 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: pgmap v631: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 521 op/s 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:46 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.184 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.184 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.185 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: pgmap v631: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 521 op/s 2023-10-08T13:16:47.185 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.185 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.185 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:47.185 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:46 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:48.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:16:48.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:16:48.021 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:47 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:48.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:16:48.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:16:48.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:47 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:48.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:16:48.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:16:48.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:47 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:16:49.022 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:48 smithi118 ceph-mon[104234]: pgmap v632: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.3 MiB/s wr, 514 op/s 2023-10-08T13:16:49.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:48 smithi060 ceph-mon[103190]: pgmap v632: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.3 MiB/s wr, 514 op/s 2023-10-08T13:16:49.177 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:48 smithi005 ceph-mon[99496]: pgmap v632: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.3 MiB/s wr, 514 op/s 2023-10-08T13:16:49.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:16:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.860+0000 7f28ad4f8700 1 -- 172.21.15.5:0/546796003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a810edf0 msgr2=0x7f28a810f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.860+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/546796003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a810edf0 0x7f28a810f1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f289801a900 tx=0x7f289801ac10 comp rx=0 tx=0).stop 2023-10-08T13:16:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.864+0000 7f28ad4f8700 1 -- 172.21.15.5:0/546796003 shutdown_connections 2023-10-08T13:16:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.864+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/546796003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28a81083a0 0x7f28a811bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.864+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/546796003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a810edf0 0x7f28a810f1d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.864+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/546796003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a81077f0 0x7f28a8107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.864+0000 7f28ad4f8700 1 -- 172.21.15.5:0/546796003 >> 172.21.15.5:0/546796003 conn(0x7f28a806b770 msgr2=0x7f28a806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.866+0000 7f28ad4f8700 1 -- 172.21.15.5:0/546796003 shutdown_connections 2023-10-08T13:16:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.866+0000 7f28ad4f8700 1 -- 172.21.15.5:0/546796003 wait complete. 2023-10-08T13:16:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.867+0000 7f28ad4f8700 1 Processor -- start 2023-10-08T13:16:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.868+0000 7f28ad4f8700 1 -- start start 2023-10-08T13:16:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28ad4f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 0x7f28a8117cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28ad4f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28a81083a0 0x7f28a8118230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28ad4f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a810edf0 0x7f28a81c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28ad4f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a81c4230 con 0x7f28a810edf0 2023-10-08T13:16:49.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28ad4f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a81c43a0 con 0x7f28a81077f0 2023-10-08T13:16:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28ad4f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a81c4560 con 0x7f28a81083a0 2023-10-08T13:16:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 0x7f28a8117cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a810edf0 0x7f28a81c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 0x7f28a8117cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60966/0 (socket says 172.21.15.5:60966) 2023-10-08T13:16:49.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a6ffd700 1 -- 172.21.15.5:0/2622772154 learned_addr learned my addr 172.21.15.5:0/2622772154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a77fe700 1 -- 172.21.15.5:0/2622772154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28a81083a0 msgr2=0x7f28a8118230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:16:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a77fe700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28a81083a0 0x7f28a8118230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a77fe700 1 -- 172.21.15.5:0/2622772154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 msgr2=0x7f28a8117cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.869+0000 7f28a77fe700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 0x7f28a8117cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f28a77fe700 1 -- 172.21.15.5:0/2622772154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289801a530 con 0x7f28a810edf0 2023-10-08T13:16:49.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 0x7f28a8117cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f28a77fe700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a810edf0 0x7f28a81c3b00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f289c00e940 tx=0x7f289c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f2897fff700 1 -- 172.21.15.5:0/2622772154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c004220 con 0x7f28a810edf0 2023-10-08T13:16:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f2897fff700 1 -- 172.21.15.5:0/2622772154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f289c004cf0 con 0x7f28a810edf0 2023-10-08T13:16:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a81c4840 con 0x7f28a810edf0 2023-10-08T13:16:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f2897fff700 1 -- 172.21.15.5:0/2622772154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c005020 con 0x7f28a810edf0 2023-10-08T13:16:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.870+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a81cbe00 con 0x7f28a810edf0 2023-10-08T13:16:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.873+0000 7f2897fff700 1 -- 172.21.15.5:0/2622772154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f289c005180 con 0x7f28a810edf0 2023-10-08T13:16:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.874+0000 7f2897fff700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28900a1670 0x7f28900a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.874+0000 7f28b96e1b80 1 Processor -- start 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.874+0000 7f2897fff700 1 -- 172.21.15.5:0/2622772154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f289c014070 con 0x7f28a810edf0 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.874+0000 7f28b96e1b80 1 -- start start 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f587e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5889110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f588ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f57e7460 con 0x55c4f587de80 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f57d8c20 con 0x55c4f5889650 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f57d6540 con 0x55c4f587e7a0 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f588ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f588ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60974/0 (socket says 172.21.15.5:60974) 2023-10-08T13:16:49.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 -- 172.21.15.5:0/3543385265 learned_addr learned my addr 172.21.15.5:0/3543385265 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28900a1670 0x7f28900a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a67fc700 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5889110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f587e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 -- 172.21.15.5:0/3543385265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 msgr2=0x55c4f5889110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5889110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 -- 172.21.15.5:0/3543385265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 msgr2=0x55c4f587e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f587e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a77fe700 1 -- 172.21.15.5:0/3543385265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f55fcde0 con 0x55c4f5889650 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.875+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f587e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.876+0000 7f28a77fe700 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f588ba40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f289c09a000 tx=0x7f289c099a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e56e9c0e6bd8452b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.876+0000 7f28957fa700 1 -- 172.21.15.5:0/3543385265 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c09a770 con 0x55c4f5889650 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.876+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28900a1670 0x7f28900a3b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f289801cdb0 tx=0x7f2898005de0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.876+0000 7f28957fa700 1 -- 172.21.15.5:0/3543385265 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f289c09a070 con 0x55c4f5889650 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.876+0000 7f28957fa700 1 -- 172.21.15.5:0/3543385265 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c04b5b0 con 0x55c4f5889650 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3543385265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 msgr2=0x55c4f588ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f588ba40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f289c09a000 tx=0x7f289c099a70 comp rx=0 tx=0).stop 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3543385265 shutdown_connections 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f588ba40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f587e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3543385265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5889110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3543385265 >> 172.21.15.5:0/3543385265 conn(0x55c4f57f3260 msgr2=0x55c4f587a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3543385265 shutdown_connections 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3543385265 wait complete. 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 -- start start 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.877+0000 7f28b96e1b80 1 Processor -- start 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f5889060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5886450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f5886a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f57d1e30 con 0x55c4f587de80 2023-10-08T13:16:49.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f576e710 con 0x55c4f5889650 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f576e3b0 con 0x55c4f587e7a0 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28b96e1b80 10 client.0 _ll_register_callbacks cb 0x55c4f55cb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f5889060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f5889060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37798/0 (socket says 172.21.15.5:37798) 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3767103643 learned_addr learned my addr 172.21.15.5:0/3767103643 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a77fe700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f5886a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a67fc700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5886450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 msgr2=0x55c4f5886450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5886450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3767103643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 msgr2=0x55c4f5886a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f5886a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3767103643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a81cbe00 con 0x55c4f587de80 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a77fe700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f5886a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f5889060 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f289801cd70 tx=0x7f289801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348882090a00eac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.878+0000 7f288a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.879+0000 7f288a7fc700 1 -- 172.21.15.5:0/3767103643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898016040 con 0x55c4f587de80 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.879+0000 7f288a7fc700 1 -- 172.21.15.5:0/3767103643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f2898015070 con 0x55c4f587de80 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.879+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4f5799eb0 con 0x55c4f587de80 2023-10-08T13:16:49.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.880+0000 7f288a7fc700 1 -- 172.21.15.5:0/3767103643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2898005240 con 0x55c4f587de80 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.880+0000 7f28b96e1b80 10 client.16971 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.880+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55c4f55e5c60 con 0x55c4f587de80 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.880+0000 7f288a7fc700 1 -- 172.21.15.5:0/3767103643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c4f5799eb0 con 0x55c4f587de80 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.880+0000 7f288a7fc700 1 -- 172.21.15.5:0/3767103643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2898031560 con 0x55c4f587de80 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28b96e1b80 10 client.16971 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28b96e1b80 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28b96e1b80 20 client.16971 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f5898f70 0x55c4f589b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28b96e1b80 4 client.16971 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:16:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4f57cae10 con 0x55c4f5898f70 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28a67fc700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f5898f70 0x55c4f589b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f288a7fc700 10 client.16971 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.881+0000 7f28a67fc700 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f5898f70 0x55c4f589b390 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef52c0480654346f server_cookie=e28b6198cf3efa18 in_seq=0 out_seq=0 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f288a7fc700 1 -- 172.21.15.5:0/3767103643 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c4f57cae10 con 0x55c4f5898f70 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f288a7fc700 10 client.16971 handle_command_reply: tid=0 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 client.16971 shutdown 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 msgr2=0x55c4f5889060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f5889060 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f289801cd70 tx=0x7f289801ac10 comp rx=0 tx=0).stop 2023-10-08T13:16:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 shutdown_connections 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f5898f70 0x55c4f589b390 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f5889650 0x55c4f5886a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587de80 0x55c4f5889060 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3767103643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587e7a0 0x55c4f5886450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 >> 172.21.15.5:0/3767103643 conn(0x55c4f57f3260 msgr2=0x55c4f5879ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.882+0000 7f288a7fc700 0 client.16971 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.883+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 shutdown_connections 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.883+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3767103643 wait complete. 2023-10-08T13:16:49.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.883+0000 7f28b96e1b80 20 client.16971 trim_cache size 0 max 16384 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 Processor -- start 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 -- start start 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 0x55c4f58900e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587e7a0 0x55c4f5879d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f5889650 0x55c4f587a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f5652920 con 0x55c4f587e7a0 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f5887340 con 0x55c4f587de80 2023-10-08T13:16:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f5890620 con 0x55c4f5889650 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587e7a0 0x55c4f5879d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 0x55c4f58900e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587e7a0 0x55c4f5879d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37808/0 (socket says 172.21.15.5:37808) 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f5889650 0x55c4f587a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 0x55c4f58900e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60988/0 (socket says 172.21.15.5:60988) 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a67fc700 1 -- 172.21.15.5:0/1812120924 learned_addr learned my addr 172.21.15.5:0/1812120924 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.906+0000 7f28a6ffd700 1 -- 172.21.15.5:0/1812120924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f5889650 msgr2=0x55c4f587a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f5889650 0x55c4f587a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f28a6ffd700 1 -- 172.21.15.5:0/1812120924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587e7a0 msgr2=0x55c4f5879d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587e7a0 0x55c4f5879d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f28a6ffd700 1 -- 172.21.15.5:0/1812120924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f5623250 con 0x55c4f587de80 2023-10-08T13:16:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 0x55c4f58900e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2898030000 tx=0x7f289801a850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9f179a03126aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f2895ffb700 1 -- 172.21.15.5:0/1812120924 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898028b70 con 0x55c4f587de80 2023-10-08T13:16:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f2895ffb700 1 -- 172.21.15.5:0/1812120924 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2898031b00 con 0x55c4f587de80 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.907+0000 7f2895ffb700 1 -- 172.21.15.5:0/1812120924 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898003b40 con 0x55c4f587de80 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 -- 172.21.15.5:0/1812120924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 msgr2=0x55c4f58900e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 0x55c4f58900e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2898030000 tx=0x7f289801a850 comp rx=0 tx=0).stop 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 -- 172.21.15.5:0/1812120924 shutdown_connections 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f5889650 0x55c4f587a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587de80 0x55c4f58900e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/1812120924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f587e7a0 0x55c4f5879d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 -- 172.21.15.5:0/1812120924 >> 172.21.15.5:0/1812120924 conn(0x55c4f57f3260 msgr2=0x55c4f5881750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 -- 172.21.15.5:0/1812120924 shutdown_connections 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 -- 172.21.15.5:0/1812120924 wait complete. 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 -- start start 2023-10-08T13:16:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.908+0000 7f28b96e1b80 1 Processor -- start 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587de80 0x55c4f588fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587e7a0 0x55c4f588e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f5889650 0x55c4f588e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f588eb40 con 0x55c4f5889650 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f588ecb0 con 0x55c4f587e7a0 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f588ee70 con 0x55c4f587de80 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28b96e1b80 10 client.0 _ll_register_callbacks cb 0x7f289801cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587e7a0 0x55c4f588e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587e7a0 0x55c4f588e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:60994/0 (socket says 172.21.15.5:60994) 2023-10-08T13:16:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a67fc700 1 -- 172.21.15.5:0/3988638872 learned_addr learned my addr 172.21.15.5:0/3988638872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587de80 0x55c4f588fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a77fe700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f5889650 0x55c4f588e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3988638872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587e7a0 msgr2=0x55c4f588e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587e7a0 0x55c4f588e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3988638872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f5889650 msgr2=0x55c4f588e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f5889650 0x55c4f588e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.909+0000 7f28a6ffd700 1 -- 172.21.15.5:0/3988638872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2898036040 con 0x55c4f587de80 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f28a6ffd700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587de80 0x55c4f588fc60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2898005e50 tx=0x7f2898005a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adca4c4b41872e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f288a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f288a7fc700 1 -- 172.21.15.5:0/3988638872 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898003680 con 0x55c4f587de80 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f288a7fc700 1 -- 172.21.15.5:0/3988638872 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f2898015030 con 0x55c4f587de80 2023-10-08T13:16:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f289c09a070 con 0x55c4f587de80 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f288a7fc700 1 -- 172.21.15.5:0/3988638872 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28980037e0 con 0x55c4f587de80 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f28b96e1b80 10 client.26452 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.910+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55c4f55fb2b0 con 0x55c4f587de80 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f288a7fc700 1 -- 172.21.15.5:0/3988638872 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f289c09a070 con 0x55c4f587de80 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f288a7fc700 1 -- 172.21.15.5:0/3988638872 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2898010910 con 0x55c4f587de80 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28b96e1b80 10 client.26452 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28b96e1b80 10 client.26452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28b96e1b80 20 client.26452 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f58edd30 0x55c4f58f0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28b96e1b80 4 client.26452 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:16:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4f57cab30 con 0x55c4f58edd30 2023-10-08T13:16:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28a67fc700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f58edd30 0x55c4f58f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f288a7fc700 10 client.26452 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.911+0000 7f28a67fc700 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f58edd30 0x55c4f58f0150 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=491957721913ee88 server_cookie=e0db854fd4aff043 in_seq=0 out_seq=0 2023-10-08T13:16:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f288a7fc700 1 -- 172.21.15.5:0/3988638872 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c4f57cab30 con 0x55c4f58edd30 2023-10-08T13:16:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f288a7fc700 10 client.26452 handle_command_reply: tid=0 2023-10-08T13:16:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 client.26452 shutdown 2023-10-08T13:16:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587de80 msgr2=0x55c4f588fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587de80 0x55c4f588fc60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2898005e50 tx=0x7f2898005a40 comp rx=0 tx=0).stop 2023-10-08T13:16:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 shutdown_connections 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4f5889650 0x55c4f588e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c4f587de80 0x55c4f588fc60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c4f58edd30 0x55c4f58f0150 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 --2- 172.21.15.5:0/3988638872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c4f587e7a0 0x55c4f588e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f288a7fc700 0 client.26452 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 >> 172.21.15.5:0/3988638872 conn(0x55c4f57f3260 msgr2=0x55c4f5879d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 shutdown_connections 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 1 -- 172.21.15.5:0/3988638872 wait complete. 2023-10-08T13:16:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.912+0000 7f28b96e1b80 20 client.26452 trim_cache size 0 max 16384 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:16:49.920 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:16:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28900a1670 msgr2=0x7f28900a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28900a1670 0x7f28900a3b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f289801cdb0 tx=0x7f2898005de0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a810edf0 msgr2=0x7f28a81c3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a810edf0 0x7f28a81c3b00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f289c00e940 tx=0x7f289c00ec50 comp rx=0 tx=0).stop 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 shutdown_connections 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f28900a1670 0x7f28900a3b30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a810edf0 0x7f28a81c3b00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a81077f0 0x7f28a8117cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 --2- 172.21.15.5:0/2622772154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28a81083a0 0x7f28a8118230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 >> 172.21.15.5:0/2622772154 conn(0x7f28a806b770 msgr2=0x7f28a806f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 shutdown_connections 2023-10-08T13:16:49.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:16:49.913+0000 7f28ad4f8700 1 -- 172.21.15.5:0/2622772154 wait complete. 2023-10-08T13:16:49.931 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:16:51.026 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:50 smithi118 ceph-mon[104234]: pgmap v633: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 537 op/s 2023-10-08T13:16:51.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:50 smithi060 ceph-mon[103190]: pgmap v633: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 537 op/s 2023-10-08T13:16:51.186 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:50 smithi005 ceph-mon[99496]: pgmap v633: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 537 op/s 2023-10-08T13:16:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 630.0 s, 534.6 tps, lat 192.392 ms stddev 241.930 2023-10-08T13:16:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.679+0000 7ff65014c700 1 -- 172.21.15.5:0/429538138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6481157f0 msgr2=0x7ff648117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.679+0000 7ff65014c700 1 --2- 172.21.15.5:0/429538138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6481157f0 0x7ff648117be0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff64000b0a0 tx=0x7ff64000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.696+0000 7ff65014c700 1 -- 172.21.15.5:0/429538138 shutdown_connections 2023-10-08T13:16:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.696+0000 7ff65014c700 1 --2- 172.21.15.5:0/429538138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6481157f0 0x7ff648117be0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.696+0000 7ff65014c700 1 --2- 172.21.15.5:0/429538138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff64810ae60 0x7ff6481077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.696+0000 7ff65014c700 1 --2- 172.21.15.5:0/429538138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff6481081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.697+0000 7ff65014c700 1 -- 172.21.15.5:0/429538138 >> 172.21.15.5:0/429538138 conn(0x7ff64806b7c0 msgr2=0x7ff64806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.698+0000 7ff65014c700 1 -- 172.21.15.5:0/429538138 shutdown_connections 2023-10-08T13:16:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.704+0000 7ff65014c700 1 -- 172.21.15.5:0/429538138 wait complete. 2023-10-08T13:16:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 Processor -- start 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 -- start start 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff648114f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ae60 0x7ff648112040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6481157f0 0x7ff648112580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648112be0 con 0x7ff64810ae60 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648112d50 con 0x7ff648107d30 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff65014c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648112f10 con 0x7ff6481157f0 2023-10-08T13:16:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.705+0000 7ff64dee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff648114f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff648114f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32776/0 (socket says 172.21.15.5:32776) 2023-10-08T13:16:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 -- 172.21.15.5:0/1390139196 learned_addr learned my addr 172.21.15.5:0/1390139196 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6481157f0 0x7ff648112580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ae60 0x7ff648112040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 -- 172.21.15.5:0/1390139196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6481157f0 msgr2=0x7ff648112580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6481157f0 0x7ff648112580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 -- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ae60 msgr2=0x7ff648112040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ae60 0x7ff648112040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 -- 172.21.15.5:0/1390139196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640009d00 con 0x7ff648107d30 2023-10-08T13:16:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.706+0000 7ff64dee8700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff648114f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9a0 tx=0x7ff64400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.712+0000 7ff63effd700 1 -- 172.21.15.5:0/1390139196 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644009790 con 0x7ff648107d30 2023-10-08T13:16:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.712+0000 7ff63effd700 1 -- 172.21.15.5:0/1390139196 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff644010430 con 0x7ff648107d30 2023-10-08T13:16:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.712+0000 7ff63effd700 1 -- 172.21.15.5:0/1390139196 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644018680 con 0x7ff648107d30 2023-10-08T13:16:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.713+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6481b20a0 con 0x7ff648107d30 2023-10-08T13:16:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.713+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6481b25b0 con 0x7ff648107d30 2023-10-08T13:16:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 Processor -- start 2023-10-08T13:16:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 -- start start 2023-10-08T13:16:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca466c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca460b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 0x55c7ca461510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca3c9400 con 0x55c7ca466880 2023-10-08T13:16:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca3babc0 con 0x55c7ca4610b0 2023-10-08T13:16:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.720+0000 7ff65c335b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca3b84e0 con 0x55c7ca4671a0 2023-10-08T13:16:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.721+0000 7ff64e6e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca466c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.721+0000 7ff64e6e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca466c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37832/0 (socket says 172.21.15.5:37832) 2023-10-08T13:16:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.721+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3166566024 learned_addr learned my addr 172.21.15.5:0/3166566024 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.722+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3166566024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 msgr2=0x55c7ca460b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.722+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca460b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.722+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3166566024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 msgr2=0x55c7ca461510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.722+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 0x55c7ca461510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.722+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3166566024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7ca1ded80 con 0x55c7ca466880 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.723+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca466c60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff640015000 tx=0x7ff6400095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b42ac5d5fb1e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.728+0000 7ff63effd700 1 -- 172.21.15.5:0/1390139196 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff6440105a0 con 0x7ff648107d30 2023-10-08T13:16:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.729+0000 7ff63effd700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff6340a17b0 0x7ff6340a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.729+0000 7ff63effd700 1 -- 172.21.15.5:0/1390139196 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff644014070 con 0x7ff648107d30 2023-10-08T13:16:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.733+0000 7ff64dee8700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff6340a17b0 0x7ff6340a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.743+0000 7ff633fff700 1 -- 172.21.15.5:0/3166566024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000e040 con 0x55c7ca466880 2023-10-08T13:16:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.743+0000 7ff633fff700 1 -- 172.21.15.5:0/3166566024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6400074e0 con 0x55c7ca466880 2023-10-08T13:16:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.743+0000 7ff633fff700 1 -- 172.21.15.5:0/3166566024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64001c860 con 0x55c7ca466880 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.744+0000 7ff65c335b80 1 -- 172.21.15.5:0/3166566024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 msgr2=0x55c7ca466c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.744+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca466c60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff640015000 tx=0x7ff6400095a0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.745+0000 7ff65c335b80 1 -- 172.21.15.5:0/3166566024 shutdown_connections 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.745+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 0x55c7ca461510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.745+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca466c60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.745+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3166566024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca460b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.745+0000 7ff65c335b80 1 -- 172.21.15.5:0/3166566024 >> 172.21.15.5:0/3166566024 conn(0x55c7ca3d5200 msgr2=0x55c7ca45bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.766+0000 7ff64dee8700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff6340a17b0 0x7ff6340a3c70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55c7ca467600 tx=0x7ff644096040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.767+0000 7ff65c335b80 1 -- 172.21.15.5:0/3166566024 shutdown_connections 2023-10-08T13:16:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.773+0000 7ff65c335b80 1 -- 172.21.15.5:0/3166566024 wait complete. 2023-10-08T13:16:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.773+0000 7ff65c335b80 1 -- start start 2023-10-08T13:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 Processor -- start 2023-10-08T13:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 0x55c7ca46a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca46ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca46b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca3b3dd0 con 0x55c7ca466880 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca3506b0 con 0x55c7ca4610b0 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca350350 con 0x55c7ca4671a0 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.774+0000 7ff65c335b80 10 client.0 _ll_register_callbacks cb 0x55c7ca1ad7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca46ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca46ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37836/0 (socket says 172.21.15.5:37836) 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 -- 172.21.15.5:0/3065702218 learned_addr learned my addr 172.21.15.5:0/3065702218 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 -- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 msgr2=0x55c7ca46b080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca46b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 -- 172.21.15.5:0/3065702218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 msgr2=0x55c7ca46a600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 0x55c7ca46a600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.775+0000 7ff64d6e7700 1 -- 172.21.15.5:0/3065702218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6481187a0 con 0x55c7ca466880 2023-10-08T13:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.776+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca46ab40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff63800e480 tx=0x7ff63800e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729a1ec0fe4b6496 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.786+0000 7ff6317fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:16:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.786+0000 7ff6317fa700 1 -- 172.21.15.5:0/3065702218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63800ee90 con 0x55c7ca466880 2023-10-08T13:16:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.786+0000 7ff6317fa700 1 -- 172.21.15.5:0/3065702218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff638013680 con 0x55c7ca466880 2023-10-08T13:16:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.791+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7ca37be50 con 0x55c7ca466880 2023-10-08T13:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.797+0000 7ff6317fa700 1 -- 172.21.15.5:0/3065702218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff638013840 con 0x55c7ca466880 2023-10-08T13:16:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.800+0000 7ff65c335b80 10 client.16989 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.800+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55c7ca1c7c00 con 0x55c7ca466880 2023-10-08T13:16:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.800+0000 7ff6317fa700 1 -- 172.21.15.5:0/3065702218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c7ca37be50 con 0x55c7ca466880 2023-10-08T13:16:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff6317fa700 1 -- 172.21.15.5:0/3065702218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff638011070 con 0x55c7ca466880 2023-10-08T13:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff65c335b80 10 client.16989 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff65c335b80 10 client.16989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff65c335b80 20 client.16989 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca47adf0 0x55c7ca47d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff65c335b80 4 client.16989 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.801+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7ca3acdb0 con 0x55c7ca47adf0 2023-10-08T13:16:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.807+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca47adf0 0x55c7ca47d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.807+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca47adf0 0x55c7ca47d210 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9853c05e63a85e9c server_cookie=71536e8773af0628 in_seq=0 out_seq=0 2023-10-08T13:16:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.807+0000 7ff6317fa700 10 client.16989 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.813+0000 7ff6317fa700 1 -- 172.21.15.5:0/3065702218 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7ca3acdb0 con 0x55c7ca47adf0 2023-10-08T13:16:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.813+0000 7ff6317fa700 10 client.16989 handle_command_reply: tid=0 2023-10-08T13:16:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.817+0000 7ff65c335b80 1 client.16989 shutdown 2023-10-08T13:16:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.822+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 msgr2=0x55c7ca46ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.822+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca46ab40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff63800e480 tx=0x7ff63800e840 comp rx=0 tx=0).stop 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 shutdown_connections 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca46b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca47adf0 0x55c7ca47d210 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4610b0 0x55c7ca46a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3065702218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca466880 0x55c7ca46ab40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff6317fa700 0 client.16989 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 >> 172.21.15.5:0/3065702218 conn(0x55c7ca3d5200 msgr2=0x55c7ca45b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 shutdown_connections 2023-10-08T13:16:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.830+0000 7ff65c335b80 1 -- 172.21.15.5:0/3065702218 wait complete. 2023-10-08T13:16:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.831+0000 7ff65c335b80 20 client.16989 trim_cache size 0 max 16384 2023-10-08T13:16:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.857+0000 7ff65c335b80 1 Processor -- start 2023-10-08T13:16:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 -- start start 2023-10-08T13:16:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca460b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca466880 0x55c7ca476d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4671a0 0x55c7ca471b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca2348c0 con 0x55c7ca4610b0 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca37be50 con 0x55c7ca4671a0 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff65c335b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca466eb0 con 0x55c7ca466880 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff64e6e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca460b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff64e6e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca460b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37844/0 (socket says 172.21.15.5:37844) 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff64e6e9700 1 -- 172.21.15.5:0/1466407281 learned_addr learned my addr 172.21.15.5:0/1466407281 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca466880 0x55c7ca476d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.858+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4671a0 0x55c7ca471b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.859+0000 7ff64e6e9700 1 -- 172.21.15.5:0/1466407281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca466880 msgr2=0x55c7ca476d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.859+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca466880 0x55c7ca476d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.859+0000 7ff64e6e9700 1 -- 172.21.15.5:0/1466407281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 msgr2=0x55c7ca460b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.859+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca460b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.859+0000 7ff64e6e9700 1 -- 172.21.15.5:0/1466407281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7ca2051f0 con 0x55c7ca4671a0 2023-10-08T13:16:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.860+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4671a0 0x55c7ca471b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff640004fd0 tx=0x7ff640026040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee83ae9e549863e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.872+0000 7ff63cff9700 1 -- 172.21.15.5:0/1466407281 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640029040 con 0x55c7ca4671a0 2023-10-08T13:16:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.872+0000 7ff63cff9700 1 -- 172.21.15.5:0/1466407281 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff640003a00 con 0x55c7ca4671a0 2023-10-08T13:16:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.872+0000 7ff63cff9700 1 -- 172.21.15.5:0/1466407281 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64004dc40 con 0x55c7ca4671a0 2023-10-08T13:16:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.875+0000 7ff65c335b80 1 -- 172.21.15.5:0/1466407281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4671a0 msgr2=0x55c7ca471b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.875+0000 7ff65c335b80 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4671a0 0x55c7ca471b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff640004fd0 tx=0x7ff640026040 comp rx=0 tx=0).stop 2023-10-08T13:16:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.880+0000 7ff65c335b80 1 -- 172.21.15.5:0/1466407281 shutdown_connections 2023-10-08T13:16:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.880+0000 7ff65c335b80 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca4671a0 0x55c7ca471b90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.880+0000 7ff65c335b80 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca460b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.880+0000 7ff65c335b80 1 --2- 172.21.15.5:0/1466407281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca466880 0x55c7ca476d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.880+0000 7ff65c335b80 1 -- 172.21.15.5:0/1466407281 >> 172.21.15.5:0/1466407281 conn(0x55c7ca3d5200 msgr2=0x55c7ca46aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.884+0000 7ff65c335b80 1 -- 172.21.15.5:0/1466407281 shutdown_connections 2023-10-08T13:16:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.887+0000 7ff65c335b80 1 -- 172.21.15.5:0/1466407281 wait complete. 2023-10-08T13:16:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.887+0000 7ff65c335b80 1 -- start start 2023-10-08T13:16:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.887+0000 7ff65c335b80 1 Processor -- start 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.887+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca4c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.887+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca466880 0x55c7ca4c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff65c335b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca4cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff65c335b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca4c3890 con 0x55c7ca4610b0 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff65c335b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca4c3a00 con 0x55c7ca466880 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff65c335b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ca4ce180 con 0x55c7ca4671a0 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff65c335b80 10 client.0 _ll_register_callbacks cb 0x7ff638009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca4cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca4cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51056/0 (socket says 172.21.15.5:51056) 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3163446156 learned_addr learned my addr 172.21.15.5:0/3163446156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca4c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3163446156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca466880 msgr2=0x55c7ca4c30b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca466880 0x55c7ca4c30b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3163446156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 msgr2=0x55c7ca4c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca4c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.888+0000 7ff64e6e9700 1 -- 172.21.15.5:0/3163446156 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7ca1ded80 con 0x55c7ca4671a0 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.889+0000 7ff64e6e9700 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca4cdbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55c7ca471d90 tx=0x7ff64004d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86a1bde1af2791e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:16:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.889+0000 7ff6317fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:16:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.889+0000 7ff6317fa700 1 -- 172.21.15.5:0/3163446156 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640007850 con 0x55c7ca4671a0 2023-10-08T13:16:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.890+0000 7ff6317fa700 1 -- 172.21.15.5:0/3163446156 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff6400079b0 con 0x55c7ca4671a0 2023-10-08T13:16:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.894+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6400074e0 con 0x55c7ca4671a0 2023-10-08T13:16:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.898+0000 7ff6317fa700 1 -- 172.21.15.5:0/3163446156 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff64004d8c0 con 0x55c7ca4671a0 2023-10-08T13:16:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.898+0000 7ff65c335b80 10 client.26464 fetch_fsmap learned FSMap version 51 2023-10-08T13:16:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.898+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55c7ca1dd250 con 0x55c7ca4671a0 2023-10-08T13:16:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.898+0000 7ff6317fa700 1 -- 172.21.15.5:0/3163446156 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6400074e0 con 0x55c7ca4671a0 2023-10-08T13:16:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.898+0000 7ff6317fa700 1 -- 172.21.15.5:0/3163446156 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff640019030 con 0x55c7ca4671a0 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.899+0000 7ff65c335b80 10 client.26464 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.899+0000 7ff65c335b80 10 client.26464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.899+0000 7ff65c335b80 20 client.26464 populate_metadata read hostname 'smithi005' 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.899+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca4cf480 0x55c7ca4d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.899+0000 7ff65c335b80 4 client.26464 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.899+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c7ca3acad0 con 0x55c7ca4cf480 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.900+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca4cf480 0x55c7ca4d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:16:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.900+0000 7ff6317fa700 10 client.26464 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.900+0000 7ff64d6e7700 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca4cf480 0x55c7ca4d1870 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a7f7e336676a21 server_cookie=f8449c2adfc2f63a in_seq=0 out_seq=0 2023-10-08T13:16:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.912+0000 7ff6317fa700 1 -- 172.21.15.5:0/3163446156 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c7ca3acad0 con 0x55c7ca4cf480 2023-10-08T13:16:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.912+0000 7ff6317fa700 10 client.26464 handle_command_reply: tid=0 2023-10-08T13:16:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.912+0000 7ff65c335b80 1 client.26464 shutdown 2023-10-08T13:16:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 msgr2=0x55c7ca4cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca4cdbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55c7ca471d90 tx=0x7ff64004d820 comp rx=0 tx=0).stop 2023-10-08T13:16:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 shutdown_connections 2023-10-08T13:16:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c7ca4671a0 0x55c7ca4cdbf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c7ca4610b0 0x55c7ca4c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55c7ca4cf480 0x55c7ca4d1870 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 --2- 172.21.15.5:0/3163446156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c7ca466880 0x55c7ca4c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 >> 172.21.15.5:0/3163446156 conn(0x55c7ca3d5200 msgr2=0x55c7ca46aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff6317fa700 0 client.26464 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:16:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 shutdown_connections 2023-10-08T13:16:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 1 -- 172.21.15.5:0/3163446156 wait complete. 2023-10-08T13:16:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.916+0000 7ff65c335b80 20 client.26464 trim_cache size 0 max 16384 2023-10-08T13:16:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:16:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:16:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:16:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:16:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff6340a17b0 msgr2=0x7ff6340a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff6340a17b0 0x7ff6340a3c70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55c7ca467600 tx=0x7ff644096040 comp rx=0 tx=0).stop 2023-10-08T13:16:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 msgr2=0x7ff648114f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:16:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff648114f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9a0 tx=0x7ff64400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 shutdown_connections 2023-10-08T13:16:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff6340a17b0 0x7ff6340a3c70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6481157f0 0x7ff648112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff648107d30 0x7ff648114f70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 --2- 172.21.15.5:0/1390139196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ae60 0x7ff648112040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:16:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 >> 172.21.15.5:0/1390139196 conn(0x7ff64806b7c0 msgr2=0x7ff648071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:16:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 shutdown_connections 2023-10-08T13:16:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:16:52.917+0000 7ff65014c700 1 -- 172.21.15.5:0/1390139196 wait complete. 2023-10-08T13:16:53.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:52 smithi060 ceph-mon[103190]: pgmap v634: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 503 op/s 2023-10-08T13:16:53.181 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:52 smithi005 ceph-mon[99496]: pgmap v634: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 503 op/s 2023-10-08T13:16:53.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:52 smithi118 ceph-mon[104234]: pgmap v634: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.8 MiB/s wr, 503 op/s 2023-10-08T13:16:55.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:54 smithi060 ceph-mon[103190]: pgmap v635: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 463 op/s 2023-10-08T13:16:55.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:54 smithi005 ceph-mon[99496]: pgmap v635: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 463 op/s 2023-10-08T13:16:55.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:54 smithi118 ceph-mon[104234]: pgmap v635: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.3 MiB/s wr, 463 op/s 2023-10-08T13:16:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 635.0 s, 498.9 tps, lat 194.009 ms stddev 228.106 2023-10-08T13:16:57.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:56 smithi060 ceph-mon[103190]: pgmap v636: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2023-10-08T13:16:57.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:56 smithi005 ceph-mon[99496]: pgmap v636: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2023-10-08T13:16:57.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:56 smithi118 ceph-mon[104234]: pgmap v636: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2023-10-08T13:16:59.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:16:58 smithi060 ceph-mon[103190]: pgmap v637: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 503 op/s 2023-10-08T13:16:59.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:16:58 smithi005 ceph-mon[99496]: pgmap v637: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 503 op/s 2023-10-08T13:16:59.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:16:58 smithi118 ceph-mon[104234]: pgmap v637: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 503 op/s 2023-10-08T13:17:01.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:00 smithi060 ceph-mon[103190]: pgmap v638: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.9 MiB/s wr, 517 op/s 2023-10-08T13:17:01.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:00 smithi005 ceph-mon[99496]: pgmap v638: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.9 MiB/s wr, 517 op/s 2023-10-08T13:17:01.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:00 smithi118 ceph-mon[104234]: pgmap v638: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.9 MiB/s wr, 517 op/s 2023-10-08T13:17:01.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 640.0 s, 445.7 tps, lat 225.728 ms stddev 253.655 2023-10-08T13:17:03.163 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:02 smithi060 ceph-mon[103190]: pgmap v639: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.5 MiB/s wr, 474 op/s 2023-10-08T13:17:03.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:02 smithi005 ceph-mon[99496]: pgmap v639: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.5 MiB/s wr, 474 op/s 2023-10-08T13:17:03.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:02 smithi118 ceph-mon[104234]: pgmap v639: 129 pgs: 129 active+clean; 3.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.5 MiB/s wr, 474 op/s 2023-10-08T13:17:05.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:04 smithi060 ceph-mon[103190]: pgmap v640: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.5 MiB/s wr, 473 op/s 2023-10-08T13:17:05.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:04 smithi005 ceph-mon[99496]: pgmap v640: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.5 MiB/s wr, 473 op/s 2023-10-08T13:17:05.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:04 smithi118 ceph-mon[104234]: pgmap v640: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.5 MiB/s wr, 473 op/s 2023-10-08T13:17:06.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:05 smithi060 ceph-mon[103190]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T13:17:06.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:05 smithi005 ceph-mon[99496]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T13:17:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.193+0000 7f88c4d36700 1 -- 172.21.15.5:0/753018127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 msgr2=0x7f88c010c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.193+0000 7f88c4d36700 1 --2- 172.21.15.5:0/753018127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c010c3f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88b401a9a0 tx=0x7f88b401acb0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.194+0000 7f88c4d36700 1 -- 172.21.15.5:0/753018127 shutdown_connections 2023-10-08T13:17:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.194+0000 7f88c4d36700 1 --2- 172.21.15.5:0/753018127 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c010c3f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.194+0000 7f88c4d36700 1 --2- 172.21.15.5:0/753018127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c0105630 0x7f88c0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.194+0000 7f88c4d36700 1 --2- 172.21.15.5:0/753018127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c00ff570 0x7f88c00ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.194+0000 7f88c4d36700 1 -- 172.21.15.5:0/753018127 >> 172.21.15.5:0/753018127 conn(0x7f88c00fb080 msgr2=0x7f88c00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.196+0000 7f88c4d36700 1 -- 172.21.15.5:0/753018127 shutdown_connections 2023-10-08T13:17:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.196+0000 7f88c4d36700 1 -- 172.21.15.5:0/753018127 wait complete. 2023-10-08T13:17:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 Processor -- start 2023-10-08T13:17:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 -- start start 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c0072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c0105630 0x7f88c006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c006c620 0x7f88c006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00728b0 con 0x7f88c0105630 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01a9ae0 con 0x7f88c006c620 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88c4d36700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01a9ca0 con 0x7f88c00fff30 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88be59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c0072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88be59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c0072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51062/0 (socket says 172.21.15.5:51062) 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88be59c700 1 -- 172.21.15.5:0/2060134341 learned_addr learned my addr 172.21.15.5:0/2060134341 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c0105630 0x7f88c006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.197+0000 7f88bed9d700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c006c620 0x7f88c006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88be59c700 1 -- 172.21.15.5:0/2060134341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c006c620 msgr2=0x7f88c006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88be59c700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c006c620 0x7f88c006cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88be59c700 1 -- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c0105630 msgr2=0x7f88c006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88be59c700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c0105630 0x7f88c006c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88be59c700 1 -- 172.21.15.5:0/2060134341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b401a600 con 0x7f88c00fff30 2023-10-08T13:17:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88be59c700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c0072040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88b800ba50 tx=0x7f88b800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88af7fe700 1 -- 172.21.15.5:0/2060134341 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b800c930 con 0x7f88c00fff30 2023-10-08T13:17:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88af7fe700 1 -- 172.21.15.5:0/2060134341 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88b8014440 con 0x7f88c00fff30 2023-10-08T13:17:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88af7fe700 1 -- 172.21.15.5:0/2060134341 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80075b0 con 0x7f88c00fff30 2023-10-08T13:17:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c01a9f80 con 0x7f88c00fff30 2023-10-08T13:17:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.198+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c01aa350 con 0x7f88c00fff30 2023-10-08T13:17:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.202+0000 7f88af7fe700 1 -- 172.21.15.5:0/2060134341 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f88b80145b0 con 0x7f88c00fff30 2023-10-08T13:17:06.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.202+0000 7f88af7fe700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f88a80a1630 0x7f88a80a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.203+0000 7f88af7fe700 1 -- 172.21.15.5:0/2060134341 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f88b80ccab0 con 0x7f88c00fff30 2023-10-08T13:17:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.203+0000 7f88d0f1fb80 1 Processor -- start 2023-10-08T13:17:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.203+0000 7f88d0f1fb80 1 -- start start 2023-10-08T13:17:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.203+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f88a80a1630 0x7f88a80a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.203+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa320ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa32100510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa32068400 con 0x55fa321000b0 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa32059bc0 con 0x55fa32105880 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa320574e0 con 0x55fa321061a0 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32818/0 (socket says 172.21.15.5:32818) 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 -- 172.21.15.5:0/4059399020 learned_addr learned my addr 172.21.15.5:0/4059399020 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa320ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 -- 172.21.15.5:0/4059399020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 msgr2=0x55fa320ffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa320ffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 -- 172.21.15.5:0/4059399020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 msgr2=0x55fa32100510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa32100510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 -- 172.21.15.5:0/4059399020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa31e7dd80 con 0x55fa32105880 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f88a80a1630 0x7f88a80a3af0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f88c006d810 tx=0x7f88b0009f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.204+0000 7f88be59c700 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32105c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f88b8099740 tx=0x7f88b8099420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106e80484b9680f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.213+0000 7f88acff9700 1 -- 172.21.15.5:0/4059399020 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80a1b40 con 0x55fa32105880 2023-10-08T13:17:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.213+0000 7f88acff9700 1 -- 172.21.15.5:0/4059399020 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88b80b9070 con 0x55fa32105880 2023-10-08T13:17:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.213+0000 7f88acff9700 1 -- 172.21.15.5:0/4059399020 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8099c70 con 0x55fa32105880 2023-10-08T13:17:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/4059399020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 msgr2=0x55fa32105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32105c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f88b8099740 tx=0x7f88b8099420 comp rx=0 tx=0).stop 2023-10-08T13:17:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/4059399020 shutdown_connections 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa32100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32105c60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/4059399020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa320ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/4059399020 >> 172.21.15.5:0/4059399020 conn(0x55fa32074200 msgr2=0x55fa320fab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/4059399020 shutdown_connections 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.214+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/4059399020 wait complete. 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 -- start start 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 Processor -- start 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa321095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32109af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa3210a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa32052dd0 con 0x55fa321000b0 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa31fef6b0 con 0x55fa32105880 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa31fef350 con 0x55fa321061a0 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88d0f1fb80 10 client.0 _ll_register_callbacks cb 0x55fa31e4c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88be59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa321095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88be59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa321095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37870/0 (socket says 172.21.15.5:37870) 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88be59c700 1 -- 172.21.15.5:0/2487830105 learned_addr learned my addr 172.21.15.5:0/2487830105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88bed9d700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa3210a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.215+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88be59c700 1 -- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 msgr2=0x55fa3210a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88be59c700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa3210a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88be59c700 1 -- 172.21.15.5:0/2487830105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 msgr2=0x55fa32109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88be59c700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32109af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88be59c700 1 -- 172.21.15.5:0/2487830105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c01aa350 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88be59c700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa321095b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f88b80a1610 tx=0x7f88b80996b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e170587da97f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88a5ffb700 1 -- 172.21.15.5:0/2487830105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80a1b40 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88a5ffb700 1 -- 172.21.15.5:0/2487830105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f88b80b2020 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa3201ae50 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88a5ffb700 1 -- 172.21.15.5:0/2487830105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b8098eb0 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88d0f1fb80 10 client.17001 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.216+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55fa31e66c00 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88a5ffb700 1 -- 172.21.15.5:0/2487830105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fa3201ae50 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88a5ffb700 1 -- 172.21.15.5:0/2487830105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f88b80955a0 con 0x55fa321000b0 2023-10-08T13:17:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88d0f1fb80 10 client.17001 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88d0f1fb80 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88d0f1fb80 20 client.17001 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3210f030 0x55fa321114d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88d0f1fb80 4 client.17001 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa3204bdb0 con 0x55fa3210f030 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.217+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3210f030 0x55fa321114d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.218+0000 7f88a5ffb700 10 client.17001 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.218+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3210f030 0x55fa321114d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72909cad1e33348 server_cookie=6a0b5d4a7807cc0e in_seq=0 out_seq=0 2023-10-08T13:17:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88a5ffb700 1 -- 172.21.15.5:0/2487830105 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa3204bdb0 con 0x55fa3210f030 2023-10-08T13:17:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88a5ffb700 10 client.17001 handle_command_reply: tid=0 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 client.17001 shutdown 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 msgr2=0x55fa321095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa321095b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f88b80a1610 tx=0x7f88b80996b0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 shutdown_connections 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321061a0 0x55fa3210a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321000b0 0x55fa321095b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3210f030 0x55fa321114d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/2487830105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa32105880 0x55fa32109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 >> 172.21.15.5:0/2487830105 conn(0x55fa32074200 msgr2=0x55fa320fa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88a5ffb700 0 client.17001 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 shutdown_connections 2023-10-08T13:17:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/2487830105 wait complete. 2023-10-08T13:17:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.219+0000 7f88d0f1fb80 20 client.17001 trim_cache size 0 max 16384 2023-10-08T13:17:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.248+0000 7f88d0f1fb80 1 Processor -- start 2023-10-08T13:17:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 -- start start 2023-10-08T13:17:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321000b0 0x55fa32108830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 0x55fa32104f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321061a0 0x55fa32109e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa31ed38c0 con 0x55fa32105880 2023-10-08T13:17:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa320fc6b0 con 0x55fa321061a0 2023-10-08T13:17:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa320f52b0 con 0x55fa321000b0 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88bdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 0x55fa32104f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88bdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 0x55fa32104f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37878/0 (socket says 172.21.15.5:37878) 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88bdd9b700 1 -- 172.21.15.5:0/3743858148 learned_addr learned my addr 172.21.15.5:0/3743858148 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88be59c700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321000b0 0x55fa32108830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.249+0000 7f88bed9d700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321061a0 0x55fa32109e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bdd9b700 1 -- 172.21.15.5:0/3743858148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321000b0 msgr2=0x55fa32108830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321000b0 0x55fa32108830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bdd9b700 1 -- 172.21.15.5:0/3743858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321061a0 msgr2=0x55fa32109e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321061a0 0x55fa32109e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bdd9b700 1 -- 172.21.15.5:0/3743858148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa31ea41f0 con 0x55fa32105880 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88be59c700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321000b0 0x55fa32108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bed9d700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321061a0 0x55fa32109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 0x55fa32104f10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f88c01006c0 tx=0x7f88b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00d40696bce00e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88ad7fa700 1 -- 172.21.15.5:0/3743858148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0028de0 con 0x55fa32105880 2023-10-08T13:17:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88ad7fa700 1 -- 172.21.15.5:0/3743858148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88b002c070 con 0x55fa32105880 2023-10-08T13:17:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.250+0000 7f88ad7fa700 1 -- 172.21.15.5:0/3743858148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0026e10 con 0x55fa32105880 2023-10-08T13:17:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.251+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/3743858148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 msgr2=0x55fa32104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.251+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 0x55fa32104f10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f88c01006c0 tx=0x7f88b0019000 comp rx=0 tx=0).stop 2023-10-08T13:17:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.266+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/3743858148 shutdown_connections 2023-10-08T13:17:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.266+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321061a0 0x55fa32109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.266+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa321000b0 0x55fa32108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.266+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/3743858148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa32105880 0x55fa32104f10 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.266+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/3743858148 >> 172.21.15.5:0/3743858148 conn(0x55fa32074200 msgr2=0x55fa32106630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:06.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:05 smithi118 ceph-mon[104234]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T13:17:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.272+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/3743858148 shutdown_connections 2023-10-08T13:17:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.273+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/3743858148 wait complete. 2023-10-08T13:17:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.273+0000 7f88d0f1fb80 1 -- start start 2023-10-08T13:17:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.273+0000 7f88d0f1fb80 1 Processor -- start 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321000b0 0x55fa3211e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 0x55fa3211cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321061a0 0x55fa3211d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3211f290 con 0x55fa321061a0 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3211d760 con 0x55fa321000b0 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa3211d8d0 con 0x55fa32105880 2023-10-08T13:17:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88d0f1fb80 10 client.0 _ll_register_callbacks cb 0x7f88b8099110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 0x55fa3211cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321061a0 0x55fa3211d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 0x55fa3211cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51088/0 (socket says 172.21.15.5:51088) 2023-10-08T13:17:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 -- 172.21.15.5:0/225005879 learned_addr learned my addr 172.21.15.5:0/225005879 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 -- 172.21.15.5:0/225005879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321000b0 msgr2=0x55fa3211e980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:17:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321000b0 0x55fa3211e980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 -- 172.21.15.5:0/225005879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321061a0 msgr2=0x55fa3211d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321061a0 0x55fa3211d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.274+0000 7f88bdd9b700 1 -- 172.21.15.5:0/225005879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa31e66c00 con 0x55fa32105880 2023-10-08T13:17:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.275+0000 7f88bdd9b700 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 0x55fa3211cce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88c01006c0 tx=0x7f88b0026950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e170ecc5f3f49e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.275+0000 7f88a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:17:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.275+0000 7f88a5ffb700 1 -- 172.21.15.5:0/225005879 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0012d80 con 0x55fa32105880 2023-10-08T13:17:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.275+0000 7f88a5ffb700 1 -- 172.21.15.5:0/225005879 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f88b0028de0 con 0x55fa32105880 2023-10-08T13:17:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.275+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88b80b9070 con 0x55fa32105880 2023-10-08T13:17:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.275+0000 7f88a5ffb700 1 -- 172.21.15.5:0/225005879 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b0026a90 con 0x55fa32105880 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.276+0000 7f88d0f1fb80 10 client.26479 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.277+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f88c010ccf0 con 0x55fa32105880 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.277+0000 7f88a5ffb700 1 -- 172.21.15.5:0/225005879 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88b80b9070 con 0x55fa32105880 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88a5ffb700 1 -- 172.21.15.5:0/225005879 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f88b0041070 con 0x55fa32105880 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88d0f1fb80 10 client.26479 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88d0f1fb80 10 client.26479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88d0f1fb80 20 client.26479 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3216e890 0x55fa32170cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88d0f1fb80 4 client.26479 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fa3204bad0 con 0x55fa3216e890 2023-10-08T13:17:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.278+0000 7f88be59c700 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3216e890 0x55fa32170cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.279+0000 7f88a5ffb700 10 client.26479 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.279+0000 7f88be59c700 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3216e890 0x55fa32170cb0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a6a128e4a4f8fa server_cookie=287d83b06eac0f5a in_seq=0 out_seq=0 2023-10-08T13:17:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.295+0000 7f88a5ffb700 1 -- 172.21.15.5:0/225005879 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fa3204bad0 con 0x55fa3216e890 2023-10-08T13:17:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.295+0000 7f88a5ffb700 10 client.26479 handle_command_reply: tid=0 2023-10-08T13:17:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.295+0000 7f88d0f1fb80 1 client.26479 shutdown 2023-10-08T13:17:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 msgr2=0x55fa3211cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 0x55fa3211cce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88c01006c0 tx=0x7f88b0026950 comp rx=0 tx=0).stop 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 shutdown_connections 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa321061a0 0x55fa3211d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fa3216e890 0x55fa32170cb0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa321000b0 0x55fa3211e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 --2- 172.21.15.5:0/225005879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fa32105880 0x55fa3211cce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 >> 172.21.15.5:0/225005879 conn(0x55fa32074200 msgr2=0x55fa32106580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88a5ffb700 0 client.26479 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 shutdown_connections 2023-10-08T13:17:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.296+0000 7f88d0f1fb80 1 -- 172.21.15.5:0/225005879 wait complete. 2023-10-08T13:17:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:17:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:17:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:17:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:17:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.299+0000 7f88d0f1fb80 20 client.26479 trim_cache size 0 max 16384 2023-10-08T13:17:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.301+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f88a80a1630 msgr2=0x7f88a80a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f88a80a1630 0x7f88a80a3af0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f88c006d810 tx=0x7f88b0009f60 comp rx=0 tx=0).stop 2023-10-08T13:17:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 msgr2=0x7f88c0072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c0072040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88b800ba50 tx=0x7f88b800bd60 comp rx=0 tx=0).stop 2023-10-08T13:17:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 shutdown_connections 2023-10-08T13:17:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f88a80a1630 0x7f88a80a3af0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c006c620 0x7f88c006cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88c00fff30 0x7f88c0072040 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 --2- 172.21.15.5:0/2060134341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c0105630 0x7f88c006c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.302+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 >> 172.21.15.5:0/2060134341 conn(0x7f88c00fb080 msgr2=0x7f88c00fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.307+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 shutdown_connections 2023-10-08T13:17:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:06.307+0000 7f88c4d36700 1 -- 172.21.15.5:0/2060134341 wait complete. 2023-10-08T13:17:06.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 645.0 s, 414.0 tps, lat 239.163 ms stddev 311.624 2023-10-08T13:17:07.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:06 smithi060 ceph-mon[103190]: pgmap v642: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2023-10-08T13:17:07.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:06 smithi005 ceph-mon[99496]: pgmap v642: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2023-10-08T13:17:07.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:06 smithi118 ceph-mon[104234]: pgmap v642: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.3 MiB/s wr, 477 op/s 2023-10-08T13:17:09.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:08 smithi060 ceph-mon[103190]: pgmap v643: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.6 MiB/s wr, 469 op/s 2023-10-08T13:17:09.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:08 smithi005 ceph-mon[99496]: pgmap v643: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.6 MiB/s wr, 469 op/s 2023-10-08T13:17:09.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:08 smithi118 ceph-mon[104234]: pgmap v643: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.6 MiB/s wr, 469 op/s 2023-10-08T13:17:11.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:10 smithi060 ceph-mon[103190]: pgmap v644: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.1 MiB/s wr, 441 op/s 2023-10-08T13:17:11.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:10 smithi005 ceph-mon[99496]: pgmap v644: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.1 MiB/s wr, 441 op/s 2023-10-08T13:17:11.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:10 smithi118 ceph-mon[104234]: pgmap v644: 129 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 117 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.1 MiB/s wr, 441 op/s 2023-10-08T13:17:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 650.0 s, 480.4 tps, lat 211.253 ms stddev 245.217 2023-10-08T13:17:13.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:12 smithi118 ceph-mon[104234]: pgmap v645: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.0 MiB/s wr, 428 op/s 2023-10-08T13:17:13.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:12 smithi060 ceph-mon[103190]: pgmap v645: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.0 MiB/s wr, 428 op/s 2023-10-08T13:17:13.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:12 smithi005 ceph-mon[99496]: pgmap v645: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.0 MiB/s wr, 428 op/s 2023-10-08T13:17:15.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:15 smithi118 ceph-mon[104234]: pgmap v646: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.1 MiB/s wr, 431 op/s 2023-10-08T13:17:15.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:15 smithi060 ceph-mon[103190]: pgmap v646: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.1 MiB/s wr, 431 op/s 2023-10-08T13:17:15.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:15 smithi005 ceph-mon[99496]: pgmap v646: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.1 MiB/s wr, 431 op/s 2023-10-08T13:17:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 655.0 s, 601.0 tps, lat 166.477 ms stddev 176.555 2023-10-08T13:17:17.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:16 smithi060 ceph-mon[103190]: pgmap v647: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 485 op/s 2023-10-08T13:17:17.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:16 smithi060 ceph-mon[103190]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T13:17:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:16 smithi005 ceph-mon[99496]: pgmap v647: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 485 op/s 2023-10-08T13:17:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:16 smithi005 ceph-mon[99496]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T13:17:17.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:16 smithi118 ceph-mon[104234]: pgmap v647: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.9 MiB/s wr, 485 op/s 2023-10-08T13:17:17.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:16 smithi118 ceph-mon[104234]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T13:17:19.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:18 smithi060 ceph-mon[103190]: pgmap v649: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.6 MiB/s wr, 472 op/s 2023-10-08T13:17:19.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:18 smithi005 ceph-mon[99496]: pgmap v649: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.6 MiB/s wr, 472 op/s 2023-10-08T13:17:19.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:18 smithi118 ceph-mon[104234]: pgmap v649: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.6 MiB/s wr, 472 op/s 2023-10-08T13:17:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 -- 172.21.15.5:0/703781346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0ff570 msgr2=0x7faeec0ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 --2- 172.21.15.5:0/703781346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0ff570 0x7faeec0ff9f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7faee00099c0 tx=0x7faee0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 -- 172.21.15.5:0/703781346 shutdown_connections 2023-10-08T13:17:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 --2- 172.21.15.5:0/703781346 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec0fff30 0x7faeec10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 --2- 172.21.15.5:0/703781346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec105630 0x7faeec105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 --2- 172.21.15.5:0/703781346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0ff570 0x7faeec0ff9f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 -- 172.21.15.5:0/703781346 >> 172.21.15.5:0/703781346 conn(0x7faeec0fb080 msgr2=0x7faeec0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 -- 172.21.15.5:0/703781346 shutdown_connections 2023-10-08T13:17:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.457+0000 7faef18dc700 1 -- 172.21.15.5:0/703781346 wait complete. 2023-10-08T13:17:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 Processor -- start 2023-10-08T13:17:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 -- start start 2023-10-08T13:17:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec0ff570 0x7faeec19d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 0x7faeec19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec105630 0x7faeec1a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1a1fb0 con 0x7faeec0fff30 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1a2120 con 0x7faeec0ff570 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faef18dc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1a22e0 con 0x7faeec105630 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faeea7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 0x7faeec19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faeeaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec0ff570 0x7faeec19d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faeea7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 0x7faeec19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37898/0 (socket says 172.21.15.5:37898) 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.458+0000 7faeea7fc700 1 -- 172.21.15.5:0/1930021423 learned_addr learned my addr 172.21.15.5:0/1930021423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec105630 0x7faeec1a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeea7fc700 1 -- 172.21.15.5:0/1930021423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec105630 msgr2=0x7faeec1a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec105630 0x7faeec1a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeea7fc700 1 -- 172.21.15.5:0/1930021423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec0ff570 msgr2=0x7faeec19d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec0ff570 0x7faeec19d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeea7fc700 1 -- 172.21.15.5:0/1930021423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00095f0 con 0x7faeec0fff30 2023-10-08T13:17:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec0ff570 0x7faeec19d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 0x7faeec19d5d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faee0009fd0 tx=0x7faee00186e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faef08da700 1 -- 172.21.15.5:0/1930021423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0018b20 con 0x7faeec0fff30 2023-10-08T13:17:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec1a2560 con 0x7faeec0fff30 2023-10-08T13:17:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faef08da700 1 -- 172.21.15.5:0/1930021423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faee0018c80 con 0x7faeec0fff30 2023-10-08T13:17:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faef08da700 1 -- 172.21.15.5:0/1930021423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0022830 con 0x7faeec0fff30 2023-10-08T13:17:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.459+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec1a9e00 con 0x7faeec0fff30 2023-10-08T13:17:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.462+0000 7faef08da700 1 -- 172.21.15.5:0/1930021423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faee002c440 con 0x7faeec0fff30 2023-10-08T13:17:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.464+0000 7faefdac5b80 1 Processor -- start 2023-10-08T13:17:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.464+0000 7faefdac5b80 1 -- start start 2023-10-08T13:17:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.465+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170edd6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.465+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd71a0 0x56170edd0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.465+0000 7faeeb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170edd6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.465+0000 7faeeb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170edd6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32852/0 (socket says 172.21.15.5:32852) 2023-10-08T13:17:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edd1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faefdac5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ed39400 con 0x56170edd71a0 2023-10-08T13:17:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faefdac5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ed2abc0 con 0x56170edd6880 2023-10-08T13:17:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faefdac5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ed284e0 con 0x56170edd10b0 2023-10-08T13:17:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 -- 172.21.15.5:0/3754086391 learned_addr learned my addr 172.21.15.5:0/3754086391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeea7fc700 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edd1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 -- 172.21.15.5:0/3754086391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 msgr2=0x56170edd1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edd1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 -- 172.21.15.5:0/3754086391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd71a0 msgr2=0x56170edd0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd71a0 0x56170edd0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 -- 172.21.15.5:0/3754086391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56170eb4ed80 con 0x56170edd6880 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faef08da700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faed40a15e0 0x7faed40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeea7fc700 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edd1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faed40a15e0 0x7faed40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170edd6c60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faee4009550 tx=0x7faee4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49529baa778c5c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.466+0000 7faef08da700 1 -- 172.21.15.5:0/1930021423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7faee00ceb30 con 0x7faeec0fff30 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faed1ffb700 1 -- 172.21.15.5:0/3754086391 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4003c00 con 0x56170edd6880 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faed1ffb700 1 -- 172.21.15.5:0/3754086391 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faee4003d60 con 0x56170edd6880 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faed1ffb700 1 -- 172.21.15.5:0/3754086391 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40043a0 con 0x56170edd6880 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 -- 172.21.15.5:0/3754086391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 msgr2=0x56170edd6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170edd6c60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faee4009550 tx=0x7faee4009920 comp rx=0 tx=0).stop 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 -- 172.21.15.5:0/3754086391 shutdown_connections 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edd1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170edd6c60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 --2- 172.21.15.5:0/3754086391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd71a0 0x56170edd0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.467+0000 7faefdac5b80 1 -- 172.21.15.5:0/3754086391 >> 172.21.15.5:0/3754086391 conn(0x56170ed45200 msgr2=0x56170edcbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 -- 172.21.15.5:0/3754086391 shutdown_connections 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 -- 172.21.15.5:0/3754086391 wait complete. 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faed40a15e0 0x7faed40a3aa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x56170edd7600 tx=0x7faedc004750 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 -- start start 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 Processor -- start 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edda5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd6880 0x56170eddaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd71a0 0x56170eddb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ed23dd0 con 0x56170edd6880 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ecc06b0 con 0x56170edd71a0 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.468+0000 7faefdac5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ecc0350 con 0x56170edd10b0 2023-10-08T13:17:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faefdac5b80 10 client.0 _ll_register_callbacks cb 0x56170eb1d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeea7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd6880 0x56170eddaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeaffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edda5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeea7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd6880 0x56170eddaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37912/0 (socket says 172.21.15.5:37912) 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeea7fc700 1 -- 172.21.15.5:0/1996857717 learned_addr learned my addr 172.21.15.5:0/1996857717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd71a0 0x56170eddb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 -- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 msgr2=0x56170edda5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edda5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 -- 172.21.15.5:0/1996857717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd6880 msgr2=0x56170eddaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd6880 0x56170eddaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 -- 172.21.15.5:0/1996857717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee4009200 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd71a0 0x56170eddb020 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d20 tx=0x7faee40128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8974b80775eb6135 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faecaffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faecaffd700 1 -- 172.21.15.5:0/1996857717 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4004cd0 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56170ecebe50 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faecaffd700 1 -- 172.21.15.5:0/1996857717 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7faee4004e30 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.469+0000 7faecaffd700 1 -- 172.21.15.5:0/1996857717 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee4012da0 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 10 client.26417 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56170eb37c00 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faecaffd700 1 -- 172.21.15.5:0/1996857717 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56170ecebe50 con 0x56170edd71a0 2023-10-08T13:17:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faecaffd700 1 -- 172.21.15.5:0/1996857717 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faee40052f0 con 0x56170edd71a0 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 10 client.26417 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 10 client.26417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 20 client.26417 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170edeaae0 0x56170edeced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 4 client.26417 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56170ed1cdb0 con 0x56170edeaae0 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.470+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170edeaae0 0x56170edeced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.471+0000 7faecaffd700 10 client.26417 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.471+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170edeaae0 0x56170edeced0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67d660fcb7d2d8a server_cookie=395aa058f440a2db in_seq=0 out_seq=0 2023-10-08T13:17:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.471+0000 7faecaffd700 1 -- 172.21.15.5:0/1996857717 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56170ed1cdb0 con 0x56170edeaae0 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.471+0000 7faecaffd700 10 client.26417 handle_command_reply: tid=0 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.471+0000 7faefdac5b80 1 client.26417 shutdown 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd71a0 msgr2=0x56170eddb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd71a0 0x56170eddb020 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d20 tx=0x7faee40128e0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 shutdown_connections 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170edeaae0 0x56170edeced0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd71a0 0x56170eddb020 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faecaffd700 0 client.26417 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd10b0 0x56170edda5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1996857717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd6880 0x56170eddaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 >> 172.21.15.5:0/1996857717 conn(0x56170ed45200 msgr2=0x56170edcb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 shutdown_connections 2023-10-08T13:17:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 1 -- 172.21.15.5:0/1996857717 wait complete. 2023-10-08T13:17:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.472+0000 7faefdac5b80 20 client.26417 trim_cache size 0 max 16384 2023-10-08T13:17:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 Processor -- start 2023-10-08T13:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 -- start start 2023-10-08T13:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170edd5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170edd9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170eba48c0 con 0x56170edd10b0 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170edc8830 con 0x56170edd6880 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faefdac5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170edcc610 con 0x56170edd71a0 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faeea7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faeeaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170edd5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faeea7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32868/0 (socket says 172.21.15.5:32868) 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.496+0000 7faeea7fc700 1 -- 172.21.15.5:0/2309340051 learned_addr learned my addr 172.21.15.5:0/2309340051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170edd9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeaffd700 1 -- 172.21.15.5:0/2309340051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 msgr2=0x56170edd9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeaffd700 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170edd9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeaffd700 1 -- 172.21.15.5:0/2309340051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 msgr2=0x56170eddae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeaffd700 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeaffd700 1 -- 172.21.15.5:0/2309340051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56170edf1b00 con 0x56170edd10b0 2023-10-08T13:17:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeea7fc700 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeb7fe700 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170edd9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:17:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.497+0000 7faeeaffd700 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170edd5f00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x56170eddb690 tx=0x7faedc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddb6891a7efb2f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.500+0000 7faed27fc700 1 -- 172.21.15.5:0/2309340051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc024070 con 0x56170edd10b0 2023-10-08T13:17:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.500+0000 7faed27fc700 1 -- 172.21.15.5:0/2309340051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faedc015070 con 0x56170edd10b0 2023-10-08T13:17:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.500+0000 7faed27fc700 1 -- 172.21.15.5:0/2309340051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc025c10 con 0x56170edd10b0 2023-10-08T13:17:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 -- 172.21.15.5:0/2309340051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 msgr2=0x56170edd5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170edd5f00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x56170eddb690 tx=0x7faedc013000 comp rx=0 tx=0).stop 2023-10-08T13:17:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 -- 172.21.15.5:0/2309340051 shutdown_connections 2023-10-08T13:17:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170edd9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170edd5f00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 --2- 172.21.15.5:0/2309340051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 -- 172.21.15.5:0/2309340051 >> 172.21.15.5:0/2309340051 conn(0x56170ed45200 msgr2=0x56170edd8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 -- 172.21.15.5:0/2309340051 shutdown_connections 2023-10-08T13:17:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 -- 172.21.15.5:0/2309340051 wait complete. 2023-10-08T13:17:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 -- start start 2023-10-08T13:17:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.501+0000 7faefdac5b80 1 Processor -- start 2023-10-08T13:17:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170ede1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170ede02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ede0830 con 0x56170edd10b0 2023-10-08T13:17:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ede09a0 con 0x56170edd6880 2023-10-08T13:17:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170ede0b60 con 0x56170edd71a0 2023-10-08T13:17:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faefdac5b80 10 client.0 _ll_register_callbacks cb 0x56170eb1d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeeaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170ede1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeeb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170ede02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeeaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170ede1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37926/0 (socket says 172.21.15.5:37926) 2023-10-08T13:17:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeeaffd700 1 -- 172.21.15.5:0/1908845834 learned_addr learned my addr 172.21.15.5:0/1908845834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeea7fc700 1 -- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 msgr2=0x56170ede02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170ede02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeea7fc700 1 -- 172.21.15.5:0/1908845834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 msgr2=0x56170ede1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170ede1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeea7fc700 1 -- 172.21.15.5:0/1908845834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec1a9e00 con 0x56170edd6880 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.502+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170ede1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faeea7fc700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddfdb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faee00047c0 tx=0x7faee0010b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc68c3f332915f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faecaffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faecaffd700 1 -- 172.21.15.5:0/1908845834 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0084ea0 con 0x56170edd6880 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faee4003d60 con 0x56170edd6880 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faecaffd700 1 -- 172.21.15.5:0/1908845834 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7faee0018df0 con 0x56170edd6880 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faecaffd700 1 -- 172.21.15.5:0/1908845834 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee00cc320 con 0x56170edd6880 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 10 client.26423 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7faedc0041f0 con 0x56170edd6880 2023-10-08T13:17:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faecaffd700 1 -- 172.21.15.5:0/1908845834 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faee4003d60 con 0x56170edd6880 2023-10-08T13:17:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faecaffd700 1 -- 172.21.15.5:0/1908845834 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faee009adb0 con 0x56170edd6880 2023-10-08T13:17:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 10 client.26423 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 10 client.26423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 20 client.26423 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170ee39aa0 0x56170ee39eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 4 client.26423 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:17:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.503+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56170ed1cad0 con 0x56170ee39aa0 2023-10-08T13:17:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.504+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170ee39aa0 0x56170ee39eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.504+0000 7faecaffd700 10 client.26423 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.504+0000 7faeeaffd700 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170ee39aa0 0x56170ee39eb0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff742fb3cc02be33 server_cookie=206e2fce4250e01c in_seq=0 out_seq=0 2023-10-08T13:17:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faecaffd700 1 -- 172.21.15.5:0/1908845834 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56170ed1cad0 con 0x56170ee39aa0 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faecaffd700 10 client.26423 handle_command_reply: tid=0 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 client.26423 shutdown 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 msgr2=0x56170eddfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddfdb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faee00047c0 tx=0x7faee0010b70 comp rx=0 tx=0).stop 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 shutdown_connections 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56170edd71a0 0x56170ede02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56170edd10b0 0x56170ede1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56170ee39aa0 0x56170ee39eb0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 --2- 172.21.15.5:0/1908845834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56170edd6880 0x56170eddfdb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faecaffd700 0 client.26423 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 >> 172.21.15.5:0/1908845834 conn(0x56170ed45200 msgr2=0x56170edd7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 shutdown_connections 2023-10-08T13:17:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 1 -- 172.21.15.5:0/1908845834 wait complete. 2023-10-08T13:17:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.517+0000 7faefdac5b80 20 client.26423 trim_cache size 0 max 16384 2023-10-08T13:17:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:17:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:17:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:17:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:17:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faed40a15e0 msgr2=0x7faed40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faed40a15e0 0x7faed40a3aa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x56170edd7600 tx=0x7faedc004750 comp rx=0 tx=0).stop 2023-10-08T13:17:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 msgr2=0x7faeec19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 0x7faeec19d5d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7faee0009fd0 tx=0x7faee00186e0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 shutdown_connections 2023-10-08T13:17:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faed40a15e0 0x7faed40a3aa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faeec105630 0x7faeec1a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faeec0ff570 0x7faeec19d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 --2- 172.21.15.5:0/1930021423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeec0fff30 0x7faeec19d5d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 >> 172.21.15.5:0/1930021423 conn(0x7faeec0fb080 msgr2=0x7faeec0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 shutdown_connections 2023-10-08T13:17:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:19.518+0000 7faef18dc700 1 -- 172.21.15.5:0/1930021423 wait complete. 2023-10-08T13:17:19.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.280+0000 7f25db2c8700 1 -- 172.21.15.5:0/1583086179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40ff5d0 msgr2=0x7f25d40ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.280+0000 7f25db2c8700 1 --2- 172.21.15.5:0/1583086179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40ff5d0 0x7f25d40ff9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25cc01c0d0 tx=0x7f25cc01c3e0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.281+0000 7f25db2c8700 1 -- 172.21.15.5:0/1583086179 shutdown_connections 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.281+0000 7f25db2c8700 1 --2- 172.21.15.5:0/1583086179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d41049d0 0x7f25d4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.281+0000 7f25db2c8700 1 --2- 172.21.15.5:0/1583086179 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d40ff5d0 0x7f25d40ff9b0 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25cc01c0d0 tx=0x7f25cc01c3e0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.281+0000 7f25db2c8700 1 --2- 172.21.15.5:0/1583086179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d40ffef0 0x7f25d41043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.281+0000 7f25db2c8700 1 -- 172.21.15.5:0/1583086179 >> 172.21.15.5:0/1583086179 conn(0x7f25d40fafc0 msgr2=0x7f25d40fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.282+0000 7f25db2c8700 1 -- 172.21.15.5:0/1583086179 shutdown_connections 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.282+0000 7f25db2c8700 1 -- 172.21.15.5:0/1583086179 wait complete. 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 Processor -- start 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 -- start start 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d40ffef0 0x7f25d4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d41049d0 0x7f25d40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d410bcc0 0x7f25d410c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d4072020 con 0x7f25d40ffef0 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d410c680 con 0x7f25d41049d0 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.283+0000 7f25db2c8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d410c7f0 con 0x7f25d410bcc0 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d40ffef0 0x7f25d4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d410bcc0 0x7f25d410c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d410bcc0 0x7f25d410c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51138/0 (socket says 172.21.15.5:51138) 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9865700 1 -- 172.21.15.5:0/169614874 learned_addr learned my addr 172.21.15.5:0/169614874 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d8863700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d41049d0 0x7f25d40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 -- 172.21.15.5:0/169614874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d410bcc0 msgr2=0x7f25d410c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d410bcc0 0x7f25d410c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 -- 172.21.15.5:0/169614874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d41049d0 msgr2=0x7f25d40718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d41049d0 0x7f25d40718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 -- 172.21.15.5:0/169614874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc01ad10 con 0x7f25d40ffef0 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.284+0000 7f25d9064700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d40ffef0 0x7f25d4071380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f25d4067fd0 tx=0x7f25cc018dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.285+0000 7f25ca7fc700 1 -- 172.21.15.5:0/169614874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc01f040 con 0x7f25d40ffef0 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.285+0000 7f25ca7fc700 1 -- 172.21.15.5:0/169614874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25cc018ae0 con 0x7f25d40ffef0 2023-10-08T13:17:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.285+0000 7f25ca7fc700 1 -- 172.21.15.5:0/169614874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc02c680 con 0x7f25d40ffef0 2023-10-08T13:17:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.285+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d410ca70 con 0x7f25d40ffef0 2023-10-08T13:17:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.285+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d41aa4d0 con 0x7f25d40ffef0 2023-10-08T13:17:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.289+0000 7f25ca7fc700 1 -- 172.21.15.5:0/169614874 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f25cc02c7e0 con 0x7f25d40ffef0 2023-10-08T13:17:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.289+0000 7f25ca7fc700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25c00a1730 0x7f25c00a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 Processor -- start 2023-10-08T13:17:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 -- start start 2023-10-08T13:17:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25ca7fc700 1 -- 172.21.15.5:0/169614874 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f25cc0e03c0 con 0x7f25d40ffef0 2023-10-08T13:17:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792dd7a0 0x5592792e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279246460 con 0x5592792dce80 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279237c20 con 0x5592792e8650 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279235540 con 0x5592792dd7a0 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25d9064700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25d9064700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792dd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37940/0 (socket says 172.21.15.5:37940) 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25d9064700 1 -- 172.21.15.5:0/1284214073 learned_addr learned my addr 172.21.15.5:0/1284214073 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.290+0000 7f25d9865700 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25d9064700 1 -- 172.21.15.5:0/1284214073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792dd7a0 msgr2=0x5592792e8110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:17:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25d9064700 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792dd7a0 0x5592792e8110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25d9064700 1 -- 172.21.15.5:0/1284214073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 msgr2=0x5592792eaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25d9064700 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792eaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25d9064700 1 -- 172.21.15.5:0/1284214073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927905bde0 con 0x5592792dce80 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25d9064700 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792dd260 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f25cc01c0d0 tx=0x7f25cc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511b0c40491ab82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25bf7fe700 1 -- 172.21.15.5:0/1284214073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0b1220 con 0x5592792dce80 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25bf7fe700 1 -- 172.21.15.5:0/1284214073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25cc0b53d0 con 0x5592792dce80 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.291+0000 7f25bf7fe700 1 -- 172.21.15.5:0/1284214073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0ad330 con 0x5592792dce80 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.292+0000 7f25e74b1b80 1 -- 172.21.15.5:0/1284214073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 msgr2=0x5592792dd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.292+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792dd260 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f25cc01c0d0 tx=0x7f25cc01c3e0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.293+0000 7f25e74b1b80 1 -- 172.21.15.5:0/1284214073 shutdown_connections 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.293+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792eaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.293+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792dd260 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.294+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/1284214073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792dd7a0 0x5592792e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.294+0000 7f25e74b1b80 1 -- 172.21.15.5:0/1284214073 >> 172.21.15.5:0/1284214073 conn(0x559279252260 msgr2=0x5592792d92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.295+0000 7f25e74b1b80 1 -- 172.21.15.5:0/1284214073 shutdown_connections 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.295+0000 7f25e74b1b80 1 -- 172.21.15.5:0/1284214073 wait complete. 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.295+0000 7f25e74b1b80 1 -- start start 2023-10-08T13:17:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.295+0000 7f25e74b1b80 1 Processor -- start 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25d8863700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25c00a1730 0x7f25c00a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 0x5592792e9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279230e30 con 0x5592792e8650 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592791cd710 con 0x5592792dce80 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592791cd3b0 con 0x5592792f1aa0 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25e74b1b80 10 client.0 _ll_register_callbacks cb 0x55927902a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25d9064700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25d9064700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32896/0 (socket says 172.21.15.5:32896) 2023-10-08T13:17:20.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25d9064700 1 -- 172.21.15.5:0/3523925325 learned_addr learned my addr 172.21.15.5:0/3523925325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.296+0000 7f25d9865700 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d9064700 1 -- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 msgr2=0x5592792f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d9064700 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d9064700 1 -- 172.21.15.5:0/3523925325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 msgr2=0x5592792e9160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:17:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d9064700 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 0x5592792e9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d9064700 1 -- 172.21.15.5:0/3523925325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d41aa4d0 con 0x5592792dce80 2023-10-08T13:17:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d9064700 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792e8c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0dd860 tx=0x7f25cc0acfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1092ac23d9182a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25d8863700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25c00a1730 0x7f25c00a3bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5592792d9f40 tx=0x7f25c40090e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25bcff9700 1 -- 172.21.15.5:0/3523925325 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0e0170 con 0x5592792dce80 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25bcff9700 1 -- 172.21.15.5:0/3523925325 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f25cc0b1220 con 0x5592792dce80 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.297+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592791f8eb0 con 0x5592792dce80 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25bcff9700 1 -- 172.21.15.5:0/3523925325 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25cc0ac5c0 con 0x5592792dce80 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 10 client.26432 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x559279044c60 con 0x5592792dce80 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25bcff9700 1 -- 172.21.15.5:0/3523925325 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5592791f8eb0 con 0x5592792dce80 2023-10-08T13:17:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25bcff9700 1 -- 172.21.15.5:0/3523925325 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f25cc0b4f40 con 0x5592792dce80 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 10 client.26432 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 10 client.26432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 20 client.26432 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592792f7f50 0x5592792fa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 4 client.26432 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559279229e10 con 0x5592792f7f50 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.298+0000 7f25d8863700 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592792f7f50 0x5592792fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.299+0000 7f25bcff9700 10 client.26432 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.299+0000 7f25d8863700 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592792f7f50 0x5592792fa370 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61f79b8b062cc3ea server_cookie=eaffc79ed1199280 in_seq=0 out_seq=0 2023-10-08T13:17:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25bcff9700 1 -- 172.21.15.5:0/3523925325 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559279229e10 con 0x5592792f7f50 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25bcff9700 10 client.26432 handle_command_reply: tid=0 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 client.26432 shutdown 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 msgr2=0x5592792e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792e8c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0dd860 tx=0x7f25cc0acfd0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 shutdown_connections 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592792f7f50 0x5592792fa370 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792e8c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3523925325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 0x5592792e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.300+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 >> 172.21.15.5:0/3523925325 conn(0x559279252260 msgr2=0x5592792d8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.301+0000 7f25bcff9700 0 client.26432 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.301+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 shutdown_connections 2023-10-08T13:17:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.301+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3523925325 wait complete. 2023-10-08T13:17:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.302+0000 7f25e74b1b80 20 client.26432 trim_cache size 0 max 16384 2023-10-08T13:17:20.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 Processor -- start 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 -- start start 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792eda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592790b1920 con 0x5592792dce80 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592792d9510 con 0x5592792e8650 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592792de0d0 con 0x5592792f1aa0 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25d9865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25d9865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792e22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51158/0 (socket says 172.21.15.5:51158) 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25d8863700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.328+0000 7f25d9865700 1 -- 172.21.15.5:0/2740626445 learned_addr learned my addr 172.21.15.5:0/2740626445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d9865700 1 -- 172.21.15.5:0/2740626445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 msgr2=0x5592792e1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d9865700 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792e1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d9865700 1 -- 172.21.15.5:0/2740626445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 msgr2=0x5592792eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d9865700 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d9865700 1 -- 172.21.15.5:0/2740626445 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592792d52a0 con 0x5592792f1aa0 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d8863700 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25d9865700 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792e22a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f25d000ba10 tx=0x7f25d000bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5766df97e828ca30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25bffff700 1 -- 172.21.15.5:0/2740626445 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000b6f0 con 0x5592792f1aa0 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25bffff700 1 -- 172.21.15.5:0/2740626445 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25d0012e10 con 0x5592792f1aa0 2023-10-08T13:17:20.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.329+0000 7f25bffff700 1 -- 172.21.15.5:0/2740626445 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0015dc0 con 0x5592792f1aa0 2023-10-08T13:17:20.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 -- 172.21.15.5:0/2740626445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 msgr2=0x5592792e22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792e22a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f25d000ba10 tx=0x7f25d000bd20 comp rx=0 tx=0).stop 2023-10-08T13:17:20.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 -- 172.21.15.5:0/2740626445 shutdown_connections 2023-10-08T13:17:20.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x5592792e22a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792dce80 0x5592792eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/2740626445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792e8650 0x5592792e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 -- 172.21.15.5:0/2740626445 >> 172.21.15.5:0/2740626445 conn(0x559279252260 msgr2=0x5592792e6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 -- 172.21.15.5:0/2740626445 shutdown_connections 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.330+0000 7f25e74b1b80 1 -- 172.21.15.5:0/2740626445 wait complete. 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 -- start start 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 Processor -- start 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 0x5592792ec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x559279344d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279345250 con 0x5592792e8650 2023-10-08T13:17:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279345390 con 0x5592792dce80 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559279345550 con 0x5592792f1aa0 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25e74b1b80 10 client.0 _ll_register_callbacks cb 0x7f25d000b240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25d9865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x559279344d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25d9865700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x559279344d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51164/0 (socket says 172.21.15.5:51164) 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.331+0000 7f25d9865700 1 -- 172.21.15.5:0/3080351173 learned_addr learned my addr 172.21.15.5:0/3080351173 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25d9865700 1 -- 172.21.15.5:0/3080351173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 msgr2=0x5592792ebc40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25d9865700 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792ebc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25d9865700 1 -- 172.21.15.5:0/3080351173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 msgr2=0x5592792ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25d9865700 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 0x5592792ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25d9865700 1 -- 172.21.15.5:0/3080351173 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c4009e10 con 0x5592792f1aa0 2023-10-08T13:17:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25d9865700 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x559279344d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f25d0015b00 tx=0x7f25d0012c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b87036d6bc95a39 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25bcff9700 1 -- 172.21.15.5:0/3080351173 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0015920 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25bcff9700 1 -- 172.21.15.5:0/3080351173 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f25d0015b60 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25cc0b53d0 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25bcff9700 1 -- 172.21.15.5:0/3080351173 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d0015d20 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25e74b1b80 10 client.26506 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.332+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f25d000e040 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25bcff9700 1 -- 172.21.15.5:0/3080351173 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25cc0b53d0 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25bcff9700 1 -- 172.21.15.5:0/3080351173 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f25d001e5d0 con 0x5592792f1aa0 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25e74b1b80 10 client.26506 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25e74b1b80 10 client.26506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25e74b1b80 20 client.26506 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55927934cd30 0x55927934f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25e74b1b80 4 client.26506 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:17:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.333+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559279229b30 con 0x55927934cd30 2023-10-08T13:17:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.337+0000 7f25d9064700 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55927934cd30 0x55927934f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.337+0000 7f25bcff9700 10 client.26506 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.337+0000 7f25d9064700 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55927934cd30 0x55927934f1d0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640c5b233e36effc server_cookie=f4bf76be391f9bc1 in_seq=0 out_seq=0 2023-10-08T13:17:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.338+0000 7f25bcff9700 1 -- 172.21.15.5:0/3080351173 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559279229b30 con 0x55927934cd30 2023-10-08T13:17:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.338+0000 7f25bcff9700 10 client.26506 handle_command_reply: tid=0 2023-10-08T13:17:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.340+0000 7f25e74b1b80 1 client.26506 shutdown 2023-10-08T13:17:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 msgr2=0x559279344d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x559279344d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f25d0015b00 tx=0x7f25d0012c30 comp rx=0 tx=0).stop 2023-10-08T13:17:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 shutdown_connections 2023-10-08T13:17:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592792f1aa0 0x559279344d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55927934cd30 0x55927934f1d0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592792dce80 0x5592792ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 --2- 172.21.15.5:0/3080351173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592792e8650 0x5592792ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 >> 172.21.15.5:0/3080351173 conn(0x559279252260 msgr2=0x5592792e8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25bcff9700 0 client.26506 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 shutdown_connections 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 1 -- 172.21.15.5:0/3080351173 wait complete. 2023-10-08T13:17:20.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.341+0000 7f25e74b1b80 20 client.26506 trim_cache size 0 max 16384 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:17:20.344 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:17:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25c00a1730 msgr2=0x7f25c00a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25c00a1730 0x7f25c00a3bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5592792d9f40 tx=0x7f25c40090e0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d40ffef0 msgr2=0x7f25d4071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:20.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d40ffef0 0x7f25d4071380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f25d4067fd0 tx=0x7f25cc018dd0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 shutdown_connections 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f25c00a1730 0x7f25c00a3bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25d410bcc0 0x7f25d410c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d40ffef0 0x7f25d4071380 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 --2- 172.21.15.5:0/169614874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25d41049d0 0x7f25d40718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 >> 172.21.15.5:0/169614874 conn(0x7f25d40fafc0 msgr2=0x7f25d406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 shutdown_connections 2023-10-08T13:17:20.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:20.342+0000 7f25db2c8700 1 -- 172.21.15.5:0/169614874 wait complete. 2023-10-08T13:17:20.370 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:17:21.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:20 smithi060 ceph-mon[103190]: pgmap v650: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 519 op/s 2023-10-08T13:17:21.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:20 smithi005 ceph-mon[99496]: pgmap v650: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 519 op/s 2023-10-08T13:17:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:20 smithi118 ceph-mon[104234]: pgmap v650: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 519 op/s 2023-10-08T13:17:21.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 660.0 s, 478.8 tps, lat 203.959 ms stddev 219.887 2023-10-08T13:17:23.161 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:22 smithi060 ceph-mon[103190]: pgmap v651: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2023-10-08T13:17:23.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:22 smithi005 ceph-mon[99496]: pgmap v651: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2023-10-08T13:17:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:22 smithi118 ceph-mon[104234]: pgmap v651: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2023-10-08T13:17:25.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:24 smithi118 ceph-mon[104234]: pgmap v652: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.0 MiB/s wr, 527 op/s 2023-10-08T13:17:25.415 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:24 smithi060 ceph-mon[103190]: pgmap v652: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.0 MiB/s wr, 527 op/s 2023-10-08T13:17:25.429 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:24 smithi005 ceph-mon[99496]: pgmap v652: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.0 MiB/s wr, 527 op/s 2023-10-08T13:17:26.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 665.0 s, 472.8 tps, lat 214.388 ms stddev 236.199 2023-10-08T13:17:27.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:26 smithi118 ceph-mon[104234]: pgmap v653: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.2 MiB/s wr, 512 op/s 2023-10-08T13:17:27.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:26 smithi060 ceph-mon[103190]: pgmap v653: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.2 MiB/s wr, 512 op/s 2023-10-08T13:17:27.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:26 smithi005 ceph-mon[99496]: pgmap v653: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.2 MiB/s wr, 512 op/s 2023-10-08T13:17:29.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:28 smithi118 ceph-mon[104234]: pgmap v654: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 456 op/s 2023-10-08T13:17:29.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:28 smithi060 ceph-mon[103190]: pgmap v654: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 456 op/s 2023-10-08T13:17:29.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:28 smithi005 ceph-mon[99496]: pgmap v654: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.5 MiB/s wr, 456 op/s 2023-10-08T13:17:31.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:31 smithi118 ceph-mon[104234]: pgmap v655: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.6 MiB/s wr, 557 op/s 2023-10-08T13:17:31.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:31 smithi060 ceph-mon[103190]: pgmap v655: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.6 MiB/s wr, 557 op/s 2023-10-08T13:17:31.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:31 smithi005 ceph-mon[99496]: pgmap v655: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.6 MiB/s wr, 557 op/s 2023-10-08T13:17:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 670.0 s, 405.9 tps, lat 242.088 ms stddev 260.589 2023-10-08T13:17:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 -- 172.21.15.5:0/1831466202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153410eea0 msgr2=0x7f15341077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 --2- 172.21.15.5:0/1831466202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153410eea0 0x7f15341077f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1528009920 tx=0x7f1528009c30 comp rx=0 tx=0).stop 2023-10-08T13:17:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 -- 172.21.15.5:0/1831466202 shutdown_connections 2023-10-08T13:17:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 --2- 172.21.15.5:0/1831466202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1534119fd0 0x7f153411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 --2- 172.21.15.5:0/1831466202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f153410eea0 0x7f15341077f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 --2- 172.21.15.5:0/1831466202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410f310 0x7f1534107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.744+0000 7f1539498700 1 -- 172.21.15.5:0/1831466202 >> 172.21.15.5:0/1831466202 conn(0x7f153406b7c0 msgr2=0x7f153406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.750+0000 7f1539498700 1 -- 172.21.15.5:0/1831466202 shutdown_connections 2023-10-08T13:17:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.761+0000 7f1539498700 1 -- 172.21.15.5:0/1831466202 wait complete. 2023-10-08T13:17:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.761+0000 7f1539498700 1 Processor -- start 2023-10-08T13:17:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 -- start start 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410eea0 0x7f15341194a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153410f310 0x7f15341199e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1534119fd0 0x7f15341136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534113ea0 con 0x7f153410eea0 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534114010 con 0x7f153410f310 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1539498700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15341141d0 con 0x7f1534119fd0 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410eea0 0x7f15341194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410eea0 0x7f15341194a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37972/0 (socket says 172.21.15.5:37972) 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f1532ffd700 1 -- 172.21.15.5:0/681705751 learned_addr learned my addr 172.21.15.5:0/681705751 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.762+0000 7f15327fc700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153410f310 0x7f15341199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.763+0000 7f15327fc700 1 -- 172.21.15.5:0/681705751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1534119fd0 msgr2=0x7f15341136d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.763+0000 7f15327fc700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1534119fd0 0x7f15341136d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.763+0000 7f15327fc700 1 -- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410eea0 msgr2=0x7f15341194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.763+0000 7f15327fc700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410eea0 0x7f15341194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.763+0000 7f15327fc700 1 -- 172.21.15.5:0/681705751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528009520 con 0x7f153410f310 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.763+0000 7f15327fc700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153410f310 0x7f15341199e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f153406e020 tx=0x7f152400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.767+0000 7f151bfff700 1 -- 172.21.15.5:0/681705751 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524009930 con 0x7f153410f310 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.767+0000 7f151bfff700 1 -- 172.21.15.5:0/681705751 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1524032470 con 0x7f153410f310 2023-10-08T13:17:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.767+0000 7f151bfff700 1 -- 172.21.15.5:0/681705751 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400b5d0 con 0x7f153410f310 2023-10-08T13:17:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.768+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1534072a20 con 0x7f153410f310 2023-10-08T13:17:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.768+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1534072eb0 con 0x7f153410f310 2023-10-08T13:17:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.772+0000 7f151bfff700 1 -- 172.21.15.5:0/681705751 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f15240325e0 con 0x7f153410f310 2023-10-08T13:17:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 Processor -- start 2023-10-08T13:17:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 -- start start 2023-10-08T13:17:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9225c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc921fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9220510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc9188400 con 0x561bc9225880 2023-10-08T13:17:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc9179bc0 con 0x561bc92261a0 2023-10-08T13:17:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f1545681b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc91774e0 con 0x561bc92200b0 2023-10-08T13:17:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f151bfff700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f151c0a1770 0x7f151c0a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f15337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9225c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.773+0000 7f15337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9225c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37976/0 (socket says 172.21.15.5:37976) 2023-10-08T13:17:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.774+0000 7f151bfff700 1 -- 172.21.15.5:0/681705751 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f15240eefa0 con 0x7f153410f310 2023-10-08T13:17:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.774+0000 7f15337fe700 1 -- 172.21.15.5:0/2144691332 learned_addr learned my addr 172.21.15.5:0/2144691332 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.774+0000 7f15327fc700 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9220510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.774+0000 7f1532ffd700 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc921fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.775+0000 7f15327fc700 1 -- 172.21.15.5:0/2144691332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 msgr2=0x561bc921fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.775+0000 7f15327fc700 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc921fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.775+0000 7f15327fc700 1 -- 172.21.15.5:0/2144691332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 msgr2=0x561bc9225c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.775+0000 7f15327fc700 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9225c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.775+0000 7f15327fc700 1 -- 172.21.15.5:0/2144691332 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bc8f9dd80 con 0x561bc92200b0 2023-10-08T13:17:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.776+0000 7f15327fc700 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9220510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15240ec360 tx=0x7f15240bbb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d661e9921630b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.776+0000 7f15197fa700 1 -- 172.21.15.5:0/2144691332 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240bfdc0 con 0x561bc92200b0 2023-10-08T13:17:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.776+0000 7f15197fa700 1 -- 172.21.15.5:0/2144691332 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15240c4000 con 0x561bc92200b0 2023-10-08T13:17:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.776+0000 7f15197fa700 1 -- 172.21.15.5:0/2144691332 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240bbed0 con 0x561bc92200b0 2023-10-08T13:17:32.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.776+0000 7f15337fe700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f151c0a1770 0x7f151c0a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.777+0000 7f1545681b80 1 -- 172.21.15.5:0/2144691332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 msgr2=0x561bc9220510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.777+0000 7f1545681b80 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9220510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15240ec360 tx=0x7f15240bbb70 comp rx=0 tx=0).stop 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 -- 172.21.15.5:0/2144691332 shutdown_connections 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9220510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9225c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 --2- 172.21.15.5:0/2144691332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc921fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 -- 172.21.15.5:0/2144691332 >> 172.21.15.5:0/2144691332 conn(0x561bc9194200 msgr2=0x561bc921ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 -- 172.21.15.5:0/2144691332 shutdown_connections 2023-10-08T13:17:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f15337fe700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f151c0a1770 0x7f151c0a3c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f152c0060b0 tx=0x7f152c004b40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.778+0000 7f1545681b80 1 -- 172.21.15.5:0/2144691332 wait complete. 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 -- start start 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 Processor -- start 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 0x561bc92295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9229b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92261a0 0x561bc922a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc9172dd0 con 0x561bc9225880 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc910f6b0 con 0x561bc92200b0 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc910f350 con 0x561bc92261a0 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1545681b80 10 client.0 _ll_register_callbacks cb 0x561bc8f6c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 0x561bc92295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 0x561bc92295e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32934/0 (socket says 172.21.15.5:32934) 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.779+0000 7f1532ffd700 1 -- 172.21.15.5:0/1554333783 learned_addr learned my addr 172.21.15.5:0/1554333783 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f15337fe700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92261a0 0x561bc922a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f15327fc700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9229b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1532ffd700 1 -- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92261a0 msgr2=0x561bc922a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1532ffd700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92261a0 0x561bc922a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1532ffd700 1 -- 172.21.15.5:0/1554333783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 msgr2=0x561bc9229b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1532ffd700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9229b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1532ffd700 1 -- 172.21.15.5:0/1554333783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1534072eb0 con 0x561bc92200b0 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1532ffd700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 0x561bc92295e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1528005c10 tx=0x7f152800f700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224cebd346e9ca79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1516ff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:17:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1516ff5700 1 -- 172.21.15.5:0/1554333783 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800b760 con 0x561bc92200b0 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1516ff5700 1 -- 172.21.15.5:0/1554333783 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f152800b8c0 con 0x561bc92200b0 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.780+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bc913ae50 con 0x561bc92200b0 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1516ff5700 1 -- 172.21.15.5:0/1554333783 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f152800ba80 con 0x561bc92200b0 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 10 client.26447 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561bc8f86c00 con 0x561bc92200b0 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1516ff5700 1 -- 172.21.15.5:0/1554333783 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561bc913ae50 con 0x561bc92200b0 2023-10-08T13:17:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1516ff5700 1 -- 172.21.15.5:0/1554333783 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1528015020 con 0x561bc92200b0 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 10 client.26447 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 10 client.26447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 20 client.26447 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc9239c80 0x561bc923c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 4 client.26447 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.781+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bc916bdb0 con 0x561bc9239c80 2023-10-08T13:17:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.782+0000 7f15327fc700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc9239c80 0x561bc923c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.789+0000 7f1516ff5700 10 client.26447 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.789+0000 7f15327fc700 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc9239c80 0x561bc923c0a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4632afbe3a965586 server_cookie=f922296cff169231 in_seq=0 out_seq=0 2023-10-08T13:17:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1516ff5700 1 -- 172.21.15.5:0/1554333783 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561bc916bdb0 con 0x561bc9239c80 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1516ff5700 10 client.26447 handle_command_reply: tid=0 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 client.26447 shutdown 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 msgr2=0x561bc92295e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 0x561bc92295e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1528005c10 tx=0x7f152800f700 comp rx=0 tx=0).stop 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 shutdown_connections 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92261a0 0x561bc922a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc9239c80 0x561bc923c0a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92200b0 0x561bc92295e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1516ff5700 0 client.26447 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 --2- 172.21.15.5:0/1554333783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc9225880 0x561bc9229b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 >> 172.21.15.5:0/1554333783 conn(0x561bc9194200 msgr2=0x561bc921a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 shutdown_connections 2023-10-08T13:17:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.790+0000 7f1545681b80 1 -- 172.21.15.5:0/1554333783 wait complete. 2023-10-08T13:17:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.791+0000 7f1545681b80 20 client.26447 trim_cache size 0 max 16384 2023-10-08T13:17:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.814+0000 7f1545681b80 1 Processor -- start 2023-10-08T13:17:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 -- start start 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92200b0 0x561bc921fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 0x561bc9235cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc9224dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc8ff38c0 con 0x561bc92200b0 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc913ae50 con 0x561bc92261a0 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f1545681b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc9225eb0 con 0x561bc9225880 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f15327fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 0x561bc9235cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f15327fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 0x561bc9235cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51196/0 (socket says 172.21.15.5:51196) 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.817+0000 7f15327fc700 1 -- 172.21.15.5:0/170661980 learned_addr learned my addr 172.21.15.5:0/170661980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f1532ffd700 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92200b0 0x561bc921fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f15327fc700 1 -- 172.21.15.5:0/170661980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 msgr2=0x561bc9224dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f15327fc700 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc9224dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f15327fc700 1 -- 172.21.15.5:0/170661980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92200b0 msgr2=0x561bc921fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f15327fc700 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92200b0 0x561bc921fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f15327fc700 1 -- 172.21.15.5:0/170661980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bc8fc41f0 con 0x561bc9225880 2023-10-08T13:17:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f15327fc700 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 0x561bc9235cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15240ec410 tx=0x7f1524032cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef21a6c6d815d1f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.818+0000 7f1519ffb700 1 -- 172.21.15.5:0/170661980 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524045db0 con 0x561bc9225880 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.819+0000 7f1519ffb700 1 -- 172.21.15.5:0/170661980 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15240328c0 con 0x561bc9225880 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.819+0000 7f1519ffb700 1 -- 172.21.15.5:0/170661980 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240bb3c0 con 0x561bc9225880 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 -- 172.21.15.5:0/170661980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 msgr2=0x561bc9235cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 0x561bc9235cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15240ec410 tx=0x7f1524032cc0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 -- 172.21.15.5:0/170661980 shutdown_connections 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc92261a0 0x561bc9224dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92200b0 0x561bc921fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 --2- 172.21.15.5:0/170661980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc9225880 0x561bc9235cd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.820+0000 7f1545681b80 1 -- 172.21.15.5:0/170661980 >> 172.21.15.5:0/170661980 conn(0x561bc9194200 msgr2=0x561bc92246c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 -- 172.21.15.5:0/170661980 shutdown_connections 2023-10-08T13:17:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 -- 172.21.15.5:0/170661980 wait complete. 2023-10-08T13:17:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 -- start start 2023-10-08T13:17:32.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 Processor -- start 2023-10-08T13:17:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9281c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc9225880 0x561bc9282170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92261a0 0x561bc928cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc9282840 con 0x561bc92261a0 2023-10-08T13:17:32.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc928d000 con 0x561bc9225880 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc928d140 con 0x561bc92200b0 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.821+0000 7f1545681b80 10 client.0 _ll_register_callbacks cb 0x7f152800fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9281c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9281c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51202/0 (socket says 172.21.15.5:51202) 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 -- 172.21.15.5:0/1205754376 learned_addr learned my addr 172.21.15.5:0/1205754376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f15337fe700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92261a0 0x561bc928cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f15327fc700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc9225880 0x561bc9282170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 -- 172.21.15.5:0/1205754376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc9225880 msgr2=0x561bc9282170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc9225880 0x561bc9282170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 -- 172.21.15.5:0/1205754376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92261a0 msgr2=0x561bc928cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92261a0 0x561bc928cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f1532ffd700 1 -- 172.21.15.5:0/1205754376 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bc8f9dd80 con 0x561bc92200b0 2023-10-08T13:17:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.822+0000 7f15327fc700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc9225880 0x561bc9282170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:17:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1532ffd700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9281c30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1528003af0 tx=0x7f1528009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f67d9ffd8974f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1516ff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:17:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1516ff5700 1 -- 172.21.15.5:0/1205754376 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800b970 con 0x561bc92200b0 2023-10-08T13:17:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1516ff5700 1 -- 172.21.15.5:0/1205754376 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f152800bad0 con 0x561bc92200b0 2023-10-08T13:17:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15240c4000 con 0x561bc92200b0 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1516ff5700 1 -- 172.21.15.5:0/1205754376 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f152800b2c0 con 0x561bc92200b0 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1545681b80 10 client.26521 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.823+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561bc8f9c250 con 0x561bc92200b0 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1516ff5700 1 -- 172.21.15.5:0/1205754376 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15240c4000 con 0x561bc92200b0 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1516ff5700 1 -- 172.21.15.5:0/1205754376 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1528009950 con 0x561bc92200b0 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1545681b80 10 client.26521 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1545681b80 10 client.26521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1545681b80 20 client.26521 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1545681b80 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc928e4c0 0x561bc92908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1545681b80 4 client.26521 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:17:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561bc916bad0 con 0x561bc928e4c0 2023-10-08T13:17:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f15327fc700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc928e4c0 0x561bc92908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f1516ff5700 10 client.26521 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.824+0000 7f15327fc700 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc928e4c0 0x561bc92908b0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7077ab76bf573102 server_cookie=cc9f4fe42bf22649 in_seq=0 out_seq=0 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1516ff5700 1 -- 172.21.15.5:0/1205754376 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561bc916bad0 con 0x561bc928e4c0 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1516ff5700 10 client.26521 handle_command_reply: tid=0 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 client.26521 shutdown 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 msgr2=0x561bc9281c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9281c30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1528003af0 tx=0x7f1528009300 comp rx=0 tx=0).stop 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 shutdown_connections 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bc92261a0 0x561bc928cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561bc92200b0 0x561bc9281c30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x561bc928e4c0 0x561bc92908b0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 --2- 172.21.15.5:0/1205754376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561bc9225880 0x561bc9282170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 >> 172.21.15.5:0/1205754376 conn(0x561bc9194200 msgr2=0x561bc922ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1516ff5700 0 client.26521 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 shutdown_connections 2023-10-08T13:17:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.838+0000 7f1545681b80 1 -- 172.21.15.5:0/1205754376 wait complete. 2023-10-08T13:17:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.839+0000 7f1545681b80 20 client.26521 trim_cache size 0 max 16384 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.840+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f151c0a1770 msgr2=0x7f151c0a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.840+0000 7f1539498700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f151c0a1770 0x7f151c0a3c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f152c0060b0 tx=0x7f152c004b40 comp rx=0 tx=0).stop 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.840+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153410f310 msgr2=0x7f15341199e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.840+0000 7f1539498700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153410f310 0x7f15341199e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f153406e020 tx=0x7f152400dc30 comp rx=0 tx=0).stop 2023-10-08T13:17:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.845+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 shutdown_connections 2023-10-08T13:17:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.845+0000 7f1539498700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f151c0a1770 0x7f151c0a3c30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.845+0000 7f1539498700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1534119fd0 0x7f15341136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.845+0000 7f1539498700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f153410eea0 0x7f15341194a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.845+0000 7f1539498700 1 --2- 172.21.15.5:0/681705751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153410f310 0x7f15341199e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:32.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.845+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 >> 172.21.15.5:0/681705751 conn(0x7f153406b7c0 msgr2=0x7f153410b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:32.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.849+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 shutdown_connections 2023-10-08T13:17:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:32.856+0000 7f1539498700 1 -- 172.21.15.5:0/681705751 wait complete. 2023-10-08T13:17:33.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:33 smithi118 ceph-mon[104234]: pgmap v656: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.5 MiB/s wr, 492 op/s 2023-10-08T13:17:33.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:33 smithi060 ceph-mon[103190]: pgmap v656: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.5 MiB/s wr, 492 op/s 2023-10-08T13:17:33.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:33 smithi005 ceph-mon[99496]: pgmap v656: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.5 MiB/s wr, 492 op/s 2023-10-08T13:17:35.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:35 smithi060 ceph-mon[103190]: pgmap v657: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.3 MiB/s wr, 523 op/s 2023-10-08T13:17:35.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:35 smithi005 ceph-mon[99496]: pgmap v657: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.3 MiB/s wr, 523 op/s 2023-10-08T13:17:35.526 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:35 smithi118 ceph-mon[104234]: pgmap v657: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.3 MiB/s wr, 523 op/s 2023-10-08T13:17:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 675.0 s, 439.1 tps, lat 230.564 ms stddev 255.222 2023-10-08T13:17:37.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:36 smithi060 ceph-mon[103190]: pgmap v658: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.9 MiB/s wr, 592 op/s 2023-10-08T13:17:37.187 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:36 smithi005 ceph-mon[99496]: pgmap v658: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.9 MiB/s wr, 592 op/s 2023-10-08T13:17:37.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:36 smithi118 ceph-mon[104234]: pgmap v658: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.9 MiB/s wr, 592 op/s 2023-10-08T13:17:39.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:38 smithi060 ceph-mon[103190]: pgmap v659: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.5 MiB/s wr, 480 op/s 2023-10-08T13:17:39.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:38 smithi005 ceph-mon[99496]: pgmap v659: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.5 MiB/s wr, 480 op/s 2023-10-08T13:17:39.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:38 smithi118 ceph-mon[104234]: pgmap v659: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.5 MiB/s wr, 480 op/s 2023-10-08T13:17:41.167 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:40 smithi060 ceph-mon[103190]: pgmap v660: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.0 MiB/s wr, 534 op/s 2023-10-08T13:17:41.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:40 smithi005 ceph-mon[99496]: pgmap v660: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.0 MiB/s wr, 534 op/s 2023-10-08T13:17:41.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:40 smithi118 ceph-mon[104234]: pgmap v660: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.0 MiB/s wr, 534 op/s 2023-10-08T13:17:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 680.0 s, 485.1 tps, lat 208.854 ms stddev 254.820 2023-10-08T13:17:43.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:42 smithi118 ceph-mon[104234]: pgmap v661: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.8 MiB/s wr, 451 op/s 2023-10-08T13:17:43.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:42 smithi060 ceph-mon[103190]: pgmap v661: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.8 MiB/s wr, 451 op/s 2023-10-08T13:17:43.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:42 smithi005 ceph-mon[99496]: pgmap v661: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.8 MiB/s wr, 451 op/s 2023-10-08T13:17:45.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:44 smithi118 ceph-mon[104234]: pgmap v662: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.7 MiB/s wr, 473 op/s 2023-10-08T13:17:45.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:44 smithi060 ceph-mon[103190]: pgmap v662: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.7 MiB/s wr, 473 op/s 2023-10-08T13:17:45.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:44 smithi005 ceph-mon[99496]: pgmap v662: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.7 MiB/s wr, 473 op/s 2023-10-08T13:17:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.073+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1783640236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec119fd0 msgr2=0x7fd1ec11c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.073+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1783640236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec11c3c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80099c0 tx=0x7fd1e8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.085+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1783640236 shutdown_connections 2023-10-08T13:17:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.085+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1783640236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec11c3c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.085+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1783640236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10eea0 0x7fd1ec1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.085+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1783640236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec10f310 0x7fd1ec107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.085+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1783640236 >> 172.21.15.5:0/1783640236 conn(0x7fd1ec06b7c0 msgr2=0x7fd1ec06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.097+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1783640236 shutdown_connections 2023-10-08T13:17:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.099+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1783640236 wait complete. 2023-10-08T13:17:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.099+0000 7fd1f41a1700 1 Processor -- start 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 -- start start 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec10eea0 0x7fd1ec1182c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10f310 0x7fd1ec118840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec111390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec111b40 con 0x7fd1ec10eea0 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec111cb0 con 0x7fd1ec119fd0 2023-10-08T13:17:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f41a1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec111e70 con 0x7fd1ec10f310 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f273e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec111390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f273e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec111390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32964/0 (socket says 172.21.15.5:32964) 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.100+0000 7fd1f273e700 1 -- 172.21.15.5:0/1485187801 learned_addr learned my addr 172.21.15.5:0/1485187801 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f173c700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10f310 0x7fd1ec118840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f273e700 1 -- 172.21.15.5:0/1485187801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10f310 msgr2=0x7fd1ec118840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f273e700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10f310 0x7fd1ec118840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f273e700 1 -- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec10eea0 msgr2=0x7fd1ec1182c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f273e700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec10eea0 0x7fd1ec1182c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f273e700 1 -- 172.21.15.5:0/1485187801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80095f0 con 0x7fd1ec119fd0 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f173c700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10f310 0x7fd1ec118840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f273e700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec111390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80098e0 tx=0x7fd1e80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1e2ffd700 1 -- 172.21.15.5:0/1485187801 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e801d070 con 0x7fd1ec119fd0 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1e2ffd700 1 -- 172.21.15.5:0/1485187801 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e8003f30 con 0x7fd1ec119fd0 2023-10-08T13:17:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.101+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec1120f0 con 0x7fd1ec119fd0 2023-10-08T13:17:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.102+0000 7fd1e2ffd700 1 -- 172.21.15.5:0/1485187801 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800fbc0 con 0x7fd1ec119fd0 2023-10-08T13:17:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.102+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec116080 con 0x7fd1ec119fd0 2023-10-08T13:17:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.116+0000 7fd1e2ffd700 1 -- 172.21.15.5:0/1485187801 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd1e802b440 con 0x7fd1ec119fd0 2023-10-08T13:17:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.117+0000 7fd20038ab80 1 Processor -- start 2023-10-08T13:17:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.117+0000 7fd1e2ffd700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1d80a16b0 0x7fd1d80a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.118+0000 7fd1e2ffd700 1 -- 172.21.15.5:0/1485187801 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd1e80ceb50 con 0x7fd1ec119fd0 2023-10-08T13:17:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.120+0000 7fd1f173c700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1d80a16b0 0x7fd1d80a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.121+0000 7fd1f173c700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1d80a16b0 0x7fd1d80a3b70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc005e10 tx=0x7fd1dc005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 -- start start 2023-10-08T13:17:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a401a0 0x55a3a4a39b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a49a2400 con 0x55a3a4a401a0 2023-10-08T13:17:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4993bc0 con 0x55a3a4a3f880 2023-10-08T13:17:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.122+0000 7fd20038ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a49914e0 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32970/0 (socket says 172.21.15.5:32970) 2023-10-08T13:17:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3637035534 learned_addr learned my addr 172.21.15.5:0/3637035534 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f173c700 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a401a0 0x55a3a4a39b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f273e700 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3637035534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 msgr2=0x55a3a4a3a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3637035534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a401a0 msgr2=0x55a3a4a39b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a401a0 0x55a3a4a39b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3637035534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3a47b7d80 con 0x55a3a4a3f880 2023-10-08T13:17:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.123+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3fc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009c60 tx=0x7fd1e4009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e0ae272412ad73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.124+0000 7fd1d7fff700 1 -- 172.21.15.5:0/3637035534 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4004bb0 con 0x55a3a4a3f880 2023-10-08T13:17:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd1d7fff700 1 -- 172.21.15.5:0/3637035534 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e400f040 con 0x55a3a4a3f880 2023-10-08T13:17:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd1d7fff700 1 -- 172.21.15.5:0/3637035534 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40133f0 con 0x55a3a4a3f880 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 -- 172.21.15.5:0/3637035534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 msgr2=0x55a3a4a3fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3fc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009c60 tx=0x7fd1e4009f70 comp rx=0 tx=0).stop 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 -- 172.21.15.5:0/3637035534 shutdown_connections 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3fc60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3637035534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a401a0 0x55a3a4a39b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.125+0000 7fd20038ab80 1 -- 172.21.15.5:0/3637035534 >> 172.21.15.5:0/3637035534 conn(0x55a3a49ae200 msgr2=0x55a3a4a34b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.126+0000 7fd20038ab80 1 -- 172.21.15.5:0/3637035534 shutdown_connections 2023-10-08T13:17:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.126+0000 7fd20038ab80 1 -- 172.21.15.5:0/3637035534 wait complete. 2023-10-08T13:17:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.126+0000 7fd20038ab80 1 -- start start 2023-10-08T13:17:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.126+0000 7fd20038ab80 1 Processor -- start 2023-10-08T13:17:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a43490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a43ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a498cdd0 con 0x55a3a4a3f880 2023-10-08T13:17:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a49296b0 con 0x55a3a4a401a0 2023-10-08T13:17:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4929350 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd20038ab80 10 client.0 _ll_register_callbacks cb 0x55a3a47867a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd1f273e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a43ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd1f273e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a43ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32974/0 (socket says 172.21.15.5:32974) 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.127+0000 7fd1f273e700 1 -- 172.21.15.5:0/1031722950 learned_addr learned my addr 172.21.15.5:0/1031722950 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f173c700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a43490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f273e700 1 -- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 msgr2=0x55a3a4a461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f273e700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f273e700 1 -- 172.21.15.5:0/1031722950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 msgr2=0x55a3a4a43490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f273e700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a43490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f273e700 1 -- 172.21.15.5:0/1031722950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e40098c0 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f173c700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a43490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.128+0000 7fd1f273e700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a43ac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8005b40 tx=0x7fd1e80040a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae68dc2b12fc6585 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd1d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd1d57fa700 1 -- 172.21.15.5:0/1031722950 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e809b830 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd1d57fa700 1 -- 172.21.15.5:0/1031722950 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd1e809f980 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3a4954e50 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd1d57fa700 1 -- 172.21.15.5:0/1031722950 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1e80a3b30 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd20038ab80 10 client.26462 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a3a47a0c00 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.129+0000 7fd1d57fa700 1 -- 172.21.15.5:0/1031722950 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a3a4954e50 con 0x55a3a4a401a0 2023-10-08T13:17:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd1d57fa700 1 -- 172.21.15.5:0/1031722950 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd1e809ad20 con 0x55a3a4a401a0 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd20038ab80 10 client.26462 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd20038ab80 10 client.26462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd20038ab80 20 client.26462 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd20038ab80 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4a539b0 0x55a3a4a55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd20038ab80 4 client.26462 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3a4985db0 con 0x55a3a4a539b0 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4a539b0 0x55a3a4a55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd1d57fa700 10 client.26462 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.130+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4a539b0 0x55a3a4a55da0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b1386da11a84f81 server_cookie=d6e7647f8753b848 in_seq=0 out_seq=0 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd1d57fa700 1 -- 172.21.15.5:0/1031722950 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a3a4985db0 con 0x55a3a4a539b0 2023-10-08T13:17:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd1d57fa700 10 client.26462 handle_command_reply: tid=0 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 client.26462 shutdown 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 msgr2=0x55a3a4a43ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a43ac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8005b40 tx=0x7fd1e80040a0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 shutdown_connections 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4a539b0 0x55a3a4a55da0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a43ac0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd1d57fa700 0 client.26462 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 --2- 172.21.15.5:0/1031722950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a43490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 >> 172.21.15.5:0/1031722950 conn(0x55a3a49ae200 msgr2=0x55a3a4a34010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.131+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 shutdown_connections 2023-10-08T13:17:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.132+0000 7fd20038ab80 1 -- 172.21.15.5:0/1031722950 wait complete. 2023-10-08T13:17:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.132+0000 7fd20038ab80 20 client.26462 trim_cache size 0 max 16384 2023-10-08T13:17:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.149+0000 7fd20038ab80 1 Processor -- start 2023-10-08T13:17:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.149+0000 7fd20038ab80 1 -- start start 2023-10-08T13:17:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a39b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a34790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a34cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd20038ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a480d8c0 con 0x55a3a4a3f880 2023-10-08T13:17:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd20038ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4a2f2b0 con 0x55a3a4a401a0 2023-10-08T13:17:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd20038ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4a506c0 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f173c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a34790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f1f3d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a39b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f1f3d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a39b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51236/0 (socket says 172.21.15.5:51236) 2023-10-08T13:17:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f273e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a34cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/633840183 learned_addr learned my addr 172.21.15.5:0/633840183 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f273e700 1 -- 172.21.15.5:0/633840183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 msgr2=0x55a3a4a39b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f273e700 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a39b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f273e700 1 -- 172.21.15.5:0/633840183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 msgr2=0x55a3a4a34790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f273e700 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a34790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.150+0000 7fd1f273e700 1 -- 172.21.15.5:0/633840183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3a47de1f0 con 0x55a3a4a401a0 2023-10-08T13:17:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.151+0000 7fd1f273e700 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a34cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009990 tx=0x7fd1e80a36a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b651e7809d65cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.151+0000 7fd1e0ff9700 1 -- 172.21.15.5:0/633840183 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e807d070 con 0x55a3a4a401a0 2023-10-08T13:17:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.151+0000 7fd1e0ff9700 1 -- 172.21.15.5:0/633840183 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e8097b70 con 0x55a3a4a401a0 2023-10-08T13:17:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.151+0000 7fd1e0ff9700 1 -- 172.21.15.5:0/633840183 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e809ad20 con 0x55a3a4a401a0 2023-10-08T13:17:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 -- 172.21.15.5:0/633840183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 msgr2=0x55a3a4a34cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a34cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009990 tx=0x7fd1e80a36a0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 -- 172.21.15.5:0/633840183 shutdown_connections 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a401a0 0x55a3a4a34cd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a39b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 --2- 172.21.15.5:0/633840183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a34790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 -- 172.21.15.5:0/633840183 >> 172.21.15.5:0/633840183 conn(0x55a3a49ae200 msgr2=0x55a3a4a43450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 -- 172.21.15.5:0/633840183 shutdown_connections 2023-10-08T13:17:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.152+0000 7fd20038ab80 1 -- 172.21.15.5:0/633840183 wait complete. 2023-10-08T13:17:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 -- start start 2023-10-08T13:17:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 Processor -- start 2023-10-08T13:17:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a401a0 0x55a3a4a3b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4a3b800 con 0x55a3a4a3f880 2023-10-08T13:17:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4a3b970 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3a4a3bb30 con 0x55a3a4a401a0 2023-10-08T13:17:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.153+0000 7fd20038ab80 10 client.0 _ll_register_callbacks cb 0x7fd1e809b370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:32988/0 (socket says 172.21.15.5:32988) 2023-10-08T13:17:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3068878379 learned_addr learned my addr 172.21.15.5:0/3068878379 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f273e700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a401a0 0x55a3a4a3b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f173c700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a401a0 msgr2=0x55a3a4a3b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a401a0 0x55a3a4a3b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3068878379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 msgr2=0x55a3a4a3cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 -- 172.21.15.5:0/3068878379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3a47a0c00 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f273e700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a401a0 0x55a3a4a3b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1f1f3d700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3c5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009c60 tx=0x7fd1e4009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c73a527e70d467 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1d57fa700 1 -- 172.21.15.5:0/3068878379 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4023130 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd1d57fa700 1 -- 172.21.15.5:0/3068878379 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd1e4023290 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.154+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1e400f040 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd1d57fa700 1 -- 172.21.15.5:0/3068878379 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1e4023490 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 10 client.26468 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a3a47b6250 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd1d57fa700 1 -- 172.21.15.5:0/3068878379 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e400f040 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd1d57fa700 1 -- 172.21.15.5:0/3068878379 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd1e4007500 con 0x55a3a4a3a0b0 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 10 client.26468 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 10 client.26468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 20 client.26468 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4aa8680 0x55a3a4aaaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 4 client.26468 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3a4985ad0 con 0x55a3a4aa8680 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.155+0000 7fd1f173c700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4aa8680 0x55a3a4aaaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.156+0000 7fd1d57fa700 10 client.26468 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.156+0000 7fd1f173c700 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4aa8680 0x55a3a4aaaaa0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feb3029aba17e933 server_cookie=cec6a6b36cbd6efa in_seq=0 out_seq=0 2023-10-08T13:17:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.164+0000 7fd1d57fa700 1 -- 172.21.15.5:0/3068878379 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3a4985ad0 con 0x55a3a4aa8680 2023-10-08T13:17:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.164+0000 7fd1d57fa700 10 client.26468 handle_command_reply: tid=0 2023-10-08T13:17:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.164+0000 7fd20038ab80 1 client.26468 shutdown 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 msgr2=0x55a3a4a3c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3c5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009c60 tx=0x7fd1e4009240 comp rx=0 tx=0).stop 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 shutdown_connections 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a3a4a401a0 0x55a3a4a3b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a3a4aa8680 0x55a3a4aaaaa0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a3a4a3a0b0 0x55a3a4a3c5d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd1d57fa700 0 client.26468 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 --2- 172.21.15.5:0/3068878379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a3a4a3f880 0x55a3a4a3cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 >> 172.21.15.5:0/3068878379 conn(0x55a3a49ae200 msgr2=0x55a3a4a43070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 shutdown_connections 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 1 -- 172.21.15.5:0/3068878379 wait complete. 2023-10-08T13:17:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.165+0000 7fd20038ab80 20 client.26468 trim_cache size 0 max 16384 2023-10-08T13:17:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:17:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:17:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:17:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1d80a16b0 msgr2=0x7fd1d80a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1d80a16b0 0x7fd1d80a3b70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc005e10 tx=0x7fd1dc005d60 comp rx=0 tx=0).stop 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 msgr2=0x7fd1ec111390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec111390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80098e0 tx=0x7fd1e80057f0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 shutdown_connections 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd1d80a16b0 0x7fd1d80a3b70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1ec119fd0 0x7fd1ec111390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1ec10eea0 0x7fd1ec1182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 --2- 172.21.15.5:0/1485187801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1ec10f310 0x7fd1ec118840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 >> 172.21.15.5:0/1485187801 conn(0x7fd1ec06b7c0 msgr2=0x7fd1ec06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 shutdown_connections 2023-10-08T13:17:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:46.166+0000 7fd1f41a1700 1 -- 172.21.15.5:0/1485187801 wait complete. 2023-10-08T13:17:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 685.0 s, 573.8 tps, lat 172.691 ms stddev 225.356 2023-10-08T13:17:47.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:46 smithi118 ceph-mon[104234]: pgmap v663: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.1 MiB/s wr, 519 op/s 2023-10-08T13:17:47.414 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:46 smithi060 ceph-mon[103190]: pgmap v663: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.1 MiB/s wr, 519 op/s 2023-10-08T13:17:47.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:46 smithi005 ceph-mon[99496]: pgmap v663: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.1 MiB/s wr, 519 op/s 2023-10-08T13:17:49.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:48 smithi118 ceph-mon[104234]: pgmap v664: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.3 MiB/s wr, 404 op/s 2023-10-08T13:17:49.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:48 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:17:49.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:48 smithi060 ceph-mon[103190]: pgmap v664: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.3 MiB/s wr, 404 op/s 2023-10-08T13:17:49.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:48 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:17:49.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:48 smithi005 ceph-mon[99496]: pgmap v664: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.3 MiB/s wr, 404 op/s 2023-10-08T13:17:49.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:48 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:17:50.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:17:50.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:50 smithi005 ceph-mon[99496]: pgmap v665: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 MiB/s wr, 479 op/s 2023-10-08T13:17:50.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:50.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:50 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.791+0000 7f4b8d168700 1 -- 172.21.15.5:0/2381894086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881083a0 msgr2=0x7f4b8811bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.791+0000 7f4b8d168700 1 --2- 172.21.15.5:0/2381894086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881083a0 0x7f4b8811bfe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009990 tx=0x7f4b7c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.793+0000 7f4b8d168700 1 -- 172.21.15.5:0/2381894086 shutdown_connections 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.793+0000 7f4b8d168700 1 --2- 172.21.15.5:0/2381894086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881083a0 0x7f4b8811bfe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.793+0000 7f4b8d168700 1 --2- 172.21.15.5:0/2381894086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b8810edf0 0x7f4b8810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.793+0000 7f4b8d168700 1 --2- 172.21.15.5:0/2381894086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b881077f0 0x7f4b88107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.793+0000 7f4b8d168700 1 -- 172.21.15.5:0/2381894086 >> 172.21.15.5:0/2381894086 conn(0x7f4b8806b770 msgr2=0x7f4b8806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.803+0000 7f4b8d168700 1 -- 172.21.15.5:0/2381894086 shutdown_connections 2023-10-08T13:17:50.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.808+0000 7f4b8d168700 1 -- 172.21.15.5:0/2381894086 wait complete. 2023-10-08T13:17:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.808+0000 7f4b8d168700 1 Processor -- start 2023-10-08T13:17:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 -- start start 2023-10-08T13:17:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881077f0 0x7f4b8811ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b881083a0 0x7f4b88114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 0x7f4b88115540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8811c330 con 0x7f4b88115090 2023-10-08T13:17:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88119610 con 0x7f4b881083a0 2023-10-08T13:17:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.809+0000 7f4b8d168700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881197d0 con 0x7f4b881077f0 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.810+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 0x7f4b88115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.810+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 0x7f4b88115540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38054/0 (socket says 172.21.15.5:38054) 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.810+0000 7f4b8759e700 1 -- 172.21.15.5:0/1664865777 learned_addr learned my addr 172.21.15.5:0/1664865777 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.810+0000 7f4b8659c700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b881083a0 0x7f4b88114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.811+0000 7f4b8759e700 1 -- 172.21.15.5:0/1664865777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881077f0 msgr2=0x7f4b8811ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.811+0000 7f4b8759e700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881077f0 0x7f4b8811ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.811+0000 7f4b8759e700 1 -- 172.21.15.5:0/1664865777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b881083a0 msgr2=0x7f4b88114b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.811+0000 7f4b8759e700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b881083a0 0x7f4b88114b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.811+0000 7f4b8759e700 1 -- 172.21.15.5:0/1664865777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0095f0 con 0x7f4b88115090 2023-10-08T13:17:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.811+0000 7f4b8759e700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 0x7f4b88115540 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c003b60 tx=0x7f4b7c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:50.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.821+0000 7f4b6ffff700 1 -- 172.21.15.5:0/1664865777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c01d070 con 0x7f4b88115090 2023-10-08T13:17:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.821+0000 7f4b6ffff700 1 -- 172.21.15.5:0/1664865777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b7c005580 con 0x7f4b88115090 2023-10-08T13:17:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.821+0000 7f4b6ffff700 1 -- 172.21.15.5:0/1664865777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00fea0 con 0x7f4b88115090 2023-10-08T13:17:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.824+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b88119a50 con 0x7f4b88115090 2023-10-08T13:17:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.824+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b88119eb0 con 0x7f4b88115090 2023-10-08T13:17:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.830+0000 7f4b99351b80 1 Processor -- start 2023-10-08T13:17:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.838+0000 7f4b6ffff700 1 -- 172.21.15.5:0/1664865777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4b7c00f460 con 0x7f4b88115090 2023-10-08T13:17:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.838+0000 7f4b6ffff700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b700a1800 0x7f4b700a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.839+0000 7f4b6ffff700 1 -- 172.21.15.5:0/1664865777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4b7c0ce560 con 0x7f4b88115090 2023-10-08T13:17:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.839+0000 7f4b8659c700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b700a1800 0x7f4b700a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.840+0000 7f4b8659c700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b700a1800 0x7f4b700a3cc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4b88116280 tx=0x7f4b80007240 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 -- start start 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882ce80 0x55b0b882d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 0x55b0b8838110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b8796460 con 0x55b0b882d7a0 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b8787c20 con 0x55b0b882ce80 2023-10-08T13:17:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.841+0000 7f4b99351b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b8785540 con 0x55b0b8838650 2023-10-08T13:17:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.845+0000 7f4b8659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 0x55b0b8838110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.845+0000 7f4b8659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 0x55b0b8838110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38058/0 (socket says 172.21.15.5:38058) 2023-10-08T13:17:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.845+0000 7f4b8659c700 1 -- 172.21.15.5:0/2487131051 learned_addr learned my addr 172.21.15.5:0/2487131051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.852+0000 7f4b8759e700 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.852+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882ce80 0x55b0b882d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.861+0000 7f4b8659c700 1 -- 172.21.15.5:0/2487131051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 msgr2=0x55b0b883aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.861+0000 7f4b8659c700 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.861+0000 7f4b8659c700 1 -- 172.21.15.5:0/2487131051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882ce80 msgr2=0x55b0b882d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.861+0000 7f4b8659c700 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882ce80 0x55b0b882d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.861+0000 7f4b8659c700 1 -- 172.21.15.5:0/2487131051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0b85abde0 con 0x55b0b882d7a0 2023-10-08T13:17:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.883+0000 7f4b8659c700 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 0x55b0b8838110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000cba0 tx=0x7f4b8000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83afedb49780664c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.894+0000 7f4b6d7fa700 1 -- 172.21.15.5:0/2487131051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80003cc0 con 0x55b0b882d7a0 2023-10-08T13:17:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.894+0000 7f4b6d7fa700 1 -- 172.21.15.5:0/2487131051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b80003e20 con 0x55b0b882d7a0 2023-10-08T13:17:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.894+0000 7f4b6d7fa700 1 -- 172.21.15.5:0/2487131051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80004810 con 0x55b0b882d7a0 2023-10-08T13:17:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.895+0000 7f4b99351b80 1 -- 172.21.15.5:0/2487131051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 msgr2=0x55b0b8838110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.895+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 0x55b0b8838110 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000cba0 tx=0x7f4b8000f000 comp rx=0 tx=0).stop 2023-10-08T13:17:50.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.900+0000 7f4b99351b80 1 -- 172.21.15.5:0/2487131051 shutdown_connections 2023-10-08T13:17:50.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.900+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.900+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882ce80 0x55b0b882d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.900+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2487131051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882d7a0 0x55b0b8838110 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.900+0000 7f4b99351b80 1 -- 172.21.15.5:0/2487131051 >> 172.21.15.5:0/2487131051 conn(0x55b0b87a2260 msgr2=0x55b0b88292d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.915+0000 7f4b99351b80 1 -- 172.21.15.5:0/2487131051 shutdown_connections 2023-10-08T13:17:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.920+0000 7f4b99351b80 1 -- 172.21.15.5:0/2487131051 wait complete. 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.920+0000 7f4b99351b80 1 -- start start 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.920+0000 7f4b99351b80 1 Processor -- start 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b8838060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b8835350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 0x55b0b88359f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b8780e30 con 0x55b0b8838650 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b871d710 con 0x55b0b882d7a0 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b871d3b0 con 0x55b0b882ce80 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.921+0000 7f4b99351b80 10 client.0 _ll_register_callbacks cb 0x55b0b857a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b8838060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b8838060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51268/0 (socket says 172.21.15.5:51268) 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 -- 172.21.15.5:0/1427118068 learned_addr learned my addr 172.21.15.5:0/1427118068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 -- 172.21.15.5:0/1427118068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 msgr2=0x55b0b8835350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b8835350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 -- 172.21.15.5:0/1427118068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 msgr2=0x55b0b88359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 0x55b0b88359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 -- 172.21.15.5:0/1427118068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8000c8e0 con 0x55b0b882ce80 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b8838060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d190 tx=0x7f4b7800d550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0a0e4f9e3b1e73a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.922+0000 7f4b6aff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:17:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.924+0000 7f4b6aff5700 1 -- 172.21.15.5:0/1427118068 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800de90 con 0x55b0b882ce80 2023-10-08T13:17:50.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.924+0000 7f4b6aff5700 1 -- 172.21.15.5:0/1427118068 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4b78012420 con 0x55b0b882ce80 2023-10-08T13:17:50.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.924+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0b8748eb0 con 0x55b0b882ce80 2023-10-08T13:17:50.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.935+0000 7f4b6aff5700 1 -- 172.21.15.5:0/1427118068 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b780125e0 con 0x55b0b882ce80 2023-10-08T13:17:50.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.942+0000 7f4b99351b80 10 client.26542 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:50.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.942+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55b0b8594c60 con 0x55b0b882ce80 2023-10-08T13:17:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.957+0000 7f4b6aff5700 1 -- 172.21.15.5:0/1427118068 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0b8748eb0 con 0x55b0b882ce80 2023-10-08T13:17:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.957+0000 7f4b6aff5700 1 -- 172.21.15.5:0/1427118068 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4b78014a00 con 0x55b0b882ce80 2023-10-08T13:17:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b99351b80 10 client.26542 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b99351b80 10 client.26542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b99351b80 20 client.26542 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b99351b80 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b88482b0 0x55b0b884a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b99351b80 4 client.26542 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0b8779e10 con 0x55b0b88482b0 2023-10-08T13:17:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.959+0000 7f4b8659c700 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b88482b0 0x55b0b884a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.969+0000 7f4b6aff5700 10 client.26542 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.969+0000 7f4b8659c700 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b88482b0 0x55b0b884a6d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e10a971b7b0bfd server_cookie=f8887ca42f40061f in_seq=0 out_seq=0 2023-10-08T13:17:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.970+0000 7f4b6aff5700 1 -- 172.21.15.5:0/1427118068 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0b8779e10 con 0x55b0b88482b0 2023-10-08T13:17:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.970+0000 7f4b6aff5700 10 client.26542 handle_command_reply: tid=0 2023-10-08T13:17:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.972+0000 7f4b99351b80 1 client.26542 shutdown 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 msgr2=0x55b0b8838060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b8838060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800d190 tx=0x7f4b7800d550 comp rx=0 tx=0).stop 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 shutdown_connections 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 0x55b0b88359f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b8838060 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b88482b0 0x55b0b884a6d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 --2- 172.21.15.5:0/1427118068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b8835350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b6aff5700 0 client.26542 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 >> 172.21.15.5:0/1427118068 conn(0x55b0b87a2260 msgr2=0x55b0b8828ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 shutdown_connections 2023-10-08T13:17:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 1 -- 172.21.15.5:0/1427118068 wait complete. 2023-10-08T13:17:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:50.976+0000 7f4b99351b80 20 client.26542 trim_cache size 0 max 16384 2023-10-08T13:17:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.002+0000 7f4b99351b80 1 Processor -- start 2023-10-08T13:17:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 -- start start 2023-10-08T13:17:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b884a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b8833c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 0x55b0b8834160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b8601920 con 0x55b0b8838650 2023-10-08T13:17:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b88346a0 con 0x55b0b882d7a0 2023-10-08T13:17:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b99351b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b8823570 con 0x55b0b882ce80 2023-10-08T13:17:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b884a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b884a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51276/0 (socket says 172.21.15.5:51276) 2023-10-08T13:17:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 -- 172.21.15.5:0/2678800118 learned_addr learned my addr 172.21.15.5:0/2678800118 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 -- 172.21.15.5:0/2678800118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 msgr2=0x55b0b8833c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b8833c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 -- 172.21.15.5:0/2678800118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 msgr2=0x55b0b8834160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 0x55b0b8834160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.003+0000 7f4b86d9d700 1 -- 172.21.15.5:0/2678800118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0b85d2250 con 0x55b0b882ce80 2023-10-08T13:17:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.004+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b884a6a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006d60 tx=0x7f4b78004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5618f827aa69e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.009+0000 7f4b6dffb700 1 -- 172.21.15.5:0/2678800118 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800a070 con 0x55b0b882ce80 2023-10-08T13:17:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.009+0000 7f4b6dffb700 1 -- 172.21.15.5:0/2678800118 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b78013450 con 0x55b0b882ce80 2023-10-08T13:17:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.009+0000 7f4b6dffb700 1 -- 172.21.15.5:0/2678800118 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78013cd0 con 0x55b0b882ce80 2023-10-08T13:17:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.010+0000 7f4b99351b80 1 -- 172.21.15.5:0/2678800118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 msgr2=0x55b0b884a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.010+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b884a6a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006d60 tx=0x7f4b78004740 comp rx=0 tx=0).stop 2023-10-08T13:17:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.019+0000 7f4b99351b80 1 -- 172.21.15.5:0/2678800118 shutdown_connections 2023-10-08T13:17:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.019+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b8838650 0x55b0b8834160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.019+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b882ce80 0x55b0b884a6a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.019+0000 7f4b99351b80 1 --2- 172.21.15.5:0/2678800118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b8833c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.019+0000 7f4b99351b80 1 -- 172.21.15.5:0/2678800118 >> 172.21.15.5:0/2678800118 conn(0x55b0b87a2260 msgr2=0x55b0b8830650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.024+0000 7f4b99351b80 1 -- 172.21.15.5:0/2678800118 shutdown_connections 2023-10-08T13:17:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.024+0000 7f4b99351b80 1 -- 172.21.15.5:0/2678800118 wait complete. 2023-10-08T13:17:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.024+0000 7f4b99351b80 1 -- start start 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.024+0000 7f4b99351b80 1 Processor -- start 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882ce80 0x55b0b883eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b883d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b883f7d0 con 0x55b0b882ce80 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b883de80 con 0x55b0b882d7a0 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b883e040 con 0x55b0b8838650 2023-10-08T13:17:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.033+0000 7f4b99351b80 10 client.0 _ll_register_callbacks cb 0x7f4b7800b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.038+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.038+0000 7f4b8759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51280/0 (socket says 172.21.15.5:51280) 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.038+0000 7f4b8759e700 1 -- 172.21.15.5:0/3605643338 learned_addr learned my addr 172.21.15.5:0/3605643338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.039+0000 7f4b8759e700 1 -- 172.21.15.5:0/3605643338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 msgr2=0x55b0b883d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.039+0000 7f4b8759e700 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b883d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.039+0000 7f4b8759e700 1 -- 172.21.15.5:0/3605643338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882ce80 msgr2=0x55b0b883eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.039+0000 7f4b8759e700 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882ce80 0x55b0b883eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.039+0000 7f4b8759e700 1 -- 172.21.15.5:0/3605643338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0b8594c60 con 0x55b0b8838650 2023-10-08T13:17:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.040+0000 7f4b8759e700 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883d940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c09aee0 tx=0x7f4b7c09ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3925f860f3142cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.044+0000 7f4b6aff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:17:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.044+0000 7f4b6aff5700 1 -- 172.21.15.5:0/3605643338 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c09f170 con 0x55b0b8838650 2023-10-08T13:17:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.044+0000 7f4b6aff5700 1 -- 172.21.15.5:0/3605643338 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f4b7c029540 con 0x55b0b8838650 2023-10-08T13:17:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.044+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b80003e20 con 0x55b0b8838650 2023-10-08T13:17:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.057+0000 7f4b6aff5700 1 -- 172.21.15.5:0/3605643338 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7c09b1e0 con 0x55b0b8838650 2023-10-08T13:17:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.069+0000 7f4b99351b80 10 client.26548 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.069+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55b0b85aa2b0 con 0x55b0b8838650 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.071+0000 7f4b6aff5700 1 -- 172.21.15.5:0/3605643338 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b80003e20 con 0x55b0b8838650 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b6aff5700 1 -- 172.21.15.5:0/3605643338 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4b7c09b440 con 0x55b0b8838650 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b99351b80 10 client.26548 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b99351b80 10 client.26548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b99351b80 20 client.26548 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b99351b80 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b889d170 0x55b0b889f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b99351b80 4 client.26548 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:17:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b0b8779b30 con 0x55b0b889d170 2023-10-08T13:17:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.072+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b889d170 0x55b0b889f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.079+0000 7f4b86d9d700 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b889d170 0x55b0b889f590 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdce81e38a53026 server_cookie=b8c4e45429c408a5 in_seq=0 out_seq=0 2023-10-08T13:17:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.079+0000 7f4b6aff5700 10 client.26548 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.079+0000 7f4b6aff5700 1 -- 172.21.15.5:0/3605643338 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b0b8779b30 con 0x55b0b889d170 2023-10-08T13:17:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.079+0000 7f4b6aff5700 10 client.26548 handle_command_reply: tid=0 2023-10-08T13:17:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.079+0000 7f4b99351b80 1 client.26548 shutdown 2023-10-08T13:17:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.084+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 msgr2=0x55b0b883d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.084+0000 7f4b99351b80 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883d940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c09aee0 tx=0x7f4b7c09ab40 comp rx=0 tx=0).stop 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 shutdown_connections 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b99351b80 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b0b8838650 0x55b0b883d940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b99351b80 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b0b882ce80 0x55b0b883eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b99351b80 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b0b889d170 0x55b0b889f590 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b99351b80 1 --2- 172.21.15.5:0/3605643338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0b882d7a0 0x55b0b883d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b6aff5700 0 client.26548 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.085+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 >> 172.21.15.5:0/3605643338 conn(0x55b0b87a2260 msgr2=0x55b0b8833b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.093+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 shutdown_connections 2023-10-08T13:17:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.093+0000 7f4b99351b80 1 -- 172.21.15.5:0/3605643338 wait complete. 2023-10-08T13:17:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.094+0000 7f4b99351b80 20 client.26548 trim_cache size 0 max 16384 2023-10-08T13:17:51.095 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:17:51.095 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:17:51.095 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:17:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.095+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b700a1800 msgr2=0x7f4b700a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.095+0000 7f4b8d168700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b700a1800 0x7f4b700a3cc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4b88116280 tx=0x7f4b80007240 comp rx=0 tx=0).stop 2023-10-08T13:17:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.095+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 msgr2=0x7f4b88115540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.095+0000 7f4b8d168700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 0x7f4b88115540 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c003b60 tx=0x7f4b7c003c40 comp rx=0 tx=0).stop 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 shutdown_connections 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f4b700a1800 0x7f4b700a3cc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b88115090 0x7f4b88115540 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4b881077f0 0x7f4b8811ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 --2- 172.21.15.5:0/1664865777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b881083a0 0x7f4b88114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 >> 172.21.15.5:0/1664865777 conn(0x7f4b8806b770 msgr2=0x7f4b8806f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 shutdown_connections 2023-10-08T13:17:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:17:51.098+0000 7f4b8d168700 1 -- 172.21.15.5:0/1664865777 wait complete. 2023-10-08T13:17:51.118 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:17:51.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:50 smithi060 ceph-mon[103190]: pgmap v665: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 MiB/s wr, 479 op/s 2023-10-08T13:17:51.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:51.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:50 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:51.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:50 smithi118 ceph-mon[104234]: pgmap v665: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 MiB/s wr, 479 op/s 2023-10-08T13:17:51.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:51.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:50 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 690.0 s, 497.5 tps, lat 203.320 ms stddev 255.944 2023-10-08T13:17:52.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:51 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:17:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:51 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:17:52.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:51 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:52.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:51 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:17:52.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:51 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:17:52.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:51 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:52.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:51 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:17:52.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:51 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:17:52.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:51 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:17:53.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:53 smithi060 ceph-mon[103190]: pgmap v666: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.2 MiB/s wr, 493 op/s 2023-10-08T13:17:53.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:53 smithi005 ceph-mon[99496]: pgmap v666: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.2 MiB/s wr, 493 op/s 2023-10-08T13:17:53.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:53 smithi118 ceph-mon[104234]: pgmap v666: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.2 MiB/s wr, 493 op/s 2023-10-08T13:17:55.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:55 smithi005 ceph-mon[99496]: pgmap v667: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.0 MiB/s wr, 465 op/s 2023-10-08T13:17:55.529 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:55 smithi118 ceph-mon[104234]: pgmap v667: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.0 MiB/s wr, 465 op/s 2023-10-08T13:17:55.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:55 smithi060 ceph-mon[103190]: pgmap v667: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.0 MiB/s wr, 465 op/s 2023-10-08T13:17:56.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 695.0 s, 518.1 tps, lat 191.101 ms stddev 203.984 2023-10-08T13:17:57.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:56 smithi060 ceph-mon[103190]: pgmap v668: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 524 op/s 2023-10-08T13:17:57.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:56 smithi005 ceph-mon[99496]: pgmap v668: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 524 op/s 2023-10-08T13:17:57.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:56 smithi118 ceph-mon[104234]: pgmap v668: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 524 op/s 2023-10-08T13:17:59.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:17:58 smithi060 ceph-mon[103190]: pgmap v669: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 426 op/s 2023-10-08T13:17:59.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:17:58 smithi005 ceph-mon[99496]: pgmap v669: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 426 op/s 2023-10-08T13:17:59.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:17:58 smithi118 ceph-mon[104234]: pgmap v669: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 426 op/s 2023-10-08T13:17:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.354+0000 7f269844f700 1 -- 172.21.15.5:0/644505292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010f310 msgr2=0x7f2690107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.354+0000 7f269844f700 1 --2- 172.21.15.5:0/644505292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010f310 0x7f2690107d30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f268c0099c0 tx=0x7f268c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.356+0000 7f269844f700 1 -- 172.21.15.5:0/644505292 shutdown_connections 2023-10-08T13:17:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.356+0000 7f269844f700 1 --2- 172.21.15.5:0/644505292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690119fd0 0x7f269011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.356+0000 7f269844f700 1 --2- 172.21.15.5:0/644505292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f269010eea0 0x7f26901077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.356+0000 7f269844f700 1 --2- 172.21.15.5:0/644505292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010f310 0x7f2690107d30 secure :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f268c0099c0 tx=0x7f268c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.356+0000 7f269844f700 1 -- 172.21.15.5:0/644505292 >> 172.21.15.5:0/644505292 conn(0x7f269006b7c0 msgr2=0x7f269006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.369+0000 7f269844f700 1 -- 172.21.15.5:0/644505292 shutdown_connections 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.378+0000 7f269844f700 1 -- 172.21.15.5:0/644505292 wait complete. 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 Processor -- start 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 -- start start 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010eea0 0x7f2690118570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690119fd0 0x7f2690111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2690111b80 0x7f2690112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2690118e20 con 0x7f269010eea0 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2690116100 con 0x7f2690119fd0 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.379+0000 7f269844f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26901162c0 con 0x7f2690111b80 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.380+0000 7f26961eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010eea0 0x7f2690118570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.380+0000 7f26961eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010eea0 0x7f2690118570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38090/0 (socket says 172.21.15.5:38090) 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.380+0000 7f26961eb700 1 -- 172.21.15.5:0/3283130382 learned_addr learned my addr 172.21.15.5:0/3283130382 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.382+0000 7f26969ec700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2690111b80 0x7f2690112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26959ea700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690119fd0 0x7f2690111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26969ec700 1 -- 172.21.15.5:0/3283130382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690119fd0 msgr2=0x7f2690111640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26969ec700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690119fd0 0x7f2690111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26969ec700 1 -- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010eea0 msgr2=0x7f2690118570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26969ec700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010eea0 0x7f2690118570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26969ec700 1 -- 172.21.15.5:0/3283130382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0095f0 con 0x7f2690111b80 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.386+0000 7f26969ec700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2690111b80 0x7f2690112030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f268800bb00 tx=0x7f268800bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.387+0000 7f26877fe700 1 -- 172.21.15.5:0/3283130382 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800cae0 con 0x7f2690111b80 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.387+0000 7f26877fe700 1 -- 172.21.15.5:0/3283130382 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f268800cc40 con 0x7f2690111b80 2023-10-08T13:17:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.387+0000 7f26877fe700 1 -- 172.21.15.5:0/3283130382 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26880125a0 con 0x7f2690111b80 2023-10-08T13:17:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.390+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26901165a0 con 0x7f2690111b80 2023-10-08T13:17:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.390+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2690116a30 con 0x7f2690111b80 2023-10-08T13:17:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.393+0000 7f26877fe700 1 -- 172.21.15.5:0/3283130382 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2688014440 con 0x7f2690111b80 2023-10-08T13:17:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.394+0000 7f26877fe700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f267c0a17f0 0x7f267c0a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.394+0000 7f26877fe700 1 -- 172.21.15.5:0/3283130382 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f26880cc770 con 0x7f2690111b80 2023-10-08T13:17:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.396+0000 7f26961eb700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f267c0a17f0 0x7f267c0a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.397+0000 7f26961eb700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f267c0a17f0 0x7f267c0a3cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2680005fd0 tx=0x7f2680005e70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 Processor -- start 2023-10-08T13:17:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 -- start start 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b5880 0x5581694b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 0x5581694afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b00b0 0x5581694b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558169418400 con 0x5581694b61a0 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x558169409bc0 con 0x5581694b00b0 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26a4638b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581694074e0 con 0x5581694b5880 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26959ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 0x5581694afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26959ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 0x5581694afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38100/0 (socket says 172.21.15.5:38100) 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26959ea700 1 -- 172.21.15.5:0/3067529951 learned_addr learned my addr 172.21.15.5:0/3067529951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.405+0000 7f26961eb700 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b5880 0x5581694b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.406+0000 7f26959ea700 1 -- 172.21.15.5:0/3067529951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b5880 msgr2=0x5581694b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.406+0000 7f26959ea700 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b5880 0x5581694b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.406+0000 7f26959ea700 1 -- 172.21.15.5:0/3067529951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b00b0 msgr2=0x5581694b0510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:17:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.406+0000 7f26959ea700 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b00b0 0x5581694b0510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.406+0000 7f26959ea700 1 -- 172.21.15.5:0/3067529951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816922dd80 con 0x5581694b61a0 2023-10-08T13:17:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.406+0000 7f26959ea700 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 0x5581694afb70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b580 tx=0x7f268c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555cc266a44c0349 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.411+0000 7f2684d82700 1 -- 172.21.15.5:0/3067529951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c01e070 con 0x5581694b61a0 2023-10-08T13:17:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.411+0000 7f2684d82700 1 -- 172.21.15.5:0/3067529951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f268c005500 con 0x5581694b61a0 2023-10-08T13:17:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.411+0000 7f2684d82700 1 -- 172.21.15.5:0/3067529951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0038f0 con 0x5581694b61a0 2023-10-08T13:17:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.412+0000 7f26a4638b80 1 -- 172.21.15.5:0/3067529951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 msgr2=0x5581694afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.412+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 0x5581694afb70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b580 tx=0x7f268c003680 comp rx=0 tx=0).stop 2023-10-08T13:17:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.413+0000 7f26a4638b80 1 -- 172.21.15.5:0/3067529951 shutdown_connections 2023-10-08T13:17:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.413+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b00b0 0x5581694b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.413+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b5880 0x5581694b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.413+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3067529951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694b61a0 0x5581694afb70 secure :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b580 tx=0x7f268c003680 comp rx=0 tx=0).stop 2023-10-08T13:17:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.413+0000 7f26a4638b80 1 -- 172.21.15.5:0/3067529951 >> 172.21.15.5:0/3067529951 conn(0x558169424200 msgr2=0x5581694aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.425+0000 7f26a4638b80 1 -- 172.21.15.5:0/3067529951 shutdown_connections 2023-10-08T13:17:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.429+0000 7f26a4638b80 1 -- 172.21.15.5:0/3067529951 wait complete. 2023-10-08T13:17:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 -- start start 2023-10-08T13:17:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 Processor -- start 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558169402dd0 con 0x5581694ba210 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816939f6b0 con 0x5581694b5880 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816939f350 con 0x5581694b00b0 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.430+0000 7f26a4638b80 10 client.0 _ll_register_callbacks cb 0x5581691fc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694b9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51308/0 (socket says 172.21.15.5:51308) 2023-10-08T13:17:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 -- 172.21.15.5:0/3611741626 learned_addr learned my addr 172.21.15.5:0/3611741626 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26959ea700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26969ec700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 -- 172.21.15.5:0/3611741626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 msgr2=0x5581694b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 -- 172.21.15.5:0/3611741626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 msgr2=0x5581694c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 -- 172.21.15.5:0/3611741626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269011cbd0 con 0x5581694b00b0 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26959ea700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.431+0000 7f26961eb700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694b9790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26800109b0 tx=0x7f2680004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c045ca284aa23d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f2679ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f2679ffb700 1 -- 172.21.15.5:0/3611741626 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680004a30 con 0x5581694b00b0 2023-10-08T13:17:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f2679ffb700 1 -- 172.21.15.5:0/3611741626 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f2680004b90 con 0x5581694b00b0 2023-10-08T13:17:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581693cae50 con 0x5581694b00b0 2023-10-08T13:17:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f2679ffb700 1 -- 172.21.15.5:0/3611741626 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2680004d50 con 0x5581694b00b0 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f26a4638b80 10 client.26557 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x558169216c00 con 0x5581694b00b0 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.432+0000 7f2679ffb700 1 -- 172.21.15.5:0/3611741626 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5581693cae50 con 0x5581694b00b0 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f2679ffb700 1 -- 172.21.15.5:0/3611741626 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f268001dba0 con 0x5581694b00b0 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26a4638b80 10 client.26557 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26a4638b80 10 client.26557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26a4638b80 20 client.26557 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5581694ca290 0x5581694cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26a4638b80 4 client.26557 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:17:59.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581693fbdb0 con 0x5581694ca290 2023-10-08T13:17:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.433+0000 7f26959ea700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5581694ca290 0x5581694cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.434+0000 7f2679ffb700 10 client.26557 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.434+0000 7f26959ea700 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5581694ca290 0x5581694cc6b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d51b9064b4f35b3 server_cookie=5f31534541e00ad5 in_seq=0 out_seq=0 2023-10-08T13:17:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.436+0000 7f2679ffb700 1 -- 172.21.15.5:0/3611741626 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5581693fbdb0 con 0x5581694ca290 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.436+0000 7f2679ffb700 10 client.26557 handle_command_reply: tid=0 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.436+0000 7f26a4638b80 1 client.26557 shutdown 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.436+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 msgr2=0x5581694b9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.436+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694b9790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26800109b0 tx=0x7f2680004750 comp rx=0 tx=0).stop 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 shutdown_connections 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694b9790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5581694ca290 0x5581694cc6b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3611741626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 >> 172.21.15.5:0/3611741626 conn(0x558169424200 msgr2=0x5581694aa010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f2679ffb700 0 client.26557 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 shutdown_connections 2023-10-08T13:17:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 1 -- 172.21.15.5:0/3611741626 wait complete. 2023-10-08T13:17:59.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.437+0000 7f26a4638b80 20 client.26557 trim_cache size 0 max 16384 2023-10-08T13:17:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 Processor -- start 2023-10-08T13:17:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 -- start start 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694aa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581692838c0 con 0x5581694ba210 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581694bc330 con 0x5581694b5880 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26a4638b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581694c7940 con 0x5581694b00b0 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26969ec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26969ec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694aa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38114/0 (socket says 172.21.15.5:38114) 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26969ec700 1 -- 172.21.15.5:0/3194881339 learned_addr learned my addr 172.21.15.5:0/3194881339 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26959ea700 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.458+0000 7f26961eb700 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26969ec700 1 -- 172.21.15.5:0/3194881339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 msgr2=0x5581694afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26969ec700 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26969ec700 1 -- 172.21.15.5:0/3194881339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 msgr2=0x5581694b8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26969ec700 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26969ec700 1 -- 172.21.15.5:0/3194881339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581692541f0 con 0x5581694ba210 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26959ea700 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f26969ec700 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694aa790 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f26880c9c40 tx=0x7f2688098e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac28fe18be0c871 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f2685583700 1 -- 172.21.15.5:0/3194881339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268809d5c0 con 0x5581694ba210 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f2685583700 1 -- 172.21.15.5:0/3194881339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26880a1800 con 0x5581694ba210 2023-10-08T13:17:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.459+0000 7f2685583700 1 -- 172.21.15.5:0/3194881339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268809d3d0 con 0x5581694ba210 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 -- 172.21.15.5:0/3194881339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 msgr2=0x5581694aa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694aa790 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f26880c9c40 tx=0x7f2688098e20 comp rx=0 tx=0).stop 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 -- 172.21.15.5:0/3194881339 shutdown_connections 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694aa790 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581694afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 --2- 172.21.15.5:0/3194881339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581694b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 -- 172.21.15.5:0/3194881339 >> 172.21.15.5:0/3194881339 conn(0x558169424200 msgr2=0x5581694b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 -- 172.21.15.5:0/3194881339 shutdown_connections 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 -- 172.21.15.5:0/3194881339 wait complete. 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 -- start start 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.460+0000 7f26a4638b80 1 Processor -- start 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581695173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581695178e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581694bf1a0 con 0x5581694ba210 2023-10-08T13:17:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581694bf310 con 0x5581694b5880 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581694bf4d0 con 0x5581694b00b0 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26a4638b80 10 client.0 _ll_register_callbacks cb 0x7f268000eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694bebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38120/0 (socket says 172.21.15.5:38120) 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26961eb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581695173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 -- 172.21.15.5:0/2616355853 learned_addr learned my addr 172.21.15.5:0/2616355853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26959ea700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581695178e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 -- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 msgr2=0x5581695173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581695173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 -- 172.21.15.5:0/2616355853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 msgr2=0x5581695178e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:17:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581695178e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 -- 172.21.15.5:0/2616355853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55816922dd80 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26959ea700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581695178e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f26969ec700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694bebd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2688099400 tx=0x7f2688014c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cf6a190f413a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f2679ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.461+0000 7f2679ffb700 1 -- 172.21.15.5:0/2616355853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268809d5c0 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f268c005500 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f2679ffb700 1 -- 172.21.15.5:0/2616355853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f26880cc300 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f2679ffb700 1 -- 172.21.15.5:0/2616355853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26880cc4c0 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 10 client.17082 fetch_fsmap learned FSMap version 51 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f2690116a30 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f2679ffb700 1 -- 172.21.15.5:0/2616355853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f268c005500 con 0x5581694ba210 2023-10-08T13:17:59.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f2679ffb700 1 -- 172.21.15.5:0/2616355853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f26880a1370 con 0x5581694ba210 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 10 client.17082 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 10 client.17082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 20 client.17082 populate_metadata read hostname 'smithi005' 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55816951efc0 0x5581695213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 4 client.17082 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5581693fbad0 con 0x55816951efc0 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.462+0000 7f26961eb700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55816951efc0 0x5581695213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.463+0000 7f2679ffb700 10 client.17082 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:59.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.463+0000 7f26961eb700 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55816951efc0 0x5581695213e0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8280549764640a0d server_cookie=f4cdb91b0934200c in_seq=0 out_seq=0 2023-10-08T13:17:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.474+0000 7f2679ffb700 1 -- 172.21.15.5:0/2616355853 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5581693fbad0 con 0x55816951efc0 2023-10-08T13:17:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.474+0000 7f2679ffb700 10 client.17082 handle_command_reply: tid=0 2023-10-08T13:17:59.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 client.17082 shutdown 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 msgr2=0x5581694bebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694bebd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2688099400 tx=0x7f2688014c70 comp rx=0 tx=0).stop 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 shutdown_connections 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5581694ba210 0x5581694bebd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581694b00b0 0x5581695173a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55816951efc0 0x5581695213e0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 --2- 172.21.15.5:0/2616355853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5581694b5880 0x5581695178e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f2679ffb700 0 client.17082 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 >> 172.21.15.5:0/2616355853 conn(0x558169424200 msgr2=0x5581694c5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:59.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 shutdown_connections 2023-10-08T13:17:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 1 -- 172.21.15.5:0/2616355853 wait complete. 2023-10-08T13:17:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.475+0000 7f26a4638b80 20 client.17082 trim_cache size 0 max 16384 2023-10-08T13:17:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:17:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:17:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:17:59.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:17:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f267c0a17f0 msgr2=0x7f267c0a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f267c0a17f0 0x7f267c0a3cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2680005fd0 tx=0x7f2680005e70 comp rx=0 tx=0).stop 2023-10-08T13:17:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2690111b80 msgr2=0x7f2690112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:17:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2690111b80 0x7f2690112030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f268800bb00 tx=0x7f268800bec0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 shutdown_connections 2023-10-08T13:17:59.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f267c0a17f0 0x7f267c0a3cb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2690111b80 0x7f2690112030 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f269010eea0 0x7f2690118570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 --2- 172.21.15.5:0/3283130382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690119fd0 0x7f2690111640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:17:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 >> 172.21.15.5:0/3283130382 conn(0x7f269006b7c0 msgr2=0x7f269006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:17:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 shutdown_connections 2023-10-08T13:17:59.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:17:59.476+0000 7f269844f700 1 -- 172.21.15.5:0/3283130382 wait complete. 2023-10-08T13:18:01.164 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:00 smithi060 ceph-mon[103190]: pgmap v670: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 508 op/s 2023-10-08T13:18:01.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:00 smithi005 ceph-mon[99496]: pgmap v670: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 508 op/s 2023-10-08T13:18:01.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:00 smithi118 ceph-mon[104234]: pgmap v670: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 508 op/s 2023-10-08T13:18:01.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 700.0 s, 497.7 tps, lat 204.058 ms stddev 233.199 2023-10-08T13:18:03.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:02 smithi060 ceph-mon[103190]: pgmap v671: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.2 MiB/s wr, 508 op/s 2023-10-08T13:18:03.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:02 smithi005 ceph-mon[99496]: pgmap v671: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.2 MiB/s wr, 508 op/s 2023-10-08T13:18:03.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:02 smithi118 ceph-mon[104234]: pgmap v671: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.2 MiB/s wr, 508 op/s 2023-10-08T13:18:05.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:04 smithi005 ceph-mon[99496]: pgmap v672: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.9 MiB/s wr, 472 op/s 2023-10-08T13:18:05.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:04 smithi118 ceph-mon[104234]: pgmap v672: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.9 MiB/s wr, 472 op/s 2023-10-08T13:18:05.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:04 smithi060 ceph-mon[103190]: pgmap v672: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.9 MiB/s wr, 472 op/s 2023-10-08T13:18:06.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:05 smithi118 ceph-mon[104234]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T13:18:06.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:05 smithi060 ceph-mon[103190]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T13:18:06.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:05 smithi005 ceph-mon[99496]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T13:18:06.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 705.0 s, 380.6 tps, lat 253.203 ms stddev 296.523 2023-10-08T13:18:07.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:06 smithi118 ceph-mon[104234]: pgmap v674: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.8 MiB/s wr, 500 op/s 2023-10-08T13:18:07.414 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:06 smithi060 ceph-mon[103190]: pgmap v674: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.8 MiB/s wr, 500 op/s 2023-10-08T13:18:07.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:06 smithi005 ceph-mon[99496]: pgmap v674: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.8 MiB/s wr, 500 op/s 2023-10-08T13:18:09.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:08 smithi118 ceph-mon[104234]: pgmap v675: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.7 MiB/s wr, 494 op/s 2023-10-08T13:18:09.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:08 smithi060 ceph-mon[103190]: pgmap v675: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.7 MiB/s wr, 494 op/s 2023-10-08T13:18:09.429 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:08 smithi005 ceph-mon[99496]: pgmap v675: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.7 MiB/s wr, 494 op/s 2023-10-08T13:18:11.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:10 smithi118 ceph-mon[104234]: pgmap v676: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 465 op/s 2023-10-08T13:18:11.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:10 smithi060 ceph-mon[103190]: pgmap v676: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 465 op/s 2023-10-08T13:18:11.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:10 smithi005 ceph-mon[99496]: pgmap v676: 129 pgs: 5 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 103 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 465 op/s 2023-10-08T13:18:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 710.0 s, 490.2 tps, lat 201.621 ms stddev 252.722 2023-10-08T13:18:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 -- 172.21.15.5:0/4022672664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8108110 msgr2=0x7f9cf8113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/4022672664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8108110 0x7f9cf8113400 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009990 tx=0x7f9ce8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 -- 172.21.15.5:0/4022672664 shutdown_connections 2023-10-08T13:18:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/4022672664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf8113940 0x7f9cf8115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/4022672664 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf81077f0 0x7f9cf8107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/4022672664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8108110 0x7f9cf8113400 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 -- 172.21.15.5:0/4022672664 >> 172.21.15.5:0/4022672664 conn(0x7f9cf806b7c0 msgr2=0x7f9cf806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 -- 172.21.15.5:0/4022672664 shutdown_connections 2023-10-08T13:18:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.673+0000 7f9cfe07f700 1 -- 172.21.15.5:0/4022672664 wait complete. 2023-10-08T13:18:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.674+0000 7f9cfe07f700 1 Processor -- start 2023-10-08T13:18:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.674+0000 7f9cfe07f700 1 -- start start 2023-10-08T13:18:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cfe07f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 0x7f9cf81a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cfe07f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8108110 0x7f9cf81a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cfe07f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8113940 0x7f9cf81a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cfe07f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81a6460 con 0x7f9cf8113940 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cfe07f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81a65d0 con 0x7f9cf81077f0 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cfe07f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81a6790 con 0x7f9cf8108110 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 0x7f9cf81a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8113940 0x7f9cf81a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 0x7f9cf81a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33080/0 (socket says 172.21.15.5:33080) 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2904024136 learned_addr learned my addr 172.21.15.5:0/2904024136 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8108110 0x7f9cf81a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2904024136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8108110 msgr2=0x7f9cf81a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8108110 0x7f9cf81a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8113940 msgr2=0x7f9cf81a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8113940 0x7f9cf81a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2904024136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80095f0 con 0x7f9cf81077f0 2023-10-08T13:18:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.675+0000 7f9cf7fff700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8113940 0x7f9cf81a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:18:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.676+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 0x7f9cf81a1540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00d950 tx=0x7f9cec00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.676+0000 7f9cf4ff9700 1 -- 172.21.15.5:0/2904024136 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00f890 con 0x7f9cf81077f0 2023-10-08T13:18:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.676+0000 7f9cf4ff9700 1 -- 172.21.15.5:0/2904024136 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cec010460 con 0x7f9cf81077f0 2023-10-08T13:18:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.676+0000 7f9cf4ff9700 1 -- 172.21.15.5:0/2904024136 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00e610 con 0x7f9cf81077f0 2023-10-08T13:18:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.676+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf81a6a70 con 0x7f9cf81077f0 2023-10-08T13:18:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.676+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf81ae2b0 con 0x7f9cf81077f0 2023-10-08T13:18:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.678+0000 7f9cf4ff9700 1 -- 172.21.15.5:0/2904024136 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f9cec0108d0 con 0x7f9cf81077f0 2023-10-08T13:18:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.679+0000 7f9cf4ff9700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9ce00a15e0 0x7f9ce00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf4ff9700 1 -- 172.21.15.5:0/2904024136 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f9cec0cd2e0 con 0x7f9cf81077f0 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9ce00a15e0 0x7f9ce00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 Processor -- start 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 -- start start 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f028c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0291a0 0x55896f022b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0230b0 0x55896f023510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ef8b400 con 0x55896f0291a0 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ef7cbc0 con 0x55896f0230b0 2023-10-08T13:18:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ef7a4e0 con 0x55896f028880 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f028c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f028c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51342/0 (socket says 172.21.15.5:51342) 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf77fe700 1 -- 172.21.15.5:0/3587556224 learned_addr learned my addr 172.21.15.5:0/3587556224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9ce00a15e0 0x7f9ce00a3aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9cf81a2a90 tx=0x7f9ce8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf7fff700 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0230b0 0x55896f023510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0291a0 0x55896f022b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.680+0000 7f9cf77fe700 1 -- 172.21.15.5:0/3587556224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0230b0 msgr2=0x55896f023510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0230b0 0x55896f023510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cf77fe700 1 -- 172.21.15.5:0/3587556224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0291a0 msgr2=0x55896f022b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0291a0 0x55896f022b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cf77fe700 1 -- 172.21.15.5:0/3587556224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55896eda0d80 con 0x55896f028880 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0291a0 0x55896f022b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f028c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0a1d30 tx=0x7f9cec09a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f690c423da3aed75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cddffb700 1 -- 172.21.15.5:0/3587556224 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0cd170 con 0x55896f028880 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cddffb700 1 -- 172.21.15.5:0/3587556224 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cec09e020 con 0x55896f028880 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.681+0000 7f9cddffb700 1 -- 172.21.15.5:0/3587556224 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec099620 con 0x55896f028880 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 -- 172.21.15.5:0/3587556224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 msgr2=0x55896f028c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f028c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0a1d30 tx=0x7f9cec09a650 comp rx=0 tx=0).stop 2023-10-08T13:18:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 -- 172.21.15.5:0/3587556224 shutdown_connections 2023-10-08T13:18:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0230b0 0x55896f023510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f028c60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/3587556224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0291a0 0x55896f022b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.682+0000 7f9d0a268b80 1 -- 172.21.15.5:0/3587556224 >> 172.21.15.5:0/3587556224 conn(0x55896ef97200 msgr2=0x55896f01db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.684+0000 7f9d0a268b80 1 -- 172.21.15.5:0/3587556224 shutdown_connections 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.684+0000 7f9d0a268b80 1 -- 172.21.15.5:0/3587556224 wait complete. 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 -- start start 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 Processor -- start 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f02c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f02cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0291a0 0x55896f02d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ef75dd0 con 0x55896f0230b0 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ef126b0 con 0x55896f0291a0 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896ef12350 con 0x55896f028880 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.685+0000 7f9d0a268b80 10 client.0 _ll_register_callbacks cb 0x55896ed6f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f02c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0291a0 0x55896f02d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f02c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38144/0 (socket says 172.21.15.5:38144) 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf77fe700 1 -- 172.21.15.5:0/1038252988 learned_addr learned my addr 172.21.15.5:0/1038252988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f02cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 -- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 msgr2=0x55896f02cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f02cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 -- 172.21.15.5:0/1038252988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 msgr2=0x55896f02c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f02c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 -- 172.21.15.5:0/1038252988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf81ae2b0 con 0x55896f0291a0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cf7fff700 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0291a0 0x55896f02d020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004630 tx=0x7f9cf0004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a7dbba91f6068bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/1038252988 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0004db0 con 0x55896f0291a0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55896ef3de50 con 0x55896f0291a0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.686+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/1038252988 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f9cf0007710 con 0x55896f0291a0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/1038252988 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cf0020940 con 0x55896f0291a0 2023-10-08T13:18:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 10 client.26489 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55896ed89c00 con 0x55896f0291a0 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/1038252988 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55896ef3de50 con 0x55896f0291a0 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/1038252988 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9cf00201a0 con 0x55896f0291a0 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 10 client.26489 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 10 client.26489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 20 client.26489 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f045480 0x55896f0478a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 4 client.26489 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.687+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55896ef6edb0 con 0x55896f045480 2023-10-08T13:18:12.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.688+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f045480 0x55896f0478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.688+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f045480 0x55896f0478a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11a768e5c5131d4 server_cookie=166b00533c192b49 in_seq=0 out_seq=0 2023-10-08T13:18:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.688+0000 7f9cd6ffd700 10 client.26489 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/1038252988 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55896ef6edb0 con 0x55896f045480 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9cd6ffd700 10 client.26489 handle_command_reply: tid=0 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 client.26489 shutdown 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0291a0 msgr2=0x55896f02d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0291a0 0x55896f02d020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0004630 tx=0x7f9cf0004660 comp rx=0 tx=0).stop 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 shutdown_connections 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f045480 0x55896f0478a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f0291a0 0x55896f02d020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f02c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9cd6ffd700 0 client.26489 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1038252988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f02cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.689+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 >> 172.21.15.5:0/1038252988 conn(0x55896ef97200 msgr2=0x55896f01d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.690+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 shutdown_connections 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.690+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1038252988 wait complete. 2023-10-08T13:18:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.690+0000 7f9d0a268b80 20 client.26489 trim_cache size 0 max 16384 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.712+0000 7f9d0a268b80 1 Processor -- start 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.712+0000 7f9d0a268b80 1 -- start start 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ef97200 0x55896f022b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 0x55896f027f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f028880 0x55896f03c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896edf68c0 con 0x55896ef97200 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896f0182b0 con 0x55896f028880 2023-10-08T13:18:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896f01e610 con 0x55896f0230b0 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 0x55896f027f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ef97200 0x55896f022b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f028880 0x55896f03c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 0x55896f027f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51358/0 (socket says 172.21.15.5:51358) 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 -- 172.21.15.5:0/1769564556 learned_addr learned my addr 172.21.15.5:0/1769564556 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 -- 172.21.15.5:0/1769564556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f028880 msgr2=0x55896f03c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f028880 0x55896f03c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 -- 172.21.15.5:0/1769564556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ef97200 msgr2=0x55896f022b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ef97200 0x55896f022b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 -- 172.21.15.5:0/1769564556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55896f04c4d0 con 0x55896f0230b0 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.713+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 0x55896f027f00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009990 tx=0x7f9ce8021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970c2f83e5d8aea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.714+0000 7f9cde7fc700 1 -- 172.21.15.5:0/1769564556 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800b9c0 con 0x55896f0230b0 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.714+0000 7f9cde7fc700 1 -- 172.21.15.5:0/1769564556 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ce8028030 con 0x55896f0230b0 2023-10-08T13:18:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.714+0000 7f9cde7fc700 1 -- 172.21.15.5:0/1769564556 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800fa50 con 0x55896f0230b0 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.714+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1769564556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 msgr2=0x55896f027f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.714+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 0x55896f027f00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009990 tx=0x7f9ce8021000 comp rx=0 tx=0).stop 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.714+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1769564556 shutdown_connections 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896f028880 0x55896f03c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896ef97200 0x55896f022b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/1769564556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f0230b0 0x55896f027f00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1769564556 >> 172.21.15.5:0/1769564556 conn(0x55896f0237f0 msgr2=0x55896f02ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1769564556 shutdown_connections 2023-10-08T13:18:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- 172.21.15.5:0/1769564556 wait complete. 2023-10-08T13:18:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- start start 2023-10-08T13:18:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 Processor -- start 2023-10-08T13:18:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 0x55896f03bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f03c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f038390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896f038ad0 con 0x55896f0230b0 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896f038c40 con 0x55896ef97200 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.715+0000 7f9d0a268b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896f038e00 con 0x55896f028880 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9d0a268b80 10 client.0 _ll_register_callbacks cb 0x7f9cf0003da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 0x55896f03bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 0x55896f03bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33108/0 (socket says 172.21.15.5:33108) 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2035082180 learned_addr learned my addr 172.21.15.5:0/2035082180 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf7fff700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f03c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 msgr2=0x55896f038390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f038390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2035082180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 msgr2=0x55896f03c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f03c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 -- 172.21.15.5:0/2035082180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf8116630 con 0x55896ef97200 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cf77fe700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 0x55896f03bca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9cec099bd0 tx=0x7f9cec010cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54653d5233da5d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/2035082180 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0995c0 con 0x55896ef97200 2023-10-08T13:18:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/2035082180 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f9cec0b6070 con 0x55896ef97200 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.716+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cec09e020 con 0x55896ef97200 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/2035082180 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cec0a2260 con 0x55896ef97200 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 10 client.26495 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55896edc71f0 con 0x55896ef97200 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/2035082180 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cec07c070 con 0x55896ef97200 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/2035082180 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9cec095cc0 con 0x55896ef97200 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 10 client.26495 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 10 client.26495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 20 client.26495 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f0291a0 0x55896f09c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 4 client.26495 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:18:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55896ef6ead0 con 0x55896f0291a0 2023-10-08T13:18:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.717+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f0291a0 0x55896f09c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.718+0000 7f9cd6ffd700 10 client.26495 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.718+0000 7f9cf6ffd700 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f0291a0 0x55896f09c070 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b82e374ae3c65c2 server_cookie=b1e822ae36dbd3f9 in_seq=0 out_seq=0 2023-10-08T13:18:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.734+0000 7f9cd6ffd700 1 -- 172.21.15.5:0/2035082180 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55896ef6ead0 con 0x55896f0291a0 2023-10-08T13:18:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.734+0000 7f9cd6ffd700 10 client.26495 handle_command_reply: tid=0 2023-10-08T13:18:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.734+0000 7f9d0a268b80 1 client.26495 shutdown 2023-10-08T13:18:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 msgr2=0x55896f03bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 0x55896f03bca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9cec099bd0 tx=0x7f9cec010cd0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 shutdown_connections 2023-10-08T13:18:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55896f028880 0x55896f038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55896f0291a0 0x55896f09c070 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55896ef97200 0x55896f03bca0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 --2- 172.21.15.5:0/2035082180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55896f0230b0 0x55896f03c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 >> 172.21.15.5:0/2035082180 conn(0x55896f0237f0 msgr2=0x55896f029580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9cd6ffd700 0 client.26495 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 shutdown_connections 2023-10-08T13:18:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.735+0000 7f9d0a268b80 1 -- 172.21.15.5:0/2035082180 wait complete. 2023-10-08T13:18:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9d0a268b80 20 client.26495 trim_cache size 0 max 16384 2023-10-08T13:18:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:18:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:18:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:18:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:18:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9ce00a15e0 msgr2=0x7f9ce00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9ce00a15e0 0x7f9ce00a3aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9cf81a2a90 tx=0x7f9ce8005fd0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 msgr2=0x7f9cf81a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 0x7f9cf81a1540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00d950 tx=0x7f9cec00dc60 comp rx=0 tx=0).stop 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 shutdown_connections 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f9ce00a15e0 0x7f9ce00a3aa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cf8113940 0x7f9cf81a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf81077f0 0x7f9cf81a1540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 --2- 172.21.15.5:0/2904024136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cf8108110 0x7f9cf81a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 >> 172.21.15.5:0/2904024136 conn(0x7f9cf806b7c0 msgr2=0x7f9cf806f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 shutdown_connections 2023-10-08T13:18:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:12.736+0000 7f9cfe07f700 1 -- 172.21.15.5:0/2904024136 wait complete. 2023-10-08T13:18:13.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:13 smithi118 ceph-mon[104234]: pgmap v677: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.7 MiB/s wr, 445 op/s 2023-10-08T13:18:13.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:13 smithi060 ceph-mon[103190]: pgmap v677: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.7 MiB/s wr, 445 op/s 2023-10-08T13:18:13.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:13 smithi005 ceph-mon[99496]: pgmap v677: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.7 MiB/s wr, 445 op/s 2023-10-08T13:18:15.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:15 smithi060 ceph-mon[103190]: pgmap v678: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.4 MiB/s wr, 432 op/s 2023-10-08T13:18:15.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:15 smithi005 ceph-mon[99496]: pgmap v678: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.4 MiB/s wr, 432 op/s 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:15 smithi118 ceph-mon[104234]: pgmap v678: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.4 MiB/s wr, 432 op/s 2023-10-08T13:18:16.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 715.0 s, 512.4 tps, lat 200.916 ms stddev 248.558 2023-10-08T13:18:17.158 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:16 smithi060 ceph-mon[103190]: pgmap v679: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.8 MiB/s wr, 505 op/s 2023-10-08T13:18:17.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:16 smithi060 ceph-mon[103190]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T13:18:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:16 smithi005 ceph-mon[99496]: pgmap v679: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.8 MiB/s wr, 505 op/s 2023-10-08T13:18:17.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:16 smithi005 ceph-mon[99496]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T13:18:17.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:16 smithi118 ceph-mon[104234]: pgmap v679: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.8 MiB/s wr, 505 op/s 2023-10-08T13:18:17.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:16 smithi118 ceph-mon[104234]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T13:18:19.274 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:18 smithi118 ceph-mon[104234]: pgmap v681: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 484 op/s 2023-10-08T13:18:19.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:18 smithi060 ceph-mon[103190]: pgmap v681: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 484 op/s 2023-10-08T13:18:19.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:18 smithi005 ceph-mon[99496]: pgmap v681: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 484 op/s 2023-10-08T13:18:21.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:18:21.251 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:20 smithi005 ceph-mon[99496]: pgmap v682: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-08T13:18:21.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:20 smithi118 ceph-mon[104234]: pgmap v682: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 -- 172.21.15.5:0/2340099518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100ff0 msgr2=0x7f572010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 --2- 172.21.15.5:0/2340099518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100ff0 0x7f572010d610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f571800b0a0 tx=0x7f571800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 -- 172.21.15.5:0/2340099518 shutdown_connections 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 --2- 172.21.15.5:0/2340099518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100ff0 0x7f572010d610 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 --2- 172.21.15.5:0/2340099518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5720106750 0x7f5720106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 --2- 172.21.15.5:0/2340099518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720100630 0x7f5720100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 -- 172.21.15.5:0/2340099518 >> 172.21.15.5:0/2340099518 conn(0x7f57200fc100 msgr2=0x7f57200fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 -- 172.21.15.5:0/2340099518 shutdown_connections 2023-10-08T13:18:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.377+0000 7f5726918700 1 -- 172.21.15.5:0/2340099518 wait complete. 2023-10-08T13:18:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 Processor -- start 2023-10-08T13:18:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 -- start start 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 0x7f572019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5720100ff0 0x7f572019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720106750 0x7f5720196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720197200 con 0x7f5720100630 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720197370 con 0x7f5720106750 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5726918700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720197530 con 0x7f5720100ff0 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 0x7f572019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 0x7f572019c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38170/0 (socket says 172.21.15.5:38170) 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5720100ff0 0x7f572019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f571ffff700 1 -- 172.21.15.5:0/1622684414 learned_addr learned my addr 172.21.15.5:0/1622684414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f5724eb5700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720106750 0x7f5720196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.378+0000 7f571ffff700 1 -- 172.21.15.5:0/1622684414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5720100ff0 msgr2=0x7f572019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571ffff700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5720100ff0 0x7f572019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571ffff700 1 -- 172.21.15.5:0/1622684414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720106750 msgr2=0x7f5720196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571ffff700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720106750 0x7f5720196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571ffff700 1 -- 172.21.15.5:0/1622684414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009d00 con 0x7f5720100630 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571ffff700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 0x7f572019c990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f571000e9a0 tx=0x7f571000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571d7fa700 1 -- 172.21.15.5:0/1622684414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710009790 con 0x7f5720100630 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5720197810 con 0x7f5720100630 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571d7fa700 1 -- 172.21.15.5:0/1622684414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5710010430 con 0x7f5720100630 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f571d7fa700 1 -- 172.21.15.5:0/1622684414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710018680 con 0x7f5720100630 2023-10-08T13:18:21.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.379+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57201a3960 con 0x7f5720100630 2023-10-08T13:18:21.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.381+0000 7f571d7fa700 1 -- 172.21.15.5:0/1622684414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f57100187e0 con 0x7f5720100630 2023-10-08T13:18:21.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.382+0000 7f571d7fa700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f57080a15f0 0x7f57080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.382+0000 7f5732b01b80 1 Processor -- start 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.382+0000 7f571d7fa700 1 -- 172.21.15.5:0/1622684414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f5710014070 con 0x7f5720100630 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.382+0000 7f571f7fe700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f57080a15f0 0x7f57080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.382+0000 7f5732b01b80 1 -- start start 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69db4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dbf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5732b01b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69d1d460 con 0x557f69db3e80 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5732b01b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69d0ec20 con 0x557f69dbf650 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5732b01b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69d0c540 con 0x557f69db47a0 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69db4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69db4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38178/0 (socket says 172.21.15.5:38178) 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f571ffff700 1 -- 172.21.15.5:0/307463685 learned_addr learned my addr 172.21.15.5:0/307463685 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f571f7fe700 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dbf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 -- 172.21.15.5:0/307463685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 msgr2=0x557f69dbf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f571f7fe700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f57080a15f0 0x7f57080a3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f57201981a0 tx=0x7f5714009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dbf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 -- 172.21.15.5:0/307463685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 msgr2=0x557f69db4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69db4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 -- 172.21.15.5:0/307463685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f69b32de0 con 0x557f69dbf650 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f571ffff700 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69db4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.383+0000 7f5724eb5700 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc1a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f57180062a0 tx=0x7f5718009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef2db40186569468 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.384+0000 7f57067fc700 1 -- 172.21.15.5:0/307463685 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800e040 con 0x557f69dbf650 2023-10-08T13:18:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.384+0000 7f57067fc700 1 -- 172.21.15.5:0/307463685 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f571800bcb0 con 0x557f69dbf650 2023-10-08T13:18:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.384+0000 7f57067fc700 1 -- 172.21.15.5:0/307463685 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571801c640 con 0x557f69dbf650 2023-10-08T13:18:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 -- 172.21.15.5:0/307463685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 msgr2=0x557f69dc1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc1a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f57180062a0 tx=0x7f5718009470 comp rx=0 tx=0).stop 2023-10-08T13:18:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 -- 172.21.15.5:0/307463685 shutdown_connections 2023-10-08T13:18:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc1a40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69db4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 --2- 172.21.15.5:0/307463685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dbf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.385+0000 7f5732b01b80 1 -- 172.21.15.5:0/307463685 >> 172.21.15.5:0/307463685 conn(0x557f69d29260 msgr2=0x557f69db02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.386+0000 7f5732b01b80 1 -- 172.21.15.5:0/307463685 shutdown_connections 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.386+0000 7f5732b01b80 1 -- 172.21.15.5:0/307463685 wait complete. 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 -- start start 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 Processor -- start 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dbefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69dbf650 0x557f69dbc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69d07e30 con 0x557f69db3e80 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69ca4710 con 0x557f69db47a0 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69ca43b0 con 0x557f69dbf650 2023-10-08T13:18:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5732b01b80 10 client.0 _ll_register_callbacks cb 0x557f69b01800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dbefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dbefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38184/0 (socket says 172.21.15.5:38184) 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33134/0 (socket says 172.21.15.5:33134) 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f571ffff700 1 -- 172.21.15.5:0/4224635720 learned_addr learned my addr 172.21.15.5:0/4224635720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.387+0000 7f5724eb5700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69dbf650 0x557f69dbc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571f7fe700 1 -- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69dbf650 msgr2=0x557f69dbc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571f7fe700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69dbf650 0x557f69dbc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571f7fe700 1 -- 172.21.15.5:0/4224635720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 msgr2=0x557f69dbefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571f7fe700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dbefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571f7fe700 1 -- 172.21.15.5:0/4224635720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57201a3960 con 0x557f69db47a0 2023-10-08T13:18:21.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571ffff700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dbefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f571f7fe700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbc2c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5720198230 tx=0x7f57140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cfa5d3ffe1713e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f56ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f56ff7fe700 1 -- 172.21.15.5:0/4224635720 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714004240 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f56ff7fe700 1 -- 172.21.15.5:0/4224635720 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f57140043a0 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f69ccfeb0 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f56ff7fe700 1 -- 172.21.15.5:0/4224635720 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5714004560 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f5732b01b80 10 client.26507 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.388+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f572010df10 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f56ff7fe700 1 -- 172.21.15.5:0/4224635720 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f571402f020 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f56ff7fe700 1 -- 172.21.15.5:0/4224635720 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5714003680 con 0x557f69db47a0 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f5732b01b80 10 client.26507 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:21.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f5732b01b80 10 client.26507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f5732b01b80 20 client.26507 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f5732b01b80 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69dd3580 0x557f69dd59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f5732b01b80 4 client.26507 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f69d00e10 con 0x557f69dd3580 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.389+0000 7f571ffff700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69dd3580 0x557f69dd59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.390+0000 7f571ffff700 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69dd3580 0x557f69dd59a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37bcbe0931ce87b8 server_cookie=18c065071b502410 in_seq=0 out_seq=0 2023-10-08T13:18:21.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.390+0000 7f56ff7fe700 10 client.26507 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.390+0000 7f56ff7fe700 1 -- 172.21.15.5:0/4224635720 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557f69d00e10 con 0x557f69dd3580 2023-10-08T13:18:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.390+0000 7f56ff7fe700 10 client.26507 handle_command_reply: tid=0 2023-10-08T13:18:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.390+0000 7f5732b01b80 1 client.26507 shutdown 2023-10-08T13:18:21.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 msgr2=0x557f69dbc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbc2c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5720198230 tx=0x7f57140047c0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 shutdown_connections 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69dbf650 0x557f69dbc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dbefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69dd3580 0x557f69dd59a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 --2- 172.21.15.5:0/4224635720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbc2c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f56ff7fe700 0 client.26507 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 >> 172.21.15.5:0/4224635720 conn(0x557f69d29260 msgr2=0x557f69dafec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 shutdown_connections 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 1 -- 172.21.15.5:0/4224635720 wait complete. 2023-10-08T13:18:21.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.391+0000 7f5732b01b80 20 client.26507 trim_cache size 0 max 16384 2023-10-08T13:18:21.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:20 smithi060 ceph-mon[103190]: pgmap v682: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 Processor -- start 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 -- start start 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 0x557f69dbab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69dbf650 0x557f69dca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69b88920 con 0x557f69dbf650 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69dbd200 con 0x557f69db47a0 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.415+0000 7f5732b01b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69da7b40 con 0x557f69db3e80 2023-10-08T13:18:21.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 0x557f69dbab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 0x557f69dbab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51394/0 (socket says 172.21.15.5:51394) 2023-10-08T13:18:21.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 -- 172.21.15.5:0/692356470 learned_addr learned my addr 172.21.15.5:0/692356470 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:21.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f5724eb5700 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69dbf650 0x557f69dca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571f7fe700 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 -- 172.21.15.5:0/692356470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 msgr2=0x557f69dbb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 -- 172.21.15.5:0/692356470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69dbf650 msgr2=0x557f69dca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69dbf650 0x557f69dca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 -- 172.21.15.5:0/692356470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f69b1bc60 con 0x557f69db3e80 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.416+0000 7f571ffff700 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 0x557f69dbab90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f571009a140 tx=0x7f571001a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bbcaee2b2092522 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.417+0000 7f5706ffd700 1 -- 172.21.15.5:0/692356470 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571009a1b0 con 0x557f69db3e80 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.417+0000 7f5706ffd700 1 -- 172.21.15.5:0/692356470 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f571009e300 con 0x557f69db3e80 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.417+0000 7f5706ffd700 1 -- 172.21.15.5:0/692356470 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571009a410 con 0x557f69db3e80 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.417+0000 7f5732b01b80 1 -- 172.21.15.5:0/692356470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 msgr2=0x557f69dbab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.417+0000 7f5732b01b80 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 0x557f69dbab90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f571009a140 tx=0x7f571001a040 comp rx=0 tx=0).stop 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 -- 172.21.15.5:0/692356470 shutdown_connections 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69dbf650 0x557f69dca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db3e80 0x557f69dbab90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 --2- 172.21.15.5:0/692356470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69db47a0 0x557f69dbb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 -- 172.21.15.5:0/692356470 >> 172.21.15.5:0/692356470 conn(0x557f69d29260 msgr2=0x557f69db7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 -- 172.21.15.5:0/692356470 shutdown_connections 2023-10-08T13:18:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 -- 172.21.15.5:0/692356470 wait complete. 2023-10-08T13:18:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 -- start start 2023-10-08T13:18:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.418+0000 7f5732b01b80 1 Processor -- start 2023-10-08T13:18:21.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dc5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dc2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69dca7b0 con 0x557f69db3e80 2023-10-08T13:18:21.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69dca920 con 0x557f69dbf650 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f69dc2e90 con 0x557f69db47a0 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5732b01b80 10 client.0 _ll_register_callbacks cb 0x7f5714011e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dc5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dc5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38196/0 (socket says 172.21.15.5:38196) 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 -- 172.21.15.5:0/1070883620 learned_addr learned my addr 172.21.15.5:0/1070883620 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f5724eb5700 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 -- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 msgr2=0x557f69dc2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dc2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 -- 172.21.15.5:0/1070883620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 msgr2=0x557f69dc28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.419+0000 7f571ffff700 1 -- 172.21.15.5:0/1070883620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5720197810 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f571ffff700 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dc5dd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5710096c20 tx=0x7f57100cd4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3efa94ae701451 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f56ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f56ff7fe700 1 -- 172.21.15.5:0/1070883620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57100a2540 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f56ff7fe700 1 -- 172.21.15.5:0/1070883620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f571009a1b0 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f571800bcb0 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f56ff7fe700 1 -- 172.21.15.5:0/1070883620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5710010880 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 10 client.17115 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x557f69b59250 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f56ff7fe700 1 -- 172.21.15.5:0/1070883620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f571800bcb0 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f56ff7fe700 1 -- 172.21.15.5:0/1070883620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f571009a410 con 0x557f69db3e80 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 10 client.17115 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:21.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 20 client.17115 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69e20190 0x557f69e22580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 4 client.17115 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.420+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557f69d00b30 con 0x557f69e20190 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.421+0000 7f571f7fe700 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69e20190 0x557f69e22580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.422+0000 7f571f7fe700 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69e20190 0x557f69e22580 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70e5b4cc2e29ad0 server_cookie=5a06fd9b19cd4465 in_seq=0 out_seq=0 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.422+0000 7f56ff7fe700 10 client.17115 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.422+0000 7f56ff7fe700 1 -- 172.21.15.5:0/1070883620 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557f69d00b30 con 0x557f69e20190 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.422+0000 7f56ff7fe700 10 client.17115 handle_command_reply: tid=0 2023-10-08T13:18:21.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.422+0000 7f5732b01b80 1 client.17115 shutdown 2023-10-08T13:18:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 msgr2=0x557f69dc5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dc5dd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5710096c20 tx=0x7f57100cd4d0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 shutdown_connections 2023-10-08T13:18:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557f69e20190 0x557f69e22580 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557f69dbf650 0x557f69dc28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557f69db3e80 0x557f69dc5dd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f56ff7fe700 0 client.17115 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 --2- 172.21.15.5:0/1070883620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557f69db47a0 0x557f69dc2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 >> 172.21.15.5:0/1070883620 conn(0x557f69d29260 msgr2=0x557f69db7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 shutdown_connections 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 1 -- 172.21.15.5:0/1070883620 wait complete. 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5732b01b80 20 client.17115 trim_cache size 0 max 16384 2023-10-08T13:18:21.429 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:18:21.430 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:18:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f57080a15f0 msgr2=0x7f57080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f57080a15f0 0x7f57080a3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f57201981a0 tx=0x7f5714009260 comp rx=0 tx=0).stop 2023-10-08T13:18:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 msgr2=0x7f572019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 0x7f572019c990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f571000e9a0 tx=0x7f571000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 shutdown_connections 2023-10-08T13:18:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f57080a15f0 0x7f57080a3ab0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720106750 0x7f5720196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5720100630 0x7f572019c990 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 --2- 172.21.15.5:0/1622684414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5720100ff0 0x7f572019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.423+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 >> 172.21.15.5:0/1622684414 conn(0x7f57200fc100 msgr2=0x7f57200fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.424+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 shutdown_connections 2023-10-08T13:18:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:21.424+0000 7f5726918700 1 -- 172.21.15.5:0/1622684414 wait complete. 2023-10-08T13:18:21.459 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:18:21.752 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 720.0 s, 503.8 tps, lat 195.922 ms stddev 244.723 2023-10-08T13:18:23.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:22 smithi118 ceph-mon[104234]: pgmap v683: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 532 op/s 2023-10-08T13:18:23.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:22 smithi060 ceph-mon[103190]: pgmap v683: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 532 op/s 2023-10-08T13:18:23.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:22 smithi005 ceph-mon[99496]: pgmap v683: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 532 op/s 2023-10-08T13:18:25.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:24 smithi118 ceph-mon[104234]: pgmap v684: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.8 MiB/s wr, 527 op/s 2023-10-08T13:18:25.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:24 smithi060 ceph-mon[103190]: pgmap v684: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.8 MiB/s wr, 527 op/s 2023-10-08T13:18:25.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:24 smithi005 ceph-mon[99496]: pgmap v684: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.8 MiB/s wr, 527 op/s 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 -- 172.21.15.5:0/3467692490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410f310 msgr2=0x7ff024107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/3467692490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410f310 0x7ff024107d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff01401aa00 tx=0x7ff01401ad10 comp rx=0 tx=0).stop 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 -- 172.21.15.5:0/3467692490 shutdown_connections 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/3467692490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 0x7ff02411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/3467692490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410eea0 0x7ff0241077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/3467692490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410f310 0x7ff024107d30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.988+0000 7ff02bdf2700 1 -- 172.21.15.5:0/3467692490 >> 172.21.15.5:0/3467692490 conn(0x7ff02406b7c0 msgr2=0x7ff02406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.991+0000 7ff02bdf2700 1 -- 172.21.15.5:0/3467692490 shutdown_connections 2023-10-08T13:18:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.991+0000 7ff02bdf2700 1 -- 172.21.15.5:0/3467692490 wait complete. 2023-10-08T13:18:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 Processor -- start 2023-10-08T13:18:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 -- start start 2023-10-08T13:18:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 0x7ff0241155d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410f310 0x7ff024115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 0x7ff024118f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024119550 con 0x7ff024119fd0 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0241196c0 con 0x7ff02410eea0 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02bdf2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff024119880 con 0x7ff02410f310 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02a38f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 0x7ff024118f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 0x7ff0241155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02938d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410f310 0x7ff024115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 0x7ff0241155d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33160/0 (socket says 172.21.15.5:33160) 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02a38f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 0x7ff024118f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38214/0 (socket says 172.21.15.5:38214) 2023-10-08T13:18:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff02938d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410f310 0x7ff024115b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51416/0 (socket says 172.21.15.5:51416) 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.992+0000 7ff029b8e700 1 -- 172.21.15.5:0/2340890068 learned_addr learned my addr 172.21.15.5:0/2340890068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.993+0000 7ff029b8e700 1 -- 172.21.15.5:0/2340890068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410f310 msgr2=0x7ff024115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.993+0000 7ff029b8e700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410f310 0x7ff024115b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.993+0000 7ff029b8e700 1 -- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 msgr2=0x7ff024118f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.993+0000 7ff029b8e700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 0x7ff024118f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.993+0000 7ff029b8e700 1 -- 172.21.15.5:0/2340890068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01401a600 con 0x7ff02410eea0 2023-10-08T13:18:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.993+0000 7ff029b8e700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 0x7ff0241155d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e9a0 tx=0x7ff02000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.997+0000 7ff01affd700 1 -- 172.21.15.5:0/2340890068 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020009790 con 0x7ff02410eea0 2023-10-08T13:18:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.997+0000 7ff01affd700 1 -- 172.21.15.5:0/2340890068 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff020010430 con 0x7ff02410eea0 2023-10-08T13:18:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.997+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff024119b60 con 0x7ff02410eea0 2023-10-08T13:18:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.997+0000 7ff01affd700 1 -- 172.21.15.5:0/2340890068 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020018680 con 0x7ff02410eea0 2023-10-08T13:18:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:25.997+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0241a9ef0 con 0x7ff02410eea0 2023-10-08T13:18:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.003+0000 7ff037fdbb80 1 Processor -- start 2023-10-08T13:18:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.004+0000 7ff01affd700 1 -- 172.21.15.5:0/2340890068 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff0200105a0 con 0x7ff02410eea0 2023-10-08T13:18:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.004+0000 7ff037fdbb80 1 -- start start 2023-10-08T13:18:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf12dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf12dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf12dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51420/0 (socket says 172.21.15.5:51420) 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 -- 172.21.15.5:0/606391474 learned_addr learned my addr 172.21.15.5:0/606391474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf127b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf128510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf090400 con 0x55e4bf1280b0 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf081bc0 con 0x55e4bf12e1a0 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf07f4e0 con 0x55e4bf12d880 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02938d700 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf128510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff029b8e700 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf127b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 -- 172.21.15.5:0/606391474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 msgr2=0x55e4bf127b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff01affd700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff0100a1770 0x7ff0100a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf127b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 -- 172.21.15.5:0/606391474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 msgr2=0x55e4bf128510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.005+0000 7ff02a38f700 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf128510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff02a38f700 1 -- 172.21.15.5:0/606391474 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4beea5d80 con 0x55e4bf12d880 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff02938d700 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf128510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff01affd700 1 -- 172.21.15.5:0/2340890068 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff020014070 con 0x7ff02410eea0 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff02a38f700 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf12dc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00a430 tx=0x7ff01c009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdac238069f0dafc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff02a38f700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff0100a1770 0x7ff0100a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff00ffff700 1 -- 172.21.15.5:0/606391474 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c019030 con 0x55e4bf12d880 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff00ffff700 1 -- 172.21.15.5:0/606391474 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff01c011910 con 0x55e4bf12d880 2023-10-08T13:18:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.006+0000 7ff00ffff700 1 -- 172.21.15.5:0/606391474 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c010040 con 0x55e4bf12d880 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.007+0000 7ff02a38f700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff0100a1770 0x7ff0100a3c30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff01c014fd0 tx=0x7ff01c014ca0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.007+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 msgr2=0x55e4bf12dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.007+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf12dc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00a430 tx=0x7ff01c009650 comp rx=0 tx=0).stop 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.008+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 shutdown_connections 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.008+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf128510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.008+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf12dc60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.008+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/606391474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf127b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.008+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 >> 172.21.15.5:0/606391474 conn(0x55e4bf09c200 msgr2=0x55e4bf122b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.009+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 shutdown_connections 2023-10-08T13:18:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.009+0000 7ff037fdbb80 1 -- 172.21.15.5:0/606391474 wait complete. 2023-10-08T13:18:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.009+0000 7ff037fdbb80 1 -- start start 2023-10-08T13:18:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.009+0000 7ff037fdbb80 1 Processor -- start 2023-10-08T13:18:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 0x55e4bf131560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12e1a0 0x55e4bf131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf07add0 con 0x55e4bf12e1a0 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf0176b0 con 0x55e4bf1280b0 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf017350 con 0x55e4bf12d880 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff037fdbb80 10 client.0 _ll_register_callbacks cb 0x55e4bee747a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 0x55e4bf131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 0x55e4bf131560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33176/0 (socket says 172.21.15.5:33176) 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.010+0000 7ff029b8e700 1 -- 172.21.15.5:0/1142542679 learned_addr learned my addr 172.21.15.5:0/1142542679 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.011+0000 7ff029b8e700 1 -- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 msgr2=0x55e4bf131aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.011+0000 7ff029b8e700 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf131aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.011+0000 7ff029b8e700 1 -- 172.21.15.5:0/1142542679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12e1a0 msgr2=0x55e4bf131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.011+0000 7ff029b8e700 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12e1a0 0x55e4bf131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.011+0000 7ff029b8e700 1 -- 172.21.15.5:0/1142542679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c009c60 con 0x55e4bf1280b0 2023-10-08T13:18:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.011+0000 7ff029b8e700 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 0x55e4bf131560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e970 tx=0x7ff02009a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a96aeca8b01ec06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff00d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:18:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff00d7fa700 1 -- 172.21.15.5:0/1142542679 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02009a620 con 0x55e4bf1280b0 2023-10-08T13:18:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff00d7fa700 1 -- 172.21.15.5:0/1142542679 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff02009a8c0 con 0x55e4bf1280b0 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4bf042e50 con 0x55e4bf1280b0 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff00d7fa700 1 -- 172.21.15.5:0/1142542679 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff02009e120 con 0x55e4bf1280b0 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff037fdbb80 10 client.26525 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.012+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55e4bee8ec00 con 0x55e4bf1280b0 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff00d7fa700 1 -- 172.21.15.5:0/1142542679 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0200b6020 con 0x55e4bf1280b0 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff00d7fa700 1 -- 172.21.15.5:0/1142542679 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff020099740 con 0x55e4bf1280b0 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff037fdbb80 10 client.26525 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff037fdbb80 10 client.26525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff037fdbb80 20 client.26525 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf141c50 0x55e4bf144040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff037fdbb80 4 client.26525 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:18:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4bf073db0 con 0x55e4bf141c50 2023-10-08T13:18:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.013+0000 7ff02938d700 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf141c50 0x55e4bf144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.014+0000 7ff02938d700 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf141c50 0x55e4bf144040 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ddcd8be84c1377 server_cookie=7f48ef4f1d8fba2 in_seq=0 out_seq=0 2023-10-08T13:18:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.014+0000 7ff00d7fa700 10 client.26525 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff00d7fa700 1 -- 172.21.15.5:0/1142542679 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4bf073db0 con 0x55e4bf141c50 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff00d7fa700 10 client.26525 handle_command_reply: tid=0 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 client.26525 shutdown 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 msgr2=0x55e4bf131560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 0x55e4bf131560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e970 tx=0x7ff02009a040 comp rx=0 tx=0).stop 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 shutdown_connections 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12e1a0 0x55e4bf131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf141c50 0x55e4bf144040 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf1280b0 0x55e4bf131560 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff00d7fa700 0 client.26525 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1142542679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf12d880 0x55e4bf131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 >> 172.21.15.5:0/1142542679 conn(0x55e4bf09c200 msgr2=0x55e4bf122010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 shutdown_connections 2023-10-08T13:18:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1142542679 wait complete. 2023-10-08T13:18:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.015+0000 7ff037fdbb80 20 client.26525 trim_cache size 0 max 16384 2023-10-08T13:18:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.039+0000 7ff037fdbb80 1 Processor -- start 2023-10-08T13:18:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.039+0000 7ff037fdbb80 1 -- start start 2023-10-08T13:18:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 0x55e4bf131e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12d880 0x55e4bf122790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4beefb8c0 con 0x55e4bf12d880 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf12d4b0 con 0x55e4bf12e1a0 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf12f590 con 0x55e4bf1280b0 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 0x55e4bf131e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 0x55e4bf131e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51434/0 (socket says 172.21.15.5:51434) 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.040+0000 7ff029b8e700 1 -- 172.21.15.5:0/1189146515 learned_addr learned my addr 172.21.15.5:0/1189146515 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff029b8e700 1 -- 172.21.15.5:0/1189146515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 msgr2=0x55e4bf122cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff029b8e700 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf122cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff029b8e700 1 -- 172.21.15.5:0/1189146515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12d880 msgr2=0x55e4bf122790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff029b8e700 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12d880 0x55e4bf122790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff029b8e700 1 -- 172.21.15.5:0/1189146515 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4beecc1f0 con 0x55e4bf1280b0 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff029b8e700 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 0x55e4bf131e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff020096c30 tx=0x7ff020099be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b638a8f7aada87cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff018ff9700 1 -- 172.21.15.5:0/1189146515 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200a20c0 con 0x55e4bf1280b0 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff018ff9700 1 -- 172.21.15.5:0/1189146515 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0200b6070 con 0x55e4bf1280b0 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.041+0000 7ff018ff9700 1 -- 172.21.15.5:0/1189146515 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200d0ac0 con 0x55e4bf1280b0 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1189146515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 msgr2=0x55e4bf131e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 0x55e4bf131e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff020096c30 tx=0x7ff020099be0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1189146515 shutdown_connections 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf1280b0 0x55e4bf131e00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/1189146515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf12d880 0x55e4bf122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.042+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1189146515 >> 172.21.15.5:0/1189146515 conn(0x55e4bf09c200 msgr2=0x55e4bf128490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.043+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1189146515 shutdown_connections 2023-10-08T13:18:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.043+0000 7ff037fdbb80 1 -- 172.21.15.5:0/1189146515 wait complete. 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 -- start start 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 Processor -- start 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf137300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf18ea60 0x55e4bf18eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf18f420 con 0x55e4bf1280b0 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf18f590 con 0x55e4bf12e1a0 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4bf18f750 con 0x55e4bf18ea60 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff037fdbb80 10 client.0 _ll_register_callbacks cb 0x55e4bee747a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.044+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff029b8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38232/0 (socket says 172.21.15.5:38232) 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff029b8e700 1 -- 172.21.15.5:0/2201603251 learned_addr learned my addr 172.21.15.5:0/2201603251 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02a38f700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf18ea60 0x55e4bf18eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf137300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 -- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf18ea60 msgr2=0x55e4bf18eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf18ea60 0x55e4bf18eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 -- 172.21.15.5:0/2201603251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 msgr2=0x55e4bf136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf136dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 -- 172.21.15.5:0/2201603251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4bee8ec00 con 0x55e4bf12e1a0 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff029b8e700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:18:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02a38f700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf18ea60 0x55e4bf18eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff02938d700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf137300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff01401a8f0 tx=0x7ff01401cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50aa950b1b950f85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff00d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff00d7fa700 1 -- 172.21.15.5:0/2201603251 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01402e070 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff00d7fa700 1 -- 172.21.15.5:0/2201603251 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff014035240 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.045+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff01c011910 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff00d7fa700 1 -- 172.21.15.5:0/2201603251 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff014035400 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 10 client.26528 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55e4beea4250 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff00d7fa700 1 -- 172.21.15.5:0/2201603251 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff01c011910 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff00d7fa700 1 -- 172.21.15.5:0/2201603251 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff014003a50 con 0x55e4bf12e1a0 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 10 client.26528 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 10 client.26528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 20 client.26528 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf197060 0x55e4bf199480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 4 client.26528 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e4bf073ad0 con 0x55e4bf197060 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.046+0000 7ff029b8e700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf197060 0x55e4bf199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.050+0000 7ff029b8e700 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf197060 0x55e4bf199480 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d748a723688ae814 server_cookie=e9d01b3e941c9d89 in_seq=0 out_seq=0 2023-10-08T13:18:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.050+0000 7ff00d7fa700 10 client.26528 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.058+0000 7ff00d7fa700 1 -- 172.21.15.5:0/2201603251 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e4bf073ad0 con 0x55e4bf197060 2023-10-08T13:18:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.058+0000 7ff00d7fa700 10 client.26528 handle_command_reply: tid=0 2023-10-08T13:18:26.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.058+0000 7ff037fdbb80 1 client.26528 shutdown 2023-10-08T13:18:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 msgr2=0x55e4bf137300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf137300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff01401a8f0 tx=0x7ff01401cfa0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 shutdown_connections 2023-10-08T13:18:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e4bf18ea60 0x55e4bf18eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4bf1280b0 0x55e4bf136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55e4bf197060 0x55e4bf199480 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 --2- 172.21.15.5:0/2201603251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4bf12e1a0 0x55e4bf137300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 >> 172.21.15.5:0/2201603251 conn(0x55e4bf09c200 msgr2=0x55e4bf12fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff00d7fa700 0 client.26528 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 shutdown_connections 2023-10-08T13:18:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 1 -- 172.21.15.5:0/2201603251 wait complete. 2023-10-08T13:18:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.059+0000 7ff037fdbb80 20 client.26528 trim_cache size 0 max 16384 2023-10-08T13:18:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:18:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:18:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:18:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:18:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff0100a1770 msgr2=0x7ff0100a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff0100a1770 0x7ff0100a3c30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff01c014fd0 tx=0x7ff01c014ca0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 msgr2=0x7ff0241155d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 0x7ff0241155d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e9a0 tx=0x7ff02000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 shutdown_connections 2023-10-08T13:18:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff0100a1770 0x7ff0100a3c30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff024119fd0 0x7ff024118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff02410eea0 0x7ff0241155d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 --2- 172.21.15.5:0/2340890068 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff02410f310 0x7ff024115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.061+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 >> 172.21.15.5:0/2340890068 conn(0x7ff02406b7c0 msgr2=0x7ff024071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.063+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 shutdown_connections 2023-10-08T13:18:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:26.063+0000 7ff02bdf2700 1 -- 172.21.15.5:0/2340890068 wait complete. 2023-10-08T13:18:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 725.0 s, 464.7 tps, lat 217.953 ms stddev 251.003 2023-10-08T13:18:27.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:27 smithi060 ceph-mon[103190]: pgmap v685: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.5 MiB/s wr, 522 op/s 2023-10-08T13:18:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:27 smithi005 ceph-mon[99496]: pgmap v685: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.5 MiB/s wr, 522 op/s 2023-10-08T13:18:27.526 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:27 smithi118 ceph-mon[104234]: pgmap v685: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.5 MiB/s wr, 522 op/s 2023-10-08T13:18:29.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:29 smithi060 ceph-mon[103190]: pgmap v686: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.0 MiB/s wr, 465 op/s 2023-10-08T13:18:29.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:29 smithi005 ceph-mon[99496]: pgmap v686: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.0 MiB/s wr, 465 op/s 2023-10-08T13:18:29.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:29 smithi118 ceph-mon[104234]: pgmap v686: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.0 MiB/s wr, 465 op/s 2023-10-08T13:18:31.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:31 smithi060 ceph-mon[103190]: pgmap v687: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.8 MiB/s wr, 527 op/s 2023-10-08T13:18:31.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:31 smithi005 ceph-mon[99496]: pgmap v687: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.8 MiB/s wr, 527 op/s 2023-10-08T13:18:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:31 smithi118 ceph-mon[104234]: pgmap v687: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.8 MiB/s wr, 527 op/s 2023-10-08T13:18:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 730.0 s, 486.3 tps, lat 209.030 ms stddev 257.409 2023-10-08T13:18:33.413 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:33 smithi060 ceph-mon[103190]: pgmap v688: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.7 MiB/s wr, 514 op/s 2023-10-08T13:18:33.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:33 smithi005 ceph-mon[99496]: pgmap v688: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.7 MiB/s wr, 514 op/s 2023-10-08T13:18:33.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:33 smithi118 ceph-mon[104234]: pgmap v688: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.7 MiB/s wr, 514 op/s 2023-10-08T13:18:35.413 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:35 smithi060 ceph-mon[103190]: pgmap v689: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.6 MiB/s wr, 465 op/s 2023-10-08T13:18:35.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:35 smithi005 ceph-mon[99496]: pgmap v689: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.6 MiB/s wr, 465 op/s 2023-10-08T13:18:35.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:35 smithi118 ceph-mon[104234]: pgmap v689: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.6 MiB/s wr, 465 op/s 2023-10-08T13:18:36.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 735.0 s, 502.2 tps, lat 193.136 ms stddev 217.642 2023-10-08T13:18:37.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:37 smithi060 ceph-mon[103190]: pgmap v690: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 7.5 MiB/s wr, 570 op/s 2023-10-08T13:18:37.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:37 smithi005 ceph-mon[99496]: pgmap v690: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 7.5 MiB/s wr, 570 op/s 2023-10-08T13:18:37.525 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:37 smithi118 ceph-mon[104234]: pgmap v690: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 7.5 MiB/s wr, 570 op/s 2023-10-08T13:18:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.327+0000 7ff064b04700 1 -- 172.21.15.5:0/2086899485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff060119fd0 msgr2=0x7ff06011c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.327+0000 7ff064b04700 1 --2- 172.21.15.5:0/2086899485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff060119fd0 0x7ff06011c3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0580099c0 tx=0x7ff058009cd0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.340+0000 7ff064b04700 1 -- 172.21.15.5:0/2086899485 shutdown_connections 2023-10-08T13:18:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.340+0000 7ff064b04700 1 --2- 172.21.15.5:0/2086899485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff060119fd0 0x7ff06011c3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.340+0000 7ff064b04700 1 --2- 172.21.15.5:0/2086899485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff06010eea0 0x7ff0601077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.340+0000 7ff064b04700 1 --2- 172.21.15.5:0/2086899485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010f310 0x7ff060107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.340+0000 7ff064b04700 1 -- 172.21.15.5:0/2086899485 >> 172.21.15.5:0/2086899485 conn(0x7ff06006b7c0 msgr2=0x7ff06006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.343+0000 7ff064b04700 1 -- 172.21.15.5:0/2086899485 shutdown_connections 2023-10-08T13:18:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.356+0000 7ff064b04700 1 -- 172.21.15.5:0/2086899485 wait complete. 2023-10-08T13:18:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.357+0000 7ff064b04700 1 Processor -- start 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 -- start start 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010eea0 0x7ff060118420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 0x7ff0601189a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff060119fd0 0x7ff060111630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060111e00 con 0x7ff06010eea0 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060111f70 con 0x7ff060119fd0 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.362+0000 7ff064b04700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060112130 con 0x7ff06010f310 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.363+0000 7ff05dd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 0x7ff0601189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.363+0000 7ff05dd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 0x7ff0601189a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51450/0 (socket says 172.21.15.5:51450) 2023-10-08T13:18:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.363+0000 7ff05dd9b700 1 -- 172.21.15.5:0/897635450 learned_addr learned my addr 172.21.15.5:0/897635450 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.363+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff060119fd0 0x7ff060111630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05e59c700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010eea0 0x7ff060118420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05dd9b700 1 -- 172.21.15.5:0/897635450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff060119fd0 msgr2=0x7ff060111630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff060119fd0 0x7ff060111630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05dd9b700 1 -- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010eea0 msgr2=0x7ff060118420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010eea0 0x7ff060118420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05dd9b700 1 -- 172.21.15.5:0/897635450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580095f0 con 0x7ff06010f310 2023-10-08T13:18:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05e59c700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010eea0 0x7ff060118420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:18:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.368+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 0x7ff0601189a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff04800b500 tx=0x7ff04800b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.372+0000 7ff0577fe700 1 -- 172.21.15.5:0/897635450 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048011830 con 0x7ff06010f310 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.373+0000 7ff0577fe700 1 -- 172.21.15.5:0/897635450 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff048011e50 con 0x7ff06010f310 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.373+0000 7ff0577fe700 1 -- 172.21.15.5:0/897635450 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800f2e0 con 0x7ff06010f310 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.374+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff060115fb0 con 0x7ff06010f310 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.374+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060116470 con 0x7ff06010f310 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.379+0000 7ff070cedb80 1 Processor -- start 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 -- start start 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f9880 0x556cfd2f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd25c400 con 0x556cfd2fa1a0 2023-10-08T13:18:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd24dbc0 con 0x556cfd2f40b0 2023-10-08T13:18:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.381+0000 7ff070cedb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd24b4e0 con 0x556cfd2f9880 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.384+0000 7ff05dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.385+0000 7ff05dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33204/0 (socket says 172.21.15.5:33204) 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.385+0000 7ff05dd9b700 1 -- 172.21.15.5:0/810991560 learned_addr learned my addr 172.21.15.5:0/810991560 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.385+0000 7ff0577fe700 1 -- 172.21.15.5:0/897635450 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff048011990 con 0x7ff06010f310 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff0577fe700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff04c0a17f0 0x7ff04c0a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff05e59c700 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff0577fe700 1 -- 172.21.15.5:0/897635450 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff0480ccd90 con 0x7ff06010f310 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff05dd9b700 1 -- 172.21.15.5:0/810991560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f9880 msgr2=0x556cfd2f9c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f9880 0x556cfd2f9c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff05dd9b700 1 -- 172.21.15.5:0/810991560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2fa1a0 msgr2=0x556cfd2f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.386+0000 7ff05dd9b700 1 -- 172.21.15.5:0/810991560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cfd071d80 con 0x556cfd2f40b0 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.387+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f4510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff0480ca170 tx=0x7ff048004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde77ae0f8cf126 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.388+0000 7ff054ff9700 1 -- 172.21.15.5:0/810991560 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480995d0 con 0x556cfd2f40b0 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.388+0000 7ff054ff9700 1 -- 172.21.15.5:0/810991560 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0480993f0 con 0x556cfd2f40b0 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.388+0000 7ff054ff9700 1 -- 172.21.15.5:0/810991560 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048099cf0 con 0x556cfd2f40b0 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.389+0000 7ff070cedb80 1 -- 172.21.15.5:0/810991560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 msgr2=0x556cfd2f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.389+0000 7ff070cedb80 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f4510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff0480ca170 tx=0x7ff048004860 comp rx=0 tx=0).stop 2023-10-08T13:18:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.396+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff04c0a17f0 0x7ff04c0a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.396+0000 7ff070cedb80 1 -- 172.21.15.5:0/810991560 shutdown_connections 2023-10-08T13:18:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.396+0000 7ff070cedb80 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f4510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.396+0000 7ff070cedb80 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f9880 0x556cfd2f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.397+0000 7ff070cedb80 1 --2- 172.21.15.5:0/810991560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.397+0000 7ff070cedb80 1 -- 172.21.15.5:0/810991560 >> 172.21.15.5:0/810991560 conn(0x556cfd268200 msgr2=0x556cfd2eeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.397+0000 7ff070cedb80 1 -- 172.21.15.5:0/810991560 shutdown_connections 2023-10-08T13:18:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.409+0000 7ff070cedb80 1 -- 172.21.15.5:0/810991560 wait complete. 2023-10-08T13:18:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.409+0000 7ff070cedb80 1 -- start start 2023-10-08T13:18:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.409+0000 7ff070cedb80 1 Processor -- start 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd300180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2fd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd2fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd246dd0 con 0x556cfd2f9880 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd1e36b0 con 0x556cfd2f40b0 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd1e3350 con 0x556cfd2fa1a0 2023-10-08T13:18:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.410+0000 7ff070cedb80 10 client.0 _ll_register_callbacks cb 0x556cfd0407a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:39.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.413+0000 7ff05e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd300180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.413+0000 7ff05e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd300180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33212/0 (socket says 172.21.15.5:33212) 2023-10-08T13:18:39.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.413+0000 7ff05e59c700 1 -- 172.21.15.5:0/361600682 learned_addr learned my addr 172.21.15.5:0/361600682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:39.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.418+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd2fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff04c0a17f0 0x7ff04c0a3cb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff058005cd0 tx=0x7ff058005c40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:39.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05e59c700 1 -- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 msgr2=0x556cfd2fdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:39.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05e59c700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd2fdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05e59c700 1 -- 172.21.15.5:0/361600682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 msgr2=0x556cfd2fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:39.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05e59c700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.419+0000 7ff05e59c700 1 -- 172.21.15.5:0/361600682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060116470 con 0x556cfd2f40b0 2023-10-08T13:18:39.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.420+0000 7ff05e59c700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd300180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff05000fc80 tx=0x7ff05000fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdba2bebbc83b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.422+0000 7ff045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:18:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.433+0000 7ff045ffb700 1 -- 172.21.15.5:0/361600682 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500108f0 con 0x556cfd2f40b0 2023-10-08T13:18:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.433+0000 7ff045ffb700 1 -- 172.21.15.5:0/361600682 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff050010a50 con 0x556cfd2f40b0 2023-10-08T13:18:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.438+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556cfd20ee50 con 0x556cfd2f40b0 2023-10-08T13:18:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.444+0000 7ff045ffb700 1 -- 172.21.15.5:0/361600682 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff050010c10 con 0x556cfd2f40b0 2023-10-08T13:18:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.444+0000 7ff070cedb80 10 client.26537 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.444+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x556cfd05ac00 con 0x556cfd2f40b0 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff045ffb700 1 -- 172.21.15.5:0/361600682 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556cfd20ee50 con 0x556cfd2f40b0 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff045ffb700 1 -- 172.21.15.5:0/361600682 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff05001f020 con 0x556cfd2f40b0 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff070cedb80 10 client.26537 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff070cedb80 10 client.26537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff070cedb80 20 client.26537 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff070cedb80 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd30dc70 0x556cfd310090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff070cedb80 4 client.26537 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:18:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.447+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cfd23fdb0 con 0x556cfd30dc70 2023-10-08T13:18:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.448+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd30dc70 0x556cfd310090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.448+0000 7ff045ffb700 10 client.26537 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.448+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd30dc70 0x556cfd310090 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61fd6344fd44537 server_cookie=f20064542777c6a6 in_seq=0 out_seq=0 2023-10-08T13:18:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.449+0000 7ff045ffb700 1 -- 172.21.15.5:0/361600682 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556cfd23fdb0 con 0x556cfd30dc70 2023-10-08T13:18:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.449+0000 7ff045ffb700 10 client.26537 handle_command_reply: tid=0 2023-10-08T13:18:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.449+0000 7ff070cedb80 1 client.26537 shutdown 2023-10-08T13:18:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.449+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 msgr2=0x556cfd300180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.449+0000 7ff070cedb80 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd300180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff05000fc80 tx=0x7ff05000fcb0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 shutdown_connections 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff070cedb80 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd2fdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff070cedb80 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd30dc70 0x556cfd310090 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff070cedb80 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd300180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff070cedb80 1 --2- 172.21.15.5:0/361600682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 >> 172.21.15.5:0/361600682 conn(0x556cfd268200 msgr2=0x556cfd2ee010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:39.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.453+0000 7ff045ffb700 0 client.26537 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.454+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 shutdown_connections 2023-10-08T13:18:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.454+0000 7ff070cedb80 1 -- 172.21.15.5:0/361600682 wait complete. 2023-10-08T13:18:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.462+0000 7ff070cedb80 20 client.26537 trim_cache size 0 max 16384 2023-10-08T13:18:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.486+0000 7ff070cedb80 1 Processor -- start 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.486+0000 7ff070cedb80 1 -- start start 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd304bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd309a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff070cedb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd0c78c0 con 0x556cfd2f9880 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff070cedb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd2e6670 con 0x556cfd2f40b0 2023-10-08T13:18:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff070cedb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd2f0100 con 0x556cfd2fa1a0 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd309a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd309a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51472/0 (socket says 172.21.15.5:51472) 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 -- 172.21.15.5:0/2684524730 learned_addr learned my addr 172.21.15.5:0/2684524730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05e59c700 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 -- 172.21.15.5:0/2684524730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 msgr2=0x556cfd2f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 -- 172.21.15.5:0/2684524730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 msgr2=0x556cfd304bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd304bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.487+0000 7ff05ed9d700 1 -- 172.21.15.5:0/2684524730 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cfd0981f0 con 0x556cfd2fa1a0 2023-10-08T13:18:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.488+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd309a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff058015000 tx=0x7ff058022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=717fa3c79fb62ad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.488+0000 7ff0557fa700 1 -- 172.21.15.5:0/2684524730 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05802b050 con 0x556cfd2fa1a0 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.488+0000 7ff0557fa700 1 -- 172.21.15.5:0/2684524730 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff05802c040 con 0x556cfd2fa1a0 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.488+0000 7ff0557fa700 1 -- 172.21.15.5:0/2684524730 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058004500 con 0x556cfd2fa1a0 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 -- 172.21.15.5:0/2684524730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 msgr2=0x556cfd309a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd309a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff058015000 tx=0x7ff058022000 comp rx=0 tx=0).stop 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 -- 172.21.15.5:0/2684524730 shutdown_connections 2023-10-08T13:18:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2fa1a0 0x556cfd309a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2f40b0 0x556cfd2f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2684524730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd304bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 -- 172.21.15.5:0/2684524730 >> 172.21.15.5:0/2684524730 conn(0x556cfd268200 msgr2=0x556cfd309310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 -- 172.21.15.5:0/2684524730 shutdown_connections 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.489+0000 7ff070cedb80 1 -- 172.21.15.5:0/2684524730 wait complete. 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 -- start start 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 Processor -- start 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 0x556cfd2f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2f5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd2f7100 con 0x556cfd2f9880 2023-10-08T13:18:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd2f5e10 con 0x556cfd2fa1a0 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cfd2f5f80 con 0x556cfd2f40b0 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff070cedb80 10 client.0 _ll_register_callbacks cb 0x7ff05000f750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff05e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 0x556cfd2f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff05e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 0x556cfd2f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51476/0 (socket says 172.21.15.5:51476) 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff05e59c700 1 -- 172.21.15.5:0/2364841217 learned_addr learned my addr 172.21.15.5:0/2364841217 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.490+0000 7ff05ed9d700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05e59c700 1 -- 172.21.15.5:0/2364841217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2fa1a0 msgr2=0x556cfd2f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05e59c700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05e59c700 1 -- 172.21.15.5:0/2364841217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 msgr2=0x556cfd2f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05e59c700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05e59c700 1 -- 172.21.15.5:0/2364841217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06011cbd0 con 0x556cfd2f40b0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff05e59c700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 0x556cfd2f6a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff050008010 tx=0x7ff0500119c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e70c1275f716992 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff045ffb700 1 -- 172.21.15.5:0/2364841217 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050007a20 con 0x556cfd2f40b0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.491+0000 7ff045ffb700 1 -- 172.21.15.5:0/2364841217 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff050007830 con 0x556cfd2f40b0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.492+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0480993f0 con 0x556cfd2f40b0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.492+0000 7ff045ffb700 1 -- 172.21.15.5:0/2364841217 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff050011e60 con 0x556cfd2f40b0 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.492+0000 7ff070cedb80 10 client.26626 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.492+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x556cfd070250 con 0x556cfd2f40b0 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.492+0000 7ff045ffb700 1 -- 172.21.15.5:0/2364841217 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0480993f0 con 0x556cfd2f40b0 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff045ffb700 1 -- 172.21.15.5:0/2364841217 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff050018480 con 0x556cfd2f40b0 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff070cedb80 10 client.26626 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff070cedb80 10 client.26626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff070cedb80 20 client.26626 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd362de0 0x556cfd365200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff070cedb80 4 client.26626 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:18:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556cfd23fad0 con 0x556cfd362de0 2023-10-08T13:18:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd362de0 0x556cfd365200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff045ffb700 10 client.26626 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.493+0000 7ff05dd9b700 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd362de0 0x556cfd365200 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95e7d1aa754f4018 server_cookie=2897407b21b8417d in_seq=0 out_seq=0 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff045ffb700 1 -- 172.21.15.5:0/2364841217 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556cfd23fad0 con 0x556cfd362de0 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff045ffb700 10 client.26626 handle_command_reply: tid=0 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 client.26626 shutdown 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 msgr2=0x556cfd2f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 0x556cfd2f6a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff050008010 tx=0x7ff0500119c0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 shutdown_connections 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556cfd362de0 0x556cfd365200 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556cfd2fa1a0 0x556cfd2f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556cfd2f40b0 0x556cfd2f6a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff045ffb700 0 client.26626 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 --2- 172.21.15.5:0/2364841217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cfd2f9880 0x556cfd2f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 >> 172.21.15.5:0/2364841217 conn(0x556cfd268200 msgr2=0x556cfd309ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 shutdown_connections 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.510+0000 7ff070cedb80 1 -- 172.21.15.5:0/2364841217 wait complete. 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff070cedb80 20 client.26626 trim_cache size 0 max 16384 2023-10-08T13:18:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:18:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:18:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:18:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:18:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff04c0a17f0 msgr2=0x7ff04c0a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff04c0a17f0 0x7ff04c0a3cb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff058005cd0 tx=0x7ff058005c40 comp rx=0 tx=0).stop 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 msgr2=0x7ff0601189a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 0x7ff0601189a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff04800b500 tx=0x7ff04800b8c0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 shutdown_connections 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff04c0a17f0 0x7ff04c0a3cb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff060119fd0 0x7ff060111630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06010eea0 0x7ff060118420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 --2- 172.21.15.5:0/897635450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff06010f310 0x7ff0601189a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 >> 172.21.15.5:0/897635450 conn(0x7ff06006b7c0 msgr2=0x7ff06006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 shutdown_connections 2023-10-08T13:18:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:39.511+0000 7ff064b04700 1 -- 172.21.15.5:0/897635450 wait complete. 2023-10-08T13:18:39.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:39 smithi118 ceph-mon[104234]: pgmap v691: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 5.9 MiB/s wr, 457 op/s 2023-10-08T13:18:39.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:39 smithi060 ceph-mon[103190]: pgmap v691: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 5.9 MiB/s wr, 457 op/s 2023-10-08T13:18:39.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:39 smithi005 ceph-mon[99496]: pgmap v691: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 5.9 MiB/s wr, 457 op/s 2023-10-08T13:18:40.526 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:40 smithi118 ceph-mon[104234]: pgmap v692: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.0 MiB/s wr, 519 op/s 2023-10-08T13:18:40.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:40 smithi060 ceph-mon[103190]: pgmap v692: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.0 MiB/s wr, 519 op/s 2023-10-08T13:18:40.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:40 smithi005 ceph-mon[99496]: pgmap v692: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.0 MiB/s wr, 519 op/s 2023-10-08T13:18:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 740.0 s, 539.9 tps, lat 191.476 ms stddev 222.466 2023-10-08T13:18:43.162 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:42 smithi060 ceph-mon[103190]: pgmap v693: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 5.9 MiB/s wr, 504 op/s 2023-10-08T13:18:43.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:42 smithi005 ceph-mon[99496]: pgmap v693: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 5.9 MiB/s wr, 504 op/s 2023-10-08T13:18:43.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:42 smithi118 ceph-mon[104234]: pgmap v693: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 5.9 MiB/s wr, 504 op/s 2023-10-08T13:18:45.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:44 smithi005 ceph-mon[99496]: pgmap v694: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 5.5 MiB/s wr, 456 op/s 2023-10-08T13:18:45.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:44 smithi118 ceph-mon[104234]: pgmap v694: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 5.5 MiB/s wr, 456 op/s 2023-10-08T13:18:45.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:44 smithi060 ceph-mon[103190]: pgmap v694: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 5.5 MiB/s wr, 456 op/s 2023-10-08T13:18:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 745.0 s, 498.2 tps, lat 202.627 ms stddev 217.785 2023-10-08T13:18:47.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:46 smithi005 ceph-mon[99496]: pgmap v695: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 7.0 MiB/s wr, 564 op/s 2023-10-08T13:18:47.271 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:46 smithi118 ceph-mon[104234]: pgmap v695: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 7.0 MiB/s wr, 564 op/s 2023-10-08T13:18:47.418 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:46 smithi060 ceph-mon[103190]: pgmap v695: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 7.0 MiB/s wr, 564 op/s 2023-10-08T13:18:49.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:48 smithi118 ceph-mon[104234]: pgmap v696: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 443 op/s 2023-10-08T13:18:49.413 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:48 smithi060 ceph-mon[103190]: pgmap v696: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 443 op/s 2023-10-08T13:18:49.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:48 smithi005 ceph-mon[99496]: pgmap v696: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 443 op/s 2023-10-08T13:18:51.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:50 smithi118 ceph-mon[104234]: pgmap v697: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.3 MiB/s wr, 519 op/s 2023-10-08T13:18:51.414 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:50 smithi060 ceph-mon[103190]: pgmap v697: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.3 MiB/s wr, 519 op/s 2023-10-08T13:18:51.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:50 smithi005 ceph-mon[99496]: pgmap v697: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.3 MiB/s wr, 519 op/s 2023-10-08T13:18:51.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:18:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 750.0 s, 504.6 tps, lat 188.718 ms stddev 206.577 2023-10-08T13:18:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 -- 172.21.15.5:0/3312005079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581077f0 msgr2=0x7f7e58107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/3312005079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581077f0 0x7f7e58107c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e4801a9a0 tx=0x7f7e4801acb0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 -- 172.21.15.5:0/3312005079 shutdown_connections 2023-10-08T13:18:51.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/3312005079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581083a0 0x7f7e5811bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/3312005079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5810edf0 0x7f7e5810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/3312005079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581077f0 0x7f7e58107c70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.765+0000 7f7e5e5db700 1 -- 172.21.15.5:0/3312005079 >> 172.21.15.5:0/3312005079 conn(0x7f7e5806b770 msgr2=0x7f7e5806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.770+0000 7f7e5e5db700 1 -- 172.21.15.5:0/3312005079 shutdown_connections 2023-10-08T13:18:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.771+0000 7f7e5e5db700 1 -- 172.21.15.5:0/3312005079 wait complete. 2023-10-08T13:18:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 Processor -- start 2023-10-08T13:18:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 -- start start 2023-10-08T13:18:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 0x7f7e58117d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581083a0 0x7f7e58118260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5810edf0 0x7f7e581a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e581a2200 con 0x7f7e581077f0 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e581a2370 con 0x7f7e581083a0 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e5e5db700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e581a2530 con 0x7f7e5810edf0 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.772+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 0x7f7e58117d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 0x7f7e58117d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38290/0 (socket says 172.21.15.5:38290) 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 -- 172.21.15.5:0/220835034 learned_addr learned my addr 172.21.15.5:0/220835034 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e577fe700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581083a0 0x7f7e58118260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5810edf0 0x7f7e581a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 -- 172.21.15.5:0/220835034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5810edf0 msgr2=0x7f7e581a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5810edf0 0x7f7e581a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 -- 172.21.15.5:0/220835034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581083a0 msgr2=0x7f7e58118260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581083a0 0x7f7e58118260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 -- 172.21.15.5:0/220835034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4801a600 con 0x7f7e581077f0 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e57fff700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 0x7f7e58117d20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00d950 tx=0x7f7e4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e557fa700 1 -- 172.21.15.5:0/220835034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c009940 con 0x7f7e581077f0 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e557fa700 1 -- 172.21.15.5:0/220835034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e4c010460 con 0x7f7e581077f0 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e557fa700 1 -- 172.21.15.5:0/220835034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c00f620 con 0x7f7e581077f0 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.773+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e581a2810 con 0x7f7e581077f0 2023-10-08T13:18:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.774+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e581a9d90 con 0x7f7e581077f0 2023-10-08T13:18:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.780+0000 7f7e6a7c4b80 1 Processor -- start 2023-10-08T13:18:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.780+0000 7f7e557fa700 1 -- 172.21.15.5:0/220835034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7e4c0108d0 con 0x7f7e581077f0 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.781+0000 7f7e557fa700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7e400a1670 0x7f7e400a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.781+0000 7f7e557fa700 1 -- 172.21.15.5:0/220835034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f7e4c0cd2d0 con 0x7f7e581077f0 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 -- start start 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b44260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b4f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b4f650 0x55a034b51a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034aad460 con 0x55a034b447a0 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034a9ec20 con 0x55a034b43e80 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034a9c540 con 0x55a034b4f650 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b44260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b44260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33248/0 (socket says 172.21.15.5:33248) 2023-10-08T13:18:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.782+0000 7f7e57fff700 1 -- 172.21.15.5:0/1748833878 learned_addr learned my addr 172.21.15.5:0/1748833878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7e400a1670 0x7f7e400a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e57fff700 1 -- 172.21.15.5:0/1748833878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b4f650 msgr2=0x55a034b51a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:18:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e57fff700 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b4f650 0x55a034b51a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e57fff700 1 -- 172.21.15.5:0/1748833878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 msgr2=0x55a034b4f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e57fff700 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b4f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e57fff700 1 -- 172.21.15.5:0/1748833878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0348c2de0 con 0x55a034b43e80 2023-10-08T13:18:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.783+0000 7f7e57fff700 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b44260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0963c0 tx=0x7f7e4c0998a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7cb34119c64cb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.785+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7e400a1670 0x7f7e400a3b30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e581087d0 tx=0x7f7e5000b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.787+0000 7f7e3e7fc700 1 -- 172.21.15.5:0/1748833878 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c09e010 con 0x55a034b43e80 2023-10-08T13:18:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.787+0000 7f7e3e7fc700 1 -- 172.21.15.5:0/1748833878 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e4c0a2250 con 0x55a034b43e80 2023-10-08T13:18:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.787+0000 7f7e3e7fc700 1 -- 172.21.15.5:0/1748833878 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c099610 con 0x55a034b43e80 2023-10-08T13:18:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.788+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1748833878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 msgr2=0x55a034b44260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.788+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b44260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0963c0 tx=0x7f7e4c0998a0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1748833878 shutdown_connections 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b4f650 0x55a034b51a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b44260 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1748833878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b4f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1748833878 >> 172.21.15.5:0/1748833878 conn(0x55a034ab9260 msgr2=0x55a034b402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1748833878 shutdown_connections 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1748833878 wait complete. 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 -- start start 2023-10-08T13:18:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.789+0000 7f7e6a7c4b80 1 Processor -- start 2023-10-08T13:18:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 0x55a034b4f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b4c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034a97e30 con 0x55a034b43e80 2023-10-08T13:18:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034a34710 con 0x55a034b4f650 2023-10-08T13:18:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034a343b0 con 0x55a034b447a0 2023-10-08T13:18:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e6a7c4b80 10 client.0 _ll_register_callbacks cb 0x55a034891800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 0x55a034b4f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 0x55a034b4f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38304/0 (socket says 172.21.15.5:38304) 2023-10-08T13:18:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e577fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b4c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e57fff700 1 -- 172.21.15.5:0/1256199488 learned_addr learned my addr 172.21.15.5:0/1256199488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.790+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.791+0000 7f7e57fff700 1 -- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 msgr2=0x55a034b4c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.791+0000 7f7e57fff700 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b4c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.791+0000 7f7e57fff700 1 -- 172.21.15.5:0/1256199488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 msgr2=0x55a034b4cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.791+0000 7f7e57fff700 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b4cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.791+0000 7f7e57fff700 1 -- 172.21.15.5:0/1256199488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e581a9d90 con 0x55a034b43e80 2023-10-08T13:18:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.793+0000 7f7e57fff700 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 0x55a034b4f0f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0a1d20 tx=0x7f7e4c0caae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbda4ad5c16895dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.793+0000 7f7e377fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:18:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.793+0000 7f7e377fe700 1 -- 172.21.15.5:0/1256199488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0b8180 con 0x55a034b43e80 2023-10-08T13:18:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.793+0000 7f7e377fe700 1 -- 172.21.15.5:0/1256199488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f7e4c0995c0 con 0x55a034b43e80 2023-10-08T13:18:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.793+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a034a5feb0 con 0x55a034b43e80 2023-10-08T13:18:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e377fe700 1 -- 172.21.15.5:0/1256199488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e4c09a120 con 0x55a034b43e80 2023-10-08T13:18:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 10 client.17142 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a0348abc60 con 0x55a034b43e80 2023-10-08T13:18:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e377fe700 1 -- 172.21.15.5:0/1256199488 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a034a5feb0 con 0x55a034b43e80 2023-10-08T13:18:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e377fe700 1 -- 172.21.15.5:0/1256199488 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7e4c094c30 con 0x55a034b43e80 2023-10-08T13:18:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 10 client.17142 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 10 client.17142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 20 client.17142 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034b80bf0 0x55a034b82fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 4 client.17142 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:18:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.794+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a034a90e10 con 0x55a034b80bf0 2023-10-08T13:18:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.805+0000 7f7e577fe700 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034b80bf0 0x55a034b82fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.806+0000 7f7e377fe700 10 client.17142 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.806+0000 7f7e577fe700 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034b80bf0 0x55a034b82fe0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53932eea79c921d server_cookie=fed8a87f88de0c8c in_seq=0 out_seq=0 2023-10-08T13:18:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e377fe700 1 -- 172.21.15.5:0/1256199488 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a034a90e10 con 0x55a034b80bf0 2023-10-08T13:18:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e377fe700 10 client.17142 handle_command_reply: tid=0 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 client.17142 shutdown 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 msgr2=0x55a034b4f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 0x55a034b4f0f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0a1d20 tx=0x7f7e4c0caae0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 shutdown_connections 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034b80bf0 0x55a034b82fe0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b4cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b43e80 0x55a034b4f0f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/1256199488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b4c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 >> 172.21.15.5:0/1256199488 conn(0x55a034ab9260 msgr2=0x55a034b3fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e377fe700 0 client.17142 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 shutdown_connections 2023-10-08T13:18:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.807+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/1256199488 wait complete. 2023-10-08T13:18:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.808+0000 7f7e6a7c4b80 20 client.17142 trim_cache size 0 max 16384 2023-10-08T13:18:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.839+0000 7f7e6a7c4b80 1 Processor -- start 2023-10-08T13:18:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 -- start start 2023-10-08T13:18:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b46d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 0x55a034b4ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034918920 con 0x55a034b4f650 2023-10-08T13:18:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034b40850 con 0x55a034b43e80 2023-10-08T13:18:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.840+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034b44db0 con 0x55a034b447a0 2023-10-08T13:18:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 0x55a034b4ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 0x55a034b4ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38316/0 (socket says 172.21.15.5:38316) 2023-10-08T13:18:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 -- 172.21.15.5:0/2776699088 learned_addr learned my addr 172.21.15.5:0/2776699088 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e577fe700 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b46d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 -- 172.21.15.5:0/2776699088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 msgr2=0x55a034b46d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b46d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 -- 172.21.15.5:0/2776699088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 msgr2=0x55a034b780f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:18:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b780f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 -- 172.21.15.5:0/2776699088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0348e9250 con 0x55a034b4f650 2023-10-08T13:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.841+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 0x55a034b4ed00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009340 tx=0x7f7e50013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50259916686d3f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.842+0000 7f7e3effd700 1 -- 172.21.15.5:0/2776699088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000e050 con 0x55a034b4f650 2023-10-08T13:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.842+0000 7f7e3effd700 1 -- 172.21.15.5:0/2776699088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e5001a070 con 0x55a034b4f650 2023-10-08T13:18:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.842+0000 7f7e3effd700 1 -- 172.21.15.5:0/2776699088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500168c0 con 0x55a034b4f650 2023-10-08T13:18:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.843+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/2776699088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 msgr2=0x55a034b4ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.843+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 0x55a034b4ed00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009340 tx=0x7f7e50013000 comp rx=0 tx=0).stop 2023-10-08T13:18:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/2776699088 shutdown_connections 2023-10-08T13:18:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b4f650 0x55a034b4ed00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b43e80 0x55a034b780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/2776699088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b447a0 0x55a034b46d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/2776699088 >> 172.21.15.5:0/2776699088 conn(0x55a034ab9260 msgr2=0x55a034b3fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/2776699088 shutdown_connections 2023-10-08T13:18:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.844+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/2776699088 wait complete. 2023-10-08T13:18:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 -- start start 2023-10-08T13:18:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 Processor -- start 2023-10-08T13:18:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 0x55a034b766f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b76c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b77170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034bd4960 con 0x55a034b447a0 2023-10-08T13:18:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034bd4aa0 con 0x55a034b4f650 2023-10-08T13:18:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a034bd4be0 con 0x55a034b43e80 2023-10-08T13:18:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e6a7c4b80 10 client.0 _ll_register_callbacks cb 0x7f7e4c099a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 0x55a034b766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e5cb78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b77170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 0x55a034b766f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51522/0 (socket says 172.21.15.5:51522) 2023-10-08T13:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e5cb78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b77170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33270/0 (socket says 172.21.15.5:33270) 2023-10-08T13:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e57fff700 1 -- 172.21.15.5:0/530731681 learned_addr learned my addr 172.21.15.5:0/530731681 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e577fe700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b76c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e57fff700 1 -- 172.21.15.5:0/530731681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 msgr2=0x55a034b77170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.845+0000 7f7e57fff700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b77170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e57fff700 1 -- 172.21.15.5:0/530731681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 msgr2=0x55a034b76c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e57fff700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b76c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e57fff700 1 -- 172.21.15.5:0/530731681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e50007d40 con 0x55a034b43e80 2023-10-08T13:18:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e5cb78700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b77170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:18:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e57fff700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 0x55a034b766f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00bfd0 tx=0x7f7e4c009670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b8e7f76c26cd672 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e377fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:18:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e377fe700 1 -- 172.21.15.5:0/530731681 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0b8180 con 0x55a034b43e80 2023-10-08T13:18:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e4c0a2250 con 0x55a034b43e80 2023-10-08T13:18:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e377fe700 1 -- 172.21.15.5:0/530731681 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f7e4c0830b0 con 0x55a034b43e80 2023-10-08T13:18:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e377fe700 1 -- 172.21.15.5:0/530731681 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e4c083270 con 0x55a034b43e80 2023-10-08T13:18:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e6a7c4b80 10 client.26641 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.846+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a0348c12b0 con 0x55a034b43e80 2023-10-08T13:18:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e377fe700 1 -- 172.21.15.5:0/530731681 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e4c0a2250 con 0x55a034b43e80 2023-10-08T13:18:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e377fe700 1 -- 172.21.15.5:0/530731681 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7e4c09a120 con 0x55a034b43e80 2023-10-08T13:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e6a7c4b80 10 client.26641 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e6a7c4b80 10 client.26641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e6a7c4b80 20 client.26641 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034bd5f50 0x55a034bd8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e6a7c4b80 4 client.26641 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:18:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a034a90b30 con 0x55a034bd5f50 2023-10-08T13:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e577fe700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034bd5f50 0x55a034bd8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.847+0000 7f7e377fe700 10 client.26641 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e577fe700 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034bd5f50 0x55a034bd8370 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84485bcac3e57b44 server_cookie=5edf3b7027f327ef in_seq=0 out_seq=0 2023-10-08T13:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e377fe700 1 -- 172.21.15.5:0/530731681 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a034a90b30 con 0x55a034bd5f50 2023-10-08T13:18:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e377fe700 10 client.26641 handle_command_reply: tid=0 2023-10-08T13:18:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 client.26641 shutdown 2023-10-08T13:18:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 msgr2=0x55a034b766f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 0x55a034b766f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00bfd0 tx=0x7f7e4c009670 comp rx=0 tx=0).stop 2023-10-08T13:18:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 shutdown_connections 2023-10-08T13:18:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55a034bd5f50 0x55a034bd8370 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a034b4f650 0x55a034b77170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a034b43e80 0x55a034b766f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e377fe700 0 client.26641 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 --2- 172.21.15.5:0/530731681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a034b447a0 0x55a034b76c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 >> 172.21.15.5:0/530731681 conn(0x55a034ab9260 msgr2=0x55a034b477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 shutdown_connections 2023-10-08T13:18:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 1 -- 172.21.15.5:0/530731681 wait complete. 2023-10-08T13:18:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.848+0000 7f7e6a7c4b80 20 client.26641 trim_cache size 0 max 16384 2023-10-08T13:18:51.867 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:18:51.867 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:18:51.868 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:18:51.868 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:18:51.868 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:18:51.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:18:51.868 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:18:51.868 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:18:51.869 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:18:51.869 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:18:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7e400a1670 msgr2=0x7f7e400a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7e400a1670 0x7f7e400a3b30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e581087d0 tx=0x7f7e5000b040 comp rx=0 tx=0).stop 2023-10-08T13:18:51.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 msgr2=0x7f7e58117d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 0x7f7e58117d20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00d950 tx=0x7f7e4c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:18:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 shutdown_connections 2023-10-08T13:18:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f7e400a1670 0x7f7e400a3b30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e5810edf0 0x7f7e581a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e581077f0 0x7f7e58117d20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 --2- 172.21.15.5:0/220835034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e581083a0 0x7f7e58118260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 >> 172.21.15.5:0/220835034 conn(0x7f7e5806b770 msgr2=0x7f7e58070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 shutdown_connections 2023-10-08T13:18:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:18:51.849+0000 7f7e5e5db700 1 -- 172.21.15.5:0/220835034 wait complete. 2023-10-08T13:18:51.874 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:18:52.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:51 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:52.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:51 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:52.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:51 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.751+0000 7feffdeea700 1 -- 172.21.15.5:0/3266289996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810f310 msgr2=0x7feff8107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.751+0000 7feffdeea700 1 --2- 172.21.15.5:0/3266289996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810f310 0x7feff8107d30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009920 tx=0x7fefe8009c30 comp rx=0 tx=0).stop 2023-10-08T13:18:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.752+0000 7feffdeea700 1 -- 172.21.15.5:0/3266289996 shutdown_connections 2023-10-08T13:18:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.752+0000 7feffdeea700 1 --2- 172.21.15.5:0/3266289996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff8119fd0 0x7feff811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.752+0000 7feffdeea700 1 --2- 172.21.15.5:0/3266289996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff810eea0 0x7feff81077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.752+0000 7feffdeea700 1 --2- 172.21.15.5:0/3266289996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810f310 0x7feff8107d30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.752+0000 7feffdeea700 1 -- 172.21.15.5:0/3266289996 >> 172.21.15.5:0/3266289996 conn(0x7feff806b7c0 msgr2=0x7feff806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.753+0000 7feffdeea700 1 -- 172.21.15.5:0/3266289996 shutdown_connections 2023-10-08T13:18:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.765+0000 7feffdeea700 1 -- 172.21.15.5:0/3266289996 wait complete. 2023-10-08T13:18:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 Processor -- start 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 -- start start 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810eea0 0x7feff81ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff810f310 0x7feff81abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff8119fd0 0x7feff81a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81a5ea0 con 0x7feff8119fd0 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81a6010 con 0x7feff810f310 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feffdeea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81a61d0 con 0x7feff810eea0 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feff6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff810f310 0x7feff81abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feff6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff810f310 0x7feff81abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33282/0 (socket says 172.21.15.5:33282) 2023-10-08T13:18:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.766+0000 7feff6ffd700 1 -- 172.21.15.5:0/3217650447 learned_addr learned my addr 172.21.15.5:0/3217650447 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff77fe700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810eea0 0x7feff81ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff8119fd0 0x7feff81a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 -- 172.21.15.5:0/3217650447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810eea0 msgr2=0x7feff81ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810eea0 0x7feff81ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 -- 172.21.15.5:0/3217650447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff810f310 msgr2=0x7feff81abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff810f310 0x7feff81abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 -- 172.21.15.5:0/3217650447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8009520 con 0x7feff8119fd0 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.767+0000 7feff7fff700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff8119fd0 0x7feff81a57f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fefec00d720 tx=0x7fefec00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.768+0000 7feff4ff9700 1 -- 172.21.15.5:0/3217650447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec004220 con 0x7feff8119fd0 2023-10-08T13:18:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.768+0000 7feff4ff9700 1 -- 172.21.15.5:0/3217650447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefec004cf0 con 0x7feff8119fd0 2023-10-08T13:18:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.768+0000 7feff4ff9700 1 -- 172.21.15.5:0/3217650447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0056a0 con 0x7feff8119fd0 2023-10-08T13:18:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.768+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff81a64b0 con 0x7feff8119fd0 2023-10-08T13:18:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.768+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff810f990 con 0x7feff8119fd0 2023-10-08T13:18:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.776+0000 7feff4ff9700 1 -- 172.21.15.5:0/3217650447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fefec004380 con 0x7feff8119fd0 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.781+0000 7ff00a0d3b80 1 Processor -- start 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.782+0000 7feff4ff9700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fefe00a17f0 0x7fefe00a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.782+0000 7feff4ff9700 1 -- 172.21.15.5:0/3217650447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fefec0cd0b0 con 0x7feff8119fd0 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 -- start start 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564facac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fac4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fa2d400 con 0x55564facb1a0 2023-10-08T13:18:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fa1ebc0 con 0x55564fac50b0 2023-10-08T13:18:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.783+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fa1c4e0 con 0x55564faca880 2023-10-08T13:18:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.788+0000 7feff7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.792+0000 7feff77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564facac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.792+0000 7feff77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564facac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51544/0 (socket says 172.21.15.5:51544) 2023-10-08T13:18:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.792+0000 7feff77fe700 1 -- 172.21.15.5:0/2234514159 learned_addr learned my addr 172.21.15.5:0/2234514159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.794+0000 7feff6ffd700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fefe00a17f0 0x7fefe00a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.794+0000 7feff6ffd700 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fac4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.801+0000 7feff7fff700 1 -- 172.21.15.5:0/2234514159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 msgr2=0x55564facac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.801+0000 7feff7fff700 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564facac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.801+0000 7feff7fff700 1 -- 172.21.15.5:0/2234514159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 msgr2=0x55564fac4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.801+0000 7feff7fff700 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fac4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.801+0000 7feff7fff700 1 -- 172.21.15.5:0/2234514159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55564f842d80 con 0x55564fac50b0 2023-10-08T13:18:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.806+0000 7feff7fff700 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac5510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefec0ca410 tx=0x7fefec0998f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b9090c8320350 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.807+0000 7fefddffb700 1 -- 172.21.15.5:0/2234514159 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec099ca0 con 0x55564fac50b0 2023-10-08T13:18:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.807+0000 7fefddffb700 1 -- 172.21.15.5:0/2234514159 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefec09ddf0 con 0x55564fac50b0 2023-10-08T13:18:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.807+0000 7fefddffb700 1 -- 172.21.15.5:0/2234514159 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec099190 con 0x55564fac50b0 2023-10-08T13:18:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/2234514159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 msgr2=0x55564fac5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac5510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefec0ca410 tx=0x7fefec0998f0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/2234514159 shutdown_connections 2023-10-08T13:18:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac5510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564facac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/2234514159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fac4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.808+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/2234514159 >> 172.21.15.5:0/2234514159 conn(0x55564fa39200 msgr2=0x55564fabfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.812+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/2234514159 shutdown_connections 2023-10-08T13:18:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.819+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/2234514159 wait complete. 2023-10-08T13:18:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.819+0000 7ff00a0d3b80 1 -- start start 2023-10-08T13:18:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.819+0000 7ff00a0d3b80 1 Processor -- start 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564faca880 0x55564face630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564faced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fa17dd0 con 0x55564facb1a0 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564f9b46b0 con 0x55564faca880 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564f9b4350 con 0x55564fac50b0 2023-10-08T13:18:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.820+0000 7ff00a0d3b80 10 client.0 _ll_register_callbacks cb 0x55564f8117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.822+0000 7feff7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564faced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.822+0000 7feff7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564faced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38346/0 (socket says 172.21.15.5:38346) 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.822+0000 7feff7fff700 1 -- 172.21.15.5:0/1608250865 learned_addr learned my addr 172.21.15.5:0/1608250865 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.823+0000 7feff77fe700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff6ffd700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564faca880 0x55564face630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff6ffd700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fefe00a17f0 0x7fefe00a3cb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55564facb600 tx=0x7fefe8019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff7fff700 1 -- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 msgr2=0x55564fad1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff7fff700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff7fff700 1 -- 172.21.15.5:0/1608250865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564faca880 msgr2=0x55564face630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff7fff700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564faca880 0x55564face630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.824+0000 7feff7fff700 1 -- 172.21.15.5:0/1608250865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff810f990 con 0x55564facb1a0 2023-10-08T13:18:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.825+0000 7feff7fff700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564faced70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fefec005950 tx=0x7fefec022580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d867c852a985cf76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:52.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.825+0000 7fefd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.825+0000 7fefd6ffd700 1 -- 172.21.15.5:0/1608250865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0a2030 con 0x55564facb1a0 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.826+0000 7fefd6ffd700 1 -- 172.21.15.5:0/1608250865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fefec099ca0 con 0x55564facb1a0 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.826+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55564f9dfe50 con 0x55564facb1a0 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.826+0000 7fefd6ffd700 1 -- 172.21.15.5:0/1608250865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefec0993a0 con 0x55564facb1a0 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.826+0000 7ff00a0d3b80 10 client.17160 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.826+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55564f82bc00 con 0x55564facb1a0 2023-10-08T13:18:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7fefd6ffd700 1 -- 172.21.15.5:0/1608250865 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55564f9dfe50 con 0x55564facb1a0 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7fefd6ffd700 1 -- 172.21.15.5:0/1608250865 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fefec0cab60 con 0x55564facb1a0 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7ff00a0d3b80 10 client.17160 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7ff00a0d3b80 10 client.17160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7ff00a0d3b80 20 client.17160 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fade790 0x55564fae0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7ff00a0d3b80 4 client.17160 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:18:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.827+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55564fa10db0 con 0x55564fade790 2023-10-08T13:18:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.830+0000 7feff77fe700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fade790 0x55564fae0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.833+0000 7feff77fe700 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fade790 0x55564fae0bb0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e966add702aef9d server_cookie=1db361e7e0f4652e in_seq=0 out_seq=0 2023-10-08T13:18:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.833+0000 7fefd6ffd700 10 client.17160 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.834+0000 7fefd6ffd700 1 -- 172.21.15.5:0/1608250865 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55564fa10db0 con 0x55564fade790 2023-10-08T13:18:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.834+0000 7fefd6ffd700 10 client.17160 handle_command_reply: tid=0 2023-10-08T13:18:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.836+0000 7ff00a0d3b80 1 client.17160 shutdown 2023-10-08T13:18:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.836+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 msgr2=0x55564faced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.836+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564faced70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fefec005950 tx=0x7fefec022580 comp rx=0 tx=0).stop 2023-10-08T13:18:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 shutdown_connections 2023-10-08T13:18:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564faced70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fade790 0x55564fae0bb0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/1608250865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564faca880 0x55564face630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 >> 172.21.15.5:0/1608250865 conn(0x55564fa39200 msgr2=0x55564fabf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.837+0000 7fefd6ffd700 0 client.17160 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.840+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 shutdown_connections 2023-10-08T13:18:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.840+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/1608250865 wait complete. 2023-10-08T13:18:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.863+0000 7ff00a0d3b80 20 client.17160 trim_cache size 0 max 16384 2023-10-08T13:18:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.892+0000 7ff00a0d3b80 1 Processor -- start 2023-10-08T13:18:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 -- start start 2023-10-08T13:18:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564fad5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fad0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564f8988c0 con 0x55564facb1a0 2023-10-08T13:18:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564faba2b0 con 0x55564fac50b0 2023-10-08T13:18:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.895+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564facaeb0 con 0x55564faca880 2023-10-08T13:18:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fad0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fad0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38352/0 (socket says 172.21.15.5:38352) 2023-10-08T13:18:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 -- 172.21.15.5:0/3050012940 learned_addr learned my addr 172.21.15.5:0/3050012940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 -- 172.21.15.5:0/3050012940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 msgr2=0x55564fad5c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:18:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564fad5c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 -- 172.21.15.5:0/3050012940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 msgr2=0x55564fac9e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:18:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac9e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.897+0000 7feff7fff700 1 -- 172.21.15.5:0/3050012940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55564f8691f0 con 0x55564facb1a0 2023-10-08T13:18:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.898+0000 7feff7fff700 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fad0d30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fefec0961a0 tx=0x7fefec00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3321bf528ca93d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.906+0000 7fefde7fc700 1 -- 172.21.15.5:0/3050012940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0ca3d0 con 0x55564facb1a0 2023-10-08T13:18:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.906+0000 7fefde7fc700 1 -- 172.21.15.5:0/3050012940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefec099ca0 con 0x55564facb1a0 2023-10-08T13:18:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.906+0000 7fefde7fc700 1 -- 172.21.15.5:0/3050012940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec098300 con 0x55564facb1a0 2023-10-08T13:18:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.913+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/3050012940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 msgr2=0x55564fad0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.913+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fad0d30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fefec0961a0 tx=0x7fefec00b420 comp rx=0 tx=0).stop 2023-10-08T13:18:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.927+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/3050012940 shutdown_connections 2023-10-08T13:18:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.927+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564facb1a0 0x55564fad0d30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.927+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564fac50b0 0x55564fac9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.927+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/3050012940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564faca880 0x55564fad5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.927+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/3050012940 >> 172.21.15.5:0/3050012940 conn(0x55564fa39200 msgr2=0x55564fac9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.935+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/3050012940 shutdown_connections 2023-10-08T13:18:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.939+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/3050012940 wait complete. 2023-10-08T13:18:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.940+0000 7ff00a0d3b80 1 -- start start 2023-10-08T13:18:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.940+0000 7ff00a0d3b80 1 Processor -- start 2023-10-08T13:18:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564faca880 0x55564fad4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564facb1a0 0x55564fad4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fb31600 con 0x55564faca880 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fb31740 con 0x55564facb1a0 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55564fb31880 con 0x55564fac50b0 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7ff00a0d3b80 10 client.0 _ll_register_callbacks cb 0x7fefe8009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7feff7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564facb1a0 0x55564fad4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7feff7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564facb1a0 0x55564fad4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33308/0 (socket says 172.21.15.5:33308) 2023-10-08T13:18:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.944+0000 7feff7fff700 1 -- 172.21.15.5:0/4162861183 learned_addr learned my addr 172.21.15.5:0/4162861183 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:18:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.945+0000 7feff6ffd700 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564faca880 0x55564fad4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.945+0000 7feff6ffd700 1 -- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 msgr2=0x55564fad3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.945+0000 7feff6ffd700 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.945+0000 7feff6ffd700 1 -- 172.21.15.5:0/4162861183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564facb1a0 msgr2=0x55564fad4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:18:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.945+0000 7feff6ffd700 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564facb1a0 0x55564fad4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.945+0000 7feff6ffd700 1 -- 172.21.15.5:0/4162861183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55564f82bc00 con 0x55564faca880 2023-10-08T13:18:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.946+0000 7feff6ffd700 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564faca880 0x55564fad4140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feff81a6f20 tx=0x7fefe8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e202a9a6b198f798 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:18:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.946+0000 7fefd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:18:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.947+0000 7fefd6ffd700 1 -- 172.21.15.5:0/4162861183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80052c0 con 0x55564faca880 2023-10-08T13:18:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.947+0000 7fefd6ffd700 1 -- 172.21.15.5:0/4162861183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fefe8005420 con 0x55564faca880 2023-10-08T13:18:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.947+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefec09ddf0 con 0x55564faca880 2023-10-08T13:18:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7fefd6ffd700 1 -- 172.21.15.5:0/4162861183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe80055e0 con 0x55564faca880 2023-10-08T13:18:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7ff00a0d3b80 10 client.17166 fetch_fsmap learned FSMap version 51 2023-10-08T13:18:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55564f841250 con 0x55564faca880 2023-10-08T13:18:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7fefd6ffd700 1 -- 172.21.15.5:0/4162861183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefec09ddf0 con 0x55564faca880 2023-10-08T13:18:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7fefd6ffd700 1 -- 172.21.15.5:0/4162861183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fefe8003a60 con 0x55564faca880 2023-10-08T13:18:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7ff00a0d3b80 10 client.17166 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:18:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.948+0000 7ff00a0d3b80 10 client.17166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:18:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.949+0000 7ff00a0d3b80 20 client.17166 populate_metadata read hostname 'smithi005' 2023-10-08T13:18:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.949+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fb33050 0x55564fb35470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:18:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.949+0000 7ff00a0d3b80 4 client.17166 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:18:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.949+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55564fa10ad0 con 0x55564fb33050 2023-10-08T13:18:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.949+0000 7feff77fe700 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fb33050 0x55564fb35470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:18:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.961+0000 7feff77fe700 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fb33050 0x55564fb35470 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dbb2997be64e937 server_cookie=13cac2a47a36c701 in_seq=0 out_seq=0 2023-10-08T13:18:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.961+0000 7fefd6ffd700 10 client.17166 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7fefd6ffd700 1 -- 172.21.15.5:0/4162861183 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55564fa10ad0 con 0x55564fb33050 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7fefd6ffd700 10 client.17166 handle_command_reply: tid=0 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 client.17166 shutdown 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564faca880 msgr2=0x55564fad4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564faca880 0x55564fad4140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7feff81a6f20 tx=0x7fefe8009c30 comp rx=0 tx=0).stop 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 shutdown_connections 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55564fb33050 0x55564fb35470 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55564facb1a0 0x55564fad4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55564fac50b0 0x55564fad3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 --2- 172.21.15.5:0/4162861183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55564faca880 0x55564fad4140 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 >> 172.21.15.5:0/4162861183 conn(0x55564fa39200 msgr2=0x55564faccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7fefd6ffd700 0 client.17166 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 shutdown_connections 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 1 -- 172.21.15.5:0/4162861183 wait complete. 2023-10-08T13:18:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.984+0000 7ff00a0d3b80 20 client.17166 trim_cache size 0 max 16384 2023-10-08T13:18:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:18:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:18:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:18:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:18:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fefe00a17f0 msgr2=0x7fefe00a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fefe00a17f0 0x7fefe00a3cb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55564facb600 tx=0x7fefe8019040 comp rx=0 tx=0).stop 2023-10-08T13:18:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff8119fd0 msgr2=0x7feff81a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:18:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff8119fd0 0x7feff81a57f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fefec00d720 tx=0x7fefec00da30 comp rx=0 tx=0).stop 2023-10-08T13:18:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 shutdown_connections 2023-10-08T13:18:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fefe00a17f0 0x7fefe00a3cb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feff8119fd0 0x7feff81a57f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feff810eea0 0x7feff81ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 --2- 172.21.15.5:0/3217650447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feff810f310 0x7feff81abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:18:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 >> 172.21.15.5:0/3217650447 conn(0x7feff806b7c0 msgr2=0x7feff8117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:18:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.989+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 shutdown_connections 2023-10-08T13:18:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:18:52.990+0000 7feffdeea700 1 -- 172.21.15.5:0/3217650447 wait complete. 2023-10-08T13:18:53.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:53 smithi060 ceph-mon[103190]: pgmap v698: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.5 MiB/s wr, 508 op/s 2023-10-08T13:18:53.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:53 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:53 smithi005 ceph-mon[99496]: pgmap v698: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.5 MiB/s wr, 508 op/s 2023-10-08T13:18:53.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.428 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.428 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:53 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:53 smithi118 ceph-mon[104234]: pgmap v698: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.5 MiB/s wr, 508 op/s 2023-10-08T13:18:53.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:53.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:53 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:54.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:18:54.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:18:54.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:54.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:18:54.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:18:54.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:54.673 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:18:54.673 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:18:54.673 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:18:55.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:55 smithi118 ceph-mon[104234]: pgmap v699: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.0 MiB/s wr, 479 op/s 2023-10-08T13:18:55.663 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:55 smithi060 ceph-mon[103190]: pgmap v699: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.0 MiB/s wr, 479 op/s 2023-10-08T13:18:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:55 smithi005 ceph-mon[99496]: pgmap v699: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.0 MiB/s wr, 479 op/s 2023-10-08T13:18:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 755.0 s, 526.5 tps, lat 198.987 ms stddev 201.137 2023-10-08T13:18:57.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:57 smithi118 ceph-mon[104234]: pgmap v700: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.8 MiB/s wr, 576 op/s 2023-10-08T13:18:57.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:57 smithi060 ceph-mon[103190]: pgmap v700: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.8 MiB/s wr, 576 op/s 2023-10-08T13:18:57.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:57 smithi005 ceph-mon[99496]: pgmap v700: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.8 MiB/s wr, 576 op/s 2023-10-08T13:18:58.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:18:58 smithi060 ceph-mon[103190]: pgmap v701: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 456 op/s 2023-10-08T13:18:58.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:18:58 smithi005 ceph-mon[99496]: pgmap v701: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 456 op/s 2023-10-08T13:18:58.778 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:18:58 smithi118 ceph-mon[104234]: pgmap v701: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 456 op/s 2023-10-08T13:19:01.277 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:00 smithi118 ceph-mon[104234]: pgmap v702: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.3 MiB/s wr, 531 op/s 2023-10-08T13:19:01.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:00 smithi060 ceph-mon[103190]: pgmap v702: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.3 MiB/s wr, 531 op/s 2023-10-08T13:19:01.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:00 smithi005 ceph-mon[99496]: pgmap v702: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.3 MiB/s wr, 531 op/s 2023-10-08T13:19:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 760.0 s, 448.8 tps, lat 216.446 ms stddev 238.589 2023-10-08T13:19:03.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:02 smithi118 ceph-mon[104234]: pgmap v703: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.5 MiB/s wr, 502 op/s 2023-10-08T13:19:03.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:02 smithi060 ceph-mon[103190]: pgmap v703: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.5 MiB/s wr, 502 op/s 2023-10-08T13:19:03.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:02 smithi005 ceph-mon[99496]: pgmap v703: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.5 MiB/s wr, 502 op/s 2023-10-08T13:19:05.272 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:04 smithi118 ceph-mon[104234]: pgmap v704: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 488 op/s 2023-10-08T13:19:05.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:04 smithi060 ceph-mon[103190]: pgmap v704: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 488 op/s 2023-10-08T13:19:05.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:04 smithi005 ceph-mon[99496]: pgmap v704: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 488 op/s 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 -- 172.21.15.5:0/259482695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72301056d0 msgr2=0x7f7230105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 --2- 172.21.15.5:0/259482695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72301056d0 0x7f7230105ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72240099c0 tx=0x7f7224009cd0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 -- 172.21.15.5:0/259482695 shutdown_connections 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 --2- 172.21.15.5:0/259482695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723010c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 --2- 172.21.15.5:0/259482695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72301056d0 0x7f7230105ab0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 --2- 172.21.15.5:0/259482695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72300ffd00 0x7f7230100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 -- 172.21.15.5:0/259482695 >> 172.21.15.5:0/259482695 conn(0x7f7230075b20 msgr2=0x7f72300fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 -- 172.21.15.5:0/259482695 shutdown_connections 2023-10-08T13:19:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.104+0000 7f72355a7700 1 -- 172.21.15.5:0/259482695 wait complete. 2023-10-08T13:19:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 Processor -- start 2023-10-08T13:19:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 -- start start 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72300ffd00 0x7f723019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72301056d0 0x7f7230195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230195e80 con 0x7f72301006a0 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230195ff0 con 0x7f72301056d0 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.105+0000 7f72355a7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72301961b0 con 0x7f72300ffd00 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72300ffd00 0x7f723019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723019bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38376/0 (socket says 172.21.15.5:38376) 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 -- 172.21.15.5:0/1248727237 learned_addr learned my addr 172.21.15.5:0/1248727237 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722f7fe700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72301056d0 0x7f7230195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 -- 172.21.15.5:0/1248727237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72300ffd00 msgr2=0x7f723019b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72300ffd00 0x7f723019b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 -- 172.21.15.5:0/1248727237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72301056d0 msgr2=0x7f7230195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72301056d0 0x7f7230195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 -- 172.21.15.5:0/1248727237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228009c40 con 0x7f72301006a0 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f722e7fc700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723019bc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f722000e9a0 tx=0x7f722000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f7217fff700 1 -- 172.21.15.5:0/1248727237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220009790 con 0x7f72301006a0 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72240095f0 con 0x7f72301006a0 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f7217fff700 1 -- 172.21.15.5:0/1248727237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f722000ee30 con 0x7f72301006a0 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f7217fff700 1 -- 172.21.15.5:0/1248727237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220016e70 con 0x7f72301006a0 2023-10-08T13:19:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.106+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72300febf0 con 0x7f72301006a0 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.108+0000 7f7217fff700 1 -- 172.21.15.5:0/1248727237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7220016510 con 0x7f72301006a0 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.109+0000 7f7217fff700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72180a15e0 0x7f72180a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.109+0000 7f7217fff700 1 -- 172.21.15.5:0/1248727237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f72200ccbe0 con 0x7f72301006a0 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.109+0000 7f722effd700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72180a15e0 0x7f72180a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72180a15e0 0x7f72180a3aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7224009fd0 tx=0x7f7224019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 Processor -- start 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 -- start start 2023-10-08T13:19:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x55926369eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x55926369f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559263607400 con 0x5592636a4880 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592635f8bc0 con 0x5592636a51a0 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f7241790b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592635f64e0 con 0x55926369f0b0 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38382/0 (socket says 172.21.15.5:38382) 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 -- 172.21.15.5:0/282152919 learned_addr learned my addr 172.21.15.5:0/282152919 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722e7fc700 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x55926369eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722f7fe700 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x55926369f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 -- 172.21.15.5:0/282152919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 msgr2=0x55926369f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x55926369f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 -- 172.21.15.5:0/282152919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 msgr2=0x55926369eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x55926369eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722effd700 1 -- 172.21.15.5:0/282152919 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55926341cd80 con 0x5592636a4880 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.110+0000 7f722e7fc700 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x55926369eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.111+0000 7f722effd700 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a4c60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f72240099c0 tx=0x7f722401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697bbc86cf3f06d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.111+0000 7f72157fa700 1 -- 172.21.15.5:0/282152919 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400f8c0 con 0x5592636a4880 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.111+0000 7f72157fa700 1 -- 172.21.15.5:0/282152919 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f722401d040 con 0x5592636a4880 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.111+0000 7f72157fa700 1 -- 172.21.15.5:0/282152919 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224023d90 con 0x5592636a4880 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.111+0000 7f7241790b80 1 -- 172.21.15.5:0/282152919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 msgr2=0x5592636a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.111+0000 7f7241790b80 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a4c60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f72240099c0 tx=0x7f722401f000 comp rx=0 tx=0).stop 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- 172.21.15.5:0/282152919 shutdown_connections 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x55926369f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a4c60 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 --2- 172.21.15.5:0/282152919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x55926369eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- 172.21.15.5:0/282152919 >> 172.21.15.5:0/282152919 conn(0x559263613200 msgr2=0x559263699b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- 172.21.15.5:0/282152919 shutdown_connections 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- 172.21.15.5:0/282152919 wait complete. 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- start start 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 Processor -- start 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x5592636a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636a9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592635f1dd0 con 0x5592636a4880 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55926358e6b0 con 0x5592636a51a0 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55926358e350 con 0x55926369f0b0 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f7241790b80 10 client.0 _ll_register_callbacks cb 0x5592633eb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f722e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f722effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x5592636a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f722e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38390/0 (socket says 172.21.15.5:38390) 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f722effd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x5592636a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51592/0 (socket says 172.21.15.5:51592) 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.112+0000 7f722e7fc700 1 -- 172.21.15.5:0/1103073853 learned_addr learned my addr 172.21.15.5:0/1103073853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722f7fe700 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722effd700 1 -- 172.21.15.5:0/1103073853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 msgr2=0x5592636a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722effd700 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636a9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722effd700 1 -- 172.21.15.5:0/1103073853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 msgr2=0x5592636a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722effd700 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722effd700 1 -- 172.21.15.5:0/1103073853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72300febf0 con 0x55926369f0b0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f722effd700 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x5592636a8580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72240098e0 tx=0x7f7224005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368ec334532905f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7212ff5700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7212ff5700 1 -- 172.21.15.5:0/1103073853 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224023b70 con 0x55926369f0b0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592635b9e50 con 0x55926369f0b0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7212ff5700 1 -- 172.21.15.5:0/1103073853 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f7224023cd0 con 0x55926369f0b0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7212ff5700 1 -- 172.21.15.5:0/1103073853 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7224023e90 con 0x55926369f0b0 2023-10-08T13:19:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7241790b80 10 client.26662 fetch_fsmap learned FSMap version 51 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.113+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f723010cd70 con 0x55926369f0b0 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7212ff5700 1 -- 172.21.15.5:0/1103073853 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5592635b9e50 con 0x55926369f0b0 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7212ff5700 1 -- 172.21.15.5:0/1103073853 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7224037490 con 0x55926369f0b0 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7241790b80 10 client.26662 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7241790b80 10 client.26662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7241790b80 20 client.26662 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7241790b80 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592636b8750 0x5592636bab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7241790b80 4 client.26662 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592635eadb0 con 0x5592636b8750 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f722e7fc700 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592636b8750 0x5592636bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f7212ff5700 10 client.26662 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.114+0000 7f722e7fc700 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592636b8750 0x5592636bab40 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c9ce2394d1e9930 server_cookie=948d5270420bc9f1 in_seq=0 out_seq=0 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7212ff5700 1 -- 172.21.15.5:0/1103073853 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5592635eadb0 con 0x5592636b8750 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7212ff5700 10 client.26662 handle_command_reply: tid=0 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 client.26662 shutdown 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 msgr2=0x5592636a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x5592636a8580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72240098e0 tx=0x7f7224005cd0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 shutdown_connections 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5592636b8750 0x5592636bab40 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55926369f0b0 0x5592636a8580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 --2- 172.21.15.5:0/1103073853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7212ff5700 0 client.26662 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 >> 172.21.15.5:0/1103073853 conn(0x559263613200 msgr2=0x559263699010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 shutdown_connections 2023-10-08T13:19:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 1 -- 172.21.15.5:0/1103073853 wait complete. 2023-10-08T13:19:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.115+0000 7f7241790b80 20 client.26662 trim_cache size 0 max 16384 2023-10-08T13:19:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 Processor -- start 2023-10-08T13:19:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 -- start start 2023-10-08T13:19:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 0x55926369eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a51a0 0x5592636a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592634728c0 con 0x5592636a4880 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592636942b0 con 0x55926369f0b0 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f7241790b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592636a9b30 con 0x5592636a51a0 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 0x55926369eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 0x55926369eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33346/0 (socket says 172.21.15.5:33346) 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38398/0 (socket says 172.21.15.5:38398) 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 -- 172.21.15.5:0/2889173816 learned_addr learned my addr 172.21.15.5:0/2889173816 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722f7fe700 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a51a0 0x5592636a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 -- 172.21.15.5:0/2889173816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a51a0 msgr2=0x5592636a3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a51a0 0x5592636a3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 -- 172.21.15.5:0/2889173816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 msgr2=0x5592636afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722effd700 1 -- 172.21.15.5:0/2889173816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592636bf700 con 0x55926369f0b0 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722e7fc700 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.130+0000 7f722f7fe700 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a51a0 0x5592636a3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f722effd700 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 0x55926369eb70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f722400bad0 tx=0x7f72240379c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf73769ecd505cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7215ffb700 1 -- 172.21.15.5:0/2889173816 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400bde0 con 0x55926369f0b0 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7215ffb700 1 -- 172.21.15.5:0/2889173816 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f722403b070 con 0x55926369f0b0 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7215ffb700 1 -- 172.21.15.5:0/2889173816 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400f9a0 con 0x55926369f0b0 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 -- 172.21.15.5:0/2889173816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 msgr2=0x55926369eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 0x55926369eb70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f722400bad0 tx=0x7f72240379c0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 -- 172.21.15.5:0/2889173816 shutdown_connections 2023-10-08T13:19:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a51a0 0x5592636a3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55926369f0b0 0x55926369eb70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 --2- 172.21.15.5:0/2889173816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5592636a4880 0x5592636afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 -- 172.21.15.5:0/2889173816 >> 172.21.15.5:0/2889173816 conn(0x559263613200 msgr2=0x5592636a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 -- 172.21.15.5:0/2889173816 shutdown_connections 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.131+0000 7f7241790b80 1 -- 172.21.15.5:0/2889173816 wait complete. 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 -- start start 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 Processor -- start 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 0x5592636adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a4880 0x5592636ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55926370b4e0 con 0x55926369f0b0 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55926370b620 con 0x5592636a51a0 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55926370b760 con 0x5592636a4880 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f7241790b80 10 client.0 _ll_register_callbacks cb 0x7f7220095c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 0x5592636adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 0x5592636adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38402/0 (socket says 172.21.15.5:38402) 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 -- 172.21.15.5:0/2348729414 learned_addr learned my addr 172.21.15.5:0/2348729414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722e7fc700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a4880 0x5592636ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722f7fe700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 -- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a4880 msgr2=0x5592636ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a4880 0x5592636ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 -- 172.21.15.5:0/2348729414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 msgr2=0x5592636ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:06.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.132+0000 7f722effd700 1 -- 172.21.15.5:0/2348729414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72240095f0 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f722effd700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 0x5592636adb70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7224037850 tx=0x7f7224009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867eb6f1b84255c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7212ff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7212ff5700 1 -- 172.21.15.5:0/2348729414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400bde0 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7212ff5700 1 -- 172.21.15.5:0/2348729414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f7224023830 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f722401d040 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7212ff5700 1 -- 172.21.15.5:0/2348729414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72240239f0 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 10 client.17184 fetch_fsmap learned FSMap version 51 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f723010cd70 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7212ff5700 1 -- 172.21.15.5:0/2348729414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f722401d040 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7212ff5700 1 -- 172.21.15.5:0/2348729414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f722403f4b0 con 0x55926369f0b0 2023-10-08T13:19:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 10 client.17184 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 10 client.17184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 20 client.17184 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55926370c9b0 0x55926370eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 4 client.17184 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.133+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5592635eaad0 con 0x55926370c9b0 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.134+0000 7f722e7fc700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55926370c9b0 0x55926370eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.134+0000 7f7212ff5700 10 client.17184 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.134+0000 7f722e7fc700 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55926370c9b0 0x55926370eda0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2632618c527b80f2 server_cookie=805bfccd2cf64977 in_seq=0 out_seq=0 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7212ff5700 1 -- 172.21.15.5:0/2348729414 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5592635eaad0 con 0x55926370c9b0 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7212ff5700 10 client.17184 handle_command_reply: tid=0 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 client.17184 shutdown 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 msgr2=0x5592636adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 0x5592636adb70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7224037850 tx=0x7f7224009940 comp rx=0 tx=0).stop 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 shutdown_connections 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55926370c9b0 0x55926370eda0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592636a51a0 0x5592636ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7212ff5700 0 client.17184 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55926369f0b0 0x5592636adb70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 --2- 172.21.15.5:0/2348729414 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592636a4880 0x5592636ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 >> 172.21.15.5:0/2348729414 conn(0x559263613200 msgr2=0x5592636a6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 shutdown_connections 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 1 -- 172.21.15.5:0/2348729414 wait complete. 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.142+0000 7f7241790b80 20 client.17184 trim_cache size 0 max 16384 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:19:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:19:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:19:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72180a15e0 msgr2=0x7f72180a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72180a15e0 0x7f72180a3aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7224009fd0 tx=0x7f7224019040 comp rx=0 tx=0).stop 2023-10-08T13:19:06.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 msgr2=0x7f723019bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723019bc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f722000e9a0 tx=0x7f722000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 shutdown_connections 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f72180a15e0 0x7f72180a3aa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72301056d0 0x7f7230195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72300ffd00 0x7f723019b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 --2- 172.21.15.5:0/1248727237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72301006a0 0x7f723019bc20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 >> 172.21.15.5:0/1248727237 conn(0x7f7230075b20 msgr2=0x7f72300fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 shutdown_connections 2023-10-08T13:19:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:06.143+0000 7f72355a7700 1 -- 172.21.15.5:0/1248727237 wait complete. 2023-10-08T13:19:06.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 765.0 s, 329.0 tps, lat 202.987 ms stddev 218.303 2023-10-08T13:19:07.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:06 smithi118 ceph-mon[104234]: pgmap v705: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.2 MiB/s wr, 575 op/s 2023-10-08T13:19:07.418 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:06 smithi060 ceph-mon[103190]: pgmap v705: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.2 MiB/s wr, 575 op/s 2023-10-08T13:19:07.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:06 smithi005 ceph-mon[99496]: pgmap v705: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.2 MiB/s wr, 575 op/s 2023-10-08T13:19:09.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:08 smithi118 ceph-mon[104234]: pgmap v706: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.0 MiB/s wr, 473 op/s 2023-10-08T13:19:09.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:08 smithi060 ceph-mon[103190]: pgmap v706: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.0 MiB/s wr, 473 op/s 2023-10-08T13:19:09.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:08 smithi005 ceph-mon[99496]: pgmap v706: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.0 MiB/s wr, 473 op/s 2023-10-08T13:19:10.273 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:09 smithi118 ceph-mon[104234]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T13:19:10.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:09 smithi060 ceph-mon[103190]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T13:19:10.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:09 smithi005 ceph-mon[99496]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T13:19:11.279 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:11 smithi118 ceph-mon[104234]: pgmap v708: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.6 MiB/s wr, 451 op/s 2023-10-08T13:19:11.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:11 smithi060 ceph-mon[103190]: pgmap v708: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.6 MiB/s wr, 451 op/s 2023-10-08T13:19:11.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:11 smithi005 ceph-mon[99496]: pgmap v708: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.6 MiB/s wr, 451 op/s 2023-10-08T13:19:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 770.0 s, 266.8 tps, lat 499.534 ms stddev 1279.086 2023-10-08T13:19:13.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:13 smithi118 ceph-mon[104234]: pgmap v709: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 4.1 MiB/s wr, 385 op/s 2023-10-08T13:19:13.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:13 smithi060 ceph-mon[103190]: pgmap v709: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 4.1 MiB/s wr, 385 op/s 2023-10-08T13:19:13.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:13 smithi005 ceph-mon[99496]: pgmap v709: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 4.1 MiB/s wr, 385 op/s 2023-10-08T13:19:15.275 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:15 smithi118 ceph-mon[104234]: pgmap v710: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.9 MiB/s wr, 355 op/s 2023-10-08T13:19:15.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:15 smithi060 ceph-mon[103190]: pgmap v710: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.9 MiB/s wr, 355 op/s 2023-10-08T13:19:15.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:15 smithi005 ceph-mon[99496]: pgmap v710: 129 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.9 MiB/s wr, 355 op/s 2023-10-08T13:19:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 775.0 s, 477.5 tps, lat 208.786 ms stddev 217.554 2023-10-08T13:19:17.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:17 smithi060 ceph-mon[103190]: pgmap v711: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-10-08T13:19:17.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:17 smithi005 ceph-mon[99496]: pgmap v711: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-10-08T13:19:17.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:17 smithi118 ceph-mon[104234]: pgmap v711: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 -- 172.21.15.5:0/4094067020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8100670 msgr2=0x7f75f8100af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/4094067020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8100670 0x7f75f8100af0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009990 tx=0x7f75ec009ca0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 -- 172.21.15.5:0/4094067020 shutdown_connections 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/4094067020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75f8101030 0x7f75f810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/4094067020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8106680 0x7f75f8106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/4094067020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8100670 0x7f75f8100af0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 -- 172.21.15.5:0/4094067020 >> 172.21.15.5:0/4094067020 conn(0x7f75f80fc1c0 msgr2=0x7f75f80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 -- 172.21.15.5:0/4094067020 shutdown_connections 2023-10-08T13:19:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.282+0000 7f75fdfd1700 1 -- 172.21.15.5:0/4094067020 wait complete. 2023-10-08T13:19:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.283+0000 7f75fdfd1700 1 Processor -- start 2023-10-08T13:19:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.283+0000 7f75fdfd1700 1 -- start start 2023-10-08T13:19:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75fdfd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 0x7f75f806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75fdfd1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75f8101030 0x7f75f8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75fdfd1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8106680 0x7f75f806af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75fdfd1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f806b750 con 0x7f75f8106680 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75fdfd1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f806b8c0 con 0x7f75f8100670 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75fdfd1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f806ba80 con 0x7f75f8101030 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 0x7f75f806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 0x7f75f806fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33366/0 (socket says 172.21.15.5:33366) 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 -- 172.21.15.5:0/1530593752 learned_addr learned my addr 172.21.15.5:0/1530593752 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f7fff700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8106680 0x7f75f806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 -- 172.21.15.5:0/1530593752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75f8101030 msgr2=0x7f75f8070310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75f8101030 0x7f75f8070310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 -- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8106680 msgr2=0x7f75f806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8106680 0x7f75f806af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.284+0000 7f75f77fe700 1 -- 172.21.15.5:0/1530593752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8009520 con 0x7f75f8100670 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.285+0000 7f75f77fe700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 0x7f75f806fdb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eb30 tx=0x7f75e800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.285+0000 7f75f4ff9700 1 -- 172.21.15.5:0/1530593752 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800cd40 con 0x7f75f8100670 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.285+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec0095f0 con 0x7f75f8100670 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.285+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f8073d00 con 0x7f75f8100670 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.285+0000 7f75f4ff9700 1 -- 172.21.15.5:0/1530593752 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75e800cea0 con 0x7f75f8100670 2023-10-08T13:19:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.285+0000 7f75f4ff9700 1 -- 172.21.15.5:0/1530593752 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8010430 con 0x7f75f8100670 2023-10-08T13:19:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.288+0000 7f75f4ff9700 1 -- 172.21.15.5:0/1530593752 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f75e8010590 con 0x7f75f8100670 2023-10-08T13:19:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.289+0000 7f75f4ff9700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75e00a1660 0x7f75e00a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.289+0000 7f75f4ff9700 1 -- 172.21.15.5:0/1530593752 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f75e8014070 con 0x7f75f8100670 2023-10-08T13:19:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.289+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75e00a1660 0x7f75e00a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 Processor -- start 2023-10-08T13:19:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 -- start start 2023-10-08T13:19:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 0x5620dbd1bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 0x5620dbd15b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd16510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbc7e400 con 0x5620dbd160b0 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbc6fbc0 con 0x5620dbd1b880 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f760a1bab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbc6d4e0 con 0x5620dbd1c1a0 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.290+0000 7f75f6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 0x5620dbd15b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd16510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 0x5620dbd1bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 0x5620dbd15b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51628/0 (socket says 172.21.15.5:51628) 2023-10-08T13:19:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd16510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38426/0 (socket says 172.21.15.5:38426) 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 0x5620dbd1bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33372/0 (socket says 172.21.15.5:33372) 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 -- 172.21.15.5:0/2720824863 learned_addr learned my addr 172.21.15.5:0/2720824863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75e00a1660 0x7f75e00a3b20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0098e0 tx=0x7f75ec005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 -- 172.21.15.5:0/2720824863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 msgr2=0x5620dbd1bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 0x5620dbd1bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 -- 172.21.15.5:0/2720824863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 msgr2=0x5620dbd16510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd16510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 -- 172.21.15.5:0/2720824863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620dba93d80 con 0x5620dbd1c1a0 2023-10-08T13:19:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f7fff700 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd16510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f77fe700 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 0x5620dbd1bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 0x5620dbd15b70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75ec015000 tx=0x7f75ec01d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1ec29b8a7c9f8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75ddffb700 1 -- 172.21.15.5:0/2720824863 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec029070 con 0x5620dbd1c1a0 2023-10-08T13:19:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75ddffb700 1 -- 172.21.15.5:0/2720824863 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75ec005460 con 0x5620dbd1c1a0 2023-10-08T13:19:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.291+0000 7f75ddffb700 1 -- 172.21.15.5:0/2720824863 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec01d070 con 0x5620dbd1c1a0 2023-10-08T13:19:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 -- 172.21.15.5:0/2720824863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 msgr2=0x5620dbd15b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 0x5620dbd15b70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75ec015000 tx=0x7f75ec01d000 comp rx=0 tx=0).stop 2023-10-08T13:19:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 -- 172.21.15.5:0/2720824863 shutdown_connections 2023-10-08T13:19:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd16510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1b880 0x5620dbd1bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 --2- 172.21.15.5:0/2720824863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1c1a0 0x5620dbd15b70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 -- 172.21.15.5:0/2720824863 >> 172.21.15.5:0/2720824863 conn(0x5620dbc8a200 msgr2=0x5620dbd10b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 -- 172.21.15.5:0/2720824863 shutdown_connections 2023-10-08T13:19:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.292+0000 7f760a1bab80 1 -- 172.21.15.5:0/2720824863 wait complete. 2023-10-08T13:19:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 -- start start 2023-10-08T13:19:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 Processor -- start 2023-10-08T13:19:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd22230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd1f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd1fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbc68dd0 con 0x5620dbd160b0 2023-10-08T13:19:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbc056b0 con 0x5620dbd1c1a0 2023-10-08T13:19:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.293+0000 7f760a1bab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbc05350 con 0x5620dbd1b880 2023-10-08T13:19:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f760a1bab80 10 client.0 _ll_register_callbacks cb 0x5620dba627a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd22230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd22230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38428/0 (socket says 172.21.15.5:38428) 2023-10-08T13:19:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f77fe700 1 -- 172.21.15.5:0/3719788488 learned_addr learned my addr 172.21.15.5:0/3719788488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd1f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f7fff700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd1fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 -- 172.21.15.5:0/3719788488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 msgr2=0x5620dbd1fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd1fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 -- 172.21.15.5:0/3719788488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 msgr2=0x5620dbd22230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd22230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 -- 172.21.15.5:0/3719788488 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0009050 con 0x5620dbd1b880 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd1f4b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec004f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44191bf4889243a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3719788488 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec029040 con 0x5620dbd1b880 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.294+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620dbc30e50 con 0x5620dbd1b880 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3719788488 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f75ec004a30 con 0x5620dbd1b880 2023-10-08T13:19:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3719788488 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75ec0056d0 con 0x5620dbd1b880 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 10 client.26677 fetch_fsmap learned FSMap version 51 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f75f8073d00 con 0x5620dbd1b880 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3719788488 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5620dbc30e50 con 0x5620dbd1b880 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3719788488 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f75ec036070 con 0x5620dbd1b880 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 10 client.26677 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 10 client.26677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 20 client.26677 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd31bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 4 client.26677 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620dbc61db0 con 0x5620dbd2f7a0 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.295+0000 7f75f77fe700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd31bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.296+0000 7f75d6ffd700 10 client.26677 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.296+0000 7f75f77fe700 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd31bc0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=758d235433e234c0 server_cookie=a5de112d14fdb556 in_seq=0 out_seq=0 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.297+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3719788488 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5620dbc61db0 con 0x5620dbd2f7a0 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.297+0000 7f75d6ffd700 10 client.26677 handle_command_reply: tid=0 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.297+0000 7f760a1bab80 1 client.26677 shutdown 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 msgr2=0x5620dbd1f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd1f4b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec004f40 comp rx=0 tx=0).stop 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 shutdown_connections 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd31bc0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f75d6ffd700 0 client.26677 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd1fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd22230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3719788488 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd1f4b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 >> 172.21.15.5:0/3719788488 conn(0x5620dbc8a200 msgr2=0x5620dbd10010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 shutdown_connections 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 1 -- 172.21.15.5:0/3719788488 wait complete. 2023-10-08T13:19:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.298+0000 7f760a1bab80 20 client.26677 trim_cache size 0 max 16384 2023-10-08T13:19:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 Processor -- start 2023-10-08T13:19:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 -- start start 2023-10-08T13:19:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd1fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd26c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd10790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbae98c0 con 0x5620dbd160b0 2023-10-08T13:19:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbd12100 con 0x5620dbd1c1a0 2023-10-08T13:19:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.316+0000 7f760a1bab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbd12330 con 0x5620dbd1b880 2023-10-08T13:19:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd1fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd26c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd1fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38436/0 (socket says 172.21.15.5:38436) 2023-10-08T13:19:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd26c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51642/0 (socket says 172.21.15.5:51642) 2023-10-08T13:19:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f77fe700 1 -- 172.21.15.5:0/4103944902 learned_addr learned my addr 172.21.15.5:0/4103944902 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd10790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 -- 172.21.15.5:0/4103944902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 msgr2=0x5620dbd26c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd26c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 -- 172.21.15.5:0/4103944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 msgr2=0x5620dbd1fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd1fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 -- 172.21.15.5:0/4103944902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f810de40 con 0x5620dbd1c1a0 2023-10-08T13:19:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd26c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f77fe700 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd1fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75f7fff700 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd10790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f75f0007630 tx=0x7f75f0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f03b8923e866d8f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.317+0000 7f75de7fc700 1 -- 172.21.15.5:0/4103944902 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000e040 con 0x5620dbd1c1a0 2023-10-08T13:19:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.318+0000 7f75de7fc700 1 -- 172.21.15.5:0/4103944902 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75f000f040 con 0x5620dbd1c1a0 2023-10-08T13:19:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.318+0000 7f75de7fc700 1 -- 172.21.15.5:0/4103944902 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00048f0 con 0x5620dbd1c1a0 2023-10-08T13:19:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.318+0000 7f760a1bab80 1 -- 172.21.15.5:0/4103944902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 msgr2=0x5620dbd10790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.318+0000 7f760a1bab80 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd10790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f75f0007630 tx=0x7f75f0009920 comp rx=0 tx=0).stop 2023-10-08T13:19:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- 172.21.15.5:0/4103944902 shutdown_connections 2023-10-08T13:19:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd10790 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd160b0 0x5620dbd1fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 --2- 172.21.15.5:0/4103944902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd1b880 0x5620dbd26c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- 172.21.15.5:0/4103944902 >> 172.21.15.5:0/4103944902 conn(0x5620dbc8a200 msgr2=0x5620dbd16490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- 172.21.15.5:0/4103944902 shutdown_connections 2023-10-08T13:19:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- 172.21.15.5:0/4103944902 wait complete. 2023-10-08T13:19:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- start start 2023-10-08T13:19:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 Processor -- start 2023-10-08T13:19:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 0x5620dbd22bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd1b880 0x5620dbd23130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbd82700 con 0x5620dbd1b880 2023-10-08T13:19:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbd82870 con 0x5620dbd1c1a0 2023-10-08T13:19:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.319+0000 7f760a1bab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620dbd82a30 con 0x5620dbd160b0 2023-10-08T13:19:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f760a1bab80 10 client.0 _ll_register_callbacks cb 0x7f75f0009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 0x5620dbd22bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd1b880 0x5620dbd23130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 0x5620dbd22bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51646/0 (socket says 172.21.15.5:51646) 2023-10-08T13:19:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 -- 172.21.15.5:0/3606823557 learned_addr learned my addr 172.21.15.5:0/3606823557 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f7fff700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 -- 172.21.15.5:0/3606823557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 msgr2=0x5620dbd23670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd23670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 -- 172.21.15.5:0/3606823557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd1b880 msgr2=0x5620dbd23130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd1b880 0x5620dbd23130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f77fe700 1 -- 172.21.15.5:0/3606823557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec0095f0 con 0x5620dbd160b0 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.320+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd1b880 0x5620dbd23130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f75f77fe700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 0x5620dbd22bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eb00 tx=0x7f75e8009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f4cc67495ed233 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f75d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3606823557 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80b2ea0 con 0x5620dbd160b0 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75ec005460 con 0x5620dbd160b0 2023-10-08T13:19:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3606823557 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f75e809e120 con 0x5620dbd160b0 2023-10-08T13:19:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3606823557 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75e809e2e0 con 0x5620dbd160b0 2023-10-08T13:19:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f760a1bab80 10 client.26683 fetch_fsmap learned FSMap version 51 2023-10-08T13:19:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f75f8073d00 con 0x5620dbd160b0 2023-10-08T13:19:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.321+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3606823557 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75ec005460 con 0x5620dbd160b0 2023-10-08T13:19:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3606823557 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 51) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f75e80998d0 con 0x5620dbd160b0 2023-10-08T13:19:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f760a1bab80 10 client.26683 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:19:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f760a1bab80 10 client.26683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f760a1bab80 20 client.26683 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd86290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f760a1bab80 4 client.26683 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:19:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.322+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5620dbc61ad0 con 0x5620dbd2f7a0 2023-10-08T13:19:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.323+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd86290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.323+0000 7f75d6ffd700 10 client.26683 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.323+0000 7f75f6ffd700 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd86290 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313610ace42a0ec9 server_cookie=dfce27cc2ff89cac in_seq=0 out_seq=0 2023-10-08T13:19:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.332+0000 7f75d6ffd700 1 -- 172.21.15.5:0/3606823557 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5620dbc61ad0 con 0x5620dbd2f7a0 2023-10-08T13:19:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.332+0000 7f75d6ffd700 10 client.26683 handle_command_reply: tid=0 2023-10-08T13:19:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 client.26683 shutdown 2023-10-08T13:19:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 msgr2=0x5620dbd22bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 0x5620dbd22bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eb00 tx=0x7f75e8009880 comp rx=0 tx=0).stop 2023-10-08T13:19:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 shutdown_connections 2023-10-08T13:19:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5620dbd2f7a0 0x5620dbd86290 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620dbd1c1a0 0x5620dbd23670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5620dbd160b0 0x5620dbd22bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f75d6ffd700 0 client.26683 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 --2- 172.21.15.5:0/3606823557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620dbd1b880 0x5620dbd23130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 >> 172.21.15.5:0/3606823557 conn(0x5620dbc8a200 msgr2=0x5620dbd1a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 shutdown_connections 2023-10-08T13:19:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 1 -- 172.21.15.5:0/3606823557 wait complete. 2023-10-08T13:19:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f760a1bab80 20 client.26683 trim_cache size 0 max 16384 2023-10-08T13:19:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:19:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:19:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:19:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:19:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75e00a1660 msgr2=0x7f75e00a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.333+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75e00a1660 0x7f75e00a3b20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0098e0 tx=0x7f75ec005a90 comp rx=0 tx=0).stop 2023-10-08T13:19:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 msgr2=0x7f75f806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 0x7f75f806fdb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eb30 tx=0x7f75e800eef0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 shutdown_connections 2023-10-08T13:19:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f75e00a1660 0x7f75e00a3b20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75f8106680 0x7f75f806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f8100670 0x7f75f806fdb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 --2- 172.21.15.5:0/1530593752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75f8101030 0x7f75f8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 >> 172.21.15.5:0/1530593752 conn(0x7f75f80fc1c0 msgr2=0x7f75f80fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 shutdown_connections 2023-10-08T13:19:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:19.334+0000 7f75fdfd1700 1 -- 172.21.15.5:0/1530593752 wait complete. 2023-10-08T13:19:19.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:19 smithi060 ceph-mon[103190]: pgmap v712: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.4 MiB/s wr, 317 op/s 2023-10-08T13:19:19.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:19 smithi005 ceph-mon[99496]: pgmap v712: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.4 MiB/s wr, 317 op/s 2023-10-08T13:19:19.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:19 smithi118 ceph-mon[104234]: pgmap v712: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 3.4 MiB/s wr, 317 op/s 2023-10-08T13:19:21.418 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:21 smithi060 ceph-mon[103190]: pgmap v713: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.9 MiB/s wr, 375 op/s 2023-10-08T13:19:21.418 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:21 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:19:21.419 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:21 smithi060 ceph-mon[103190]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T13:19:21.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:21 smithi005 ceph-mon[99496]: pgmap v713: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.9 MiB/s wr, 375 op/s 2023-10-08T13:19:21.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:21 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:19:21.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:21 smithi005 ceph-mon[99496]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T13:19:21.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:21 smithi118 ceph-mon[104234]: pgmap v713: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.9 MiB/s wr, 375 op/s 2023-10-08T13:19:21.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:21 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:19:21.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:21 smithi118 ceph-mon[104234]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T13:19:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 780.0 s, 476.3 tps, lat 213.589 ms stddev 259.888 2023-10-08T13:19:21.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:19:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.107+0000 7fb914aaa700 1 -- 172.21.15.5:0/92426531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb91010edf0 msgr2=0x7fb91010f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.107+0000 7fb914aaa700 1 --2- 172.21.15.5:0/92426531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb91010edf0 0x7fb91010f1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb90001a9a0 tx=0x7fb90001acb0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.116+0000 7fb914aaa700 1 -- 172.21.15.5:0/92426531 shutdown_connections 2023-10-08T13:19:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.116+0000 7fb914aaa700 1 --2- 172.21.15.5:0/92426531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9101083a0 0x7fb91011bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.116+0000 7fb914aaa700 1 --2- 172.21.15.5:0/92426531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb91010edf0 0x7fb91010f1d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.116+0000 7fb914aaa700 1 --2- 172.21.15.5:0/92426531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9101077f0 0x7fb910107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.116+0000 7fb914aaa700 1 -- 172.21.15.5:0/92426531 >> 172.21.15.5:0/92426531 conn(0x7fb91006b770 msgr2=0x7fb91006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.129+0000 7fb914aaa700 1 -- 172.21.15.5:0/92426531 shutdown_connections 2023-10-08T13:19:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.135+0000 7fb914aaa700 1 -- 172.21.15.5:0/92426531 wait complete. 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 Processor -- start 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 -- start start 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9101077f0 0x7fb910117da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9101083a0 0x7fb9101182e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91010edf0 0x7fb9101a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9101a22c0 con 0x7fb9101083a0 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9101a2430 con 0x7fb91010edf0 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb914aaa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9101a25f0 con 0x7fb9101077f0 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9101077f0 0x7fb910117da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9101077f0 0x7fb910117da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51660/0 (socket says 172.21.15.5:51660) 2023-10-08T13:19:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb90e59c700 1 -- 172.21.15.5:0/3561571854 learned_addr learned my addr 172.21.15.5:0/3561571854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.136+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91010edf0 0x7fb9101a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.137+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3561571854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9101077f0 msgr2=0x7fb910117da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.137+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9101077f0 0x7fb910117da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.137+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9101083a0 msgr2=0x7fb9101182e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:19:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.137+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9101083a0 0x7fb9101182e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.137+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3561571854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90001a600 con 0x7fb91010edf0 2023-10-08T13:19:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.137+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91010edf0 0x7fb9101a1af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb90800bad0 tx=0x7fb90800bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.141+0000 7fb8ff7fe700 1 -- 172.21.15.5:0/3561571854 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800ca30 con 0x7fb91010edf0 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.141+0000 7fb8ff7fe700 1 -- 172.21.15.5:0/3561571854 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb90800cb90 con 0x7fb91010edf0 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.141+0000 7fb8ff7fe700 1 -- 172.21.15.5:0/3561571854 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908014ea0 con 0x7fb91010edf0 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.141+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9101a28d0 con 0x7fb91010edf0 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.141+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910078c30 con 0x7fb91010edf0 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.145+0000 7fb8ff7fe700 1 -- 172.21.15.5:0/3561571854 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb9080125a0 con 0x7fb91010edf0 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.145+0000 7fb8ff7fe700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb8f80a1800 0x7fb8f80a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.146+0000 7fb8ff7fe700 1 -- 172.21.15.5:0/3561571854 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fb9080cd910 con 0x7fb91010edf0 2023-10-08T13:19:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 Processor -- start 2023-10-08T13:19:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 -- start start 2023-10-08T13:19:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb116fe80 0x557cb1170260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb117b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb117b650 0x557cb117da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb10d9460 con 0x557cb117b650 2023-10-08T13:19:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb10cac20 con 0x557cb11707a0 2023-10-08T13:19:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.148+0000 7fb920c93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb10c8540 con 0x557cb116fe80 2023-10-08T13:19:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb117b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb117b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33412/0 (socket says 172.21.15.5:33412) 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 -- 172.21.15.5:0/762938614 learned_addr learned my addr 172.21.15.5:0/762938614 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 -- 172.21.15.5:0/762938614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb116fe80 msgr2=0x557cb1170260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb116fe80 0x557cb1170260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 -- 172.21.15.5:0/762938614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb117b650 msgr2=0x557cb117da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb117b650 0x557cb117da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 -- 172.21.15.5:0/762938614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cb0eeede0 con 0x557cb11707a0 2023-10-08T13:19:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb117b110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb904009830 tx=0x7fb904009b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27021494d7229bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb8fcff9700 1 -- 172.21.15.5:0/762938614 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904011830 con 0x557cb11707a0 2023-10-08T13:19:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.149+0000 7fb8fcff9700 1 -- 172.21.15.5:0/762938614 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb904011e50 con 0x557cb11707a0 2023-10-08T13:19:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.150+0000 7fb8fcff9700 1 -- 172.21.15.5:0/762938614 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904010380 con 0x557cb11707a0 2023-10-08T13:19:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.150+0000 7fb920c93b80 1 -- 172.21.15.5:0/762938614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 msgr2=0x557cb117b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.150+0000 7fb920c93b80 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb117b110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb904009830 tx=0x7fb904009b40 comp rx=0 tx=0).stop 2023-10-08T13:19:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.151+0000 7fb920c93b80 1 -- 172.21.15.5:0/762938614 shutdown_connections 2023-10-08T13:19:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.151+0000 7fb920c93b80 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb117b650 0x557cb117da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.151+0000 7fb920c93b80 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb116fe80 0x557cb1170260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.151+0000 7fb920c93b80 1 --2- 172.21.15.5:0/762938614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb117b110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.151+0000 7fb920c93b80 1 -- 172.21.15.5:0/762938614 >> 172.21.15.5:0/762938614 conn(0x557cb10e5260 msgr2=0x557cb116c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.154+0000 7fb90e59c700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb8f80a1800 0x7fb8f80a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.156+0000 7fb90e59c700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb8f80a1800 0x7fb8f80a3cc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb900003800 tx=0x7fb90002a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.156+0000 7fb920c93b80 1 -- 172.21.15.5:0/762938614 shutdown_connections 2023-10-08T13:19:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.157+0000 7fb920c93b80 1 -- 172.21.15.5:0/762938614 wait complete. 2023-10-08T13:19:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.158+0000 7fb920c93b80 1 -- start start 2023-10-08T13:19:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.158+0000 7fb920c93b80 1 Processor -- start 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb11785d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb117b650 0x557cb1178b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb11872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb10c3e30 con 0x557cb11707a0 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb1060710 con 0x557cb1179050 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb10603b0 con 0x557cb117b650 2023-10-08T13:19:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb920c93b80 10 client.0 _ll_register_callbacks cb 0x557cb0ebd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb90ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb11872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb90ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb11872f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33416/0 (socket says 172.21.15.5:33416) 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.162+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3201676435 learned_addr learned my addr 172.21.15.5:0/3201676435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb117b650 msgr2=0x557cb1178b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb117b650 0x557cb1178b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3201676435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 msgr2=0x557cb11785d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb11785d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb90ed9d700 1 -- 172.21.15.5:0/3201676435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb904009430 con 0x557cb1179050 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb11872f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb908014d10 tx=0x7fb90809ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38c4beec9692f364 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb8f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/3201676435 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90809aa70 con 0x557cb1179050 2023-10-08T13:19:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cb108beb0 con 0x557cb1179050 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.163+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/3201676435 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fb9080a29a0 con 0x557cb1179050 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/3201676435 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb908099b00 con 0x557cb1179050 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 10 client.26615 fetch_fsmap learned FSMap version 52 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x557cb0ed7c60 con 0x557cb1179050 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/3201676435 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557cb108beb0 con 0x557cb1179050 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/3201676435 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb908096400 con 0x557cb1179050 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 10 client.26615 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 10 client.26615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 20 client.26615 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb118b850 0x557cb118dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 4 client.26615 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.164+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cb10bce10 con 0x557cb118b850 2023-10-08T13:19:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.167+0000 7fb90e59c700 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb118b850 0x557cb118dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.171+0000 7fb90e59c700 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb118b850 0x557cb118dcd0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a601059a022c23fc server_cookie=a85ec7642b7088cd in_seq=0 out_seq=0 2023-10-08T13:19:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.171+0000 7fb8f5ffb700 10 client.26615 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.175+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/3201676435 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557cb10bce10 con 0x557cb118b850 2023-10-08T13:19:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.175+0000 7fb8f5ffb700 10 client.26615 handle_command_reply: tid=0 2023-10-08T13:19:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.178+0000 7fb920c93b80 1 client.26615 shutdown 2023-10-08T13:19:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.178+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 msgr2=0x557cb11872f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb11872f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb908014d10 tx=0x7fb90809ad10 comp rx=0 tx=0).stop 2023-10-08T13:19:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 shutdown_connections 2023-10-08T13:19:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb118b850 0x557cb118dcd0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb11872f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb11785d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 --2- 172.21.15.5:0/3201676435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb117b650 0x557cb1178b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 >> 172.21.15.5:0/3201676435 conn(0x557cb10e5260 msgr2=0x557cb116bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb8f5ffb700 0 client.26615 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 shutdown_connections 2023-10-08T13:19:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.179+0000 7fb920c93b80 1 -- 172.21.15.5:0/3201676435 wait complete. 2023-10-08T13:19:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.182+0000 7fb920c93b80 20 client.26615 trim_cache size 0 max 16384 2023-10-08T13:19:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 Processor -- start 2023-10-08T13:19:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 -- start start 2023-10-08T13:19:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb10e5260 0x557cb1173850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb1173d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb1179050 0x557cb1176ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb0f44920 con 0x557cb10e5260 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb117b0c0 con 0x557cb11707a0 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb920c93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb1179b30 con 0x557cb1179050 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb10e5260 0x557cb1173850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb1173d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb1173d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33422/0 (socket says 172.21.15.5:33422) 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb90dd9b700 1 -- 172.21.15.5:0/1977320944 learned_addr learned my addr 172.21.15.5:0/1977320944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.207+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb1179050 0x557cb1176ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90e59c700 1 -- 172.21.15.5:0/1977320944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb1179050 msgr2=0x557cb1176ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90e59c700 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb1179050 0x557cb1176ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90e59c700 1 -- 172.21.15.5:0/1977320944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 msgr2=0x557cb1173d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90e59c700 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb1173d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90e59c700 1 -- 172.21.15.5:0/1977320944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cb1192940 con 0x557cb10e5260 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb1173d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb90e59c700 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb10e5260 0x557cb1173850 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x557cb11711e0 tx=0x7fb900030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda20c6d7d3713fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb8fd7fa700 1 -- 172.21.15.5:0/1977320944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90003b040 con 0x557cb10e5260 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb8fd7fa700 1 -- 172.21.15.5:0/1977320944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb90002e040 con 0x557cb10e5260 2023-10-08T13:19:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.208+0000 7fb8fd7fa700 1 -- 172.21.15.5:0/1977320944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000048c0 con 0x557cb10e5260 2023-10-08T13:19:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 -- 172.21.15.5:0/1977320944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb10e5260 msgr2=0x557cb1173850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb10e5260 0x557cb1173850 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x557cb11711e0 tx=0x7fb900030000 comp rx=0 tx=0).stop 2023-10-08T13:19:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 -- 172.21.15.5:0/1977320944 shutdown_connections 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb1179050 0x557cb1176ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb10e5260 0x557cb1173850 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1977320944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb11707a0 0x557cb1173d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 -- 172.21.15.5:0/1977320944 >> 172.21.15.5:0/1977320944 conn(0x557cb117dda0 msgr2=0x557cb1178590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 -- 172.21.15.5:0/1977320944 shutdown_connections 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 -- 172.21.15.5:0/1977320944 wait complete. 2023-10-08T13:19:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 -- start start 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.209+0000 7fb920c93b80 1 Processor -- start 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb10e5260 0x557cb11822f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb1180820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb1180dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb1181490 con 0x557cb11707a0 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb1181600 con 0x557cb1179050 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb11df730 con 0x557cb10e5260 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb920c93b80 10 client.0 _ll_register_callbacks cb 0x7fb90809a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb1180820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb1180820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38478/0 (socket says 172.21.15.5:38478) 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 -- 172.21.15.5:0/1470747123 learned_addr learned my addr 172.21.15.5:0/1470747123 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90e59c700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb10e5260 0x557cb11822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90ed9d700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb1180dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 -- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb10e5260 msgr2=0x557cb11822f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb10e5260 0x557cb11822f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 -- 172.21.15.5:0/1470747123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 msgr2=0x557cb1180dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb1180dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 -- 172.21.15.5:0/1470747123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cb0eeede0 con 0x557cb11707a0 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb90dd9b700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb1180820 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb904011860 tx=0x7fb904011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bad7cdda7184ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.210+0000 7fb8f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/1470747123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904025440 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/1470747123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fb90401b430 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb904011e50 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/1470747123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb90401b5f0 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb920c93b80 10 client.17208 fetch_fsmap learned FSMap version 52 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x7fb91011cb90 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/1470747123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb904011e50 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.211+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/1470747123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 52) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb9040259e0 con 0x557cb11707a0 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 10 client.17208 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 10 client.17208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 20 client.17208 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb117b650 0x557cb11e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 4 client.17208 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557cb10bcb30 con 0x557cb117b650 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb90e59c700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb117b650 0x557cb11e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb8f5ffb700 10 client.17208 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb90e59c700 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb117b650 0x557cb11e2ed0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6698b931cf14961 server_cookie=30e1979391c70093 in_seq=0 out_seq=0 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb8f5ffb700 1 -- 172.21.15.5:0/1470747123 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557cb10bcb30 con 0x557cb117b650 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb8f5ffb700 10 client.17208 handle_command_reply: tid=0 2023-10-08T13:19:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 1 client.17208 shutdown 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 msgr2=0x557cb1180820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.212+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb1180820 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fb904011860 tx=0x7fb904011890 comp rx=0 tx=0).stop 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 shutdown_connections 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x557cb117b650 0x557cb11e2ed0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cb1179050 0x557cb1180dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb8f5ffb700 0 client.17208 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557cb10e5260 0x557cb11822f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 --2- 172.21.15.5:0/1470747123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557cb11707a0 0x557cb1180820 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 >> 172.21.15.5:0/1470747123 conn(0x557cb117dda0 msgr2=0x557cb1178470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 shutdown_connections 2023-10-08T13:19:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 1 -- 172.21.15.5:0/1470747123 wait complete. 2023-10-08T13:19:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb920c93b80 20 client.17208 trim_cache size 0 max 16384 2023-10-08T13:19:22.222 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:19:22.222 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:19:22.222 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:19:22.223 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:19:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb8f80a1800 msgr2=0x7fb8f80a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb8f80a1800 0x7fb8f80a3cc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb900003800 tx=0x7fb90002a040 comp rx=0 tx=0).stop 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91010edf0 msgr2=0x7fb9101a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91010edf0 0x7fb9101a1af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb90800bad0 tx=0x7fb90800bde0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 shutdown_connections 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb8f80a1800 0x7fb8f80a3cc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91010edf0 0x7fb9101a1af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9101077f0 0x7fb910117da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 --2- 172.21.15.5:0/3561571854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9101083a0 0x7fb9101182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 >> 172.21.15.5:0/3561571854 conn(0x7fb91006b770 msgr2=0x7fb91006f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 shutdown_connections 2023-10-08T13:19:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:22.213+0000 7fb914aaa700 1 -- 172.21.15.5:0/3561571854 wait complete. 2023-10-08T13:19:22.231 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:19:23.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:23 smithi060 ceph-mon[103190]: pgmap v715: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 440 op/s 2023-10-08T13:19:23.430 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:23 smithi005 ceph-mon[99496]: pgmap v715: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 440 op/s 2023-10-08T13:19:23.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:23 smithi118 ceph-mon[104234]: pgmap v715: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 440 op/s 2023-10-08T13:19:25.413 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:25 smithi060 ceph-mon[103190]: pgmap v716: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 4.6 MiB/s wr, 444 op/s 2023-10-08T13:19:25.429 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:25 smithi005 ceph-mon[99496]: pgmap v716: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 4.6 MiB/s wr, 444 op/s 2023-10-08T13:19:25.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:25 smithi118 ceph-mon[104234]: pgmap v716: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 4.6 MiB/s wr, 444 op/s 2023-10-08T13:19:26.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:26 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:19:26.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:26 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:19:26.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:26 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:19:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 785.0 s, 474.5 tps, lat 210.633 ms stddev 228.504 2023-10-08T13:19:27.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:27 smithi060 ceph-mon[103190]: pgmap v717: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 4.9 MiB/s wr, 469 op/s 2023-10-08T13:19:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:27 smithi005 ceph-mon[99496]: pgmap v717: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 4.9 MiB/s wr, 469 op/s 2023-10-08T13:19:27.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:27 smithi118 ceph-mon[104234]: pgmap v717: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 4.9 MiB/s wr, 469 op/s 2023-10-08T13:19:29.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:29 smithi005 ceph-mon[99496]: pgmap v718: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 5.7 MiB/s wr, 479 op/s 2023-10-08T13:19:29.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:29 smithi118 ceph-mon[104234]: pgmap v718: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 5.7 MiB/s wr, 479 op/s 2023-10-08T13:19:29.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:29 smithi060 ceph-mon[103190]: pgmap v718: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 5.7 MiB/s wr, 479 op/s 2023-10-08T13:19:31.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:31 smithi118 ceph-mon[104234]: pgmap v719: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.4 MiB/s wr, 485 op/s 2023-10-08T13:19:31.665 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:31 smithi060 ceph-mon[103190]: pgmap v719: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.4 MiB/s wr, 485 op/s 2023-10-08T13:19:31.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:31 smithi005 ceph-mon[99496]: pgmap v719: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.4 MiB/s wr, 485 op/s 2023-10-08T13:19:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 790.0 s, 473.5 tps, lat 206.341 ms stddev 233.392 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 -- 172.21.15.5:0/3247630956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c119fd0 msgr2=0x7fd36c11c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 --2- 172.21.15.5:0/3247630956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c119fd0 0x7fd36c11c3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd36400b0d0 tx=0x7fd36400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 -- 172.21.15.5:0/3247630956 shutdown_connections 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 --2- 172.21.15.5:0/3247630956 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c119fd0 0x7fd36c11c3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 --2- 172.21.15.5:0/3247630956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c10eea0 0x7fd36c1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 --2- 172.21.15.5:0/3247630956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c10f310 0x7fd36c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.542+0000 7fd371b08700 1 -- 172.21.15.5:0/3247630956 >> 172.21.15.5:0/3247630956 conn(0x7fd36c06b7c0 msgr2=0x7fd36c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.547+0000 7fd371b08700 1 -- 172.21.15.5:0/3247630956 shutdown_connections 2023-10-08T13:19:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.555+0000 7fd371b08700 1 -- 172.21.15.5:0/3247630956 wait complete. 2023-10-08T13:19:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.556+0000 7fd371b08700 1 Processor -- start 2023-10-08T13:19:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 -- start start 2023-10-08T13:19:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c10eea0 0x7fd36c1ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c119fd0 0x7fd36c1abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c1a58c0 0x7fd36c1a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1a6340 con 0x7fd36c1a58c0 2023-10-08T13:19:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1a6480 con 0x7fd36c119fd0 2023-10-08T13:19:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.562+0000 7fd371b08700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1a6640 con 0x7fd36c10eea0 2023-10-08T13:19:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c1a58c0 0x7fd36c1a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c1a58c0 0x7fd36c1a5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38488/0 (socket says 172.21.15.5:38488) 2023-10-08T13:19:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36bfff700 1 -- 172.21.15.5:0/1218235772 learned_addr learned my addr 172.21.15.5:0/1218235772 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c10eea0 0x7fd36c1ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36b7fe700 1 -- 172.21.15.5:0/1218235772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c119fd0 msgr2=0x7fd36c1abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c119fd0 0x7fd36c1abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36b7fe700 1 -- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c1a58c0 msgr2=0x7fd36c1a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c1a58c0 0x7fd36c1a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.564+0000 7fd36b7fe700 1 -- 172.21.15.5:0/1218235772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364009d00 con 0x7fd36c10eea0 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.565+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c10eea0 0x7fd36c1ab790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00d980 tx=0x7fd35c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.565+0000 7fd368ff9700 1 -- 172.21.15.5:0/1218235772 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c009930 con 0x7fd36c10eea0 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.565+0000 7fd368ff9700 1 -- 172.21.15.5:0/1218235772 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd35c010460 con 0x7fd36c10eea0 2023-10-08T13:19:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.565+0000 7fd368ff9700 1 -- 172.21.15.5:0/1218235772 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00f620 con 0x7fd36c10eea0 2023-10-08T13:19:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.566+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c10f810 con 0x7fd36c10eea0 2023-10-08T13:19:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.566+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c10fd50 con 0x7fd36c10eea0 2023-10-08T13:19:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.575+0000 7fd37dcf1b80 1 Processor -- start 2023-10-08T13:19:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.576+0000 7fd368ff9700 1 -- 172.21.15.5:0/1218235772 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd35c009a90 con 0x7fd36c10eea0 2023-10-08T13:19:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.577+0000 7fd368ff9700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd3580a17f0 0x7fd3580a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.577+0000 7fd368ff9700 1 -- 172.21.15.5:0/1218235772 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd35c0ccf00 con 0x7fd36c10eea0 2023-10-08T13:19:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 -- start start 2023-10-08T13:19:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec136cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1366b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1367510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec12cf400 con 0x555ec136c880 2023-10-08T13:19:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec12c0bc0 con 0x555ec136d1a0 2023-10-08T13:19:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec12be4e0 con 0x555ec13670b0 2023-10-08T13:19:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd36bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1367510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd36bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1367510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51700/0 (socket says 172.21.15.5:51700) 2023-10-08T13:19:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.578+0000 7fd36bfff700 1 -- 172.21.15.5:0/3353512963 learned_addr learned my addr 172.21.15.5:0/3353512963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.579+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec136cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.579+0000 7fd36bfff700 1 -- 172.21.15.5:0/3353512963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 msgr2=0x555ec1366b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:19:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.579+0000 7fd36bfff700 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1366b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.579+0000 7fd36bfff700 1 -- 172.21.15.5:0/3353512963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 msgr2=0x555ec136cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.579+0000 7fd36bfff700 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec136cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.579+0000 7fd36bfff700 1 -- 172.21.15.5:0/3353512963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ec10e4d80 con 0x555ec13670b0 2023-10-08T13:19:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.580+0000 7fd36bfff700 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1367510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd364009280 tx=0x7fd3640092b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64c6019a744923c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.580+0000 7fd36bfff700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd3580a17f0 0x7fd3580a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.581+0000 7fd36bfff700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd3580a17f0 0x7fd3580a3cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd364003fd0 tx=0x7fd3640059e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.582+0000 7fd361ffb700 1 -- 172.21.15.5:0/3353512963 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400e070 con 0x555ec13670b0 2023-10-08T13:19:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.582+0000 7fd361ffb700 1 -- 172.21.15.5:0/3353512963 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3640079a0 con 0x555ec13670b0 2023-10-08T13:19:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.582+0000 7fd361ffb700 1 -- 172.21.15.5:0/3353512963 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3640057a0 con 0x555ec13670b0 2023-10-08T13:19:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3353512963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 msgr2=0x555ec1367510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1367510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd364009280 tx=0x7fd3640092b0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3353512963 shutdown_connections 2023-10-08T13:19:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1367510 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec136cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3353512963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1366b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.583+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3353512963 >> 172.21.15.5:0/3353512963 conn(0x555ec12db200 msgr2=0x555ec1361b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.586+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3353512963 shutdown_connections 2023-10-08T13:19:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.588+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3353512963 wait complete. 2023-10-08T13:19:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 -- start start 2023-10-08T13:19:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 Processor -- start 2023-10-08T13:19:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec13731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136c880 0x555ec13704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1370c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec12b9dd0 con 0x555ec13670b0 2023-10-08T13:19:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec12566b0 con 0x555ec136d1a0 2023-10-08T13:19:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec1256350 con 0x555ec136c880 2023-10-08T13:19:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.589+0000 7fd37dcf1b80 10 client.0 _ll_register_callbacks cb 0x555ec10b37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.590+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec13731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.590+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec13731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38502/0 (socket says 172.21.15.5:38502) 2023-10-08T13:19:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.590+0000 7fd36b7fe700 1 -- 172.21.15.5:0/3872235972 learned_addr learned my addr 172.21.15.5:0/3872235972 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd36b7fe700 1 -- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136c880 msgr2=0x555ec13704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136c880 0x555ec13704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd36b7fe700 1 -- 172.21.15.5:0/3872235972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 msgr2=0x555ec1370c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1370c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd36b7fe700 1 -- 172.21.15.5:0/3872235972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c11cbd0 con 0x555ec13670b0 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec13731d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00b700 tx=0x7fd35c099ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cad3772ad7a11a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd34affd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd34affd700 1 -- 172.21.15.5:0/3872235972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0b2200 con 0x555ec13670b0 2023-10-08T13:19:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd34affd700 1 -- 172.21.15.5:0/3872235972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd35c0b2360 con 0x555ec13670b0 2023-10-08T13:19:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ec1281e50 con 0x555ec13670b0 2023-10-08T13:19:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.591+0000 7fd34affd700 1 -- 172.21.15.5:0/3872235972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd35c099d50 con 0x555ec13670b0 2023-10-08T13:19:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 10 client.17217 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x555ec10cdc00 con 0x555ec13670b0 2023-10-08T13:19:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd34affd700 1 -- 172.21.15.5:0/3872235972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555ec1281e50 con 0x555ec13670b0 2023-10-08T13:19:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd34affd700 1 -- 172.21.15.5:0/3872235972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd35c0a19f0 con 0x555ec13670b0 2023-10-08T13:19:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 10 client.17217 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 10 client.17217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 20 client.17217 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec1380c60 0x555ec13830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 4 client.17217 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ec12b2db0 con 0x555ec1380c60 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.592+0000 7fd36affd700 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec1380c60 0x555ec13830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.593+0000 7fd34affd700 10 client.17217 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.593+0000 7fd36affd700 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec1380c60 0x555ec13830c0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0660602b294ccf2 server_cookie=b1281913ba6efd0b in_seq=0 out_seq=0 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.594+0000 7fd34affd700 1 -- 172.21.15.5:0/3872235972 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555ec12b2db0 con 0x555ec1380c60 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.594+0000 7fd34affd700 10 client.17217 handle_command_reply: tid=0 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.594+0000 7fd37dcf1b80 1 client.17217 shutdown 2023-10-08T13:19:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.594+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 msgr2=0x555ec13731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.594+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec13731d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00b700 tx=0x7fd35c099ba0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 shutdown_connections 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec1380c60 0x555ec13830c0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1370c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec13731d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/3872235972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136c880 0x555ec13704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 >> 172.21.15.5:0/3872235972 conn(0x555ec12db200 msgr2=0x555ec1361010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd34affd700 0 client.17217 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 shutdown_connections 2023-10-08T13:19:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.595+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/3872235972 wait complete. 2023-10-08T13:19:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.603+0000 7fd37dcf1b80 20 client.17217 trim_cache size 0 max 16384 2023-10-08T13:19:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 Processor -- start 2023-10-08T13:19:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 -- start start 2023-10-08T13:19:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1366b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec1377c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1367490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec113a8c0 con 0x555ec136c880 2023-10-08T13:19:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec13632a0 con 0x555ec136d1a0 2023-10-08T13:19:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.632+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec1378160 con 0x555ec13670b0 2023-10-08T13:19:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.636+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1366b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.636+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1366b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51714/0 (socket says 172.21.15.5:51714) 2023-10-08T13:19:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.636+0000 7fd36b7fe700 1 -- 172.21.15.5:0/600000280 learned_addr learned my addr 172.21.15.5:0/600000280 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:32.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.637+0000 7fd36affd700 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec1377c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd36affd700 1 -- 172.21.15.5:0/600000280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 msgr2=0x555ec1366b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd36affd700 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1366b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd36affd700 1 -- 172.21.15.5:0/600000280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 msgr2=0x555ec1367490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd36affd700 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1367490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd36affd700 1 -- 172.21.15.5:0/600000280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ec110b1f0 con 0x555ec136c880 2023-10-08T13:19:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd36affd700 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec1377c20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd36c1a6a80 tx=0x7fd3540096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aab73e671ea19b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.638+0000 7fd3627fc700 1 -- 172.21.15.5:0/600000280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354014070 con 0x555ec136c880 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.639+0000 7fd3627fc700 1 -- 172.21.15.5:0/600000280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd354013400 con 0x555ec136c880 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.639+0000 7fd3627fc700 1 -- 172.21.15.5:0/600000280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35401c630 con 0x555ec136c880 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/600000280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 msgr2=0x555ec1377c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec1377c20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd36c1a6a80 tx=0x7fd3540096a0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/600000280 shutdown_connections 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec136d1a0 0x555ec1367490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec13670b0 0x555ec1366b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/600000280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec136c880 0x555ec1377c20 secure :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd36c1a6a80 tx=0x7fd3540096a0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.640+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/600000280 >> 172.21.15.5:0/600000280 conn(0x555ec12db200 msgr2=0x555ec1387a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.641+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/600000280 shutdown_connections 2023-10-08T13:19:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.646+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/600000280 wait complete. 2023-10-08T13:19:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.646+0000 7fd37dcf1b80 1 -- start start 2023-10-08T13:19:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 Processor -- start 2023-10-08T13:19:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec1377860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136d1a0 0x555ec1375c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec1376140 0x555ec13765c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec1377fe0 con 0x555ec13670b0 2023-10-08T13:19:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec13d4b20 con 0x555ec1376140 2023-10-08T13:19:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec13d4ce0 con 0x555ec136d1a0 2023-10-08T13:19:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.647+0000 7fd37dcf1b80 10 client.0 _ll_register_callbacks cb 0x7fd35c099500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec1376140 0x555ec13765c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec1376140 0x555ec13765c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33464/0 (socket says 172.21.15.5:33464) 2023-10-08T13:19:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36bfff700 1 -- 172.21.15.5:0/2284151587 learned_addr learned my addr 172.21.15.5:0/2284151587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36affd700 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136d1a0 0x555ec1375c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36affd700 1 -- 172.21.15.5:0/2284151587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec1376140 msgr2=0x555ec13765c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36affd700 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec1376140 0x555ec13765c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36affd700 1 -- 172.21.15.5:0/2284151587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 msgr2=0x555ec1377860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:19:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36affd700 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec1377860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.648+0000 7fd36affd700 1 -- 172.21.15.5:0/2284151587 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd354014a00 con 0x555ec136d1a0 2023-10-08T13:19:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.649+0000 7fd36affd700 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136d1a0 0x555ec1375c00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x555ec1373ad0 tx=0x7fd354004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4e9ce44f026bc4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.655+0000 7fd34affd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:19:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.655+0000 7fd34affd700 1 -- 172.21.15.5:0/2284151587 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354029070 con 0x555ec136d1a0 2023-10-08T13:19:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.655+0000 7fd34affd700 1 -- 172.21.15.5:0/2284151587 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd354013780 con 0x555ec136d1a0 2023-10-08T13:19:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.655+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3640079a0 con 0x555ec136d1a0 2023-10-08T13:19:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.655+0000 7fd34affd700 1 -- 172.21.15.5:0/2284151587 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd354013960 con 0x555ec136d1a0 2023-10-08T13:19:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.661+0000 7fd37dcf1b80 10 client.26710 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.661+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x555ec10e3250 con 0x555ec136d1a0 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd34affd700 1 -- 172.21.15.5:0/2284151587 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3640079a0 con 0x555ec136d1a0 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd34affd700 1 -- 172.21.15.5:0/2284151587 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd35402c030 con 0x555ec136d1a0 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd37dcf1b80 10 client.26710 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd37dcf1b80 10 client.26710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd37dcf1b80 20 client.26710 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec13d62b0 0x555ec13d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd37dcf1b80 4 client.26710 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:19:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.679+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555ec12b2ad0 con 0x555ec13d62b0 2023-10-08T13:19:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.680+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec13d62b0 0x555ec13d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.680+0000 7fd36b7fe700 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec13d62b0 0x555ec13d86d0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc4236818d3337e server_cookie=a181d84721378c61 in_seq=0 out_seq=0 2023-10-08T13:19:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.680+0000 7fd34affd700 10 client.26710 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.744+0000 7fd34affd700 1 -- 172.21.15.5:0/2284151587 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555ec12b2ad0 con 0x555ec13d62b0 2023-10-08T13:19:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.744+0000 7fd34affd700 10 client.26710 handle_command_reply: tid=0 2023-10-08T13:19:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.744+0000 7fd37dcf1b80 1 client.26710 shutdown 2023-10-08T13:19:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136d1a0 msgr2=0x555ec1375c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136d1a0 0x555ec1375c00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x555ec1373ad0 tx=0x7fd354004860 comp rx=0 tx=0).stop 2023-10-08T13:19:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 shutdown_connections 2023-10-08T13:19:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x555ec13d62b0 0x555ec13d86d0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ec1376140 0x555ec13765c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555ec13670b0 0x555ec1377860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 --2- 172.21.15.5:0/2284151587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555ec136d1a0 0x555ec1375c00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 >> 172.21.15.5:0/2284151587 conn(0x555ec12db200 msgr2=0x555ec137c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd34affd700 0 client.26710 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.747+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 shutdown_connections 2023-10-08T13:19:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.748+0000 7fd37dcf1b80 1 -- 172.21.15.5:0/2284151587 wait complete. 2023-10-08T13:19:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.750+0000 7fd37dcf1b80 20 client.26710 trim_cache size 0 max 16384 2023-10-08T13:19:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:19:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:19:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:19:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.751+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd3580a17f0 msgr2=0x7fd3580a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.751+0000 7fd371b08700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd3580a17f0 0x7fd3580a3cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd364003fd0 tx=0x7fd3640059e0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.751+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c10eea0 msgr2=0x7fd36c1ab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.751+0000 7fd371b08700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c10eea0 0x7fd36c1ab790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00d980 tx=0x7fd35c00dc90 comp rx=0 tx=0).stop 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 shutdown_connections 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd3580a17f0 0x7fd3580a3cb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd36c1a58c0 0x7fd36c1a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd36c10eea0 0x7fd36c1ab790 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00d980 tx=0x7fd35c00dc90 comp rx=0 tx=0).stop 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 --2- 172.21.15.5:0/1218235772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd36c119fd0 0x7fd36c1abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 >> 172.21.15.5:0/1218235772 conn(0x7fd36c06b7c0 msgr2=0x7fd36c117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 shutdown_connections 2023-10-08T13:19:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:32.752+0000 7fd371b08700 1 -- 172.21.15.5:0/1218235772 wait complete. 2023-10-08T13:19:33.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:33 smithi118 ceph-mon[104234]: pgmap v720: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 4.4 MiB/s wr, 457 op/s 2023-10-08T13:19:33.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:33 smithi060 ceph-mon[103190]: pgmap v720: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 4.4 MiB/s wr, 457 op/s 2023-10-08T13:19:33.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:33 smithi005 ceph-mon[99496]: pgmap v720: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 4.4 MiB/s wr, 457 op/s 2023-10-08T13:19:35.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:35 smithi118 ceph-mon[104234]: pgmap v721: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 4.8 MiB/s wr, 455 op/s 2023-10-08T13:19:35.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:35 smithi060 ceph-mon[103190]: pgmap v721: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 4.8 MiB/s wr, 455 op/s 2023-10-08T13:19:35.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:35 smithi005 ceph-mon[99496]: pgmap v721: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 4.8 MiB/s wr, 455 op/s 2023-10-08T13:19:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 795.0 s, 443.0 tps, lat 222.780 ms stddev 245.897 2023-10-08T13:19:37.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:37 smithi118 ceph-mon[104234]: pgmap v722: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 5.8 MiB/s wr, 553 op/s 2023-10-08T13:19:37.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:37 smithi060 ceph-mon[103190]: pgmap v722: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 5.8 MiB/s wr, 553 op/s 2023-10-08T13:19:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:37 smithi005 ceph-mon[99496]: pgmap v722: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 5.8 MiB/s wr, 553 op/s 2023-10-08T13:19:39.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:39 smithi118 ceph-mon[104234]: pgmap v723: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 5.3 MiB/s wr, 473 op/s 2023-10-08T13:19:39.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:39 smithi060 ceph-mon[103190]: pgmap v723: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 5.3 MiB/s wr, 473 op/s 2023-10-08T13:19:39.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:39 smithi005 ceph-mon[99496]: pgmap v723: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 5.3 MiB/s wr, 473 op/s 2023-10-08T13:19:41.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:41 smithi118 ceph-mon[104234]: pgmap v724: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2023-10-08T13:19:41.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:41 smithi060 ceph-mon[103190]: pgmap v724: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2023-10-08T13:19:41.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:41 smithi005 ceph-mon[99496]: pgmap v724: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2023-10-08T13:19:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 800.0 s, 502.9 tps, lat 205.466 ms stddev 238.919 2023-10-08T13:19:43.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:43 smithi060 ceph-mon[103190]: pgmap v725: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.6 MiB/s wr, 486 op/s 2023-10-08T13:19:43.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:43 smithi005 ceph-mon[99496]: pgmap v725: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.6 MiB/s wr, 486 op/s 2023-10-08T13:19:43.774 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:43 smithi118 ceph-mon[104234]: pgmap v725: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.6 MiB/s wr, 486 op/s 2023-10-08T13:19:44.669 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:44 smithi060 ceph-mon[103190]: pgmap v726: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.5 MiB/s wr, 447 op/s 2023-10-08T13:19:44.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:44 smithi005 ceph-mon[99496]: pgmap v726: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.5 MiB/s wr, 447 op/s 2023-10-08T13:19:44.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:44 smithi118 ceph-mon[104234]: pgmap v726: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.5 MiB/s wr, 447 op/s 2023-10-08T13:19:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.961+0000 7f07f7b6d700 1 -- 172.21.15.5:0/327903435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f0119fd0 msgr2=0x7f07f011c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.961+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/327903435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f0119fd0 0x7f07f011c3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07e801c130 tx=0x7f07e801c440 comp rx=0 tx=0).stop 2023-10-08T13:19:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.972+0000 7f07f7b6d700 1 -- 172.21.15.5:0/327903435 shutdown_connections 2023-10-08T13:19:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.972+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/327903435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f0119fd0 0x7f07f011c3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.972+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/327903435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07f010eea0 0x7f07f01077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.972+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/327903435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f010f310 0x7f07f0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.972+0000 7f07f7b6d700 1 -- 172.21.15.5:0/327903435 >> 172.21.15.5:0/327903435 conn(0x7f07f006b7c0 msgr2=0x7f07f006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:45.983+0000 7f07f7b6d700 1 -- 172.21.15.5:0/327903435 shutdown_connections 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.003+0000 7f07f7b6d700 1 -- 172.21.15.5:0/327903435 wait complete. 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.003+0000 7f07f7b6d700 1 Processor -- start 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 -- start start 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f010f310 0x7f07f01194e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07f0119fd0 0x7f07f0119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 0x7f07f0115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0116380 con 0x7f07f0115700 2023-10-08T13:19:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01cbb90 con 0x7f07f010f310 2023-10-08T13:19:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.005+0000 7f07f7b6d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01cbcd0 con 0x7f07f0119fd0 2023-10-08T13:19:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.010+0000 7f07f610a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 0x7f07f0115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.010+0000 7f07f610a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 0x7f07f0115bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38534/0 (socket says 172.21.15.5:38534) 2023-10-08T13:19:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.010+0000 7f07f610a700 1 -- 172.21.15.5:0/730948879 learned_addr learned my addr 172.21.15.5:0/730948879 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.011+0000 7f07f5909700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f010f310 0x7f07f01194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.011+0000 7f07f610a700 1 -- 172.21.15.5:0/730948879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07f0119fd0 msgr2=0x7f07f0119a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:19:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.011+0000 7f07f610a700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07f0119fd0 0x7f07f0119a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.011+0000 7f07f610a700 1 -- 172.21.15.5:0/730948879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f010f310 msgr2=0x7f07f01194e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.011+0000 7f07f610a700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f010f310 0x7f07f01194e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.011+0000 7f07f610a700 1 -- 172.21.15.5:0/730948879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e801ad10 con 0x7f07f0115700 2023-10-08T13:19:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.020+0000 7f07f610a700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 0x7f07f0115bb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f07e801a040 tx=0x7f07e80189f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.029+0000 7f07e6ffd700 1 -- 172.21.15.5:0/730948879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e801f040 con 0x7f07f0115700 2023-10-08T13:19:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.029+0000 7f07e6ffd700 1 -- 172.21.15.5:0/730948879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07e8003e10 con 0x7f07f0115700 2023-10-08T13:19:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.029+0000 7f07e6ffd700 1 -- 172.21.15.5:0/730948879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8007b80 con 0x7f07f0115700 2023-10-08T13:19:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.029+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f01cbe70 con 0x7f07f0115700 2023-10-08T13:19:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.029+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f01cc260 con 0x7f07f0115700 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 Processor -- start 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 -- start start 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 0x55fdfac69c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac63b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac640b0 0x55fdfac64510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfabcc400 con 0x55fdfac69880 2023-10-08T13:19:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfabbdbc0 con 0x55fdfac6a1a0 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.066+0000 7f0803d56b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfabbb4e0 con 0x55fdfac640b0 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.071+0000 7f07f5108700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac640b0 0x55fdfac64510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.071+0000 7f07f5108700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac640b0 0x55fdfac64510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51746/0 (socket says 172.21.15.5:51746) 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.071+0000 7f07f5108700 1 -- 172.21.15.5:0/559201052 learned_addr learned my addr 172.21.15.5:0/559201052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.071+0000 7f07e6ffd700 1 -- 172.21.15.5:0/730948879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f07e80050d0 con 0x7f07f0115700 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.072+0000 7f07e6ffd700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07dc0a17f0 0x7f07dc0a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.072+0000 7f07e6ffd700 1 -- 172.21.15.5:0/730948879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f07e80ce120 con 0x7f07f0115700 2023-10-08T13:19:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac63b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 -- 172.21.15.5:0/559201052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac640b0 msgr2=0x55fdfac64510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac640b0 0x55fdfac64510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 -- 172.21.15.5:0/559201052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 msgr2=0x55fdfac69c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 0x55fdfac69c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 -- 172.21.15.5:0/559201052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdfa9e1d80 con 0x55fdfac6a1a0 2023-10-08T13:19:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.074+0000 7f07f5909700 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac63b70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07f00729f0 tx=0x7f07e000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88b4fe60a27f412a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.084+0000 7f07f610a700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07dc0a17f0 0x7f07dc0a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.086+0000 7f07dbfff700 1 -- 172.21.15.5:0/559201052 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e00125f0 con 0x55fdfac6a1a0 2023-10-08T13:19:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.086+0000 7f07dbfff700 1 -- 172.21.15.5:0/559201052 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07e0012c10 con 0x55fdfac6a1a0 2023-10-08T13:19:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.086+0000 7f07dbfff700 1 -- 172.21.15.5:0/559201052 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0013e50 con 0x55fdfac6a1a0 2023-10-08T13:19:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.087+0000 7f0803d56b80 1 -- 172.21.15.5:0/559201052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 msgr2=0x55fdfac63b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.087+0000 7f0803d56b80 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac63b70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07f00729f0 tx=0x7f07e000ba40 comp rx=0 tx=0).stop 2023-10-08T13:19:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.089+0000 7f0803d56b80 1 -- 172.21.15.5:0/559201052 shutdown_connections 2023-10-08T13:19:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.089+0000 7f0803d56b80 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac640b0 0x55fdfac64510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.089+0000 7f0803d56b80 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 0x55fdfac69c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.089+0000 7f0803d56b80 1 --2- 172.21.15.5:0/559201052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac63b70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.089+0000 7f0803d56b80 1 -- 172.21.15.5:0/559201052 >> 172.21.15.5:0/559201052 conn(0x55fdfabd8200 msgr2=0x55fdfac5eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.089+0000 7f07f610a700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07dc0a17f0 0x7f07dc0a3cb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f07e80973b0 tx=0x7f07e8018bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:46.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 -- 172.21.15.5:0/559201052 shutdown_connections 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 -- 172.21.15.5:0/559201052 wait complete. 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 -- start start 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 Processor -- start 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac640b0 0x55fdfac6d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 0x55fdfac6db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.093+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfac6e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f0803d56b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfabb6dd0 con 0x55fdfac69880 2023-10-08T13:19:46.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f0803d56b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfab536b0 con 0x55fdfac640b0 2023-10-08T13:19:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f0803d56b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfab53350 con 0x55fdfac6a1a0 2023-10-08T13:19:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f0803d56b80 10 client.0 _ll_register_callbacks cb 0x55fdfa9b07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f07f5108700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfac6e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f07f5108700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfac6e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51754/0 (socket says 172.21.15.5:51754) 2023-10-08T13:19:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.094+0000 7f07f5108700 1 -- 172.21.15.5:0/3945171530 learned_addr learned my addr 172.21.15.5:0/3945171530 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.100+0000 7f07f5108700 1 -- 172.21.15.5:0/3945171530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac640b0 msgr2=0x55fdfac6d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.100+0000 7f07f5108700 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac640b0 0x55fdfac6d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.100+0000 7f07f5108700 1 -- 172.21.15.5:0/3945171530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 msgr2=0x55fdfac6db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.100+0000 7f07f5108700 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 0x55fdfac6db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.100+0000 7f07f5108700 1 -- 172.21.15.5:0/3945171530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e000e040 con 0x55fdfac6a1a0 2023-10-08T13:19:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.111+0000 7f07f5108700 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfac6e060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07ec004f10 tx=0x7f07ec00b970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9fe6d46757975da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.111+0000 7f07d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:19:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.111+0000 7f07d97fa700 1 -- 172.21.15.5:0/3945171530 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004220 con 0x55fdfac6a1a0 2023-10-08T13:19:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.111+0000 7f07d97fa700 1 -- 172.21.15.5:0/3945171530 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f07ec004380 con 0x55fdfac6a1a0 2023-10-08T13:19:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.112+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdfab7ee50 con 0x55fdfac6a1a0 2023-10-08T13:19:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.112+0000 7f07d97fa700 1 -- 172.21.15.5:0/3945171530 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07ec004540 con 0x55fdfac6a1a0 2023-10-08T13:19:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.112+0000 7f0803d56b80 10 client.26716 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.112+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55fdfa9cac00 con 0x55fdfac6a1a0 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.112+0000 7f07d97fa700 1 -- 172.21.15.5:0/3945171530 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fdfab7ee50 con 0x55fdfac6a1a0 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.113+0000 7f07d97fa700 1 -- 172.21.15.5:0/3945171530 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f07ec003740 con 0x55fdfac6a1a0 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.113+0000 7f0803d56b80 10 client.26716 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.113+0000 7f0803d56b80 10 client.26716 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.114+0000 7f0803d56b80 20 client.26716 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.114+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfac7de30 0x55fdfac80250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.114+0000 7f0803d56b80 4 client.26716 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.114+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdfabafdb0 con 0x55fdfac7de30 2023-10-08T13:19:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.114+0000 7f07f5909700 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfac7de30 0x55fdfac80250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.115+0000 7f07f5909700 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfac7de30 0x55fdfac80250 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1ebce6e590a58c server_cookie=1c08df86a4f3106f in_seq=0 out_seq=0 2023-10-08T13:19:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.117+0000 7f07d97fa700 10 client.26716 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.122+0000 7f07d97fa700 1 -- 172.21.15.5:0/3945171530 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fdfabafdb0 con 0x55fdfac7de30 2023-10-08T13:19:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.122+0000 7f07d97fa700 10 client.26716 handle_command_reply: tid=0 2023-10-08T13:19:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.122+0000 7f0803d56b80 1 client.26716 shutdown 2023-10-08T13:19:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.122+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 msgr2=0x55fdfac6e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.122+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfac6e060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07ec004f10 tx=0x7f07ec00b970 comp rx=0 tx=0).stop 2023-10-08T13:19:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 shutdown_connections 2023-10-08T13:19:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfac6e060 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfac7de30 0x55fdfac80250 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac640b0 0x55fdfac6d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3945171530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac69880 0x55fdfac6db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 >> 172.21.15.5:0/3945171530 conn(0x55fdfabd8200 msgr2=0x55fdfac5e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f07d97fa700 0 client.26716 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.123+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 shutdown_connections 2023-10-08T13:19:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.124+0000 7f0803d56b80 1 -- 172.21.15.5:0/3945171530 wait complete. 2023-10-08T13:19:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.129+0000 7f0803d56b80 20 client.26716 trim_cache size 0 max 16384 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.159+0000 7f0803d56b80 1 Processor -- start 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.159+0000 7f0803d56b80 1 -- start start 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfac74c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac69880 0x55fdfac5e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac5ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f0803d56b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfaa378c0 con 0x55fdfac640b0 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f0803d56b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfac6ebe0 con 0x55fdfac6a1a0 2023-10-08T13:19:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f0803d56b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfac672d0 con 0x55fdfac69880 2023-10-08T13:19:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.160+0000 7f07f5909700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac69880 0x55fdfac5e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.164+0000 7f07f5108700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac5ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.165+0000 7f07f5909700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac69880 0x55fdfac5e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51760/0 (socket says 172.21.15.5:51760) 2023-10-08T13:19:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.165+0000 7f07f5909700 1 -- 172.21.15.5:0/3712276930 learned_addr learned my addr 172.21.15.5:0/3712276930 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.170+0000 7f07f5108700 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfac74c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.173+0000 7f07f5108700 1 -- 172.21.15.5:0/3712276930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac69880 msgr2=0x55fdfac5e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.173+0000 7f07f5108700 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac69880 0x55fdfac5e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.173+0000 7f07f5108700 1 -- 172.21.15.5:0/3712276930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 msgr2=0x55fdfac5ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.173+0000 7f07f5108700 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac5ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.173+0000 7f07f5108700 1 -- 172.21.15.5:0/3712276930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdfaa081f0 con 0x55fdfac640b0 2023-10-08T13:19:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.176+0000 7f07f5108700 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfac74c80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f07ec001f70 tx=0x7f07ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b7171de1c17209 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.176+0000 7f07e4d82700 1 -- 172.21.15.5:0/3712276930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec003dd0 con 0x55fdfac640b0 2023-10-08T13:19:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.177+0000 7f07e4d82700 1 -- 172.21.15.5:0/3712276930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07ec011040 con 0x55fdfac640b0 2023-10-08T13:19:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.177+0000 7f07e4d82700 1 -- 172.21.15.5:0/3712276930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec01f930 con 0x55fdfac640b0 2023-10-08T13:19:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.178+0000 7f0803d56b80 1 -- 172.21.15.5:0/3712276930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 msgr2=0x55fdfac74c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.178+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfac74c80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f07ec001f70 tx=0x7f07ec000bc0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.185+0000 7f0803d56b80 1 -- 172.21.15.5:0/3712276930 shutdown_connections 2023-10-08T13:19:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.185+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac6a1a0 0x55fdfac5ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.185+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfac74c80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.185+0000 7f0803d56b80 1 --2- 172.21.15.5:0/3712276930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac69880 0x55fdfac5e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.185+0000 7f0803d56b80 1 -- 172.21.15.5:0/3712276930 >> 172.21.15.5:0/3712276930 conn(0x55fdfabd8200 msgr2=0x55fdfac67780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.186+0000 7f0803d56b80 1 -- 172.21.15.5:0/3712276930 shutdown_connections 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.186+0000 7f0803d56b80 1 -- 172.21.15.5:0/3712276930 wait complete. 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.186+0000 7f0803d56b80 1 -- start start 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.186+0000 7f0803d56b80 1 Processor -- start 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.186+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfacc5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.187+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac69880 0x55fdfacc6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.187+0000 7f0803d56b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfacd0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.187+0000 7f0803d56b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfacc6ac0 con 0x55fdfac640b0 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.187+0000 7f0803d56b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfacd1200 con 0x55fdfac69880 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.187+0000 7f0803d56b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdfacd13c0 con 0x55fdfac6a1a0 2023-10-08T13:19:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.187+0000 7f0803d56b80 10 client.0 _ll_register_callbacks cb 0x7f07ec0063f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.188+0000 7f07f5909700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac69880 0x55fdfacc6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.188+0000 7f07f5909700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac69880 0x55fdfacc6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33514/0 (socket says 172.21.15.5:33514) 2023-10-08T13:19:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.188+0000 7f07f5909700 1 -- 172.21.15.5:0/1556917563 learned_addr learned my addr 172.21.15.5:0/1556917563 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.189+0000 7f07f5108700 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfacc5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.189+0000 7f07f5108700 1 -- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 msgr2=0x55fdfacd0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.189+0000 7f07f5108700 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfacd0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.189+0000 7f07f5108700 1 -- 172.21.15.5:0/1556917563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac69880 msgr2=0x55fdfacc6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.189+0000 7f07f5108700 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac69880 0x55fdfacc6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.189+0000 7f07f5108700 1 -- 172.21.15.5:0/1556917563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdfa9cac00 con 0x55fdfac640b0 2023-10-08T13:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f07f5108700 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfacc5e00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f07ec003ad0 tx=0x7f07ec004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91eb289f83c5bdd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f07d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:19:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f07d97fa700 1 -- 172.21.15.5:0/1556917563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004650 con 0x55fdfac640b0 2023-10-08T13:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f07d97fa700 1 -- 172.21.15.5:0/1556917563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f07ec02c470 con 0x55fdfac640b0 2023-10-08T13:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07e0012c10 con 0x55fdfac640b0 2023-10-08T13:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f07d97fa700 1 -- 172.21.15.5:0/1556917563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07ec007ba0 con 0x55fdfac640b0 2023-10-08T13:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f0803d56b80 10 client.17229 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.190+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55fdfa9e0250 con 0x55fdfac640b0 2023-10-08T13:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.197+0000 7f07d97fa700 1 -- 172.21.15.5:0/1556917563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07ec03d080 con 0x55fdfac640b0 2023-10-08T13:19:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.197+0000 7f07d97fa700 1 -- 172.21.15.5:0/1556917563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f07ec035440 con 0x55fdfac640b0 2023-10-08T13:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.201+0000 7f0803d56b80 10 client.17229 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.201+0000 7f0803d56b80 10 client.17229 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.201+0000 7f0803d56b80 20 client.17229 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.201+0000 7f0803d56b80 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfacd2820 0x55fdfacd4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.201+0000 7f0803d56b80 4 client.17229 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:19:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.201+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fdfabafad0 con 0x55fdfacd2820 2023-10-08T13:19:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.214+0000 7f07f5909700 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfacd2820 0x55fdfacd4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.231+0000 7f07f5909700 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfacd2820 0x55fdfacd4c10 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5729ea2324ef38c5 server_cookie=6a2a79a26c87059e in_seq=0 out_seq=0 2023-10-08T13:19:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.234+0000 7f07d97fa700 10 client.17229 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:46.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.310+0000 7f07d97fa700 1 -- 172.21.15.5:0/1556917563 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fdfabafad0 con 0x55fdfacd2820 2023-10-08T13:19:46.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.310+0000 7f07d97fa700 10 client.17229 handle_command_reply: tid=0 2023-10-08T13:19:46.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.310+0000 7f0803d56b80 1 client.17229 shutdown 2023-10-08T13:19:46.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 msgr2=0x55fdfacc5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfacc5e00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f07ec003ad0 tx=0x7f07ec004d70 comp rx=0 tx=0).stop 2023-10-08T13:19:46.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 shutdown_connections 2023-10-08T13:19:46.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fdfac6a1a0 0x55fdfacd0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdfac640b0 0x55fdfacc5e00 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55fdfacd2820 0x55fdfacd4c10 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 --2- 172.21.15.5:0/1556917563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fdfac69880 0x55fdfacc6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.315 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.312+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 >> 172.21.15.5:0/1556917563 conn(0x55fdfabd8200 msgr2=0x55fdfac686d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.317+0000 7f07d97fa700 0 client.17229 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.317+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 shutdown_connections 2023-10-08T13:19:46.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.322+0000 7f0803d56b80 1 -- 172.21.15.5:0/1556917563 wait complete. 2023-10-08T13:19:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.329+0000 7f0803d56b80 20 client.17229 trim_cache size 0 max 16384 2023-10-08T13:19:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:19:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:19:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:19:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:19:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07dc0a17f0 msgr2=0x7f07dc0a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07dc0a17f0 0x7f07dc0a3cb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f07e80973b0 tx=0x7f07e8018bc0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 msgr2=0x7f07f0115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 0x7f07f0115bb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f07e801a040 tx=0x7f07e80189f0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 shutdown_connections 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f07dc0a17f0 0x7f07dc0a3cb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07f0115700 0x7f07f0115bb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07f010f310 0x7f07f01194e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 --2- 172.21.15.5:0/730948879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f07f0119fd0 0x7f07f0119a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.331+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 >> 172.21.15.5:0/730948879 conn(0x7f07f006b7c0 msgr2=0x7f07f010b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.332+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 shutdown_connections 2023-10-08T13:19:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:46.332+0000 7f07f7b6d700 1 -- 172.21.15.5:0/730948879 wait complete. 2023-10-08T13:19:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 805.0 s, 477.6 tps, lat 213.736 ms stddev 236.065 2023-10-08T13:19:47.414 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:47 smithi060 ceph-mon[103190]: pgmap v727: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 5.7 MiB/s wr, 529 op/s 2023-10-08T13:19:47.428 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:47 smithi005 ceph-mon[99496]: pgmap v727: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 5.7 MiB/s wr, 529 op/s 2023-10-08T13:19:47.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:47 smithi118 ceph-mon[104234]: pgmap v727: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 5.7 MiB/s wr, 529 op/s 2023-10-08T13:19:49.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:49 smithi060 ceph-mon[103190]: pgmap v728: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.8 MiB/s wr, 441 op/s 2023-10-08T13:19:49.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:49 smithi005 ceph-mon[99496]: pgmap v728: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.8 MiB/s wr, 441 op/s 2023-10-08T13:19:49.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:49 smithi118 ceph-mon[104234]: pgmap v728: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 4.8 MiB/s wr, 441 op/s 2023-10-08T13:19:51.421 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:51 smithi060 ceph-mon[103190]: pgmap v729: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 4.5 MiB/s wr, 429 op/s 2023-10-08T13:19:51.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:51 smithi005 ceph-mon[99496]: pgmap v729: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 4.5 MiB/s wr, 429 op/s 2023-10-08T13:19:51.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:51 smithi118 ceph-mon[104234]: pgmap v729: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 4.5 MiB/s wr, 429 op/s 2023-10-08T13:19:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 810.0 s, 467.8 tps, lat 204.863 ms stddev 214.215 2023-10-08T13:19:52.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/2761473590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40ff540 msgr2=0x7fa5e40ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/2761473590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40ff540 0x7fa5e40ff9c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40099c0 tx=0x7fa5d4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/2761473590 shutdown_connections 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/2761473590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40fff00 0x7fa5e410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/2761473590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e4105600 0x7fa5e41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/2761473590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40ff540 0x7fa5e40ff9c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/2761473590 >> 172.21.15.5:0/2761473590 conn(0x7fa5e40fb010 msgr2=0x7fa5e40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/2761473590 shutdown_connections 2023-10-08T13:19:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.536+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/2761473590 wait complete. 2023-10-08T13:19:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.537+0000 7fa5ec2ac700 1 Processor -- start 2023-10-08T13:19:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.537+0000 7fa5ec2ac700 1 -- start start 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ec2ac700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 0x7fa5e419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ec2ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 0x7fa5e419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 0x7fa5e419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 0x7fa5e419c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51780/0 (socket says 172.21.15.5:51780) 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 0x7fa5e419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ec2ac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e4105600 0x7fa5e419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ec2ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e419aa60 con 0x7fa5e40fff00 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ec2ac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e419abd0 con 0x7fa5e4105600 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ec2ac700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e419ad90 con 0x7fa5e40ff540 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 0x7fa5e419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38578/0 (socket says 172.21.15.5:38578) 2023-10-08T13:19:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 -- 172.21.15.5:0/368063994 learned_addr learned my addr 172.21.15.5:0/368063994 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 -- 172.21.15.5:0/368063994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 msgr2=0x7fa5e419c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 0x7fa5e419c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 -- 172.21.15.5:0/368063994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e4105600 msgr2=0x7fa5e419a300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e4105600 0x7fa5e419a300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5e9847700 1 -- 172.21.15.5:0/368063994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009c40 con 0x7fa5e40fff00 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.538+0000 7fa5ea048700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 0x7fa5e419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.539+0000 7fa5e9847700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 0x7fa5e419cb10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4006010 tx=0x7fa5d400b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.539+0000 7fa5db7fe700 1 -- 172.21.15.5:0/368063994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d401d070 con 0x7fa5e40fff00 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.539+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d40095f0 con 0x7fa5e40fff00 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.539+0000 7fa5db7fe700 1 -- 172.21.15.5:0/368063994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5d400beb0 con 0x7fa5e40fff00 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.539+0000 7fa5db7fe700 1 -- 172.21.15.5:0/368063994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400fb20 con 0x7fa5e40fff00 2023-10-08T13:19:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.539+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e4194ab0 con 0x7fa5e40fff00 2023-10-08T13:19:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.541+0000 7fa5db7fe700 1 -- 172.21.15.5:0/368063994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa5d402b440 con 0x7fa5e40fff00 2023-10-08T13:19:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.542+0000 7fa5db7fe700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5d00a15f0 0x7fa5d00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.542+0000 7fa5db7fe700 1 -- 172.21.15.5:0/368063994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa5d40ce0e0 con 0x7fa5e40fff00 2023-10-08T13:19:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.543+0000 7fa5ea048700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5d00a15f0 0x7fa5d00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.543+0000 7fa5ea048700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5d00a15f0 0x7fa5d00a3ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0011490 tx=0x7fa5e0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.543+0000 7fa5f8495b80 1 Processor -- start 2023-10-08T13:19:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.543+0000 7fa5f8495b80 1 -- start start 2023-10-08T13:19:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c21c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c21c7a0 0x559e6c227110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c227650 0x559e6c229a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c185460 con 0x559e6c227650 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c176c20 con 0x559e6c21c7a0 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c174540 con 0x559e6c21be80 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c21c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c21c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51786/0 (socket says 172.21.15.5:51786) 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5ea048700 1 -- 172.21.15.5:0/3721821222 learned_addr learned my addr 172.21.15.5:0/3721821222 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.544+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c21c7a0 0x559e6c227110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.545+0000 7fa5e9847700 1 -- 172.21.15.5:0/3721821222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 msgr2=0x559e6c21c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.545+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c21c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.545+0000 7fa5e9847700 1 -- 172.21.15.5:0/3721821222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c227650 msgr2=0x559e6c229a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.545+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c227650 0x559e6c229a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.545+0000 7fa5e9847700 1 -- 172.21.15.5:0/3721821222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e6bf9ade0 con 0x559e6c21c7a0 2023-10-08T13:19:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.545+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c21c7a0 0x559e6c227110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40cb470 tx=0x7fa5d409a9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76e63f2c311aab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.546+0000 7fa5d8d82700 1 -- 172.21.15.5:0/3721821222 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d409adc0 con 0x559e6c21c7a0 2023-10-08T13:19:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.546+0000 7fa5d8d82700 1 -- 172.21.15.5:0/3721821222 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5d409ef10 con 0x559e6c21c7a0 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.546+0000 7fa5d8d82700 1 -- 172.21.15.5:0/3721821222 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d409a2b0 con 0x559e6c21c7a0 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3721821222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c21c7a0 msgr2=0x559e6c227110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c21c7a0 0x559e6c227110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40cb470 tx=0x7fa5d409a9f0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3721821222 shutdown_connections 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c227650 0x559e6c229a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c21c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3721821222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c21c7a0 0x559e6c227110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3721821222 >> 172.21.15.5:0/3721821222 conn(0x559e6c191260 msgr2=0x559e6c2182d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3721821222 shutdown_connections 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3721821222 wait complete. 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.547+0000 7fa5f8495b80 1 -- start start 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 Processor -- start 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21be80 0x559e6c227a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21c7a0 0x559e6c227f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c232ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c16fe30 con 0x559e6c21be80 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c10c710 con 0x559e6c227650 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c10c3b0 con 0x559e6c21c7a0 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5f8495b80 10 client.0 _ll_register_callbacks cb 0x559e6bf69800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21c7a0 0x559e6c227f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5ea849700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c232ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21c7a0 0x559e6c227f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51792/0 (socket says 172.21.15.5:51792) 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5e9847700 1 -- 172.21.15.5:0/2818325402 learned_addr learned my addr 172.21.15.5:0/2818325402 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.548+0000 7fa5ea048700 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21be80 0x559e6c227a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5ea849700 1 -- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21c7a0 msgr2=0x559e6c227f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5ea849700 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21c7a0 0x559e6c227f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5ea849700 1 -- 172.21.15.5:0/2818325402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21be80 msgr2=0x559e6c227a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5ea849700 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21be80 0x559e6c227a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5ea849700 1 -- 172.21.15.5:0/2818325402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e4194ab0 con 0x559e6c227650 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5ea849700 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c232ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00eb80 tx=0x7fa5dc00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66067b38cf2a33e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:19:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5cdffb700 1 -- 172.21.15.5:0/2818325402 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc003a00 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5cdffb700 1 -- 172.21.15.5:0/2818325402 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa5dc003b60 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.549+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e6c137eb0 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5cdffb700 1 -- 172.21.15.5:0/2818325402 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5dc003d20 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 10 client.26651 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x559e6bf83c60 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5cdffb700 1 -- 172.21.15.5:0/2818325402 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559e6c137eb0 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5cdffb700 1 -- 172.21.15.5:0/2818325402 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa5dc004030 con 0x559e6c227650 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 10 client.26651 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 10 client.26651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 20 client.26651 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c236e20 0x559e6c239240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 4 client.26651 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e6c168e10 con 0x559e6c236e20 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.550+0000 7fa5ea048700 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c236e20 0x559e6c239240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.551+0000 7fa5cdffb700 10 client.26651 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.551+0000 7fa5ea048700 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c236e20 0x559e6c239240 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866e720d604bf431 server_cookie=ace72c2b466f83f9 in_seq=0 out_seq=0 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5cdffb700 1 -- 172.21.15.5:0/2818325402 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559e6c168e10 con 0x559e6c236e20 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5cdffb700 10 client.26651 handle_command_reply: tid=0 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 client.26651 shutdown 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 msgr2=0x559e6c232ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c232ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00eb80 tx=0x7fa5dc00ee90 comp rx=0 tx=0).stop 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 shutdown_connections 2023-10-08T13:19:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c236e20 0x559e6c239240 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c232ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21be80 0x559e6c227a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5cdffb700 0 client.26651 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/2818325402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21c7a0 0x559e6c227f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 >> 172.21.15.5:0/2818325402 conn(0x559e6c191260 msgr2=0x559e6c217ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 shutdown_connections 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 1 -- 172.21.15.5:0/2818325402 wait complete. 2023-10-08T13:19:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.552+0000 7fa5f8495b80 20 client.26651 trim_cache size 0 max 16384 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 Processor -- start 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 -- start start 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c22c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c223be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c224120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6bff0920 con 0x559e6c21c7a0 2023-10-08T13:19:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c226890 con 0x559e6c227650 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c2184e0 con 0x559e6c21be80 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c223be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c22c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c22c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51800/0 (socket says 172.21.15.5:51800) 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5ea048700 1 -- 172.21.15.5:0/4069534366 learned_addr learned my addr 172.21.15.5:0/4069534366 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.574+0000 7fa5ea849700 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c224120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5ea048700 1 -- 172.21.15.5:0/4069534366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 msgr2=0x559e6c224120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5ea048700 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c224120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5ea048700 1 -- 172.21.15.5:0/4069534366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 msgr2=0x559e6c223be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5ea048700 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c223be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5ea048700 1 -- 172.21.15.5:0/4069534366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e6bfc1250 con 0x559e6c21be80 2023-10-08T13:19:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5e9847700 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c223be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5ea048700 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c22c900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559e6c239b40 tx=0x7fa5e0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=729d0195f933f52b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.575+0000 7fa5d9583700 1 -- 172.21.15.5:0/4069534366 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0024040 con 0x559e6c21be80 2023-10-08T13:19:52.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5d9583700 1 -- 172.21.15.5:0/4069534366 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e00295b0 con 0x559e6c21be80 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5d9583700 1 -- 172.21.15.5:0/4069534366 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e001e930 con 0x559e6c21be80 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 -- 172.21.15.5:0/4069534366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 msgr2=0x559e6c22c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c22c900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559e6c239b40 tx=0x7fa5e0014000 comp rx=0 tx=0).stop 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 -- 172.21.15.5:0/4069534366 shutdown_connections 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c224120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c22c900 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/4069534366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c223be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 -- 172.21.15.5:0/4069534366 >> 172.21.15.5:0/4069534366 conn(0x559e6c191260 msgr2=0x559e6c221c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 -- 172.21.15.5:0/4069534366 shutdown_connections 2023-10-08T13:19:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.578+0000 7fa5f8495b80 1 -- 172.21.15.5:0/4069534366 wait complete. 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 -- start start 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 Processor -- start 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c284970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c284eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c27ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c27f340 con 0x559e6c21c7a0 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c27f4b0 con 0x559e6c227650 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e6c27f670 con 0x559e6c21be80 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5f8495b80 10 client.0 _ll_register_callbacks cb 0x7fa5dc00e450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c284eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5ea048700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c284970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5e9847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c284eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38602/0 (socket says 172.21.15.5:38602) 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5e9847700 1 -- 172.21.15.5:0/3255484330 learned_addr learned my addr 172.21.15.5:0/3255484330 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.579+0000 7fa5ea849700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c27ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5ea048700 1 -- 172.21.15.5:0/3255484330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 msgr2=0x559e6c27ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5ea048700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c27ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5ea048700 1 -- 172.21.15.5:0/3255484330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 msgr2=0x559e6c284eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5ea048700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c284eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5ea048700 1 -- 172.21.15.5:0/3255484330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e6bf9ade0 con 0x559e6c21be80 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c284eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5ea048700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c284970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0011be0 tx=0x7fa5e001e490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f30f04b1f1c23ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:19:52.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5cdffb700 1 -- 172.21.15.5:0/3255484330 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0024070 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5cdffb700 1 -- 172.21.15.5:0/3255484330 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa5e0029b00 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.580+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e6c168b30 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5cdffb700 1 -- 172.21.15.5:0/3255484330 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e00295c0 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 10 client.26737 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7fa5e0017070 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5cdffb700 1 -- 172.21.15.5:0/3255484330 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559e6c168b30 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5cdffb700 1 -- 172.21.15.5:0/3255484330 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa5e00049b0 con 0x559e6c21be80 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 10 client.26737 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 10 client.26737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 20 client.26737 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c28c6c0 0x559e6c28eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 4 client.26737 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559e6bfbbf70 con 0x559e6c28c6c0 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.581+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c28c6c0 0x559e6c28eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5cdffb700 10 client.26737 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5e9847700 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c28c6c0 0x559e6c28eae0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330c1345ef5b1be5 server_cookie=99e284f365857247 in_seq=0 out_seq=0 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5cdffb700 1 -- 172.21.15.5:0/3255484330 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559e6bfbbf70 con 0x559e6c28c6c0 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5cdffb700 10 client.26737 handle_command_reply: tid=0 2023-10-08T13:19:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 client.26737 shutdown 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 msgr2=0x559e6c284970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c284970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0011be0 tx=0x7fa5e001e490 comp rx=0 tx=0).stop 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 shutdown_connections 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x559e6c28c6c0 0x559e6c28eae0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559e6c227650 0x559e6c27ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559e6c21be80 0x559e6c284970 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 --2- 172.21.15.5:0/3255484330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559e6c21c7a0 0x559e6c284eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5cdffb700 0 client.26737 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 >> 172.21.15.5:0/3255484330 conn(0x559e6c191260 msgr2=0x559e6c225250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 shutdown_connections 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 1 -- 172.21.15.5:0/3255484330 wait complete. 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.582+0000 7fa5f8495b80 20 client.26737 trim_cache size 0 max 16384 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:19:52.591 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:19:52.592 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5d00a15f0 msgr2=0x7fa5d00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5d00a15f0 0x7fa5d00a3ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0011490 tx=0x7fa5e0009260 comp rx=0 tx=0).stop 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 msgr2=0x7fa5e419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 0x7fa5e419cb10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4006010 tx=0x7fa5d400b9c0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 shutdown_connections 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa5d00a15f0 0x7fa5d00a3ab0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5e4105600 0x7fa5e419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e40ff540 0x7fa5e419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 --2- 172.21.15.5:0/368063994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5e40fff00 0x7fa5e419cb10 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 >> 172.21.15.5:0/368063994 conn(0x7fa5e40fb010 msgr2=0x7fa5e40689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 shutdown_connections 2023-10-08T13:19:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:19:52.583+0000 7fa5ec2ac700 1 -- 172.21.15.5:0/368063994 wait complete. 2023-10-08T13:19:52.601 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:19:53.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:53 smithi060 ceph-mon[103190]: pgmap v730: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 467 op/s 2023-10-08T13:19:53.428 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:53 smithi005 ceph-mon[99496]: pgmap v730: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 467 op/s 2023-10-08T13:19:53.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:53 smithi118 ceph-mon[104234]: pgmap v730: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 467 op/s 2023-10-08T13:19:54.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:54 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:54.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:54 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:54.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:54 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:55.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:55 smithi118 ceph-mon[104234]: pgmap v731: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.2 MiB/s wr, 422 op/s 2023-10-08T13:19:55.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:55 smithi060 ceph-mon[103190]: pgmap v731: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.2 MiB/s wr, 422 op/s 2023-10-08T13:19:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:55 smithi005 ceph-mon[99496]: pgmap v731: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.2 MiB/s wr, 422 op/s 2023-10-08T13:19:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:56.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:56 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:19:56.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:56.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:56.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:56 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:19:56.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:56.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:56.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:56 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:19:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 815.0 s, 488.4 tps, lat 202.298 ms stddev 239.386 2023-10-08T13:19:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:57 smithi118 ceph-mon[104234]: pgmap v732: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.3 MiB/s wr, 542 op/s 2023-10-08T13:19:57.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:57 smithi060 ceph-mon[103190]: pgmap v732: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.3 MiB/s wr, 542 op/s 2023-10-08T13:19:57.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:57 smithi005 ceph-mon[99496]: pgmap v732: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.3 MiB/s wr, 542 op/s 2023-10-08T13:19:59.523 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:19:59 smithi118 ceph-mon[104234]: pgmap v733: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.0 MiB/s wr, 457 op/s 2023-10-08T13:19:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.555+0000 7f51a3ee1700 1 -- 172.21.15.5:0/2947595959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c119fd0 msgr2=0x7f519c11c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.555+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/2947595959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c119fd0 0x7f519c11c3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5198009920 tx=0x7f5198009c30 comp rx=0 tx=0).stop 2023-10-08T13:19:59.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.569+0000 7f51a3ee1700 1 -- 172.21.15.5:0/2947595959 shutdown_connections 2023-10-08T13:19:59.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.569+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/2947595959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c119fd0 0x7f519c11c3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.569+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/2947595959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519c10eea0 0x7f519c1077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.569+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/2947595959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c10f310 0x7f519c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.569+0000 7f51a3ee1700 1 -- 172.21.15.5:0/2947595959 >> 172.21.15.5:0/2947595959 conn(0x7f519c06b7c0 msgr2=0x7f519c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.573+0000 7f51a3ee1700 1 -- 172.21.15.5:0/2947595959 shutdown_connections 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.573+0000 7f51a3ee1700 1 -- 172.21.15.5:0/2947595959 wait complete. 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.573+0000 7f51a3ee1700 1 Processor -- start 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.573+0000 7f51a3ee1700 1 -- start start 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.573+0000 7f51a3ee1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c10eea0 0x7f519c1195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.573+0000 7f51a3ee1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519c10f310 0x7f519c113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a3ee1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 0x7f519c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a3ee1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c1140c0 con 0x7f519c119fd0 2023-10-08T13:19:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a3ee1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c114230 con 0x7f519c10f310 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a3ee1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c1143f0 con 0x7f519c10eea0 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 0x7f519c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a147c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519c10f310 0x7f519c113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 0x7f519c113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38620/0 (socket says 172.21.15.5:38620) 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 -- 172.21.15.5:0/3699037243 learned_addr learned my addr 172.21.15.5:0/3699037243 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 -- 172.21.15.5:0/3699037243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c10eea0 msgr2=0x7f519c1195a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c10eea0 0x7f519c1195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 -- 172.21.15.5:0/3699037243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519c10f310 msgr2=0x7f519c113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519c10f310 0x7f519c113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 -- 172.21.15.5:0/3699037243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198009520 con 0x7f519c119fd0 2023-10-08T13:19:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.574+0000 7f51a247e700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 0x7f519c113b80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5198005e90 tx=0x7f519800b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:59.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.575+0000 7f5192ffd700 1 -- 172.21.15.5:0/3699037243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519801c070 con 0x7f519c119fd0 2023-10-08T13:19:59.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.575+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c124d70 con 0x7f519c119fd0 2023-10-08T13:19:59.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.575+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c1251d0 con 0x7f519c119fd0 2023-10-08T13:19:59.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.579+0000 7f51b00cab80 1 Processor -- start 2023-10-08T13:19:59.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.579+0000 7f51b00cab80 1 -- start start 2023-10-08T13:19:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.579+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.580+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 0x56474ded2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.580+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474ded3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.580+0000 7f51b00cab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474de3b400 con 0x56474ded91a0 2023-10-08T13:19:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.580+0000 7f51b00cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474de2cbc0 con 0x56474ded30b0 2023-10-08T13:19:59.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.580+0000 7f51b00cab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474de2a4e0 con 0x56474ded8880 2023-10-08T13:19:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.583+0000 7f51a1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 0x56474ded2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.583+0000 7f51a1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 0x56474ded2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38622/0 (socket says 172.21.15.5:38622) 2023-10-08T13:19:59.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.583+0000 7f51a1c7d700 1 -- 172.21.15.5:0/3095355319 learned_addr learned my addr 172.21.15.5:0/3095355319 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:59.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.595+0000 7f51a1c7d700 1 -- 172.21.15.5:0/3095355319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 msgr2=0x56474ded8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.595+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.595+0000 7f51a1c7d700 1 -- 172.21.15.5:0/3095355319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 msgr2=0x56474ded3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.595+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474ded3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.595+0000 7f51a1c7d700 1 -- 172.21.15.5:0/3095355319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56474dc50d80 con 0x56474ded91a0 2023-10-08T13:19:59.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.596+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 0x56474ded2b70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5194009da0 tx=0x7f519400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aaef60d9eba63f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:59.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.597+0000 7f5192ffd700 1 -- 172.21.15.5:0/3699037243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f519800bbc0 con 0x7f519c119fd0 2023-10-08T13:19:59.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.597+0000 7f5192ffd700 1 -- 172.21.15.5:0/3699037243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51980038e0 con 0x7f519c119fd0 2023-10-08T13:19:59.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.597+0000 7f5192ffd700 1 -- 172.21.15.5:0/3699037243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5198020030 con 0x7f519c119fd0 2023-10-08T13:19:59.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.597+0000 7f5192ffd700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51880a17b0 0x7f51880a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.598+0000 7f5192ffd700 1 -- 172.21.15.5:0/3699037243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f51980cf380 con 0x7f519c119fd0 2023-10-08T13:19:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.605+0000 7f51a147c700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51880a17b0 0x7f51880a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.609+0000 7f5187fff700 1 -- 172.21.15.5:0/3095355319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400e070 con 0x56474ded91a0 2023-10-08T13:19:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.609+0000 7f51a147c700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51880a17b0 0x7f51880a3c70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f519c114dd0 tx=0x7f518c009960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.609+0000 7f5187fff700 1 -- 172.21.15.5:0/3095355319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f519400bbd0 con 0x56474ded91a0 2023-10-08T13:19:59.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.609+0000 7f5187fff700 1 -- 172.21.15.5:0/3095355319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940115f0 con 0x56474ded91a0 2023-10-08T13:19:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.610+0000 7f51b00cab80 1 -- 172.21.15.5:0/3095355319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 msgr2=0x56474ded2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.610+0000 7f51b00cab80 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 0x56474ded2b70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5194009da0 tx=0x7f519400b330 comp rx=0 tx=0).stop 2023-10-08T13:19:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.616+0000 7f51b00cab80 1 -- 172.21.15.5:0/3095355319 shutdown_connections 2023-10-08T13:19:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.616+0000 7f51b00cab80 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474ded3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.616+0000 7f51b00cab80 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.616+0000 7f51b00cab80 1 --2- 172.21.15.5:0/3095355319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded91a0 0x56474ded2b70 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.616+0000 7f51b00cab80 1 -- 172.21.15.5:0/3095355319 >> 172.21.15.5:0/3095355319 conn(0x56474de47200 msgr2=0x56474decdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.618+0000 7f51b00cab80 1 -- 172.21.15.5:0/3095355319 shutdown_connections 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.618+0000 7f51b00cab80 1 -- 172.21.15.5:0/3095355319 wait complete. 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.619+0000 7f51b00cab80 1 -- start start 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.619+0000 7f51b00cab80 1 Processor -- start 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dedc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 0x56474dedcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dedd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474de25dd0 con 0x56474ded30b0 2023-10-08T13:19:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474ddc26b0 con 0x56474ded8880 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474ddc2350 con 0x56474ded91a0 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51b00cab80 10 client.0 _ll_register_callbacks cb 0x56474dc1f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51a147c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 0x56474dedcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51a147c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 0x56474dedcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33582/0 (socket says 172.21.15.5:33582) 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51a147c700 1 -- 172.21.15.5:0/1738272727 learned_addr learned my addr 172.21.15.5:0/1738272727 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.620+0000 7f51a247e700 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dedd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.621+0000 7f51a147c700 1 -- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 msgr2=0x56474dedd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.621+0000 7f51a147c700 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dedd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.621+0000 7f51a147c700 1 -- 172.21.15.5:0/1738272727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 msgr2=0x56474dedc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.621+0000 7f51a147c700 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dedc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.621+0000 7f51a147c700 1 -- 172.21.15.5:0/1738272727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5194009a50 con 0x56474ded8880 2023-10-08T13:19:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.621+0000 7f51a147c700 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 0x56474dedcac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f518c005390 tx=0x7f518c0096b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=207a0935d5fdae93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51857fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:19:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51857fa700 1 -- 172.21.15.5:0/1738272727 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c01e420 con 0x56474ded8880 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51857fa700 1 -- 172.21.15.5:0/1738272727 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f518c01e580 con 0x56474ded8880 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56474ddede50 con 0x56474ded8880 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51857fa700 1 -- 172.21.15.5:0/1738272727 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f518c01e740 con 0x56474ded8880 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51b00cab80 10 client.26663 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.625+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x56474dc39c00 con 0x56474ded8880 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.627+0000 7f51857fa700 1 -- 172.21.15.5:0/1738272727 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56474ddede50 con 0x56474ded8880 2023-10-08T13:19:59.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.627+0000 7f51857fa700 1 -- 172.21.15.5:0/1738272727 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f518c024020 con 0x56474ded8880 2023-10-08T13:19:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.631+0000 7f51b00cab80 10 client.26663 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.631+0000 7f51b00cab80 10 client.26663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.631+0000 7f51b00cab80 20 client.26663 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.631+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474deeccc0 0x56474deef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.631+0000 7f51b00cab80 4 client.26663 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:19:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.631+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56474de1edb0 con 0x56474deeccc0 2023-10-08T13:19:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.635+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474deeccc0 0x56474deef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.635+0000 7f51857fa700 10 client.26663 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.635+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474deeccc0 0x56474deef0e0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b828df72283d09 server_cookie=83305ebc2c77e874 in_seq=0 out_seq=0 2023-10-08T13:19:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.636+0000 7f51857fa700 1 -- 172.21.15.5:0/1738272727 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56474de1edb0 con 0x56474deeccc0 2023-10-08T13:19:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.636+0000 7f51857fa700 10 client.26663 handle_command_reply: tid=0 2023-10-08T13:19:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.639+0000 7f51b00cab80 1 client.26663 shutdown 2023-10-08T13:19:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.645+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 msgr2=0x56474dedcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.645+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 0x56474dedcac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f518c005390 tx=0x7f518c0096b0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 shutdown_connections 2023-10-08T13:19:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dedd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dedc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474deeccc0 0x56474deef0e0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1738272727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded8880 0x56474dedcac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 >> 172.21.15.5:0/1738272727 conn(0x56474de47200 msgr2=0x56474decd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51857fa700 0 client.26663 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 shutdown_connections 2023-10-08T13:19:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.649+0000 7f51b00cab80 1 -- 172.21.15.5:0/1738272727 wait complete. 2023-10-08T13:19:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.652+0000 7f51b00cab80 20 client.26663 trim_cache size 0 max 16384 2023-10-08T13:19:59.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:19:59 smithi060 ceph-mon[103190]: pgmap v733: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.0 MiB/s wr, 457 op/s 2023-10-08T13:19:59.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:19:59 smithi005 ceph-mon[99496]: pgmap v733: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.0 MiB/s wr, 457 op/s 2023-10-08T13:19:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.677+0000 7f51b00cab80 1 Processor -- start 2023-10-08T13:19:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.677+0000 7f51b00cab80 1 -- start start 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dee8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded91a0 0x56474dedb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51b00cab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474dca68c0 con 0x56474ded30b0 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51b00cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474deea430 con 0x56474ded91a0 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51b00cab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474dece940 con 0x56474ded8880 2023-10-08T13:19:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51a1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dee8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51a1c7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dee8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38638/0 (socket says 172.21.15.5:38638) 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51a1c7d700 1 -- 172.21.15.5:0/1365832865 learned_addr learned my addr 172.21.15.5:0/1365832865 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51a247e700 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded91a0 0x56474dedb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.678+0000 7f51a147c700 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f51a1c7d700 1 -- 172.21.15.5:0/1365832865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 msgr2=0x56474ded7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f51a1c7d700 1 -- 172.21.15.5:0/1365832865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded91a0 msgr2=0x56474dedb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded91a0 0x56474dedb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f51a1c7d700 1 -- 172.21.15.5:0/1365832865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56474dc771f0 con 0x56474ded30b0 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dee8d40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5194012cf0 tx=0x7f5194004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2eff88de59b795 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f5190ff9700 1 -- 172.21.15.5:0/1365832865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400e040 con 0x56474ded30b0 2023-10-08T13:19:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f5190ff9700 1 -- 172.21.15.5:0/1365832865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5194012850 con 0x56474ded30b0 2023-10-08T13:19:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.679+0000 7f5190ff9700 1 -- 172.21.15.5:0/1365832865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519401d710 con 0x56474ded30b0 2023-10-08T13:19:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 -- 172.21.15.5:0/1365832865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 msgr2=0x56474dee8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dee8d40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5194012cf0 tx=0x7f5194004ba0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 -- 172.21.15.5:0/1365832865 shutdown_connections 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded91a0 0x56474dedb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded30b0 0x56474dee8d40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 --2- 172.21.15.5:0/1365832865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded8880 0x56474ded7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 -- 172.21.15.5:0/1365832865 >> 172.21.15.5:0/1365832865 conn(0x56474de47200 msgr2=0x56474dedae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 -- 172.21.15.5:0/1365832865 shutdown_connections 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 -- 172.21.15.5:0/1365832865 wait complete. 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 -- start start 2023-10-08T13:19:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.680+0000 7f51b00cab80 1 Processor -- start 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474dee1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded8880 0x56474dee1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dee2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474df3fce0 con 0x56474ded8880 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474df3fe50 con 0x56474ded30b0 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56474df40010 con 0x56474ded91a0 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51b00cab80 10 client.0 _ll_register_callbacks cb 0x7f518c011f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474dee1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474dee1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33594/0 (socket says 172.21.15.5:33594) 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 -- 172.21.15.5:0/2549629604 learned_addr learned my addr 172.21.15.5:0/2549629604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a147c700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded8880 0x56474dee1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a247e700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dee2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 -- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 msgr2=0x56474dee2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dee2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 -- 172.21.15.5:0/2549629604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded8880 msgr2=0x56474dee1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded8880 0x56474dee1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a1c7d700 1 -- 172.21.15.5:0/2549629604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56474dc50d80 con 0x56474ded30b0 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.681+0000 7f51a147c700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded8880 0x56474dee1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51a1c7d700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474dee1670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f519401d400 tx=0x7f519401d430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c4c8d5a5a7790ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51857fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51857fa700 1 -- 172.21.15.5:0/2549629604 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400e040 con 0x56474ded30b0 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51857fa700 1 -- 172.21.15.5:0/2549629604 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f519401d8b0 con 0x56474ded30b0 2023-10-08T13:19:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f519400bbd0 con 0x56474ded30b0 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51857fa700 1 -- 172.21.15.5:0/2549629604 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f519401da70 con 0x56474ded30b0 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51b00cab80 10 client.26669 fetch_fsmap learned FSMap version 53 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x56474dc4f250 con 0x56474ded30b0 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51857fa700 1 -- 172.21.15.5:0/2549629604 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f519400bbd0 con 0x56474ded30b0 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.682+0000 7f51857fa700 1 -- 172.21.15.5:0/2549629604 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f519400b050 con 0x56474ded30b0 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51b00cab80 10 client.26669 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51b00cab80 10 client.26669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51b00cab80 20 client.26669 populate_metadata read hostname 'smithi005' 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51b00cab80 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474df414a0 0x56474df43890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51b00cab80 4 client.26669 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56474de1ead0 con 0x56474df414a0 2023-10-08T13:19:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51a147c700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474df414a0 0x56474df43890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:19:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51857fa700 10 client.26669 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.683+0000 7f51a147c700 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474df414a0 0x56474df43890 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6c9c9ae18af05d server_cookie=f8d728a68802c503 in_seq=0 out_seq=0 2023-10-08T13:19:59.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.691+0000 7f51857fa700 1 -- 172.21.15.5:0/2549629604 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56474de1ead0 con 0x56474df414a0 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.691+0000 7f51857fa700 10 client.26669 handle_command_reply: tid=0 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.691+0000 7f51b00cab80 1 client.26669 shutdown 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 msgr2=0x56474dee1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474dee1670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f519401d400 tx=0x7f519401d430 comp rx=0 tx=0).stop 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 shutdown_connections 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56474ded91a0 0x56474dee2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x56474df414a0 0x56474df43890 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56474ded30b0 0x56474dee1670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 --2- 172.21.15.5:0/2549629604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56474ded8880 0x56474dee1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51857fa700 0 client.26669 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:19:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.692+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 >> 172.21.15.5:0/2549629604 conn(0x56474de47200 msgr2=0x56474dedce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.700+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 shutdown_connections 2023-10-08T13:19:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.700+0000 7f51b00cab80 1 -- 172.21.15.5:0/2549629604 wait complete. 2023-10-08T13:19:59.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.720+0000 7f51b00cab80 20 client.26669 trim_cache size 0 max 16384 2023-10-08T13:19:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:19:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:19:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:19:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:19:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.730+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51880a17b0 msgr2=0x7f51880a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.730+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51880a17b0 0x7f51880a3c70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f519c114dd0 tx=0x7f518c009960 comp rx=0 tx=0).stop 2023-10-08T13:19:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.730+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 msgr2=0x7f519c113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:19:59.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.730+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 0x7f519c113b80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5198005e90 tx=0x7f519800b560 comp rx=0 tx=0).stop 2023-10-08T13:19:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.748+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 shutdown_connections 2023-10-08T13:19:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.748+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f51880a17b0 0x7f51880a3c70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.748+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c119fd0 0x7f519c113b80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.748+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f519c10eea0 0x7f519c1195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.748+0000 7f51a3ee1700 1 --2- 172.21.15.5:0/3699037243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f519c10f310 0x7f519c113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:19:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.748+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 >> 172.21.15.5:0/3699037243 conn(0x7f519c06b7c0 msgr2=0x7f519c10b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:19:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.769+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 shutdown_connections 2023-10-08T13:19:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:19:59.780+0000 7f51a3ee1700 1 -- 172.21.15.5:0/3699037243 wait complete. 2023-10-08T13:20:00.524 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:00 smithi118 ceph-mon[104234]: overall HEALTH_OK 2023-10-08T13:20:00.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:00 smithi060 ceph-mon[103190]: overall HEALTH_OK 2023-10-08T13:20:00.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:00 smithi005 ceph-mon[99496]: overall HEALTH_OK 2023-10-08T13:20:01.530 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:01 smithi118 ceph-mon[104234]: pgmap v734: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.6 MiB/s wr, 425 op/s 2023-10-08T13:20:01.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:01 smithi060 ceph-mon[103190]: pgmap v734: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.6 MiB/s wr, 425 op/s 2023-10-08T13:20:01.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:01 smithi005 ceph-mon[99496]: pgmap v734: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.6 MiB/s wr, 425 op/s 2023-10-08T13:20:01.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 820.0 s, 440.9 tps, lat 230.497 ms stddev 262.229 2023-10-08T13:20:03.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:03 smithi060 ceph-mon[103190]: pgmap v735: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2023-10-08T13:20:03.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:03 smithi005 ceph-mon[99496]: pgmap v735: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2023-10-08T13:20:03.775 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:03 smithi118 ceph-mon[104234]: pgmap v735: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 523 op/s 2023-10-08T13:20:05.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:05 smithi060 ceph-mon[103190]: pgmap v736: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.6 MiB/s wr, 442 op/s 2023-10-08T13:20:05.676 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:05 smithi005 ceph-mon[99496]: pgmap v736: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.6 MiB/s wr, 442 op/s 2023-10-08T13:20:05.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:05 smithi118 ceph-mon[104234]: pgmap v736: 129 pgs: 129 active+clean; 3.3 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.6 MiB/s wr, 442 op/s 2023-10-08T13:20:06.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 825.0 s, 513.7 tps, lat 200.865 ms stddev 214.749 2023-10-08T13:20:07.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:07 smithi060 ceph-mon[103190]: pgmap v737: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.6 MiB/s wr, 529 op/s 2023-10-08T13:20:07.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:07 smithi005 ceph-mon[99496]: pgmap v737: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.6 MiB/s wr, 529 op/s 2023-10-08T13:20:07.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:07 smithi118 ceph-mon[104234]: pgmap v737: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.6 MiB/s wr, 529 op/s 2023-10-08T13:20:09.664 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:09 smithi060 ceph-mon[103190]: pgmap v738: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 4.6 MiB/s wr, 433 op/s 2023-10-08T13:20:09.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:09 smithi005 ceph-mon[99496]: pgmap v738: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 4.6 MiB/s wr, 433 op/s 2023-10-08T13:20:09.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:09 smithi118 ceph-mon[104234]: pgmap v738: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 4.6 MiB/s wr, 433 op/s 2023-10-08T13:20:10.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:10 smithi005 ceph-mon[99496]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T13:20:10.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:10 smithi005 ceph-mon[99496]: pgmap v740: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2023-10-08T13:20:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:10 smithi118 ceph-mon[104234]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T13:20:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:10 smithi118 ceph-mon[104234]: pgmap v740: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2023-10-08T13:20:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:10 smithi060 ceph-mon[103190]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T13:20:10.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:10 smithi060 ceph-mon[103190]: pgmap v740: 129 pgs: 129 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2023-10-08T13:20:11.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 830.0 s, 392.8 tps, lat 234.140 ms stddev 304.044 2023-10-08T13:20:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1607335030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 msgr2=0x7fc3ac1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1607335030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac1030b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400b0a0 tx=0x7fc3a400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1607335030 shutdown_connections 2023-10-08T13:20:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1607335030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac1030b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1607335030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac1055b0 0x7fc3ac105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1607335030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1607335030 >> 172.21.15.5:0/1607335030 conn(0x7fc3ac075b20 msgr2=0x7fc3ac0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1607335030 shutdown_connections 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.005+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1607335030 wait complete. 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 Processor -- start 2023-10-08T13:20:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 -- start start 2023-10-08T13:20:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac19d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac1055b0 0x7fc3ac1a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1a2110 con 0x7fc3ac0ff5b0 2023-10-08T13:20:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1a2280 con 0x7fc3ac1055b0 2023-10-08T13:20:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.006+0000 7fc3b0f71700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1a2440 con 0x7fc3ac0febf0 2023-10-08T13:20:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3a9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac19d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac1055b0 0x7fc3ac1a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac19d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51862/0 (socket says 172.21.15.5:51862) 2023-10-08T13:20:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3a9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38660/0 (socket says 172.21.15.5:38660) 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 -- 172.21.15.5:0/1470771749 learned_addr learned my addr 172.21.15.5:0/1470771749 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 -- 172.21.15.5:0/1470771749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac1055b0 msgr2=0x7fc3ac1a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac1055b0 0x7fc3ac1a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 -- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 msgr2=0x7fc3ac19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 -- 172.21.15.5:0/1470771749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4009d00 con 0x7fc3ac0febf0 2023-10-08T13:20:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac1055b0 0x7fc3ac1a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac19d1f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e9a0 tx=0x7fc39c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc39b7fe700 1 -- 172.21.15.5:0/1470771749 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c009790 con 0x7fc3ac0febf0 2023-10-08T13:20:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac1a2720 con 0x7fc3ac0febf0 2023-10-08T13:20:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc39b7fe700 1 -- 172.21.15.5:0/1470771749 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc39c010430 con 0x7fc3ac0febf0 2023-10-08T13:20:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc39b7fe700 1 -- 172.21.15.5:0/1470771749 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c018680 con 0x7fc3ac0febf0 2023-10-08T13:20:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.007+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac1a9f60 con 0x7fc3ac0febf0 2023-10-08T13:20:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.011+0000 7fc39b7fe700 1 -- 172.21.15.5:0/1470771749 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc39c0105a0 con 0x7fc3ac0febf0 2023-10-08T13:20:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.011+0000 7fc39b7fe700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc3940a15e0 0x7fc3940a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.011+0000 7fc39b7fe700 1 -- 172.21.15.5:0/1470771749 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fc39c014070 con 0x7fc3ac0febf0 2023-10-08T13:20:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.011+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc3940a15e0 0x7fc3940a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 Processor -- start 2023-10-08T13:20:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc3940a15e0 0x7fc3940a3aa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac19e740 tx=0x7fc3a0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 -- start start 2023-10-08T13:20:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140007c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x559140001b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 0x559140002510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913ff6a400 con 0x5591400020b0 2023-10-08T13:20:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913ff5bbc0 con 0x559140007880 2023-10-08T13:20:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913ff594e0 con 0x5591400081a0 2023-10-08T13:20:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3aad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 0x559140002510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3a9d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x559140001b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3aad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 0x559140002510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38670/0 (socket says 172.21.15.5:38670) 2023-10-08T13:20:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3aad9d700 1 -- 172.21.15.5:0/2204625399 learned_addr learned my addr 172.21.15.5:0/2204625399 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.012+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140007c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2204625399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 msgr2=0x559140001b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x559140001b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2204625399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 msgr2=0x559140002510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 0x559140002510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2204625399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55913fd7fd80 con 0x559140007880 2023-10-08T13:20:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 0x559140002510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140007c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0ca9b0 tx=0x7fc39c099ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d30110b109dccf17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc398ff9700 1 -- 172.21.15.5:0/2204625399 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c09e390 con 0x559140007880 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc398ff9700 1 -- 172.21.15.5:0/2204625399 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc39c0a25d0 con 0x559140007880 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.013+0000 7fc398ff9700 1 -- 172.21.15.5:0/2204625399 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c099730 con 0x559140007880 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2204625399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 msgr2=0x559140007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140007c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0ca9b0 tx=0x7fc39c099ba0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2204625399 shutdown_connections 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400020b0 0x559140002510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140007c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2204625399 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x559140001b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2204625399 >> 172.21.15.5:0/2204625399 conn(0x55913ff76200 msgr2=0x55913fffcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2204625399 shutdown_connections 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2204625399 wait complete. 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.014+0000 7fc3bd15ab80 1 -- start start 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 Processor -- start 2023-10-08T13:20:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x55914000b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559140007880 0x55914000bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x55914000bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913ff54dd0 con 0x559140007880 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fef16b0 con 0x5591400020b0 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fef1350 con 0x5591400081a0 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3bd15ab80 10 client.0 _ll_register_callbacks cb 0x55913fd4e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x55914000b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x55914000b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33622/0 (socket says 172.21.15.5:33622) 2023-10-08T13:20:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2952136040 learned_addr learned my addr 172.21.15.5:0/2952136040 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x55914000bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559140007880 0x55914000bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 msgr2=0x55914000bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x55914000bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2952136040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559140007880 msgr2=0x55914000bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559140007880 0x55914000bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2952136040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac103970 con 0x5591400020b0 2023-10-08T13:20:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.015+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x55914000bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x55914000b570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc39c09a1d0 tx=0x7fc39c00c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb879286952e3d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc391ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:20:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc391ffb700 1 -- 172.21.15.5:0/2952136040 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c09a4a0 con 0x5591400020b0 2023-10-08T13:20:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55913ff1ce50 con 0x5591400020b0 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc391ffb700 1 -- 172.21.15.5:0/2952136040 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fc39c09a600 con 0x5591400020b0 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc391ffb700 1 -- 172.21.15.5:0/2952136040 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc39c0a2140 con 0x5591400020b0 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 10 client.26681 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7fc3ac1a9f60 con 0x5591400020b0 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc391ffb700 1 -- 172.21.15.5:0/2952136040 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55913ff1ce50 con 0x5591400020b0 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc391ffb700 1 -- 172.21.15.5:0/2952136040 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc39c0cd220 con 0x5591400020b0 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 10 client.26681 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 10 client.26681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 20 client.26681 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914001b950 0x55914001dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 4 client.26681 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.016+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55913ff4ddb0 con 0x55914001b950 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.017+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914001b950 0x55914001dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.017+0000 7fc391ffb700 10 client.26681 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.017+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914001b950 0x55914001dd70 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=894fe66093fe51c9 server_cookie=8caf7becf726755c in_seq=0 out_seq=0 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.018+0000 7fc391ffb700 1 -- 172.21.15.5:0/2952136040 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55913ff4ddb0 con 0x55914001b950 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.018+0000 7fc391ffb700 10 client.26681 handle_command_reply: tid=0 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.018+0000 7fc3bd15ab80 1 client.26681 shutdown 2023-10-08T13:20:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.018+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 msgr2=0x55914000b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x55914000b570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc39c09a1d0 tx=0x7fc39c00c400 comp rx=0 tx=0).stop 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 shutdown_connections 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400081a0 0x55914000bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914001b950 0x55914001dd70 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x55914000b570 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2952136040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559140007880 0x55914000bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 >> 172.21.15.5:0/2952136040 conn(0x55913ff76200 msgr2=0x55913fffc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.019+0000 7fc391ffb700 0 client.26681 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.020+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 shutdown_connections 2023-10-08T13:20:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.020+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2952136040 wait complete. 2023-10-08T13:20:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.020+0000 7fc3bd15ab80 20 client.26681 trim_cache size 0 max 16384 2023-10-08T13:20:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 Processor -- start 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 -- start start 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x559140001b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 0x559140012c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x55913fffc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fdd58c0 con 0x5591400081a0 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fff72b0 con 0x5591400020b0 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fffd610 con 0x559140007880 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x559140001b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3a9d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 0x559140012c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x559140001b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33630/0 (socket says 172.21.15.5:33630) 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3a9d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 0x559140012c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51886/0 (socket says 172.21.15.5:51886) 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3aa59c700 1 -- 172.21.15.5:0/2864076763 learned_addr learned my addr 172.21.15.5:0/2864076763 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.040+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x55913fffc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aad9d700 1 -- 172.21.15.5:0/2864076763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 msgr2=0x559140012c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 0x559140012c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aad9d700 1 -- 172.21.15.5:0/2864076763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 msgr2=0x559140001b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x559140001b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aad9d700 1 -- 172.21.15.5:0/2864076763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55913fd68c00 con 0x5591400081a0 2023-10-08T13:20:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 0x559140012c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x559140001b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x55913fffc790 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400bc40 tx=0x7fc3a400bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4924597abe4eaa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3997fa700 1 -- 172.21.15.5:0/2864076763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400e040 con 0x5591400081a0 2023-10-08T13:20:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3997fa700 1 -- 172.21.15.5:0/2864076763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3a4003c00 con 0x5591400081a0 2023-10-08T13:20:13.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.041+0000 7fc3997fa700 1 -- 172.21.15.5:0/2864076763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4027a50 con 0x5591400081a0 2023-10-08T13:20:13.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2864076763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 msgr2=0x55913fffc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x55913fffc790 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400bc40 tx=0x7fc3a400bc70 comp rx=0 tx=0).stop 2023-10-08T13:20:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2864076763 shutdown_connections 2023-10-08T13:20:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x55913fffc790 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591400020b0 0x559140001b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/2864076763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559140007880 0x559140012c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2864076763 >> 172.21.15.5:0/2864076763 conn(0x55913ff76200 msgr2=0x5591400056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2864076763 shutdown_connections 2023-10-08T13:20:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/2864076763 wait complete. 2023-10-08T13:20:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.042+0000 7fc3bd15ab80 1 -- start start 2023-10-08T13:20:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 Processor -- start 2023-10-08T13:20:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400020b0 0x5591400636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140063c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x559140064150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914006e750 con 0x5591400081a0 2023-10-08T13:20:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914006e890 con 0x559140007880 2023-10-08T13:20:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914006e9d0 con 0x5591400020b0 2023-10-08T13:20:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3bd15ab80 10 client.0 _ll_register_callbacks cb 0x7fc3a0005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x559140064150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x559140064150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38690/0 (socket says 172.21.15.5:38690) 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3a9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140063c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aa59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400020b0 0x5591400636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 -- 172.21.15.5:0/3797587663 learned_addr learned my addr 172.21.15.5:0/3797587663 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 -- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400020b0 msgr2=0x5591400636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400020b0 0x5591400636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 -- 172.21.15.5:0/3797587663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 msgr2=0x559140063c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140063c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3aad9d700 1 -- 172.21.15.5:0/3797587663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac1a9f60 con 0x5591400081a0 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.043+0000 7fc3a9d9b700 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140063c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3aad9d700 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x559140064150 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400bce0 tx=0x7fc3a4027860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641a0ca1c3fffa1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc391ffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc391ffb700 1 -- 172.21.15.5:0/3797587663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400e040 con 0x5591400081a0 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc391ffb700 1 -- 172.21.15.5:0/3797587663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fc3a4027c60 con 0x5591400081a0 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc39c0a25d0 con 0x5591400081a0 2023-10-08T13:20:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc391ffb700 1 -- 172.21.15.5:0/3797587663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3a4027e20 con 0x5591400081a0 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 10 client.17277 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7fc3a0017070 con 0x5591400081a0 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc391ffb700 1 -- 172.21.15.5:0/3797587663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc39c0a25d0 con 0x5591400081a0 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc391ffb700 1 -- 172.21.15.5:0/3797587663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc3a400b0d0 con 0x5591400081a0 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 10 client.17277 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 20 client.17277 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914006fdd0 0x5591400721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 4 client.17277 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:20:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.044+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55913ff4dad0 con 0x55914006fdd0 2023-10-08T13:20:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.045+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914006fdd0 0x5591400721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.045+0000 7fc3aa59c700 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914006fdd0 0x5591400721c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83b73e7157ee3250 server_cookie=db3ea2a86d5aaf96 in_seq=0 out_seq=0 2023-10-08T13:20:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.045+0000 7fc391ffb700 10 client.17277 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.126+0000 7fc391ffb700 1 -- 172.21.15.5:0/3797587663 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55913ff4dad0 con 0x55914006fdd0 2023-10-08T13:20:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.126+0000 7fc391ffb700 10 client.17277 handle_command_reply: tid=0 2023-10-08T13:20:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.126+0000 7fc3bd15ab80 1 client.17277 shutdown 2023-10-08T13:20:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.139+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 msgr2=0x559140064150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.139+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x559140064150 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400bce0 tx=0x7fc3a4027860 comp rx=0 tx=0).stop 2023-10-08T13:20:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.140+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 shutdown_connections 2023-10-08T13:20:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.140+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591400081a0 0x559140064150 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.140+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5591400020b0 0x5591400636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.140+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55914006fdd0 0x5591400721c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.140+0000 7fc3bd15ab80 1 --2- 172.21.15.5:0/3797587663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559140007880 0x559140063c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.140+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 >> 172.21.15.5:0/3797587663 conn(0x55913ff76200 msgr2=0x559140006620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.141+0000 7fc391ffb700 0 client.17277 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.152+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 shutdown_connections 2023-10-08T13:20:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.152+0000 7fc3bd15ab80 1 -- 172.21.15.5:0/3797587663 wait complete. 2023-10-08T13:20:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.159+0000 7fc3bd15ab80 20 client.17277 trim_cache size 0 max 16384 2023-10-08T13:20:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:20:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:20:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:20:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:20:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.181+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc3940a15e0 msgr2=0x7fc3940a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.181+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc3940a15e0 0x7fc3940a3aa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac19e740 tx=0x7fc3a0009260 comp rx=0 tx=0).stop 2023-10-08T13:20:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.181+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 msgr2=0x7fc3ac19d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.181+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac19d1f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00e9a0 tx=0x7fc39c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.188+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 shutdown_connections 2023-10-08T13:20:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.188+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc3940a15e0 0x7fc3940a3aa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.188+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3ac1055b0 0x7fc3ac1a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.188+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc3ac0febf0 0x7fc3ac19d1f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.188+0000 7fc3b0f71700 1 --2- 172.21.15.5:0/1470771749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ac0ff5b0 0x7fc3ac19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.188+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 >> 172.21.15.5:0/1470771749 conn(0x7fc3ac075b20 msgr2=0x7fc3ac100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.198+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 shutdown_connections 2023-10-08T13:20:13.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:13.211+0000 7fc3b0f71700 1 -- 172.21.15.5:0/1470771749 wait complete. 2023-10-08T13:20:13.269 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:12 smithi118 ceph-mon[104234]: pgmap v741: 129 pgs: 5 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.2 MiB/s wr, 502 op/s 2023-10-08T13:20:13.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:12 smithi060 ceph-mon[103190]: pgmap v741: 129 pgs: 5 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.2 MiB/s wr, 502 op/s 2023-10-08T13:20:13.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:12 smithi005 ceph-mon[99496]: pgmap v741: 129 pgs: 5 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 5.2 MiB/s wr, 502 op/s 2023-10-08T13:20:15.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:15 smithi060 ceph-mon[103190]: pgmap v742: 129 pgs: 5 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.5 MiB/s wr, 471 op/s 2023-10-08T13:20:15.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:15 smithi005 ceph-mon[99496]: pgmap v742: 129 pgs: 5 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.5 MiB/s wr, 471 op/s 2023-10-08T13:20:15.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:15 smithi118 ceph-mon[104234]: pgmap v742: 129 pgs: 5 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 114 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.5 MiB/s wr, 471 op/s 2023-10-08T13:20:16.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 835.0 s, 486.3 tps, lat 216.826 ms stddev 280.697 2023-10-08T13:20:17.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:17 smithi060 ceph-mon[103190]: pgmap v743: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.5 MiB/s wr, 469 op/s 2023-10-08T13:20:17.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:17 smithi005 ceph-mon[99496]: pgmap v743: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.5 MiB/s wr, 469 op/s 2023-10-08T13:20:17.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:17 smithi118 ceph-mon[104234]: pgmap v743: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.5 MiB/s wr, 469 op/s 2023-10-08T13:20:19.411 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:19 smithi060 ceph-mon[103190]: pgmap v744: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.5 MiB/s wr, 473 op/s 2023-10-08T13:20:19.427 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:19 smithi005 ceph-mon[99496]: pgmap v744: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.5 MiB/s wr, 473 op/s 2023-10-08T13:20:19.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:19 smithi118 ceph-mon[104234]: pgmap v744: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.5 MiB/s wr, 473 op/s 2023-10-08T13:20:21.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:21 smithi060 ceph-mon[103190]: pgmap v745: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 465 op/s 2023-10-08T13:20:21.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:21 smithi060 ceph-mon[103190]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T13:20:21.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:21 smithi005 ceph-mon[99496]: pgmap v745: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 465 op/s 2023-10-08T13:20:21.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:21 smithi005 ceph-mon[99496]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T13:20:21.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:21 smithi118 ceph-mon[104234]: pgmap v745: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 465 op/s 2023-10-08T13:20:21.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:21 smithi118 ceph-mon[104234]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T13:20:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 840.0 s, 482.5 tps, lat 205.205 ms stddev 224.632 2023-10-08T13:20:22.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:20:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.917+0000 7f653e5a9700 1 -- 172.21.15.5:0/3255785080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 msgr2=0x7f6538107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.917+0000 7f653e5a9700 1 --2- 172.21.15.5:0/3255785080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f6538107c70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6530009f90 tx=0x7f653000b330 comp rx=0 tx=0).stop 2023-10-08T13:20:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.927+0000 7f653e5a9700 1 -- 172.21.15.5:0/3255785080 shutdown_connections 2023-10-08T13:20:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.927+0000 7f653e5a9700 1 --2- 172.21.15.5:0/3255785080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65381083a0 0x7f653811bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.927+0000 7f653e5a9700 1 --2- 172.21.15.5:0/3255785080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f653810edf0 0x7f653810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.927+0000 7f653e5a9700 1 --2- 172.21.15.5:0/3255785080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f6538107c70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.927+0000 7f653e5a9700 1 -- 172.21.15.5:0/3255785080 >> 172.21.15.5:0/3255785080 conn(0x7f653806b770 msgr2=0x7f653806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:22.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.933+0000 7f653e5a9700 1 -- 172.21.15.5:0/3255785080 shutdown_connections 2023-10-08T13:20:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.935+0000 7f653e5a9700 1 -- 172.21.15.5:0/3255785080 wait complete. 2023-10-08T13:20:22.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.936+0000 7f653e5a9700 1 Processor -- start 2023-10-08T13:20:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 -- start start 2023-10-08T13:20:22.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f653811b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65381083a0 0x7f653811bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f653810edf0 0x7f6538115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538116310 con 0x7f65381077f0 2023-10-08T13:20:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538116480 con 0x7f65381083a0 2023-10-08T13:20:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.942+0000 7f653e5a9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538116640 con 0x7f653810edf0 2023-10-08T13:20:22.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.943+0000 7f6537fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f653811b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.943+0000 7f6537fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f653811b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38700/0 (socket says 172.21.15.5:38700) 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.943+0000 7f6537fff700 1 -- 172.21.15.5:0/1750475799 learned_addr learned my addr 172.21.15.5:0/1750475799 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.944+0000 7f6537fff700 1 -- 172.21.15.5:0/1750475799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f653810edf0 msgr2=0x7f6538115b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.944+0000 7f6537fff700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f653810edf0 0x7f6538115b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.944+0000 7f6537fff700 1 -- 172.21.15.5:0/1750475799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65381083a0 msgr2=0x7f653811bec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.944+0000 7f6537fff700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65381083a0 0x7f653811bec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.944+0000 7f6537fff700 1 -- 172.21.15.5:0/1750475799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530009c40 con 0x7f65381077f0 2023-10-08T13:20:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.949+0000 7f6537fff700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f653811b980 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f652800b550 tx=0x7f652800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.949+0000 7f65357fa700 1 -- 172.21.15.5:0/1750475799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528011830 con 0x7f65381077f0 2023-10-08T13:20:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.949+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65381baaa0 con 0x7f65381077f0 2023-10-08T13:20:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.949+0000 7f65357fa700 1 -- 172.21.15.5:0/1750475799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6528011e50 con 0x7f65381077f0 2023-10-08T13:20:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.949+0000 7f65357fa700 1 -- 172.21.15.5:0/1750475799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800f2e0 con 0x7f65381077f0 2023-10-08T13:20:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.949+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65381baf20 con 0x7f65381077f0 2023-10-08T13:20:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.954+0000 7f654a792b80 1 Processor -- start 2023-10-08T13:20:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.955+0000 7f65357fa700 1 -- 172.21.15.5:0/1750475799 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f652800f440 con 0x7f65381077f0 2023-10-08T13:20:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.956+0000 7f65357fa700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f65200a1630 0x7f65200a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.956+0000 7f65357fa700 1 -- 172.21.15.5:0/1750475799 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f652800e260 con 0x7f65381077f0 2023-10-08T13:20:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 -- start start 2023-10-08T13:20:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948d9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948da6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948da8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948d04460 con 0x564948d9b7a0 2023-10-08T13:20:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948cf5c20 con 0x564948d9ae80 2023-10-08T13:20:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f654a792b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948cf3540 con 0x564948da6650 2023-10-08T13:20:22.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f6537fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948d9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f6537fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948d9b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33656/0 (socket says 172.21.15.5:33656) 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.963+0000 7f6537fff700 1 -- 172.21.15.5:0/3785575962 learned_addr learned my addr 172.21.15.5:0/3785575962 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f6537fff700 1 -- 172.21.15.5:0/3785575962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 msgr2=0x564948da8a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f6537fff700 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948da8a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f6537fff700 1 -- 172.21.15.5:0/3785575962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 msgr2=0x564948da6110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f6537fff700 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948da6110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f6537fff700 1 -- 172.21.15.5:0/3785575962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564948b19de0 con 0x564948d9ae80 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f6537fff700 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948d9b260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f65280a1d30 tx=0x7f6528099da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2d9838a41334e4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f651e7fc700 1 -- 172.21.15.5:0/3785575962 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528099ed0 con 0x564948d9ae80 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f651e7fc700 1 -- 172.21.15.5:0/3785575962 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65280cb040 con 0x564948d9ae80 2023-10-08T13:20:22.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.964+0000 7f651e7fc700 1 -- 172.21.15.5:0/3785575962 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652809a130 con 0x564948d9ae80 2023-10-08T13:20:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.965+0000 7f654a792b80 1 -- 172.21.15.5:0/3785575962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 msgr2=0x564948d9b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.965+0000 7f654a792b80 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948d9b260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f65280a1d30 tx=0x7f6528099da0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.966+0000 7f653cb46700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f65200a1630 0x7f65200a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:22.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.969+0000 7f653cb46700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f65200a1630 0x7f65200a3af0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f65381087d0 tx=0x7f652c009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.973+0000 7f654a792b80 1 -- 172.21.15.5:0/3785575962 shutdown_connections 2023-10-08T13:20:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.973+0000 7f654a792b80 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948da8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.973+0000 7f654a792b80 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948d9b260 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.973+0000 7f654a792b80 1 --2- 172.21.15.5:0/3785575962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948da6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.973+0000 7f654a792b80 1 -- 172.21.15.5:0/3785575962 >> 172.21.15.5:0/3785575962 conn(0x564948d10260 msgr2=0x564948d972d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.987+0000 7f654a792b80 1 -- 172.21.15.5:0/3785575962 shutdown_connections 2023-10-08T13:20:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.991+0000 7f654a792b80 1 -- 172.21.15.5:0/3785575962 wait complete. 2023-10-08T13:20:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.991+0000 7f654a792b80 1 -- start start 2023-10-08T13:20:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.991+0000 7f654a792b80 1 Processor -- start 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 0x564948da6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9b7a0 0x564948da32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948ceee30 con 0x564948d9ae80 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948c8b710 con 0x564948da6650 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948c8b3b0 con 0x564948d9b7a0 2023-10-08T13:20:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.992+0000 7f654a792b80 10 client.0 _ll_register_callbacks cb 0x564948ae8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.994+0000 7f6537fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 0x564948da6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.994+0000 7f6537fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 0x564948da6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38708/0 (socket says 172.21.15.5:38708) 2023-10-08T13:20:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.994+0000 7f6537fff700 1 -- 172.21.15.5:0/1201053743 learned_addr learned my addr 172.21.15.5:0/1201053743 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.995+0000 7f653cb46700 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.996+0000 7f6537fff700 1 -- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9b7a0 msgr2=0x564948da32b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:20:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.996+0000 7f6537fff700 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9b7a0 0x564948da32b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.996+0000 7f6537fff700 1 -- 172.21.15.5:0/1201053743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 msgr2=0x564948da38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.996+0000 7f6537fff700 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.996+0000 7f6537fff700 1 -- 172.21.15.5:0/1201053743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65381baf20 con 0x564948d9ae80 2023-10-08T13:20:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.997+0000 7f6537fff700 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 0x564948da6030 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6528011020 tx=0x7f6528099ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297eda7868777e32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.997+0000 7f651bff7700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:20:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.997+0000 7f651bff7700 1 -- 172.21.15.5:0/1201053743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528098270 con 0x564948d9ae80 2023-10-08T13:20:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.997+0000 7f651bff7700 1 -- 172.21.15.5:0/1201053743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f65280993c0 con 0x564948d9ae80 2023-10-08T13:20:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.997+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564948cb6eb0 con 0x564948d9ae80 2023-10-08T13:20:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.998+0000 7f651bff7700 1 -- 172.21.15.5:0/1201053743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6528099580 con 0x564948d9ae80 2023-10-08T13:20:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.998+0000 7f654a792b80 10 client.17286 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.998+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x564948b02c60 con 0x564948d9ae80 2023-10-08T13:20:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.998+0000 7f651bff7700 1 -- 172.21.15.5:0/1201053743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564948cb6eb0 con 0x564948d9ae80 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.998+0000 7f651bff7700 1 -- 172.21.15.5:0/1201053743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6528095cc0 con 0x564948d9ae80 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.999+0000 7f654a792b80 10 client.17286 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.999+0000 7f654a792b80 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:22.999+0000 7f654a792b80 20 client.17286 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.000+0000 7f654a792b80 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948db5e10 0x564948db8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.000+0000 7f654a792b80 4 client.17286 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:20:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.000+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564948ce7e10 con 0x564948db5e10 2023-10-08T13:20:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.009+0000 7f65377fe700 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948db5e10 0x564948db8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:23.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.039+0000 7f65377fe700 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948db5e10 0x564948db8230 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4f0718b37d4cc0 server_cookie=2d148cb00bef6c6a in_seq=0 out_seq=0 2023-10-08T13:20:23.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.039+0000 7f651bff7700 10 client.17286 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:23.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.042+0000 7f651bff7700 1 -- 172.21.15.5:0/1201053743 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564948ce7e10 con 0x564948db5e10 2023-10-08T13:20:23.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.042+0000 7f651bff7700 10 client.17286 handle_command_reply: tid=0 2023-10-08T13:20:23.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.050+0000 7f654a792b80 1 client.17286 shutdown 2023-10-08T13:20:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.052+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 msgr2=0x564948da6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:23.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.052+0000 7f654a792b80 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 0x564948da6030 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6528011020 tx=0x7f6528099ed0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.059+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 shutdown_connections 2023-10-08T13:20:23.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.059+0000 7f654a792b80 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948db5e10 0x564948db8230 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.059+0000 7f654a792b80 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.059+0000 7f654a792b80 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9ae80 0x564948da6030 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.059+0000 7f654a792b80 1 --2- 172.21.15.5:0/1201053743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9b7a0 0x564948da32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.059+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 >> 172.21.15.5:0/1201053743 conn(0x564948d10260 msgr2=0x564948d96ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.064+0000 7f651bff7700 0 client.17286 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.065+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 shutdown_connections 2023-10-08T13:20:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.065+0000 7f654a792b80 1 -- 172.21.15.5:0/1201053743 wait complete. 2023-10-08T13:20:23.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.071+0000 7f654a792b80 20 client.17286 trim_cache size 0 max 16384 2023-10-08T13:20:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 Processor -- start 2023-10-08T13:20:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 -- start start 2023-10-08T13:20:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9ae80 0x564948db20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dad240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948b6f920 con 0x564948d9b7a0 2023-10-08T13:20:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948d986a0 con 0x564948da6650 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f654a792b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948d915a0 con 0x564948d9ae80 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f6537fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9ae80 0x564948db20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f6537fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9ae80 0x564948db20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51922/0 (socket says 172.21.15.5:51922) 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f6537fff700 1 -- 172.21.15.5:0/4025653793 learned_addr learned my addr 172.21.15.5:0/4025653793 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.103+0000 7f653cb46700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f653cb46700 1 -- 172.21.15.5:0/4025653793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9ae80 msgr2=0x564948db20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f653cb46700 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9ae80 0x564948db20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f653cb46700 1 -- 172.21.15.5:0/4025653793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 msgr2=0x564948dad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f653cb46700 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f653cb46700 1 -- 172.21.15.5:0/4025653793 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564948b40250 con 0x564948da6650 2023-10-08T13:20:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f653cb46700 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da5b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f652c00eab0 tx=0x7f652c011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0725fd5081c74c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f651effd700 1 -- 172.21.15.5:0/4025653793 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c01da40 con 0x564948da6650 2023-10-08T13:20:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f651effd700 1 -- 172.21.15.5:0/4025653793 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f652c00ee80 con 0x564948da6650 2023-10-08T13:20:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.104+0000 7f651effd700 1 -- 172.21.15.5:0/4025653793 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0053a0 con 0x564948da6650 2023-10-08T13:20:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.105+0000 7f654a792b80 1 -- 172.21.15.5:0/4025653793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 msgr2=0x564948da5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.105+0000 7f654a792b80 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da5b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f652c00eab0 tx=0x7f652c011000 comp rx=0 tx=0).stop 2023-10-08T13:20:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.111+0000 7f654a792b80 1 -- 172.21.15.5:0/4025653793 shutdown_connections 2023-10-08T13:20:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.111+0000 7f654a792b80 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948da6650 0x564948da5b60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.111+0000 7f654a792b80 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948d9ae80 0x564948db20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.111+0000 7f654a792b80 1 --2- 172.21.15.5:0/4025653793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.111+0000 7f654a792b80 1 -- 172.21.15.5:0/4025653793 >> 172.21.15.5:0/4025653793 conn(0x564948d10260 msgr2=0x564948db1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:23.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.112+0000 7f654a792b80 1 -- 172.21.15.5:0/4025653793 shutdown_connections 2023-10-08T13:20:23.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:23 smithi005 ceph-mon[99496]: pgmap v747: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 475 op/s 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.112+0000 7f654a792b80 1 -- 172.21.15.5:0/4025653793 wait complete. 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 -- start start 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 Processor -- start 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948dab940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dabe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948dac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948e09ce0 con 0x564948d9b7a0 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948e09e20 con 0x564948d9ae80 2023-10-08T13:20:23.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564948e09fe0 con 0x564948da6650 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.113+0000 7f654a792b80 10 client.0 _ll_register_callbacks cb 0x7f6528099ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dabe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dabe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38724/0 (socket says 172.21.15.5:38724) 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 -- 172.21.15.5:0/2658925633 learned_addr learned my addr 172.21.15.5:0/2658925633 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f653cb46700 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948dac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 -- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 msgr2=0x564948dac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948dac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 -- 172.21.15.5:0/2658925633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 msgr2=0x564948dab940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948dab940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 -- 172.21.15.5:0/2658925633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c00e790 con 0x564948d9b7a0 2023-10-08T13:20:23.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f65377fe700 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dabe80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6538071bc0 tx=0x7f6530008ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2e4ca6209eceff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.114+0000 7f651bff7700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:20:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.119+0000 7f651bff7700 1 -- 172.21.15.5:0/2658925633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653000e040 con 0x564948d9b7a0 2023-10-08T13:20:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.119+0000 7f651bff7700 1 -- 172.21.15.5:0/2658925633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f6530021d10 con 0x564948d9b7a0 2023-10-08T13:20:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.119+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65280cb040 con 0x564948d9b7a0 2023-10-08T13:20:23.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.119+0000 7f651bff7700 1 -- 172.21.15.5:0/2658925633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6530021180 con 0x564948d9b7a0 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.125+0000 7f654a792b80 10 client.17289 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.125+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x564948b182b0 con 0x564948d9b7a0 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f651bff7700 1 -- 172.21.15.5:0/2658925633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f653002e030 con 0x564948d9b7a0 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f651bff7700 1 -- 172.21.15.5:0/2658925633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f653000b050 con 0x564948d9b7a0 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f654a792b80 10 client.17289 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f654a792b80 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:23.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f654a792b80 20 client.17289 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f654a792b80 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948e0b940 0x564948e0dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f654a792b80 4 client.17289 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564948ce7b30 con 0x564948e0b940 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.126+0000 7f6537fff700 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948e0b940 0x564948e0dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.127+0000 7f6537fff700 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948e0b940 0x564948e0dd60 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3151e8ef2c17bc1 server_cookie=198947ce216dc90a in_seq=0 out_seq=0 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.127+0000 7f651bff7700 10 client.17289 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.127+0000 7f651bff7700 1 -- 172.21.15.5:0/2658925633 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564948ce7b30 con 0x564948e0b940 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.127+0000 7f651bff7700 10 client.17289 handle_command_reply: tid=0 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.127+0000 7f654a792b80 1 client.17289 shutdown 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 msgr2=0x564948dabe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:23.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dabe80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6538071bc0 tx=0x7f6530008ce0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 shutdown_connections 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564948da6650 0x564948dac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x564948e0b940 0x564948e0dd60 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564948d9ae80 0x564948dab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 --2- 172.21.15.5:0/2658925633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564948d9b7a0 0x564948dabe80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 >> 172.21.15.5:0/2658925633 conn(0x564948d10260 msgr2=0x564948da27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f651bff7700 0 client.17289 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 shutdown_connections 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 1 -- 172.21.15.5:0/2658925633 wait complete. 2023-10-08T13:20:23.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.128+0000 7f654a792b80 20 client.17289 trim_cache size 0 max 16384 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:20:23.132 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:20:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f65200a1630 msgr2=0x7f65200a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f65200a1630 0x7f65200a3af0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f65381087d0 tx=0x7f652c009310 comp rx=0 tx=0).stop 2023-10-08T13:20:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 msgr2=0x7f653811b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f653811b980 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f652800b550 tx=0x7f652800b910 comp rx=0 tx=0).stop 2023-10-08T13:20:23.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 shutdown_connections 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f65200a1630 0x7f65200a3af0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f653810edf0 0x7f6538115b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65381077f0 0x7f653811b980 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 --2- 172.21.15.5:0/1750475799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65381083a0 0x7f653811bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 >> 172.21.15.5:0/1750475799 conn(0x7f653806b770 msgr2=0x7f653806f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 shutdown_connections 2023-10-08T13:20:23.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:23.129+0000 7f653e5a9700 1 -- 172.21.15.5:0/1750475799 wait complete. 2023-10-08T13:20:23.152 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:20:23.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:23 smithi060 ceph-mon[103190]: pgmap v747: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 475 op/s 2023-10-08T13:20:23.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:23 smithi118 ceph-mon[104234]: pgmap v747: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.5 MiB/s wr, 475 op/s 2023-10-08T13:20:25.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:25 smithi060 ceph-mon[103190]: pgmap v748: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2023-10-08T13:20:25.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:25 smithi005 ceph-mon[99496]: pgmap v748: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2023-10-08T13:20:25.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:25 smithi118 ceph-mon[104234]: pgmap v748: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2023-10-08T13:20:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 -- 172.21.15.5:0/3395466283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae8105660 msgr2=0x7ffae8105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/3395466283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae8105660 0x7ffae8105a40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0099c0 tx=0x7ffadc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 -- 172.21.15.5:0/3395466283 shutdown_connections 2023-10-08T13:20:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/3395466283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae80fff60 0x7ffae810c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/3395466283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae8105660 0x7ffae8105a40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/3395466283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 0x7ffae80ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.384+0000 7ffaed8f3700 1 -- 172.21.15.5:0/3395466283 >> 172.21.15.5:0/3395466283 conn(0x7ffae80fb090 msgr2=0x7ffae80fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.388+0000 7ffaed8f3700 1 -- 172.21.15.5:0/3395466283 shutdown_connections 2023-10-08T13:20:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.388+0000 7ffaed8f3700 1 -- 172.21.15.5:0/3395466283 wait complete. 2023-10-08T13:20:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.389+0000 7ffaed8f3700 1 Processor -- start 2023-10-08T13:20:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.389+0000 7ffaed8f3700 1 -- start start 2023-10-08T13:20:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffaed8f3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 0x7ffae8196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffaed8f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae80fff60 0x7ffae8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffaed8f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8105660 0x7ffae819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffaed8f3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae819b930 con 0x7ffae80fff60 2023-10-08T13:20:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffaed8f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae819baa0 con 0x7ffae8105660 2023-10-08T13:20:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffaed8f3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae819bc60 con 0x7ffae80ff5a0 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae80fff60 0x7ffae8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 0x7ffae8196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae80fff60 0x7ffae8196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38738/0 (socket says 172.21.15.5:38738) 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae67fc700 1 -- 172.21.15.5:0/408263202 learned_addr learned my addr 172.21.15.5:0/408263202 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae77fe700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8105660 0x7ffae819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae6ffd700 1 -- 172.21.15.5:0/408263202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8105660 msgr2=0x7ffae819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8105660 0x7ffae819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae6ffd700 1 -- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae80fff60 msgr2=0x7ffae8196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae80fff60 0x7ffae8196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.390+0000 7ffae6ffd700 1 -- 172.21.15.5:0/408263202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0095f0 con 0x7ffae80ff5a0 2023-10-08T13:20:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.391+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 0x7ffae8196a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0098e0 tx=0x7ffadc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.391+0000 7ffaec8f1700 1 -- 172.21.15.5:0/408263202 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc01c070 con 0x7ffae80ff5a0 2023-10-08T13:20:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.391+0000 7ffaec8f1700 1 -- 172.21.15.5:0/408263202 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffadc00fd80 con 0x7ffae80ff5a0 2023-10-08T13:20:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.391+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae819bee0 con 0x7ffae80ff5a0 2023-10-08T13:20:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.391+0000 7ffaec8f1700 1 -- 172.21.15.5:0/408263202 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc022c10 con 0x7ffae80ff5a0 2023-10-08T13:20:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.391+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae8101320 con 0x7ffae80ff5a0 2023-10-08T13:20:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.393+0000 7ffaec8f1700 1 -- 172.21.15.5:0/408263202 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ffadc020070 con 0x7ffae80ff5a0 2023-10-08T13:20:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.394+0000 7ffaec8f1700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffad00a15e0 0x7ffad00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.394+0000 7ffae67fc700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffad00a15e0 0x7ffad00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.394+0000 7ffaec8f1700 1 -- 172.21.15.5:0/408263202 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ffadc0ce140 con 0x7ffae80ff5a0 2023-10-08T13:20:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffae67fc700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffad00a15e0 0x7ffad00a3aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffae8197fa0 tx=0x7ffad8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 Processor -- start 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 -- start start 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e436c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e430b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e431510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e399400 con 0x55627e4310b0 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e38abc0 con 0x55627e436880 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.395+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e3884e0 con 0x55627e4371a0 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e431510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e431510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38746/0 (socket says 172.21.15.5:38746) 2023-10-08T13:20:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae77fe700 1 -- 172.21.15.5:0/3702709087 learned_addr learned my addr 172.21.15.5:0/3702709087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e436c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae67fc700 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e430b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 -- 172.21.15.5:0/3702709087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 msgr2=0x55627e430b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e430b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 -- 172.21.15.5:0/3702709087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 msgr2=0x55627e431510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e431510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 -- 172.21.15.5:0/3702709087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55627e1aed80 con 0x55627e436880 2023-10-08T13:20:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.396+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e436c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0cb4a0 tx=0x7ffadc09ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b50e7a8a3ee71272 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.397+0000 7ffacdffb700 1 -- 172.21.15.5:0/3702709087 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc09b4c0 con 0x55627e436880 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.397+0000 7ffacdffb700 1 -- 172.21.15.5:0/3702709087 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffadc09adc0 con 0x55627e436880 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.397+0000 7ffacdffb700 1 -- 172.21.15.5:0/3702709087 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc09a2b0 con 0x55627e436880 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3702709087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 msgr2=0x55627e436c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e436c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0cb4a0 tx=0x7ffadc09ac10 comp rx=0 tx=0).stop 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3702709087 shutdown_connections 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e431510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e436c60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3702709087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e430b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3702709087 >> 172.21.15.5:0/3702709087 conn(0x55627e3a5200 msgr2=0x55627e42bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3702709087 shutdown_connections 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.398+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3702709087 wait complete. 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 -- start start 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 Processor -- start 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e43d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e43a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e43aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e383dd0 con 0x55627e4310b0 2023-10-08T13:20:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e3206b0 con 0x55627e436880 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.399+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e320350 con 0x55627e4371a0 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffaf9adcb80 10 client.0 _ll_register_callbacks cb 0x55627e17d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e43aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e43d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e43d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38750/0 (socket says 172.21.15.5:38750) 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e43aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51956/0 (socket says 172.21.15.5:51956) 2023-10-08T13:20:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae6ffd700 1 -- 172.21.15.5:0/3645674635 learned_addr learned my addr 172.21.15.5:0/3645674635 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 -- 172.21.15.5:0/3645674635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 msgr2=0x55627e43a490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e43a490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 -- 172.21.15.5:0/3645674635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 msgr2=0x55627e43d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e43d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 -- 172.21.15.5:0/3645674635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae8101320 con 0x55627e4371a0 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e43d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffae77fe700 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e43aaf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffae0004710 tx=0x7ffae0004a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=325e315b427ccdea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:20:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.400+0000 7ffac6ffd700 1 -- 172.21.15.5:0/3645674635 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000e040 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffac6ffd700 1 -- 172.21.15.5:0/3645674635 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ffae001a070 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55627e34be50 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffac6ffd700 1 -- 172.21.15.5:0/3645674635 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffae0014900 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 10 client.26785 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55627e197c00 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffac6ffd700 1 -- 172.21.15.5:0/3645674635 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55627e34be50 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffac6ffd700 1 -- 172.21.15.5:0/3645674635 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ffae0007c00 con 0x55627e4371a0 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 10 client.26785 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 10 client.26785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 20 client.26785 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e44a980 0x55627e44cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 4 client.26785 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.401+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55627e37cdb0 con 0x55627e44a980 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.402+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e44a980 0x55627e44cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.402+0000 7ffac6ffd700 10 client.26785 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.402+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e44a980 0x55627e44cda0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=620ed0426cdba5e7 server_cookie=a9e18d0d866369d9 in_seq=0 out_seq=0 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffac6ffd700 1 -- 172.21.15.5:0/3645674635 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55627e37cdb0 con 0x55627e44a980 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffac6ffd700 10 client.26785 handle_command_reply: tid=0 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 client.26785 shutdown 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 msgr2=0x55627e43aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e43aaf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffae0004710 tx=0x7ffae0004a20 comp rx=0 tx=0).stop 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 shutdown_connections 2023-10-08T13:20:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e43aaf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4310b0 0x55627e43d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.403+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e44a980 0x55627e44cda0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.404+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/3645674635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e436880 0x55627e43a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.404+0000 7ffac6ffd700 0 client.26785 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.404+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 >> 172.21.15.5:0/3645674635 conn(0x55627e3a5200 msgr2=0x55627e42b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.404+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 shutdown_connections 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.404+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/3645674635 wait complete. 2023-10-08T13:20:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.404+0000 7ffaf9adcb80 20 client.26785 trim_cache size 0 max 16384 2023-10-08T13:20:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 Processor -- start 2023-10-08T13:20:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 -- start start 2023-10-08T13:20:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e430b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e436880 0x55627e43aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e441950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e2048c0 con 0x55627e436880 2023-10-08T13:20:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e43b400 con 0x55627e4310b0 2023-10-08T13:20:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.426+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e447fb0 con 0x55627e4371a0 2023-10-08T13:20:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.433+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e430b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.433+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e430b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33708/0 (socket says 172.21.15.5:33708) 2023-10-08T13:20:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.433+0000 7ffae6ffd700 1 -- 172.21.15.5:0/2427024377 learned_addr learned my addr 172.21.15.5:0/2427024377 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.438+0000 7ffae77fe700 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e441950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.445+0000 7ffae6ffd700 1 -- 172.21.15.5:0/2427024377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 msgr2=0x55627e441950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.445+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e441950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.445+0000 7ffae6ffd700 1 -- 172.21.15.5:0/2427024377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e436880 msgr2=0x55627e43aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.445+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e436880 0x55627e43aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.445+0000 7ffae6ffd700 1 -- 172.21.15.5:0/2427024377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55627e4519d0 con 0x55627e4310b0 2023-10-08T13:20:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.451+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e430b70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffadc099110 tx=0x7ffadc0226e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae00885a11f037b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.463+0000 7fface7fc700 1 -- 172.21.15.5:0/2427024377 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc09b540 con 0x55627e4310b0 2023-10-08T13:20:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.463+0000 7fface7fc700 1 -- 172.21.15.5:0/2427024377 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffadc09ef90 con 0x55627e4310b0 2023-10-08T13:20:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.463+0000 7fface7fc700 1 -- 172.21.15.5:0/2427024377 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0a2c30 con 0x55627e4310b0 2023-10-08T13:20:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.476+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2427024377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 msgr2=0x55627e430b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.476+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e430b70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffadc099110 tx=0x7ffadc0226e0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.502+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2427024377 shutdown_connections 2023-10-08T13:20:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.502+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e4371a0 0x55627e441950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.502+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e430b70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.502+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2427024377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e436880 0x55627e43aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.502+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2427024377 >> 172.21.15.5:0/2427024377 conn(0x55627e3a5200 msgr2=0x55627e438d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.532+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2427024377 shutdown_connections 2023-10-08T13:20:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.536+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2427024377 wait complete. 2023-10-08T13:20:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.536+0000 7ffaf9adcb80 1 -- start start 2023-10-08T13:20:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.536+0000 7ffaf9adcb80 1 Processor -- start 2023-10-08T13:20:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e441960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 0x55627e432400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4371a0 0x55627e432940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e432e80 con 0x55627e4371a0 2023-10-08T13:20:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e432ff0 con 0x55627e4310b0 2023-10-08T13:20:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627e4331b0 con 0x55627e436880 2023-10-08T13:20:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.544+0000 7ffaf9adcb80 10 client.0 _ll_register_callbacks cb 0x7ffae0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.551+0000 7ffae67fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 0x55627e432400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.553+0000 7ffae67fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 0x55627e432400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51968/0 (socket says 172.21.15.5:51968) 2023-10-08T13:20:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.553+0000 7ffae67fc700 1 -- 172.21.15.5:0/2295762107 learned_addr learned my addr 172.21.15.5:0/2295762107 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.553+0000 7ffae67fc700 1 -- 172.21.15.5:0/2295762107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 msgr2=0x55627e441960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.554+0000 7ffae67fc700 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e441960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.554+0000 7ffae67fc700 1 -- 172.21.15.5:0/2295762107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4371a0 msgr2=0x55627e432940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.554+0000 7ffae67fc700 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4371a0 0x55627e432940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.554+0000 7ffae67fc700 1 -- 172.21.15.5:0/2295762107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55627e1aed80 con 0x55627e436880 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.554+0000 7ffae67fc700 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 0x55627e432400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55627e437600 tx=0x7ffad8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e493a5e92097ecf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.554+0000 7ffac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:20:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.559+0000 7ffac6ffd700 1 -- 172.21.15.5:0/2295762107 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8022070 con 0x55627e436880 2023-10-08T13:20:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.560+0000 7ffac6ffd700 1 -- 172.21.15.5:0/2295762107 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ffad800e920 con 0x55627e436880 2023-10-08T13:20:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.560+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffadc09adc0 con 0x55627e436880 2023-10-08T13:20:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.560+0000 7ffac6ffd700 1 -- 172.21.15.5:0/2295762107 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffad800eae0 con 0x55627e436880 2023-10-08T13:20:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.560+0000 7ffaf9adcb80 10 client.26791 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.560+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55627e1d51f0 con 0x55627e436880 2023-10-08T13:20:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.560+0000 7ffac6ffd700 1 -- 172.21.15.5:0/2295762107 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffadc09adc0 con 0x55627e436880 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffac6ffd700 1 -- 172.21.15.5:0/2295762107 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ffad800ec40 con 0x55627e436880 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffaf9adcb80 10 client.26791 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffaf9adcb80 10 client.26791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffaf9adcb80 20 client.26791 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e4aff40 0x55627e4b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffaf9adcb80 4 client.26791 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:20:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.561+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55627e37cad0 con 0x55627e4aff40 2023-10-08T13:20:26.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.571+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e4aff40 0x55627e4b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.571+0000 7ffac6ffd700 10 client.26791 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.571+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e4aff40 0x55627e4b2360 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98bed5ab4e82ee4c server_cookie=b2d7c57d1c70d1c5 in_seq=0 out_seq=0 2023-10-08T13:20:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.621+0000 7ffac6ffd700 1 -- 172.21.15.5:0/2295762107 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55627e37cad0 con 0x55627e4aff40 2023-10-08T13:20:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.621+0000 7ffac6ffd700 10 client.26791 handle_command_reply: tid=0 2023-10-08T13:20:26.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.621+0000 7ffaf9adcb80 1 client.26791 shutdown 2023-10-08T13:20:26.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.622+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 msgr2=0x55627e432400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.622+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 0x55627e432400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55627e437600 tx=0x7ffad8004750 comp rx=0 tx=0).stop 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 shutdown_connections 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55627e4371a0 0x55627e432940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55627e4aff40 0x55627e4b2360 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55627e4310b0 0x55627e441960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 --2- 172.21.15.5:0/2295762107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55627e436880 0x55627e432400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 >> 172.21.15.5:0/2295762107 conn(0x55627e3a5200 msgr2=0x55627e4460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffac6ffd700 0 client.26791 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.624+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 shutdown_connections 2023-10-08T13:20:26.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.627+0000 7ffaf9adcb80 1 -- 172.21.15.5:0/2295762107 wait complete. 2023-10-08T13:20:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.627+0000 7ffaf9adcb80 20 client.26791 trim_cache size 0 max 16384 2023-10-08T13:20:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:20:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:20:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:20:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:20:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.627+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffad00a15e0 msgr2=0x7ffad00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.627+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffad00a15e0 0x7ffad00a3aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffae8197fa0 tx=0x7ffad8009260 comp rx=0 tx=0).stop 2023-10-08T13:20:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.627+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 msgr2=0x7ffae8196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.627+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 0x7ffae8196a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0098e0 tx=0x7ffadc00f690 comp rx=0 tx=0).stop 2023-10-08T13:20:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 shutdown_connections 2023-10-08T13:20:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ffad00a15e0 0x7ffad00a3aa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffae8105660 0x7ffae819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae80ff5a0 0x7ffae8196a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 --2- 172.21.15.5:0/408263202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffae80fff60 0x7ffae8196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 >> 172.21.15.5:0/408263202 conn(0x7ffae80fb090 msgr2=0x7ffae80fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 shutdown_connections 2023-10-08T13:20:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:26.628+0000 7ffaed8f3700 1 -- 172.21.15.5:0/408263202 wait complete. 2023-10-08T13:20:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 845.0 s, 485.8 tps, lat 211.508 ms stddev 217.055 2023-10-08T13:20:27.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:27 smithi060 ceph-mon[103190]: pgmap v749: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 465 op/s 2023-10-08T13:20:27.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:27 smithi005 ceph-mon[99496]: pgmap v749: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 465 op/s 2023-10-08T13:20:27.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:27 smithi118 ceph-mon[104234]: pgmap v749: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 465 op/s 2023-10-08T13:20:29.524 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:29 smithi118 ceph-mon[104234]: pgmap v750: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.0 MiB/s wr, 479 op/s 2023-10-08T13:20:29.665 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:29 smithi060 ceph-mon[103190]: pgmap v750: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.0 MiB/s wr, 479 op/s 2023-10-08T13:20:29.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:29 smithi005 ceph-mon[99496]: pgmap v750: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.0 MiB/s wr, 479 op/s 2023-10-08T13:20:31.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:31 smithi118 ceph-mon[104234]: pgmap v751: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 4.4 MiB/s wr, 457 op/s 2023-10-08T13:20:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:31 smithi060 ceph-mon[103190]: pgmap v751: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 4.4 MiB/s wr, 457 op/s 2023-10-08T13:20:31.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:31 smithi005 ceph-mon[99496]: pgmap v751: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 4.4 MiB/s wr, 457 op/s 2023-10-08T13:20:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 850.0 s, 494.0 tps, lat 195.199 ms stddev 200.162 2023-10-08T13:20:33.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:33 smithi118 ceph-mon[104234]: pgmap v752: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 4.7 MiB/s wr, 458 op/s 2023-10-08T13:20:33.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:33 smithi060 ceph-mon[103190]: pgmap v752: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 4.7 MiB/s wr, 458 op/s 2023-10-08T13:20:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:33 smithi005 ceph-mon[99496]: pgmap v752: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 4.7 MiB/s wr, 458 op/s 2023-10-08T13:20:35.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:35 smithi118 ceph-mon[104234]: pgmap v753: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.6 MiB/s wr, 430 op/s 2023-10-08T13:20:35.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:35 smithi060 ceph-mon[103190]: pgmap v753: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.6 MiB/s wr, 430 op/s 2023-10-08T13:20:35.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:35 smithi005 ceph-mon[99496]: pgmap v753: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 4.6 MiB/s wr, 430 op/s 2023-10-08T13:20:36.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 855.0 s, 458.3 tps, lat 220.651 ms stddev 240.219 2023-10-08T13:20:37.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:37 smithi118 ceph-mon[104234]: pgmap v754: 129 pgs: 129 active+clean; 3.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.3 MiB/s wr, 517 op/s 2023-10-08T13:20:37.663 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:37 smithi060 ceph-mon[103190]: pgmap v754: 129 pgs: 129 active+clean; 3.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.3 MiB/s wr, 517 op/s 2023-10-08T13:20:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:37 smithi005 ceph-mon[99496]: pgmap v754: 129 pgs: 129 active+clean; 3.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.3 MiB/s wr, 517 op/s 2023-10-08T13:20:39.667 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:39 smithi060 ceph-mon[103190]: pgmap v755: 129 pgs: 129 active+clean; 3.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.4 MiB/s wr, 465 op/s 2023-10-08T13:20:39.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:39 smithi005 ceph-mon[99496]: pgmap v755: 129 pgs: 129 active+clean; 3.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.4 MiB/s wr, 465 op/s 2023-10-08T13:20:39.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:39 smithi118 ceph-mon[104234]: pgmap v755: 129 pgs: 129 active+clean; 3.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.4 MiB/s wr, 465 op/s 2023-10-08T13:20:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/4222398726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24105630 msgr2=0x7f3a24105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/4222398726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24105630 0x7f3a24105a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a180098f0 tx=0x7f3a18009c00 comp rx=0 tx=0).stop 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/4222398726 shutdown_connections 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/4222398726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a240fff30 0x7f3a2410c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/4222398726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24105630 0x7f3a24105a10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/4222398726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 0x7f3a240ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/4222398726 >> 172.21.15.5:0/4222398726 conn(0x7f3a240fb080 msgr2=0x7f3a240fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/4222398726 shutdown_connections 2023-10-08T13:20:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.813+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/4222398726 wait complete. 2023-10-08T13:20:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 Processor -- start 2023-10-08T13:20:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 -- start start 2023-10-08T13:20:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 0x7f3a2419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a240fff30 0x7f3a2419dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a24105630 0x7f3a241092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24109a60 con 0x7f3a240ff570 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24109bd0 con 0x7f3a240fff30 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.814+0000 7f3a2a1b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24109d90 con 0x7f3a24105630 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 0x7f3a2419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 0x7f3a2419d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38776/0 (socket says 172.21.15.5:38776) 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a237fe700 1 -- 172.21.15.5:0/3247369577 learned_addr learned my addr 172.21.15.5:0/3247369577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a240fff30 0x7f3a2419dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a24105630 0x7f3a241092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a23fff700 1 -- 172.21.15.5:0/3247369577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a240fff30 msgr2=0x7f3a2419dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a240fff30 0x7f3a2419dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a23fff700 1 -- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 msgr2=0x7f3a2419d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 0x7f3a2419d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.815+0000 7f3a23fff700 1 -- 172.21.15.5:0/3247369577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18009520 con 0x7f3a24105630 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.816+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a24105630 0x7f3a241092e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00efc0 tx=0x7f3a1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.816+0000 7f3a20ff9700 1 -- 172.21.15.5:0/3247369577 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c018070 con 0x7f3a24105630 2023-10-08T13:20:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.816+0000 7f3a20ff9700 1 -- 172.21.15.5:0/3247369577 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a1c00f040 con 0x7f3a24105630 2023-10-08T13:20:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.816+0000 7f3a20ff9700 1 -- 172.21.15.5:0/3247369577 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00cd50 con 0x7f3a24105630 2023-10-08T13:20:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.817+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2410a010 con 0x7f3a24105630 2023-10-08T13:20:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.817+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a24199420 con 0x7f3a24105630 2023-10-08T13:20:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.821+0000 7f3a20ff9700 1 -- 172.21.15.5:0/3247369577 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3a1c003a00 con 0x7f3a24105630 2023-10-08T13:20:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.822+0000 7f3a3639bb80 1 Processor -- start 2023-10-08T13:20:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 -- start start 2023-10-08T13:20:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a20ff9700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a0c0a15e0 0x7f3a0c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9c880 0x55b20df9cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 0x55b20df96b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20df97510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20deff400 con 0x55b20df970b0 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20def0bc0 con 0x55b20df9d1a0 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20deee4e0 con 0x55b20df9c880 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a20ff9700 1 -- 172.21.15.5:0/3247369577 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f3a1c0cc830 con 0x7f3a24105630 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 0x55b20df96b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 0x55b20df96b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33736/0 (socket says 172.21.15.5:33736) 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a22ffd700 1 -- 172.21.15.5:0/463215922 learned_addr learned my addr 172.21.15.5:0/463215922 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a0c0a15e0 0x7f3a0c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.823+0000 7f3a23fff700 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20df97510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 -- 172.21.15.5:0/463215922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9c880 msgr2=0x55b20df9cc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:20:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9c880 0x55b20df9cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 -- 172.21.15.5:0/463215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 msgr2=0x55b20df97510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20df97510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 -- 172.21.15.5:0/463215922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b20dd14d80 con 0x55b20df9d1a0 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 0x55b20df96b70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a14005d10 tx=0x7f3a14011950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6486014c2167f353 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a0c0a15e0 0x7f3a0c0a3aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3a1401c000 tx=0x7f3a1401e000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a09ffb700 1 -- 172.21.15.5:0/463215922 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400ed40 con 0x55b20df9d1a0 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a09ffb700 1 -- 172.21.15.5:0/463215922 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a1401e940 con 0x55b20df9d1a0 2023-10-08T13:20:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.824+0000 7f3a09ffb700 1 -- 172.21.15.5:0/463215922 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400eea0 con 0x55b20df9d1a0 2023-10-08T13:20:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.825+0000 7f3a3639bb80 1 -- 172.21.15.5:0/463215922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 msgr2=0x55b20df96b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.825+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 0x55b20df96b70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a14005d10 tx=0x7f3a14011950 comp rx=0 tx=0).stop 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 -- 172.21.15.5:0/463215922 shutdown_connections 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20df97510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9c880 0x55b20df9cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/463215922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df9d1a0 0x55b20df96b70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 -- 172.21.15.5:0/463215922 >> 172.21.15.5:0/463215922 conn(0x55b20df0b200 msgr2=0x55b20df91b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 -- 172.21.15.5:0/463215922 shutdown_connections 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 -- 172.21.15.5:0/463215922 wait complete. 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 -- start start 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.826+0000 7f3a3639bb80 1 Processor -- start 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20dfa05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9d1a0 0x55b20dfa0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20dfacca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20dee9dd0 con 0x55b20df970b0 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20de866b0 con 0x55b20dfa1030 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20de86350 con 0x55b20df9d1a0 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a3639bb80 10 client.0 _ll_register_callbacks cb 0x55b20dce37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9d1a0 0x55b20dfa0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9d1a0 0x55b20dfa0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:51992/0 (socket says 172.21.15.5:51992) 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a22ffd700 1 -- 172.21.15.5:0/3649524187 learned_addr learned my addr 172.21.15.5:0/3649524187 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a237fe700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20dfa05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.827+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20dfacca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.828+0000 7f3a23fff700 1 -- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9d1a0 msgr2=0x55b20dfa0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.828+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9d1a0 0x55b20dfa0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.828+0000 7f3a23fff700 1 -- 172.21.15.5:0/3649524187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 msgr2=0x55b20dfa05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.828+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20dfa05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.828+0000 7f3a23fff700 1 -- 172.21.15.5:0/3649524187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a14019040 con 0x55b20dfa1030 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.828+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20dfacca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0c9b90 tx=0x7f3a1c0992e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d1313784a8efc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a02ffd700 1 -- 172.21.15.5:0/3649524187 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c01a2d0 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b20deb1e50 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a02ffd700 1 -- 172.21.15.5:0/3649524187 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f3a1c099b20 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a02ffd700 1 -- 172.21.15.5:0/3649524187 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1c07c0c0 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 10 client.26723 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55b20dcfdc00 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a02ffd700 1 -- 172.21.15.5:0/3649524187 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b20deb1e50 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a02ffd700 1 -- 172.21.15.5:0/3649524187 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f3a1c0c9e10 con 0x55b20dfa1030 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 10 client.26723 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 10 client.26723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 20 client.26723 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20dfb1190 0x55b20dfb35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 4 client.26723 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.829+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b20dee2db0 con 0x55b20dfb1190 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.830+0000 7f3a237fe700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20dfb1190 0x55b20dfb35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.830+0000 7f3a02ffd700 10 client.26723 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.830+0000 7f3a237fe700 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20dfb1190 0x55b20dfb35b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9b9d10305e4c13 server_cookie=27f28c7729fe2bac in_seq=0 out_seq=0 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a02ffd700 1 -- 172.21.15.5:0/3649524187 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b20dee2db0 con 0x55b20dfb1190 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a02ffd700 10 client.26723 handle_command_reply: tid=0 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 client.26723 shutdown 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 msgr2=0x55b20dfacca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20dfacca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0c9b90 tx=0x7f3a1c0992e0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 shutdown_connections 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20dfb1190 0x55b20dfb35b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20dfacca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df970b0 0x55b20dfa05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a02ffd700 0 client.26723 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3649524187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df9d1a0 0x55b20dfa0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 >> 172.21.15.5:0/3649524187 conn(0x55b20df0b200 msgr2=0x55b20df91010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 shutdown_connections 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.831+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3649524187 wait complete. 2023-10-08T13:20:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.832+0000 7f3a3639bb80 20 client.26723 trim_cache size 0 max 16384 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 Processor -- start 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 -- start start 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 0x55b20df9fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20dfa1030 0x55b20df9bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20dd6a8c0 con 0x55b20df9d1a0 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20df8e830 con 0x55b20df970b0 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.850+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20dfb0f00 con 0x55b20dfa1030 2023-10-08T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 0x55b20df9fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 0x55b20df9fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33746/0 (socket says 172.21.15.5:33746) 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38798/0 (socket says 172.21.15.5:38798) 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 -- 172.21.15.5:0/3957000317 learned_addr learned my addr 172.21.15.5:0/3957000317 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a23fff700 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20dfa1030 0x55b20df9bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 -- 172.21.15.5:0/3957000317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20dfa1030 msgr2=0x55b20df9bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20dfa1030 0x55b20df9bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 -- 172.21.15.5:0/3957000317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 msgr2=0x55b20dfa7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 -- 172.21.15.5:0/3957000317 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b20dd3b1f0 con 0x55b20df970b0 2023-10-08T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a237fe700 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 0x55b20df9fe90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009230 tx=0x7f3a18005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e5df03ad91602db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a0a7fc700 1 -- 172.21.15.5:0/3957000317 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18024990 con 0x55b20df970b0 2023-10-08T13:20:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.851+0000 7f3a0a7fc700 1 -- 172.21.15.5:0/3957000317 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a1801d040 con 0x55b20df970b0 2023-10-08T13:20:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a0a7fc700 1 -- 172.21.15.5:0/3957000317 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800b850 con 0x55b20df970b0 2023-10-08T13:20:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3957000317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 msgr2=0x55b20df9fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 0x55b20df9fe90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009230 tx=0x7f3a18005e20 comp rx=0 tx=0).stop 2023-10-08T13:20:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3957000317 shutdown_connections 2023-10-08T13:20:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20dfa1030 0x55b20df9bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20df970b0 0x55b20df9fe90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/3957000317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3957000317 >> 172.21.15.5:0/3957000317 conn(0x55b20df0b200 msgr2=0x55b20df9b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3957000317 shutdown_connections 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.852+0000 7f3a3639bb80 1 -- 172.21.15.5:0/3957000317 wait complete. 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 -- start start 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 Processor -- start 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 0x55b20dfa3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20e003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20dfa4a10 con 0x55b20df9d1a0 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20e0044b0 con 0x55b20dfa1030 2023-10-08T13:20:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20e0045f0 con 0x55b20df970b0 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a3639bb80 10 client.0 _ll_register_callbacks cb 0x7f3a1c0950f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 0x55b20dfa3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a22ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a237fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 0x55b20dfa3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52006/0 (socket says 172.21.15.5:52006) 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a237fe700 1 -- 172.21.15.5:0/2546524017 learned_addr learned my addr 172.21.15.5:0/2546524017 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38804/0 (socket says 172.21.15.5:38804) 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.853+0000 7f3a23fff700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20e003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a237fe700 1 -- 172.21.15.5:0/2546524017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 msgr2=0x55b20e003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a237fe700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20e003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a237fe700 1 -- 172.21.15.5:0/2546524017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 msgr2=0x55b20dfa4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a237fe700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a237fe700 1 -- 172.21.15.5:0/2546524017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a24067fb0 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a23fff700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20e003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a237fe700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 0x55b20dfa3bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a180098c0 tx=0x7f3a18005b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e20186509c2fbebb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a02ffd700 1 -- 172.21.15.5:0/2546524017 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18024990 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a1401e940 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a02ffd700 1 -- 172.21.15.5:0/2546524017 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f3a18024af0 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a02ffd700 1 -- 172.21.15.5:0/2546524017 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a18024cd0 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a3639bb80 10 client.26806 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.854+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55b20dd13250 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a02ffd700 1 -- 172.21.15.5:0/2546524017 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a1401e940 con 0x55b20df970b0 2023-10-08T13:20:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a02ffd700 1 -- 172.21.15.5:0/2546524017 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f3a18022040 con 0x55b20df970b0 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a3639bb80 10 client.26806 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a3639bb80 10 client.26806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a3639bb80 20 client.26806 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20e005990 0x55b20e007db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a3639bb80 4 client.26806 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b20dee2ad0 con 0x55b20e005990 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.855+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20e005990 0x55b20e007db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.856+0000 7f3a02ffd700 10 client.26806 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.856+0000 7f3a22ffd700 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20e005990 0x55b20e007db0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c097eef76b39e24 server_cookie=1af0edc813527119 in_seq=0 out_seq=0 2023-10-08T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a02ffd700 1 -- 172.21.15.5:0/2546524017 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b20dee2ad0 con 0x55b20e005990 2023-10-08T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a02ffd700 10 client.26806 handle_command_reply: tid=0 2023-10-08T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 client.26806 shutdown 2023-10-08T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 msgr2=0x55b20dfa3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 0x55b20dfa3bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a180098c0 tx=0x7f3a18005b80 comp rx=0 tx=0).stop 2023-10-08T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 shutdown_connections 2023-10-08T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55b20e005990 0x55b20e007db0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b20dfa1030 0x55b20e003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b20df970b0 0x55b20dfa3bc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 --2- 172.21.15.5:0/2546524017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b20df9d1a0 0x55b20dfa4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a02ffd700 0 client.26806 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 >> 172.21.15.5:0/2546524017 conn(0x55b20df0b200 msgr2=0x55b20df9bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 shutdown_connections 2023-10-08T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 1 -- 172.21.15.5:0/2546524017 wait complete. 2023-10-08T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.865+0000 7f3a3639bb80 20 client.26806 trim_cache size 0 max 16384 2023-10-08T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:20:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a0c0a15e0 msgr2=0x7f3a0c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a0c0a15e0 0x7f3a0c0a3aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3a1401c000 tx=0x7f3a1401e000 comp rx=0 tx=0).stop 2023-10-08T13:20:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a24105630 msgr2=0x7f3a241092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a24105630 0x7f3a241092e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00efc0 tx=0x7f3a1c00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 shutdown_connections 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f3a0c0a15e0 0x7f3a0c0a3aa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a24105630 0x7f3a241092e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a240ff570 0x7f3a2419d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 --2- 172.21.15.5:0/3247369577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a240fff30 0x7f3a2419dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 >> 172.21.15.5:0/3247369577 conn(0x7f3a240fb080 msgr2=0x7f3a240fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 shutdown_connections 2023-10-08T13:20:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:39.866+0000 7f3a2a1b2700 1 -- 172.21.15.5:0/3247369577 wait complete. 2023-10-08T13:20:41.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:41 smithi060 ceph-mon[103190]: pgmap v756: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.2 MiB/s wr, 442 op/s 2023-10-08T13:20:41.676 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:41 smithi005 ceph-mon[99496]: pgmap v756: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.2 MiB/s wr, 442 op/s 2023-10-08T13:20:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 860.0 s, 452.7 tps, lat 224.032 ms stddev 241.294 2023-10-08T13:20:41.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:41 smithi118 ceph-mon[104234]: pgmap v756: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.2 MiB/s wr, 442 op/s 2023-10-08T13:20:43.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:43 smithi060 ceph-mon[103190]: pgmap v757: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.4 MiB/s wr, 550 op/s 2023-10-08T13:20:43.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:43 smithi005 ceph-mon[99496]: pgmap v757: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.4 MiB/s wr, 550 op/s 2023-10-08T13:20:43.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:43 smithi118 ceph-mon[104234]: pgmap v757: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.4 MiB/s wr, 550 op/s 2023-10-08T13:20:45.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:45 smithi060 ceph-mon[103190]: pgmap v758: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.0 MiB/s wr, 421 op/s 2023-10-08T13:20:45.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:45 smithi005 ceph-mon[99496]: pgmap v758: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.0 MiB/s wr, 421 op/s 2023-10-08T13:20:45.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:45 smithi118 ceph-mon[104234]: pgmap v758: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.0 MiB/s wr, 421 op/s 2023-10-08T13:20:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 865.0 s, 514.6 tps, lat 194.275 ms stddev 210.504 2023-10-08T13:20:47.668 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:47 smithi060 ceph-mon[103190]: pgmap v759: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2023-10-08T13:20:47.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:47 smithi005 ceph-mon[99496]: pgmap v759: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2023-10-08T13:20:47.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:47 smithi118 ceph-mon[104234]: pgmap v759: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.4 MiB/s wr, 500 op/s 2023-10-08T13:20:49.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:49 smithi118 ceph-mon[104234]: pgmap v760: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.2 MiB/s wr, 450 op/s 2023-10-08T13:20:49.914 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:49 smithi060 ceph-mon[103190]: pgmap v760: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.2 MiB/s wr, 450 op/s 2023-10-08T13:20:49.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:49 smithi005 ceph-mon[99496]: pgmap v760: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.2 MiB/s wr, 450 op/s 2023-10-08T13:20:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 870.0 s, 493.9 tps, lat 201.699 ms stddev 236.814 2023-10-08T13:20:51.774 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:51 smithi118 ceph-mon[104234]: pgmap v761: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.5 MiB/s wr, 452 op/s 2023-10-08T13:20:51.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:51 smithi060 ceph-mon[103190]: pgmap v761: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.5 MiB/s wr, 452 op/s 2023-10-08T13:20:51.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:51 smithi005 ceph-mon[99496]: pgmap v761: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.5 MiB/s wr, 452 op/s 2023-10-08T13:20:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 -- 172.21.15.5:0/1144620477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa018105630 msgr2=0x7fa018105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1144620477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa018105630 0x7fa018105a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa0080098f0 tx=0x7fa008009c00 comp rx=0 tx=0).stop 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 -- 172.21.15.5:0/1144620477 shutdown_connections 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1144620477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180fff30 0x7fa01810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1144620477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa018105630 0x7fa018105a10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1144620477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0180ff570 0x7fa0180ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 -- 172.21.15.5:0/1144620477 >> 172.21.15.5:0/1144620477 conn(0x7fa0180fb080 msgr2=0x7fa0180fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 -- 172.21.15.5:0/1144620477 shutdown_connections 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.009+0000 7fa01d07b700 1 -- 172.21.15.5:0/1144620477 wait complete. 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 Processor -- start 2023-10-08T13:20:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 -- start start 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180ff570 0x7fa01819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0180fff30 0x7fa01819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 0x7fa0181957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018195e20 con 0x7fa018105630 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018195f90 con 0x7fa0180ff570 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.010+0000 7fa01d07b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018196150 con 0x7fa0180fff30 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 0x7fa0181957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0180fff30 0x7fa01819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180ff570 0x7fa01819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0180fff30 0x7fa01819bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52022/0 (socket says 172.21.15.5:52022) 2023-10-08T13:20:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 0x7fa0181957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38820/0 (socket says 172.21.15.5:38820) 2023-10-08T13:20:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01659c700 1 -- 172.21.15.5:0/1152320430 learned_addr learned my addr 172.21.15.5:0/1152320430 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 -- 172.21.15.5:0/1152320430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0180fff30 msgr2=0x7fa01819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0180fff30 0x7fa01819bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 -- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 msgr2=0x7fa0181957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 0x7fa0181957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 -- 172.21.15.5:0/1152320430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008009520 con 0x7fa0180ff570 2023-10-08T13:20:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01759e700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 0x7fa0181957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180ff570 0x7fa01819b680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa008009230 tx=0x7fa00800f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7f9ffffff700 1 -- 172.21.15.5:0/1152320430 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00801c070 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7f9ffffff700 1 -- 172.21.15.5:0/1152320430 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00800ba20 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0181963d0 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7f9ffffff700 1 -- 172.21.15.5:0/1152320430 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080038e0 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.011+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0181a2670 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.014+0000 7f9ffffff700 1 -- 172.21.15.5:0/1152320430 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa008020030 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.014+0000 7f9ffffff700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa0000a1660 0x7fa0000a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.014+0000 7f9ffffff700 1 -- 172.21.15.5:0/1152320430 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa0080ce230 con 0x7fa0180ff570 2023-10-08T13:20:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.014+0000 7fa01659c700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa0000a1660 0x7fa0000a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.015+0000 7fa01659c700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa0000a1660 0x7fa0000a3b20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa018196bd0 tx=0x7fa00c009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 Processor -- start 2023-10-08T13:20:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 -- start start 2023-10-08T13:20:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 0x55d8c75cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c7538400 con 0x55d8c75d5d60 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c7529bc0 con 0x55d8c75d5980 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.016+0000 7fa029264b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c75274e0 con 0x55d8c75d0640 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa01759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 0x55d8c75cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa01759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75e49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52030/0 (socket says 172.21.15.5:52030) 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa01759e700 1 -- 172.21.15.5:0/2797322550 learned_addr learned my addr 172.21.15.5:0/2797322550 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 0x55d8c75cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33776/0 (socket says 172.21.15.5:33776) 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 -- 172.21.15.5:0/2797322550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 msgr2=0x55d8c75e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 -- 172.21.15.5:0/2797322550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 msgr2=0x55d8c75d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.017+0000 7fa016d9d700 1 -- 172.21.15.5:0/2797322550 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8c734dd80 con 0x55d8c75d5980 2023-10-08T13:20:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.018+0000 7fa016d9d700 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 0x55d8c75cfb70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa0080cb5f0 tx=0x7fa008009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0cfc4174d6925ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.019+0000 7f9ffd7fa700 1 -- 172.21.15.5:0/2797322550 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00809b610 con 0x55d8c75d5980 2023-10-08T13:20:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.019+0000 7f9ffd7fa700 1 -- 172.21.15.5:0/2797322550 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00809af10 con 0x55d8c75d5980 2023-10-08T13:20:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.019+0000 7f9ffd7fa700 1 -- 172.21.15.5:0/2797322550 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a1150 con 0x55d8c75d5980 2023-10-08T13:20:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 -- 172.21.15.5:0/2797322550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 msgr2=0x55d8c75cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 0x55d8c75cfb70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa0080cb5f0 tx=0x7fa008009260 comp rx=0 tx=0).stop 2023-10-08T13:20:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 -- 172.21.15.5:0/2797322550 shutdown_connections 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5980 0x55d8c75cfb70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 --2- 172.21.15.5:0/2797322550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 -- 172.21.15.5:0/2797322550 >> 172.21.15.5:0/2797322550 conn(0x55d8c7544200 msgr2=0x55d8c75cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 -- 172.21.15.5:0/2797322550 shutdown_connections 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 -- 172.21.15.5:0/2797322550 wait complete. 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 -- start start 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.020+0000 7fa029264b80 1 Processor -- start 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 0x55d8c75de920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c7522dd0 con 0x55d8c75d5980 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c74bf6b0 con 0x55d8c75d5d60 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c74bf350 con 0x55d8c75d0640 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa029264b80 10 client.0 _ll_register_callbacks cb 0x55d8c731c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 0x55d8c75de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75de3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52034/0 (socket says 172.21.15.5:52034) 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 0x55d8c75de920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38832/0 (socket says 172.21.15.5:38832) 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa016d9d700 1 -- 172.21.15.5:0/1548459747 learned_addr learned my addr 172.21.15.5:0/1548459747 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01759e700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 -- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 msgr2=0x55d8c75de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 -- 172.21.15.5:0/1548459747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 msgr2=0x55d8c75e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01659c700 1 -- 172.21.15.5:0/1548459747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0181a2670 con 0x55d8c75d5980 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa01759e700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.021+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa01659c700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 0x55d8c75de920 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55d8c75cbc70 tx=0x7fa00c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c8d364f23b882e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7f9ffaff5700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7f9ffaff5700 1 -- 172.21.15.5:0/1548459747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c01e830 con 0x55d8c75d5980 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7f9ffaff5700 1 -- 172.21.15.5:0/1548459747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa00c01e990 con 0x55d8c75d5980 2023-10-08T13:20:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8c74eae50 con 0x55d8c75d5980 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7f9ffaff5700 1 -- 172.21.15.5:0/1548459747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa00c01eb50 con 0x55d8c75d5980 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 10 client.17328 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55d8c7336c00 con 0x55d8c75d5980 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7f9ffaff5700 1 -- 172.21.15.5:0/1548459747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d8c74eae50 con 0x55d8c75d5980 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7f9ffaff5700 1 -- 172.21.15.5:0/1548459747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa00c024020 con 0x55d8c75d5980 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 10 client.17328 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 10 client.17328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 20 client.17328 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c75faa50 0x55d8c75fce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 4 client.17328 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:20:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.022+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8c751bdb0 con 0x55d8c75faa50 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.023+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c75faa50 0x55d8c75fce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.023+0000 7f9ffaff5700 10 client.17328 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.023+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c75faa50 0x55d8c75fce70 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c75bddc9230f5415 server_cookie=34ab201ecae7df49 in_seq=0 out_seq=0 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7f9ffaff5700 1 -- 172.21.15.5:0/1548459747 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8c751bdb0 con 0x55d8c75faa50 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7f9ffaff5700 10 client.17328 handle_command_reply: tid=0 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 client.17328 shutdown 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 msgr2=0x55d8c75de920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 0x55d8c75de920 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55d8c75cbc70 tx=0x7fa00c004750 comp rx=0 tx=0).stop 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 shutdown_connections 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c75faa50 0x55d8c75fce70 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7f9ffaff5700 0 client.17328 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d0640 0x55d8c75de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 --2- 172.21.15.5:0/1548459747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5980 0x55d8c75de920 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 >> 172.21.15.5:0/1548459747 conn(0x55d8c7544200 msgr2=0x55d8c75ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 shutdown_connections 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 1 -- 172.21.15.5:0/1548459747 wait complete. 2023-10-08T13:20:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.024+0000 7fa029264b80 20 client.17328 trim_cache size 0 max 16384 2023-10-08T13:20:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.043+0000 7fa029264b80 1 Processor -- start 2023-10-08T13:20:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.043+0000 7fa029264b80 1 -- start start 2023-10-08T13:20:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa029264b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 0x55d8c75e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa029264b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75d7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa029264b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa029264b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c73a38c0 con 0x55d8c75d5d60 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa029264b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c75cb780 con 0x55d8c75d0640 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa029264b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c75dad40 con 0x55d8c75d5980 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 0x55d8c75e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38842/0 (socket says 172.21.15.5:38842) 2023-10-08T13:20:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 0x55d8c75e49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33788/0 (socket says 172.21.15.5:33788) 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 -- 172.21.15.5:0/1607901287 learned_addr learned my addr 172.21.15.5:0/1607901287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01659c700 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 -- 172.21.15.5:0/1607901287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 msgr2=0x55d8c75d7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75d7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 -- 172.21.15.5:0/1607901287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 msgr2=0x55d8c75e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 0x55d8c75e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 -- 172.21.15.5:0/1607901287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8c73741f0 con 0x55d8c75d5d60 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa016d9d700 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 0x55d8c75e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7fa01759e700 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75ca790 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa010007900 tx=0x7fa01000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9337acba0b7d7e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.044+0000 7f9ffdffb700 1 -- 172.21.15.5:0/1607901287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010003e10 con 0x55d8c75d5d60 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7f9ffdffb700 1 -- 172.21.15.5:0/1607901287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa01000f040 con 0x55d8c75d5d60 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7f9ffdffb700 1 -- 172.21.15.5:0/1607901287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01000e750 con 0x55d8c75d5d60 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 -- 172.21.15.5:0/1607901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 msgr2=0x55d8c75ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75ca790 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa010007900 tx=0x7fa01000b040 comp rx=0 tx=0).stop 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 -- 172.21.15.5:0/1607901287 shutdown_connections 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d5d60 0x55d8c75ca790 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d0640 0x55d8c75e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 --2- 172.21.15.5:0/1607901287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75d7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 -- 172.21.15.5:0/1607901287 >> 172.21.15.5:0/1607901287 conn(0x55d8c7544200 msgr2=0x55d8c75d8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 -- 172.21.15.5:0/1607901287 shutdown_connections 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.045+0000 7fa029264b80 1 -- 172.21.15.5:0/1607901287 wait complete. 2023-10-08T13:20:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 -- start start 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 Processor -- start 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 0x55d8c75e1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c764d880 con 0x55d8c75d0640 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c764d9c0 con 0x55d8c75d5d60 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c764db80 con 0x55d8c75d5980 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa029264b80 10 client.0 _ll_register_callbacks cb 0x55d8c731c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 0x55d8c75e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa016d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 0x55d8c75e1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38844/0 (socket says 172.21.15.5:38844) 2023-10-08T13:20:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa016d9d700 1 -- 172.21.15.5:0/3719884791 learned_addr learned my addr 172.21.15.5:0/3719884791 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01759e700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01659c700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01759e700 1 -- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 msgr2=0x55d8c75e1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01759e700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75e1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01759e700 1 -- 172.21.15.5:0/3719884791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 msgr2=0x55d8c75e1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01759e700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 0x55d8c75e1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01759e700 1 -- 172.21.15.5:0/3719884791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8c734dd80 con 0x55d8c75d5d60 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa01659c700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75e1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.046+0000 7fa016d9d700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 0x55d8c75e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7fa01759e700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e2180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b010 tx=0x7fa010004a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1345631213c12e9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7f9ffaff5700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:20:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7f9ffaff5700 1 -- 172.21.15.5:0/3719884791 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010024070 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7f9ffaff5700 1 -- 172.21.15.5:0/3719884791 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa010004d10 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa00809af10 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7f9ffaff5700 1 -- 172.21.15.5:0/3719884791 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa010004000 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7fa029264b80 10 client.26747 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7fa0100075b0 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.047+0000 7f9ffaff5700 1 -- 172.21.15.5:0/3719884791 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa00809af10 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7f9ffaff5700 1 -- 172.21.15.5:0/3719884791 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa01001d070 con 0x55d8c75d5d60 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7fa029264b80 10 client.26747 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7fa029264b80 10 client.26747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7fa029264b80 20 client.26747 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7fa029264b80 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c764f290 0x55d8c7651680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7fa029264b80 4 client.26747 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:20:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.048+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8c751bad0 con 0x55d8c764f290 2023-10-08T13:20:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.052+0000 7fa016d9d700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c764f290 0x55d8c7651680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.052+0000 7f9ffaff5700 10 client.26747 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.052+0000 7fa016d9d700 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c764f290 0x55d8c7651680 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c154d1f3c9f7a1af server_cookie=ff4f29efcf5bc765 in_seq=0 out_seq=0 2023-10-08T13:20:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7f9ffaff5700 1 -- 172.21.15.5:0/3719884791 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8c751bad0 con 0x55d8c764f290 2023-10-08T13:20:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7f9ffaff5700 10 client.26747 handle_command_reply: tid=0 2023-10-08T13:20:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 client.26747 shutdown 2023-10-08T13:20:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 msgr2=0x55d8c75e2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e2180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b010 tx=0x7fa010004a00 comp rx=0 tx=0).stop 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 shutdown_connections 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55d8c764f290 0x55d8c7651680 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8c75d5d60 0x55d8c75e2180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8c75d0640 0x55d8c75e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7f9ffaff5700 0 client.26747 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 --2- 172.21.15.5:0/3719884791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d8c75d5980 0x55d8c75e1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.061+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 >> 172.21.15.5:0/3719884791 conn(0x55d8c7544200 msgr2=0x55d8c75d7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 shutdown_connections 2023-10-08T13:20:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa029264b80 1 -- 172.21.15.5:0/3719884791 wait complete. 2023-10-08T13:20:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa029264b80 20 client.26747 trim_cache size 0 max 16384 2023-10-08T13:20:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:20:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:20:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:20:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:20:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa0000a1660 msgr2=0x7fa0000a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa0000a1660 0x7fa0000a3b20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa018196bd0 tx=0x7fa00c009310 comp rx=0 tx=0).stop 2023-10-08T13:20:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180ff570 msgr2=0x7fa01819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180ff570 0x7fa01819b680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa008009230 tx=0x7fa00800f990 comp rx=0 tx=0).stop 2023-10-08T13:20:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 shutdown_connections 2023-10-08T13:20:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa0000a1660 0x7fa0000a3b20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa018105630 0x7fa0181957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0180ff570 0x7fa01819b680 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 --2- 172.21.15.5:0/1152320430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0180fff30 0x7fa01819bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 >> 172.21.15.5:0/1152320430 conn(0x7fa0180fb080 msgr2=0x7fa0180fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 shutdown_connections 2023-10-08T13:20:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:20:53.062+0000 7fa01d07b700 1 -- 172.21.15.5:0/1152320430 wait complete. 2023-10-08T13:20:53.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:20:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.555+0000 7f1e53026700 1 -- 172.21.15.5:0/601552779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c1077f0 msgr2=0x7f1e4c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.555+0000 7f1e53026700 1 --2- 172.21.15.5:0/601552779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c107c70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009990 tx=0x7f1e40009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.573+0000 7f1e53026700 1 -- 172.21.15.5:0/601552779 shutdown_connections 2023-10-08T13:20:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.573+0000 7f1e53026700 1 --2- 172.21.15.5:0/601552779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c1083a0 0x7f1e4c11bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.573+0000 7f1e53026700 1 --2- 172.21.15.5:0/601552779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c10edf0 0x7f1e4c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.573+0000 7f1e53026700 1 --2- 172.21.15.5:0/601552779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c107c70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.573+0000 7f1e53026700 1 -- 172.21.15.5:0/601552779 >> 172.21.15.5:0/601552779 conn(0x7f1e4c06b770 msgr2=0x7f1e4c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.587+0000 7f1e53026700 1 -- 172.21.15.5:0/601552779 shutdown_connections 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.596+0000 7f1e53026700 1 -- 172.21.15.5:0/601552779 wait complete. 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.596+0000 7f1e53026700 1 Processor -- start 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 -- start start 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c11b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c1083a0 0x7f1e4c11be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c10edf0 0x7f1e4c114a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c115220 con 0x7f1e4c10edf0 2023-10-08T13:20:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c115390 con 0x7f1e4c1083a0 2023-10-08T13:20:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e53026700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c115550 con 0x7f1e4c1077f0 2023-10-08T13:20:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c10edf0 0x7f1e4c114a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c10edf0 0x7f1e4c114a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38858/0 (socket says 172.21.15.5:38858) 2023-10-08T13:20:53.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.597+0000 7f1e515c3700 1 -- 172.21.15.5:0/3072057021 learned_addr learned my addr 172.21.15.5:0/3072057021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.598+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c11b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.598+0000 7f1e50dc2700 1 -- 172.21.15.5:0/3072057021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c1083a0 msgr2=0x7f1e4c11be30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.598+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c1083a0 0x7f1e4c11be30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.598+0000 7f1e50dc2700 1 -- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c10edf0 msgr2=0x7f1e4c114a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.598+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c10edf0 0x7f1e4c114a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.598+0000 7f1e50dc2700 1 -- 172.21.15.5:0/3072057021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400095f0 con 0x7f1e4c1077f0 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.600+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c11b8b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400bd70 tx=0x7f1e4400bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.600+0000 7f1e49ffb700 1 -- 172.21.15.5:0/3072057021 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400cc90 con 0x7f1e4c1077f0 2023-10-08T13:20:53.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.600+0000 7f1e49ffb700 1 -- 172.21.15.5:0/3072057021 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e4400cdf0 con 0x7f1e4c1077f0 2023-10-08T13:20:53.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.600+0000 7f1e49ffb700 1 -- 172.21.15.5:0/3072057021 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44012740 con 0x7f1e4c1077f0 2023-10-08T13:20:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.608+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c115830 con 0x7f1e4c1077f0 2023-10-08T13:20:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.608+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c119740 con 0x7f1e4c1077f0 2023-10-08T13:20:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.613+0000 7f1e5f20fb80 1 Processor -- start 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 -- start start 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0eca260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0eca7a0 0x55dde0ed5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ed7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0e33460 con 0x55dde0eca7a0 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0e24c20 con 0x55dde0ed5650 2023-10-08T13:20:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.614+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0e22540 con 0x55dde0ec9e80 2023-10-08T13:20:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.615+0000 7f1e4bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ed7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.615+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0eca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.615+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0eca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52066/0 (socket says 172.21.15.5:52066) 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.615+0000 7f1e515c3700 1 -- 172.21.15.5:0/3806679367 learned_addr learned my addr 172.21.15.5:0/3806679367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.615+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0eca7a0 0x55dde0ed5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.616+0000 7f1e515c3700 1 -- 172.21.15.5:0/3806679367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 msgr2=0x55dde0ed7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.616+0000 7f1e515c3700 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ed7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.616+0000 7f1e515c3700 1 -- 172.21.15.5:0/3806679367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0eca7a0 msgr2=0x55dde0ed5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.616+0000 7f1e515c3700 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0eca7a0 0x55dde0ed5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.616+0000 7f1e515c3700 1 -- 172.21.15.5:0/3806679367 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dde0c48de0 con 0x55dde0ec9e80 2023-10-08T13:20:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.616+0000 7f1e515c3700 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0eca260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009de0 tx=0x7f1e3c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e73451949ae66c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.618+0000 7f1e32ffd700 1 -- 172.21.15.5:0/3806679367 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c019630 con 0x55dde0ec9e80 2023-10-08T13:20:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.618+0000 7f1e32ffd700 1 -- 172.21.15.5:0/3806679367 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e3c019c50 con 0x55dde0ec9e80 2023-10-08T13:20:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.618+0000 7f1e32ffd700 1 -- 172.21.15.5:0/3806679367 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00ebf0 con 0x55dde0ec9e80 2023-10-08T13:20:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.619+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/3806679367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 msgr2=0x55dde0eca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.619+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0eca260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009de0 tx=0x7f1e3c011720 comp rx=0 tx=0).stop 2023-10-08T13:20:53.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.620+0000 7f1e49ffb700 1 -- 172.21.15.5:0/3072057021 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1e44014b00 con 0x7f1e4c1077f0 2023-10-08T13:20:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.620+0000 7f1e49ffb700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1e340a16f0 0x7f1e340a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.621+0000 7f1e49ffb700 1 -- 172.21.15.5:0/3072057021 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1e44006e40 con 0x7f1e4c1077f0 2023-10-08T13:20:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.624+0000 7f1e515c3700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1e340a16f0 0x7f1e340a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.624+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/3806679367 shutdown_connections 2023-10-08T13:20:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.624+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ed7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.624+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0eca260 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.624+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/3806679367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0eca7a0 0x55dde0ed5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.624+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/3806679367 >> 172.21.15.5:0/3806679367 conn(0x55dde0e3f260 msgr2=0x55dde0ec62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.627+0000 7f1e515c3700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1e340a16f0 0x7f1e340a3bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00e6f0 tx=0x7f1e3c00e750 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.634+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/3806679367 shutdown_connections 2023-10-08T13:20:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.637+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/3806679367 wait complete. 2023-10-08T13:20:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.637+0000 7f1e5f20fb80 1 -- start start 2023-10-08T13:20:53.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.637+0000 7f1e5f20fb80 1 Processor -- start 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0ed50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0ed2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0ed2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0e1de30 con 0x55dde0ed5650 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0dba710 con 0x55dde0eca7a0 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0dba3b0 con 0x55dde0ec9e80 2023-10-08T13:20:53.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.638+0000 7f1e5f20fb80 10 client.0 _ll_register_callbacks cb 0x55dde0c17800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.639+0000 7f1e4bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0ed2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.639+0000 7f1e4bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0ed2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33824/0 (socket says 172.21.15.5:33824) 2023-10-08T13:20:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 -- 172.21.15.5:0/2317105840 learned_addr learned my addr 172.21.15.5:0/2317105840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0ed50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 -- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 msgr2=0x55dde0ed50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0ed50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 -- 172.21.15.5:0/2317105840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 msgr2=0x55dde0ed2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0ed2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 -- 172.21.15.5:0/2317105840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c009a60 con 0x55dde0eca7a0 2023-10-08T13:20:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.640+0000 7f1e4bfff700 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0ed2390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c1160b0 tx=0x7f1e40005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d060366677a9935c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.641+0000 7f1e307f8700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:20:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.642+0000 7f1e307f8700 1 -- 172.21.15.5:0/2317105840 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4001d070 con 0x55dde0eca7a0 2023-10-08T13:20:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.642+0000 7f1e307f8700 1 -- 172.21.15.5:0/2317105840 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1e40004500 con 0x55dde0eca7a0 2023-10-08T13:20:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.643+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dde0de5eb0 con 0x55dde0eca7a0 2023-10-08T13:20:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.644+0000 7f1e307f8700 1 -- 172.21.15.5:0/2317105840 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e400046c0 con 0x55dde0eca7a0 2023-10-08T13:20:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.649+0000 7f1e5f20fb80 10 client.26756 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.649+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55dde0c31c60 con 0x55dde0eca7a0 2023-10-08T13:20:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e307f8700 1 -- 172.21.15.5:0/2317105840 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dde0de5eb0 con 0x55dde0eca7a0 2023-10-08T13:20:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e307f8700 1 -- 172.21.15.5:0/2317105840 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1e4000f890 con 0x55dde0eca7a0 2023-10-08T13:20:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e5f20fb80 10 client.26756 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e5f20fb80 10 client.26756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e5f20fb80 20 client.26756 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0ee5210 0x55dde0ee7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e5f20fb80 4 client.26756 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:20:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.650+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dde0e16e10 con 0x55dde0ee5210 2023-10-08T13:20:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.655+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0ee5210 0x55dde0ee7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.661+0000 7f1e307f8700 10 client.26756 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.661+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0ee5210 0x55dde0ee7630 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6004d36d39978f3e server_cookie=69b3be810872c8f5 in_seq=0 out_seq=0 2023-10-08T13:20:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.662+0000 7f1e307f8700 1 -- 172.21.15.5:0/2317105840 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dde0e16e10 con 0x55dde0ee5210 2023-10-08T13:20:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.662+0000 7f1e307f8700 10 client.26756 handle_command_reply: tid=0 2023-10-08T13:20:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.662+0000 7f1e5f20fb80 1 client.26756 shutdown 2023-10-08T13:20:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.663+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 msgr2=0x55dde0ed2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.663+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0ed2390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c1160b0 tx=0x7f1e40005800 comp rx=0 tx=0).stop 2023-10-08T13:20:53.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:53 smithi005 ceph-mon[99496]: pgmap v762: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 551 op/s 2023-10-08T13:20:53.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.674+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 shutdown_connections 2023-10-08T13:20:53.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.674+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0ed2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.674+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0ed50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.674+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0ee5210 0x55dde0ee7630 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.674+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/2317105840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0ed2390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.674+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 >> 172.21.15.5:0/2317105840 conn(0x55dde0e3f260 msgr2=0x55dde0ec5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.675+0000 7f1e307f8700 0 client.26756 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.680+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 shutdown_connections 2023-10-08T13:20:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.680+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/2317105840 wait complete. 2023-10-08T13:20:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.680+0000 7f1e5f20fb80 20 client.26756 trim_cache size 0 max 16384 2023-10-08T13:20:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.706+0000 7f1e5f20fb80 1 Processor -- start 2023-10-08T13:20:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.706+0000 7f1e5f20fb80 1 -- start start 2023-10-08T13:20:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.707+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 0x55dde0ee7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.707+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0eca7a0 0x55dde0edc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.707+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ec5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.707+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0c9e920 con 0x55dde0ec9e80 2023-10-08T13:20:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.707+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0eccd50 con 0x55dde0ed5650 2023-10-08T13:20:53.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.707+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0ed37d0 con 0x55dde0eca7a0 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.709+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ec5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.711+0000 7f1e50dc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 0x55dde0ee7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.711+0000 7f1e50dc2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 0x55dde0ee7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38882/0 (socket says 172.21.15.5:38882) 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.711+0000 7f1e50dc2700 1 -- 172.21.15.5:0/1082236970 learned_addr learned my addr 172.21.15.5:0/1082236970 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.712+0000 7f1e50dc2700 1 -- 172.21.15.5:0/1082236970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0eca7a0 msgr2=0x55dde0edc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.712+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0eca7a0 0x55dde0edc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.712+0000 7f1e50dc2700 1 -- 172.21.15.5:0/1082236970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 msgr2=0x55dde0ec5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.712+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ec5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.712+0000 7f1e50dc2700 1 -- 172.21.15.5:0/1082236970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dde0c6f250 con 0x55dde0ec9e80 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.712+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 0x55dde0ee7600 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1e44099870 tx=0x7f1e440b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66edc7db6e3a2de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.715+0000 7f1e337fe700 1 -- 172.21.15.5:0/1082236970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44097b30 con 0x55dde0ec9e80 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.715+0000 7f1e337fe700 1 -- 172.21.15.5:0/1082236970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e44097cd0 con 0x55dde0ec9e80 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.715+0000 7f1e337fe700 1 -- 172.21.15.5:0/1082236970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44099df0 con 0x55dde0ec9e80 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/1082236970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 msgr2=0x55dde0ee7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 0x55dde0ee7600 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1e44099870 tx=0x7f1e440b9040 comp rx=0 tx=0).stop 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/1082236970 shutdown_connections 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0ed5650 0x55dde0ec5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ec9e80 0x55dde0ee7600 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/1082236970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0eca7a0 0x55dde0edc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.716+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/1082236970 >> 172.21.15.5:0/1082236970 conn(0x55dde0e3f260 msgr2=0x55dde0ec54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.732+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/1082236970 shutdown_connections 2023-10-08T13:20:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.744+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/1082236970 wait complete. 2023-10-08T13:20:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.744+0000 7f1e5f20fb80 1 -- start start 2023-10-08T13:20:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.744+0000 7f1e5f20fb80 1 Processor -- start 2023-10-08T13:20:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0edbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0eda450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0eda990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0edaed0 con 0x55dde0ed5650 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0edb040 con 0x55dde0eca7a0 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde0edb200 con 0x55dde0ec9e80 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e5f20fb80 10 client.0 _ll_register_callbacks cb 0x7f1e40005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0eda990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e50dc2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0edbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e515c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0eda990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38888/0 (socket says 172.21.15.5:38888) 2023-10-08T13:20:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.745+0000 7f1e515c3700 1 -- 172.21.15.5:0/587283824 learned_addr learned my addr 172.21.15.5:0/587283824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e50dc2700 1 -- 172.21.15.5:0/587283824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 msgr2=0x55dde0eda450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0eda450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e50dc2700 1 -- 172.21.15.5:0/587283824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 msgr2=0x55dde0eda990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0eda990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e50dc2700 1 -- 172.21.15.5:0/587283824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c119740 con 0x55dde0ec9e80 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e50dc2700 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0edbf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400bd40 tx=0x7f1e44099700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6990483b5a33d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.746+0000 7f1e307f8700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.747+0000 7f1e307f8700 1 -- 172.21.15.5:0/587283824 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440ca380 con 0x55dde0ec9e80 2023-10-08T13:20:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.747+0000 7f1e307f8700 1 -- 172.21.15.5:0/587283824 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1e44098e20 con 0x55dde0ec9e80 2023-10-08T13:20:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.747+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e3c019c50 con 0x55dde0ec9e80 2023-10-08T13:20:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.747+0000 7f1e307f8700 1 -- 172.21.15.5:0/587283824 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e44098fe0 con 0x55dde0ec9e80 2023-10-08T13:20:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.747+0000 7f1e5f20fb80 10 client.26836 fetch_fsmap learned FSMap version 53 2023-10-08T13:20:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.747+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55dde0c472b0 con 0x55dde0ec9e80 2023-10-08T13:20:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e307f8700 1 -- 172.21.15.5:0/587283824 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e3c019c50 con 0x55dde0ec9e80 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e307f8700 1 -- 172.21.15.5:0/587283824 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1e44095720 con 0x55dde0ec9e80 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e5f20fb80 10 client.26836 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e5f20fb80 10 client.26836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e5f20fb80 20 client.26836 populate_metadata read hostname 'smithi005' 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0f3a010 0x55dde0f3c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e5f20fb80 4 client.26836 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:20:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.748+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dde0e16b30 con 0x55dde0f3a010 2023-10-08T13:20:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.755+0000 7f1e4bfff700 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0f3a010 0x55dde0f3c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:53.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:53 smithi118 ceph-mon[104234]: pgmap v762: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 551 op/s 2023-10-08T13:20:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.767+0000 7f1e4bfff700 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0f3a010 0x55dde0f3c400 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a6a06e0e42b7cc9 server_cookie=2d3bd410b0d06ff7 in_seq=0 out_seq=0 2023-10-08T13:20:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.770+0000 7f1e307f8700 10 client.26836 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.773+0000 7f1e307f8700 1 -- 172.21.15.5:0/587283824 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dde0e16b30 con 0x55dde0f3a010 2023-10-08T13:20:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.773+0000 7f1e307f8700 10 client.26836 handle_command_reply: tid=0 2023-10-08T13:20:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.773+0000 7f1e5f20fb80 1 client.26836 shutdown 2023-10-08T13:20:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.785+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 msgr2=0x55dde0edbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.785+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0edbf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400bd40 tx=0x7f1e44099700 comp rx=0 tx=0).stop 2023-10-08T13:20:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 shutdown_connections 2023-10-08T13:20:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dde0ed5650 0x55dde0eda990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dde0ec9e80 0x55dde0edbf80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55dde0f3a010 0x55dde0f3c400 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e5f20fb80 1 --2- 172.21.15.5:0/587283824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dde0eca7a0 0x55dde0eda450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 >> 172.21.15.5:0/587283824 conn(0x55dde0e3f260 msgr2=0x55dde0ec5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.797+0000 7f1e307f8700 0 client.26836 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:20:53.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.804+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 shutdown_connections 2023-10-08T13:20:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.804+0000 7f1e5f20fb80 1 -- 172.21.15.5:0/587283824 wait complete. 2023-10-08T13:20:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.811+0000 7f1e5f20fb80 20 client.26836 trim_cache size 0 max 16384 2023-10-08T13:20:53.814 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:20:53.814 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:20:53.814 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:20:53.815 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1e340a16f0 msgr2=0x7f1e340a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1e340a16f0 0x7f1e340a3bb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00e6f0 tx=0x7f1e3c00e750 comp rx=0 tx=0).stop 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c1077f0 msgr2=0x7f1e4c11b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c11b8b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400bd70 tx=0x7f1e4400bda0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 shutdown_connections 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f1e340a16f0 0x7f1e340a3bb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e4c10edf0 0x7f1e4c114a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4c1077f0 0x7f1e4c11b8b0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400bd70 tx=0x7f1e4400bda0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 --2- 172.21.15.5:0/3072057021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c1083a0 0x7f1e4c11be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.813+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 >> 172.21.15.5:0/3072057021 conn(0x7f1e4c06b770 msgr2=0x7f1e4c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.819+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 shutdown_connections 2023-10-08T13:20:53.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:20:53.824+0000 7f1e53026700 1 -- 172.21.15.5:0/3072057021 wait complete. 2023-10-08T13:20:53.847 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:20:53.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:53 smithi060 ceph-mon[103190]: pgmap v762: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 551 op/s 2023-10-08T13:20:54.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:54 smithi118 ceph-mon[104234]: pgmap v763: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.2 MiB/s wr, 442 op/s 2023-10-08T13:20:54.918 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:54 smithi060 ceph-mon[103190]: pgmap v763: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.2 MiB/s wr, 442 op/s 2023-10-08T13:20:54.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:54 smithi005 ceph-mon[99496]: pgmap v763: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.2 MiB/s wr, 442 op/s 2023-10-08T13:20:56.165 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:55 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:56.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:55 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:56.280 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:55 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 875.0 s, 513.4 tps, lat 193.278 ms stddev 217.140 2023-10-08T13:20:57.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:57 smithi060 ceph-mon[103190]: pgmap v764: 129 pgs: 129 active+clean; 3.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2023-10-08T13:20:57.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:57.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:57.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:57 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:20:57.431 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:57 smithi005 ceph-mon[99496]: pgmap v764: 129 pgs: 129 active+clean; 3.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2023-10-08T13:20:57.431 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:57.431 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:57.431 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:57 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:20:57.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:57 smithi118 ceph-mon[104234]: pgmap v764: 129 pgs: 129 active+clean; 3.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2023-10-08T13:20:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:57.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:57 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:20:59.413 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:20:59 smithi060 ceph-mon[103190]: pgmap v765: 129 pgs: 129 active+clean; 3.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2023-10-08T13:20:59.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:20:59 smithi005 ceph-mon[99496]: pgmap v765: 129 pgs: 129 active+clean; 3.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2023-10-08T13:20:59.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:20:59 smithi118 ceph-mon[104234]: pgmap v765: 129 pgs: 129 active+clean; 3.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2023-10-08T13:21:01.412 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:01 smithi060 ceph-mon[103190]: pgmap v766: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 456 op/s 2023-10-08T13:21:01.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:01 smithi005 ceph-mon[99496]: pgmap v766: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 456 op/s 2023-10-08T13:21:01.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:01 smithi118 ceph-mon[104234]: pgmap v766: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 456 op/s 2023-10-08T13:21:01.745 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 880.0 s, 446.3 tps, lat 230.453 ms stddev 259.265 2023-10-08T13:21:03.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:03 smithi060 ceph-mon[103190]: pgmap v767: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.4 MiB/s wr, 569 op/s 2023-10-08T13:21:03.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:03 smithi005 ceph-mon[99496]: pgmap v767: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.4 MiB/s wr, 569 op/s 2023-10-08T13:21:03.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:03 smithi118 ceph-mon[104234]: pgmap v767: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.4 MiB/s wr, 569 op/s 2023-10-08T13:21:05.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:05 smithi005 ceph-mon[99496]: pgmap v768: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 472 op/s 2023-10-08T13:21:05.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:05 smithi118 ceph-mon[104234]: pgmap v768: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 472 op/s 2023-10-08T13:21:05.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:05 smithi060 ceph-mon[103190]: pgmap v768: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.9 MiB/s wr, 472 op/s 2023-10-08T13:21:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.293+0000 7f0516619700 1 -- 172.21.15.5:0/3121072360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f051010f310 msgr2=0x7f0510107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.293+0000 7f0516619700 1 --2- 172.21.15.5:0/3121072360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f051010f310 0x7f0510107d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f05040099c0 tx=0x7f0504009cd0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.302+0000 7f0516619700 1 -- 172.21.15.5:0/3121072360 shutdown_connections 2023-10-08T13:21:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.302+0000 7f0516619700 1 --2- 172.21.15.5:0/3121072360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0510119fd0 0x7f051011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.302+0000 7f0516619700 1 --2- 172.21.15.5:0/3121072360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051010eea0 0x7f05101077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.302+0000 7f0516619700 1 --2- 172.21.15.5:0/3121072360 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f051010f310 0x7f0510107d30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.302+0000 7f0516619700 1 -- 172.21.15.5:0/3121072360 >> 172.21.15.5:0/3121072360 conn(0x7f051006b7c0 msgr2=0x7f051006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.314+0000 7f0516619700 1 -- 172.21.15.5:0/3121072360 shutdown_connections 2023-10-08T13:21:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.317+0000 7f0516619700 1 -- 172.21.15.5:0/3121072360 wait complete. 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 Processor -- start 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 -- start start 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051010eea0 0x7f05101ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 0x7f05101abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0510119fd0 0x7f05101a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05101a5ea0 con 0x7f051010f310 2023-10-08T13:21:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05101a6010 con 0x7f051010eea0 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.318+0000 7f0516619700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05101a61d0 con 0x7f0510119fd0 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.319+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 0x7f05101abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.319+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 0x7f05101abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38906/0 (socket says 172.21.15.5:38906) 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.319+0000 7f050f7fe700 1 -- 172.21.15.5:0/3994650716 learned_addr learned my addr 172.21.15.5:0/3994650716 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.320+0000 7f050f7fe700 1 -- 172.21.15.5:0/3994650716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0510119fd0 msgr2=0x7f05101a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.320+0000 7f050f7fe700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0510119fd0 0x7f05101a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.320+0000 7f050f7fe700 1 -- 172.21.15.5:0/3994650716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051010eea0 msgr2=0x7f05101ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.320+0000 7f050f7fe700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051010eea0 0x7f05101ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.320+0000 7f050f7fe700 1 -- 172.21.15.5:0/3994650716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040095f0 con 0x7f051010f310 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.320+0000 7f050f7fe700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 0x7f05101abc40 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f050400f690 tx=0x7f050400f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.326+0000 7f050d7fa700 1 -- 172.21.15.5:0/3994650716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050401d070 con 0x7f051010f310 2023-10-08T13:21:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.326+0000 7f050d7fa700 1 -- 172.21.15.5:0/3994650716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05040054f0 con 0x7f051010f310 2023-10-08T13:21:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.326+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05101a63f0 con 0x7f051010f310 2023-10-08T13:21:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.326+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0510072c00 con 0x7f051010f310 2023-10-08T13:21:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.326+0000 7f050d7fa700 1 -- 172.21.15.5:0/3994650716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504004c60 con 0x7f051010f310 2023-10-08T13:21:06.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.339+0000 7f0522802b80 1 Processor -- start 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.339+0000 7f0522802b80 1 -- start start 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.339+0000 7f0522802b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 0x56512720ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.340+0000 7f0522802b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720f1a0 0x565127208b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.340+0000 7f050d7fa700 1 -- 172.21.15.5:0/3994650716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f050402b440 con 0x7f051010f310 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.340+0000 7f0522802b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127209510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.340+0000 7f0522802b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127171400 con 0x56512720f1a0 2023-10-08T13:21:06.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.340+0000 7f0522802b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127162bc0 con 0x56512720e880 2023-10-08T13:21:06.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.340+0000 7f0522802b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651271604e0 con 0x5651272090b0 2023-10-08T13:21:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.341+0000 7f050d7fa700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f04f80c3800 0x7f04f80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.341+0000 7f050d7fa700 1 -- 172.21.15.5:0/3994650716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f05040cf350 con 0x7f051010f310 2023-10-08T13:21:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.348+0000 7f0514bb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 0x56512720ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.348+0000 7f0514bb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 0x56512720ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33858/0 (socket says 172.21.15.5:33858) 2023-10-08T13:21:06.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.348+0000 7f0514bb6700 1 -- 172.21.15.5:0/3872242722 learned_addr learned my addr 172.21.15.5:0/3872242722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:06.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.348+0000 7f050ffff700 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720f1a0 0x565127208b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.351+0000 7f0514bb6700 1 -- 172.21.15.5:0/3872242722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 msgr2=0x565127209510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:21:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.351+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127209510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.351+0000 7f0514bb6700 1 -- 172.21.15.5:0/3872242722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720f1a0 msgr2=0x565127208b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.351+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720f1a0 0x565127208b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.352+0000 7f0514bb6700 1 -- 172.21.15.5:0/3872242722 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565126f86d80 con 0x56512720e880 2023-10-08T13:21:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.360+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 0x56512720ec60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d10 tx=0x7f0500010650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9928a2b8139658 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.360+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f04f80c3800 0x7f04f80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.360+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f04f80c3800 0x7f04f80c5cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0500009230 tx=0x7f050001e000 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:06.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.369+0000 7f04f67fc700 1 -- 172.21.15.5:0/3872242722 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500004a30 con 0x56512720e880 2023-10-08T13:21:06.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.369+0000 7f04f67fc700 1 -- 172.21.15.5:0/3872242722 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0500010cc0 con 0x56512720e880 2023-10-08T13:21:06.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.369+0000 7f04f67fc700 1 -- 172.21.15.5:0/3872242722 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500005470 con 0x56512720e880 2023-10-08T13:21:06.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.370+0000 7f0522802b80 1 -- 172.21.15.5:0/3872242722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 msgr2=0x56512720ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.370+0000 7f0522802b80 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 0x56512720ec60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d10 tx=0x7f0500010650 comp rx=0 tx=0).stop 2023-10-08T13:21:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.381+0000 7f0522802b80 1 -- 172.21.15.5:0/3872242722 shutdown_connections 2023-10-08T13:21:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.381+0000 7f0522802b80 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127209510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.381+0000 7f0522802b80 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720e880 0x56512720ec60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.381+0000 7f0522802b80 1 --2- 172.21.15.5:0/3872242722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720f1a0 0x565127208b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.381+0000 7f0522802b80 1 -- 172.21.15.5:0/3872242722 >> 172.21.15.5:0/3872242722 conn(0x56512717d200 msgr2=0x565127203b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.387+0000 7f0522802b80 1 -- 172.21.15.5:0/3872242722 shutdown_connections 2023-10-08T13:21:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.390+0000 7f0522802b80 1 -- 172.21.15.5:0/3872242722 wait complete. 2023-10-08T13:21:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.390+0000 7f0522802b80 1 -- start start 2023-10-08T13:21:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.390+0000 7f0522802b80 1 Processor -- start 2023-10-08T13:21:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127212570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127212ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x565127212ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56512715bdd0 con 0x56512720e880 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651270f86b0 con 0x5651272090b0 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651270f8350 con 0x56512720f1a0 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0522802b80 10 client.0 _ll_register_callbacks cb 0x565126f557a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127212ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127212ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38918/0 (socket says 172.21.15.5:38918) 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f050f7fe700 1 -- 172.21.15.5:0/3236083080 learned_addr learned my addr 172.21.15.5:0/3236083080 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f050ffff700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127212570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x565127212ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0514bb6700 1 -- 172.21.15.5:0/3236083080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 msgr2=0x565127212570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127212570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0514bb6700 1 -- 172.21.15.5:0/3236083080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 msgr2=0x565127212ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:06.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127212ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.391+0000 7f0514bb6700 1 -- 172.21.15.5:0/3236083080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05000099c0 con 0x56512720f1a0 2023-10-08T13:21:06.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.392+0000 7f0514bb6700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x565127212ff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d10 tx=0x7f0500004ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1b716df4fb79e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:06.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.392+0000 7f04ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:21:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.397+0000 7f04ef7fe700 1 -- 172.21.15.5:0/3236083080 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500012d40 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.397+0000 7f04ef7fe700 1 -- 172.21.15.5:0/3236083080 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f0500016070 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.397+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565127123e50 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f04ef7fe700 1 -- 172.21.15.5:0/3236083080 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05000050f0 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 10 client.26842 fetch_fsmap learned FSMap version 53 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x565126f6fc00 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f04ef7fe700 1 -- 172.21.15.5:0/3236083080 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565127123e50 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f04ef7fe700 1 -- 172.21.15.5:0/3236083080 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f05000238c0 con 0x56512720f1a0 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 10 client.26842 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 10 client.26842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 20 client.26842 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x565127222d40 0x565127225160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 4 client.26842 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:21:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.398+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565127154db0 con 0x565127222d40 2023-10-08T13:21:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.399+0000 7f050ffff700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x565127222d40 0x565127225160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.399+0000 7f04ef7fe700 10 client.26842 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.399+0000 7f050ffff700 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x565127222d40 0x565127225160 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bffd62a028ccb1b server_cookie=14e2cc80983535b8 in_seq=0 out_seq=0 2023-10-08T13:21:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.401+0000 7f04ef7fe700 1 -- 172.21.15.5:0/3236083080 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565127154db0 con 0x565127222d40 2023-10-08T13:21:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.401+0000 7f04ef7fe700 10 client.26842 handle_command_reply: tid=0 2023-10-08T13:21:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.403+0000 7f0522802b80 1 client.26842 shutdown 2023-10-08T13:21:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.420+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 msgr2=0x565127212ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.420+0000 7f0522802b80 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x565127212ff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0500009d10 tx=0x7f0500004ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 shutdown_connections 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f0522802b80 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x565127212ff0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f0522802b80 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x565127222d40 0x565127225160 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f0522802b80 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127212570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f0522802b80 1 --2- 172.21.15.5:0/3236083080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127212ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 >> 172.21.15.5:0/3236083080 conn(0x56512717d200 msgr2=0x565127203010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.427+0000 7f04ef7fe700 0 client.26842 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.435+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 shutdown_connections 2023-10-08T13:21:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.436+0000 7f0522802b80 1 -- 172.21.15.5:0/3236083080 wait complete. 2023-10-08T13:21:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.436+0000 7f0522802b80 20 client.26842 trim_cache size 0 max 16384 2023-10-08T13:21:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 Processor -- start 2023-10-08T13:21:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 -- start start 2023-10-08T13:21:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127211e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127219c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720f1a0 0x56512720dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565126fdc8c0 con 0x56512720e880 2023-10-08T13:21:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127212390 con 0x56512720f1a0 2023-10-08T13:21:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f0522802b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127205100 con 0x5651272090b0 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f050ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127211e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f050ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127211e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52128/0 (socket says 172.21.15.5:52128) 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.466+0000 7f050ffff700 1 -- 172.21.15.5:0/2247297663 learned_addr learned my addr 172.21.15.5:0/2247297663 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f050ffff700 1 -- 172.21.15.5:0/2247297663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720f1a0 msgr2=0x56512720dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f050ffff700 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720f1a0 0x56512720dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f050ffff700 1 -- 172.21.15.5:0/2247297663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 msgr2=0x565127219c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f050ffff700 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127219c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f050ffff700 1 -- 172.21.15.5:0/2247297663 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565126fad1f0 con 0x5651272090b0 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f050ffff700 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127211e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0508019ab0 tx=0x7f0508009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=222e8e70b4596461 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:06.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f04f6ffd700 1 -- 172.21.15.5:0/2247297663 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508003c00 con 0x5651272090b0 2023-10-08T13:21:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f04f6ffd700 1 -- 172.21.15.5:0/2247297663 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f050800f040 con 0x5651272090b0 2023-10-08T13:21:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.467+0000 7f04f6ffd700 1 -- 172.21.15.5:0/2247297663 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508007e70 con 0x5651272090b0 2023-10-08T13:21:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.468+0000 7f0522802b80 1 -- 172.21.15.5:0/2247297663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 msgr2=0x565127211e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.468+0000 7f0522802b80 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127211e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0508019ab0 tx=0x7f0508009040 comp rx=0 tx=0).stop 2023-10-08T13:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.473+0000 7f0522802b80 1 -- 172.21.15.5:0/2247297663 shutdown_connections 2023-10-08T13:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.473+0000 7f0522802b80 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56512720f1a0 0x56512720dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.473+0000 7f0522802b80 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5651272090b0 0x565127211e50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.473+0000 7f0522802b80 1 --2- 172.21.15.5:0/2247297663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x565127219c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.473+0000 7f0522802b80 1 -- 172.21.15.5:0/2247297663 >> 172.21.15.5:0/2247297663 conn(0x56512717d200 msgr2=0x56512720d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.474+0000 7f0522802b80 1 -- 172.21.15.5:0/2247297663 shutdown_connections 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.474+0000 7f0522802b80 1 -- 172.21.15.5:0/2247297663 wait complete. 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.474+0000 7f0522802b80 1 -- start start 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.474+0000 7f0522802b80 1 Processor -- start 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127217c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x5651272181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x5651272186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127275cf0 con 0x56512720e880 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127275e60 con 0x5651272090b0 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565127276020 con 0x56512720f1a0 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0522802b80 10 client.0 _ll_register_callbacks cb 0x7f0500009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127217c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127217c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33878/0 (socket says 172.21.15.5:33878) 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 -- 172.21.15.5:0/923467259 learned_addr learned my addr 172.21.15.5:0/923467259 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f0514bb6700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x5651272186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050f7fe700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x5651272181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 -- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 msgr2=0x5651272186e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x5651272186e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 -- 172.21.15.5:0/923467259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 msgr2=0x5651272181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x5651272181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050ffff700 1 -- 172.21.15.5:0/923467259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0508009a60 con 0x5651272090b0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.475+0000 7f050f7fe700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x5651272181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f050ffff700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127217c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0508007b30 tx=0x7f0508007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d0f36b32f8d11a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f04ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f04ef7fe700 1 -- 172.21.15.5:0/923467259 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508003c00 con 0x5651272090b0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f04ef7fe700 1 -- 172.21.15.5:0/923467259 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f05080194e0 con 0x5651272090b0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0500010cc0 con 0x5651272090b0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f04ef7fe700 1 -- 172.21.15.5:0/923467259 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0508003d60 con 0x5651272090b0 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f0522802b80 10 client.26768 fetch_fsmap learned FSMap version 53 2023-10-08T13:21:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.476+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x565126f85250 con 0x5651272090b0 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f04ef7fe700 1 -- 172.21.15.5:0/923467259 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0500010cc0 con 0x5651272090b0 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f04ef7fe700 1 -- 172.21.15.5:0/923467259 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f050803d680 con 0x5651272090b0 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f0522802b80 10 client.26768 fetch_fsmap finished waiting for FSMap version 53 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f0522802b80 10 client.26768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f0522802b80 20 client.26768 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f0522802b80 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5651272777b0 0x565127279bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f0522802b80 4 client.26768 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:21:06.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565127154ad0 con 0x5651272777b0 2023-10-08T13:21:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.477+0000 7f050f7fe700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5651272777b0 0x565127279bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.485+0000 7f04ef7fe700 10 client.26768 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.485+0000 7f050f7fe700 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5651272777b0 0x565127279bd0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b71fcb26b428774e server_cookie=75a5172afc957459 in_seq=0 out_seq=0 2023-10-08T13:21:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.498+0000 7f04ef7fe700 1 -- 172.21.15.5:0/923467259 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565127154ad0 con 0x5651272777b0 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.498+0000 7f04ef7fe700 10 client.26768 handle_command_reply: tid=0 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.498+0000 7f0522802b80 1 client.26768 shutdown 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 msgr2=0x565127217c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127217c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0508007b30 tx=0x7f0508007ec0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 shutdown_connections 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56512720f1a0 0x5651272186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5651272777b0 0x565127279bd0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5651272090b0 0x565127217c60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 --2- 172.21.15.5:0/923467259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56512720e880 0x5651272181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 >> 172.21.15.5:0/923467259 conn(0x56512717d200 msgr2=0x56512720deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f04ef7fe700 0 client.26768 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 shutdown_connections 2023-10-08T13:21:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 1 -- 172.21.15.5:0/923467259 wait complete. 2023-10-08T13:21:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.499+0000 7f0522802b80 20 client.26768 trim_cache size 0 max 16384 2023-10-08T13:21:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:21:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:21:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:21:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f04f80c3800 msgr2=0x7f04f80c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f04f80c3800 0x7f04f80c5cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0500009230 tx=0x7f050001e000 comp rx=0 tx=0).stop 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 msgr2=0x7f05101abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 0x7f05101abc40 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f050400f690 tx=0x7f050400f770 comp rx=0 tx=0).stop 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 shutdown_connections 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f04f80c3800 0x7f04f80c5cc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0510119fd0 0x7f05101a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051010eea0 0x7f05101ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 --2- 172.21.15.5:0/3994650716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f051010f310 0x7f05101abc40 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 >> 172.21.15.5:0/3994650716 conn(0x7f051006b7c0 msgr2=0x7f0510117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 shutdown_connections 2023-10-08T13:21:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:06.500+0000 7f0516619700 1 -- 172.21.15.5:0/3994650716 wait complete. 2023-10-08T13:21:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 885.0 s, 439.3 tps, lat 225.023 ms stddev 236.101 2023-10-08T13:21:07.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:07 smithi118 ceph-mon[104234]: pgmap v769: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 551 op/s 2023-10-08T13:21:07.664 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:07 smithi060 ceph-mon[103190]: pgmap v769: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 551 op/s 2023-10-08T13:21:07.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:07 smithi005 ceph-mon[99496]: pgmap v769: 129 pgs: 129 active+clean; 3.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 551 op/s 2023-10-08T13:21:09.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:09 smithi118 ceph-mon[104234]: pgmap v770: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.4 MiB/s wr, 514 op/s 2023-10-08T13:21:09.664 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:09 smithi060 ceph-mon[103190]: pgmap v770: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.4 MiB/s wr, 514 op/s 2023-10-08T13:21:09.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:09 smithi005 ceph-mon[99496]: pgmap v770: 129 pgs: 129 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.4 MiB/s wr, 514 op/s 2023-10-08T13:21:10.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:10 smithi118 ceph-mon[104234]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T13:21:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:10 smithi060 ceph-mon[103190]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T13:21:10.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:10 smithi005 ceph-mon[99496]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T13:21:11.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:11 smithi118 ceph-mon[104234]: pgmap v772: 129 pgs: 6 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.1 MiB/s wr, 523 op/s 2023-10-08T13:21:11.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:11 smithi060 ceph-mon[103190]: pgmap v772: 129 pgs: 6 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.1 MiB/s wr, 523 op/s 2023-10-08T13:21:11.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:11 smithi005 ceph-mon[99496]: pgmap v772: 129 pgs: 6 active+clean+snaptrim_wait, 123 active+clean; 3.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.1 MiB/s wr, 523 op/s 2023-10-08T13:21:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 890.0 s, 373.2 tps, lat 263.330 ms stddev 297.898 2023-10-08T13:21:13.524 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:13 smithi118 ceph-mon[104234]: pgmap v773: 129 pgs: 4 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 106 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.4 MiB/s wr, 494 op/s 2023-10-08T13:21:13.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:13 smithi060 ceph-mon[103190]: pgmap v773: 129 pgs: 4 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 106 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.4 MiB/s wr, 494 op/s 2023-10-08T13:21:13.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:13 smithi005 ceph-mon[99496]: pgmap v773: 129 pgs: 4 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 106 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.4 MiB/s wr, 494 op/s 2023-10-08T13:21:15.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:15 smithi060 ceph-mon[103190]: pgmap v774: 129 pgs: 4 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 106 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.2 MiB/s wr, 469 op/s 2023-10-08T13:21:15.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:15 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:15.680 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:15 smithi005 ceph-mon[99496]: pgmap v774: 129 pgs: 4 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 106 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.2 MiB/s wr, 469 op/s 2023-10-08T13:21:15.680 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:15 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:15.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:15 smithi118 ceph-mon[104234]: pgmap v774: 129 pgs: 4 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 106 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.2 MiB/s wr, 469 op/s 2023-10-08T13:21:15.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:15 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 895.0 s, 513.8 tps, lat 198.385 ms stddev 207.470 2023-10-08T13:21:17.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:17 smithi060 ceph-mon[103190]: pgmap v775: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.0 MiB/s wr, 426 op/s 2023-10-08T13:21:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:17 smithi005 ceph-mon[99496]: pgmap v775: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.0 MiB/s wr, 426 op/s 2023-10-08T13:21:17.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:17 smithi118 ceph-mon[104234]: pgmap v775: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.0 MiB/s wr, 426 op/s 2023-10-08T13:21:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:19 smithi060 ceph-mon[103190]: pgmap v776: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.8 MiB/s wr, 446 op/s 2023-10-08T13:21:19.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:19 smithi005 ceph-mon[99496]: pgmap v776: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.8 MiB/s wr, 446 op/s 2023-10-08T13:21:19.775 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:19 smithi118 ceph-mon[104234]: pgmap v776: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.8 MiB/s wr, 446 op/s 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 -- 172.21.15.5:0/281634837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f477410eea0 msgr2=0x7f47741077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 --2- 172.21.15.5:0/281634837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f477410eea0 0x7f47741077f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f476c00b0d0 tx=0x7f476c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 -- 172.21.15.5:0/281634837 shutdown_connections 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 --2- 172.21.15.5:0/281634837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4774119fd0 0x7f477411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 --2- 172.21.15.5:0/281634837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f477410eea0 0x7f47741077f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 --2- 172.21.15.5:0/281634837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477410f310 0x7f4774107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.867+0000 7f477a66b700 1 -- 172.21.15.5:0/281634837 >> 172.21.15.5:0/281634837 conn(0x7f477406b7c0 msgr2=0x7f477406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.880+0000 7f477a66b700 1 -- 172.21.15.5:0/281634837 shutdown_connections 2023-10-08T13:21:19.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.888+0000 7f477a66b700 1 -- 172.21.15.5:0/281634837 wait complete. 2023-10-08T13:21:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.888+0000 7f477a66b700 1 Processor -- start 2023-10-08T13:21:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 -- start start 2023-10-08T13:21:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 0x7f4774118320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477410f310 0x7f47741188a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4774119fd0 0x7f4774111430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774111c00 con 0x7f477410eea0 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774111d70 con 0x7f477410f310 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f477a66b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774111f30 con 0x7f4774119fd0 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f4773fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 0x7f4774118320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f4773fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 0x7f4774118320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38942/0 (socket says 172.21.15.5:38942) 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f4773fff700 1 -- 172.21.15.5:0/3046529469 learned_addr learned my addr 172.21.15.5:0/3046529469 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.889+0000 7f4778c08700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4774119fd0 0x7f4774111430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.890+0000 7f4773fff700 1 -- 172.21.15.5:0/3046529469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4774119fd0 msgr2=0x7f4774111430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.890+0000 7f4773fff700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4774119fd0 0x7f4774111430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.890+0000 7f4773fff700 1 -- 172.21.15.5:0/3046529469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477410f310 msgr2=0x7f47741188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.890+0000 7f4773fff700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477410f310 0x7f47741188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.890+0000 7f4773fff700 1 -- 172.21.15.5:0/3046529469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c009d00 con 0x7f477410eea0 2023-10-08T13:21:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.890+0000 7f4773fff700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 0x7f4774118320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f476c000f80 tx=0x7f476c007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.898+0000 7f47717fa700 1 -- 172.21.15.5:0/3046529469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00e040 con 0x7f477410eea0 2023-10-08T13:21:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.898+0000 7f47717fa700 1 -- 172.21.15.5:0/3046529469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476c003e10 con 0x7f477410eea0 2023-10-08T13:21:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.898+0000 7f47717fa700 1 -- 172.21.15.5:0/3046529469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c01d9e0 con 0x7f477410eea0 2023-10-08T13:21:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.899+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47741121b0 con 0x7f477410eea0 2023-10-08T13:21:19.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.900+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4774116090 con 0x7f477410eea0 2023-10-08T13:21:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.909+0000 7f4786854b80 1 Processor -- start 2023-10-08T13:21:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.909+0000 7f47717fa700 1 -- 172.21.15.5:0/3046529469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f476c01db40 con 0x7f477410eea0 2023-10-08T13:21:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.910+0000 7f47717fa700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f475c0a1770 0x7f475c0a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.911+0000 7f47717fa700 1 -- 172.21.15.5:0/3046529469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f476c09bc40 con 0x7f477410eea0 2023-10-08T13:21:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 -- start start 2023-10-08T13:21:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abc1a0 0x55de06ab5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 0x55de06ab6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06a1e400 con 0x55de06abb880 2023-10-08T13:21:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06a0fbc0 con 0x55de06abc1a0 2023-10-08T13:21:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.915+0000 7f4786854b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06a0d4e0 con 0x55de06ab60b0 2023-10-08T13:21:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.918+0000 7f4778c08700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f475c0a1770 0x7f475c0a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.918+0000 7f4778c08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 0x55de06ab6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.918+0000 7f4778c08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 0x55de06ab6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52154/0 (socket says 172.21.15.5:52154) 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.918+0000 7f4778c08700 1 -- 172.21.15.5:0/2136551762 learned_addr learned my addr 172.21.15.5:0/2136551762 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f475c0a1770 0x7f475c0a3c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f476400bb40 tx=0x7f476400bf00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 -- 172.21.15.5:0/2136551762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abc1a0 msgr2=0x55de06ab5b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abc1a0 0x55de06ab5b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 -- 172.21.15.5:0/2136551762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 msgr2=0x55de06abbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4773fff700 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 -- 172.21.15.5:0/2136551762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de06833d80 con 0x55de06ab60b0 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4773fff700 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f4778c08700 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 0x55de06ab6510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f476400fdc0 tx=0x7f476401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=586c808415221374 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f475a7fc700 1 -- 172.21.15.5:0/2136551762 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764012c10 con 0x55de06ab60b0 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f475a7fc700 1 -- 172.21.15.5:0/2136551762 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4764012d70 con 0x55de06ab60b0 2023-10-08T13:21:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.919+0000 7f475a7fc700 1 -- 172.21.15.5:0/2136551762 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640107c0 con 0x55de06ab60b0 2023-10-08T13:21:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.920+0000 7f4786854b80 1 -- 172.21.15.5:0/2136551762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 msgr2=0x55de06ab6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.920+0000 7f4786854b80 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 0x55de06ab6510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f476400fdc0 tx=0x7f476401a000 comp rx=0 tx=0).stop 2023-10-08T13:21:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.921+0000 7f4786854b80 1 -- 172.21.15.5:0/2136551762 shutdown_connections 2023-10-08T13:21:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.921+0000 7f4786854b80 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ab60b0 0x55de06ab6510 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.921+0000 7f4786854b80 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.921+0000 7f4786854b80 1 --2- 172.21.15.5:0/2136551762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abc1a0 0x55de06ab5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.921+0000 7f4786854b80 1 -- 172.21.15.5:0/2136551762 >> 172.21.15.5:0/2136551762 conn(0x55de06a2a200 msgr2=0x55de06ab0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.923+0000 7f4786854b80 1 -- 172.21.15.5:0/2136551762 shutdown_connections 2023-10-08T13:21:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.923+0000 7f4786854b80 1 -- 172.21.15.5:0/2136551762 wait complete. 2023-10-08T13:21:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.923+0000 7f4786854b80 1 -- start start 2023-10-08T13:21:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 Processor -- start 2023-10-08T13:21:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06ab60b0 0x55de06abf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06acbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06a08dd0 con 0x55de06abb880 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de069a56b0 con 0x55de06ab60b0 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de069a5350 con 0x55de06ac00b0 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.924+0000 7f4786854b80 10 client.0 _ll_register_callbacks cb 0x55de068027a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.925+0000 7f4778c08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06acbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.925+0000 7f4778c08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06acbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52162/0 (socket says 172.21.15.5:52162) 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.925+0000 7f4778c08700 1 -- 172.21.15.5:0/2053687424 learned_addr learned my addr 172.21.15.5:0/2053687424 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.930+0000 7f4773fff700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06ab60b0 0x55de06abf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4773fff700 1 -- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 msgr2=0x55de06acbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4773fff700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06acbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4773fff700 1 -- 172.21.15.5:0/2053687424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 msgr2=0x55de06abfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4773fff700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4773fff700 1 -- 172.21.15.5:0/2053687424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476400fa70 con 0x55de06ab60b0 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4773fff700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06ab60b0 0x55de06abf630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f476c0cbc20 tx=0x7f476c09b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5b449d1c7ecbbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f47537fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f47537fe700 1 -- 172.21.15.5:0/2053687424 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0cbe10 con 0x55de06ab60b0 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.931+0000 7f4778c08700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06acbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.932+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de069d0e50 con 0x55de06ab60b0 2023-10-08T13:21:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.932+0000 7f47537fe700 1 -- 172.21.15.5:0/2053687424 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f476c0b9700 con 0x55de06ab60b0 2023-10-08T13:21:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.932+0000 7f47537fe700 1 -- 172.21.15.5:0/2053687424 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f476c0cbf70 con 0x55de06ab60b0 2023-10-08T13:21:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.932+0000 7f4786854b80 10 client.26771 fetch_fsmap learned FSMap version 54 2023-10-08T13:21:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.932+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55de0681cc00 con 0x55de06ab60b0 2023-10-08T13:21:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.932+0000 7f47537fe700 1 -- 172.21.15.5:0/2053687424 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476c080080 con 0x55de06ab60b0 2023-10-08T13:21:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f47537fe700 1 -- 172.21.15.5:0/2053687424 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 54) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f476c09aa30 con 0x55de06ab60b0 2023-10-08T13:21:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f4786854b80 10 client.26771 fetch_fsmap finished waiting for FSMap version 54 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f4786854b80 10 client.26771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f4786854b80 20 client.26771 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f4786854b80 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06acff00 0x55de06ad2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f4786854b80 4 client.26771 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de06a01db0 con 0x55de06acff00 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.933+0000 7f47737fe700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06acff00 0x55de06ad2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.934+0000 7f47737fe700 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06acff00 0x55de06ad2320 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89361ad1595f0bb3 server_cookie=deee59d1e8dfe1dd in_seq=0 out_seq=0 2023-10-08T13:21:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.938+0000 7f47537fe700 10 client.26771 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.939+0000 7f47537fe700 1 -- 172.21.15.5:0/2053687424 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55de06a01db0 con 0x55de06acff00 2023-10-08T13:21:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.939+0000 7f47537fe700 10 client.26771 handle_command_reply: tid=0 2023-10-08T13:21:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.939+0000 7f4786854b80 1 client.26771 shutdown 2023-10-08T13:21:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.941+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06ab60b0 msgr2=0x55de06abf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.941+0000 7f4786854b80 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06ab60b0 0x55de06abf630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f476c0cbc20 tx=0x7f476c09b540 comp rx=0 tx=0).stop 2023-10-08T13:21:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 shutdown_connections 2023-10-08T13:21:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06acbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06acff00 0x55de06ad2320 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06ab60b0 0x55de06abf630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 --2- 172.21.15.5:0/2053687424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06abb880 0x55de06abfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 >> 172.21.15.5:0/2053687424 conn(0x55de06a2a200 msgr2=0x55de06ab0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f47537fe700 0 client.26771 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 shutdown_connections 2023-10-08T13:21:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.942+0000 7f4786854b80 1 -- 172.21.15.5:0/2053687424 wait complete. 2023-10-08T13:21:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.945+0000 7f4786854b80 20 client.26771 trim_cache size 0 max 16384 2023-10-08T13:21:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 Processor -- start 2023-10-08T13:21:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 -- start start 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ab5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ab0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ab0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de068898c0 con 0x55de06ab60b0 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06ac05f0 con 0x55de06abb880 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.964+0000 7f4786854b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06aad830 con 0x55de06ac00b0 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ab5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f47737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ab0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ab5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38964/0 (socket says 172.21.15.5:38964) 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4778c08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ab0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 -- 172.21.15.5:0/356000995 learned_addr learned my addr 172.21.15.5:0/356000995 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:19.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f47737fe700 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ab0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33914/0 (socket says 172.21.15.5:33914) 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 -- 172.21.15.5:0/356000995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 msgr2=0x55de06ab0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ab0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 -- 172.21.15.5:0/356000995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 msgr2=0x55de06ab0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ab0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 -- 172.21.15.5:0/356000995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de0685a1f0 con 0x55de06ab60b0 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f47737fe700 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ab0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f4773fff700 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ab5b70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f476c00b420 tx=0x7f476c099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d957b7d2bab51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f475affd700 1 -- 172.21.15.5:0/356000995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c09aa30 con 0x55de06ab60b0 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f475affd700 1 -- 172.21.15.5:0/356000995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55de069d0e50 con 0x55de06ab60b0 2023-10-08T13:21:19.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.965+0000 7f475affd700 1 -- 172.21.15.5:0/356000995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c09b7a0 con 0x55de06ab60b0 2023-10-08T13:21:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 -- 172.21.15.5:0/356000995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 msgr2=0x55de06ab5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ab5b70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f476c00b420 tx=0x7f476c099af0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 -- 172.21.15.5:0/356000995 shutdown_connections 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ab0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ab5b70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 --2- 172.21.15.5:0/356000995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ab0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 -- 172.21.15.5:0/356000995 >> 172.21.15.5:0/356000995 conn(0x55de06a2a200 msgr2=0x55de06abdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 -- 172.21.15.5:0/356000995 shutdown_connections 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.966+0000 7f4786854b80 1 -- 172.21.15.5:0/356000995 wait complete. 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 -- start start 2023-10-08T13:21:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 Processor -- start 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ac6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ac4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ac51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06ac5770 con 0x55de06ab60b0 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06ac58e0 con 0x55de06abb880 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de06ac5aa0 con 0x55de06ac00b0 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4786854b80 10 client.0 _ll_register_callbacks cb 0x7f476c09aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4773fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ac6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4773fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ac6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38970/0 (socket says 172.21.15.5:38970) 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4773fff700 1 -- 172.21.15.5:0/1195287240 learned_addr learned my addr 172.21.15.5:0/1195287240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f47737fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ac4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f4778c08700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ac51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f47737fe700 1 -- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 msgr2=0x55de06ac51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f47737fe700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ac51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.967+0000 7f47737fe700 1 -- 172.21.15.5:0/1195287240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 msgr2=0x55de06ac6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47737fe700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ac6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47737fe700 1 -- 172.21.15.5:0/1195287240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476800a8a0 con 0x55de06abb880 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4773fff700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ac6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47737fe700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ac4c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55de06ab1c70 tx=0x7f47680155d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4770094efb276db6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47537fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47537fe700 1 -- 172.21.15.5:0/1195287240 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768004020 con 0x55de06abb880 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4764012d70 con 0x55de06abb880 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47537fe700 1 -- 172.21.15.5:0/1195287240 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f4768004180 con 0x55de06abb880 2023-10-08T13:21:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47537fe700 1 -- 172.21.15.5:0/1195287240 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4768004340 con 0x55de06abb880 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4786854b80 10 client.26777 fetch_fsmap learned FSMap version 54 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x55de0681cc00 con 0x55de06abb880 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47537fe700 1 -- 172.21.15.5:0/1195287240 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4764012d70 con 0x55de06abb880 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f47537fe700 1 -- 172.21.15.5:0/1195287240 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 54) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f476800f540 con 0x55de06abb880 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4786854b80 10 client.26777 fetch_fsmap finished waiting for FSMap version 54 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4786854b80 10 client.26777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.968+0000 7f4786854b80 20 client.26777 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.969+0000 7f4786854b80 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06b24440 0x55de06b26860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.969+0000 7f4786854b80 4 client.26777 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.969+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55de06a01ad0 con 0x55de06b24440 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.969+0000 7f4773fff700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06b24440 0x55de06b26860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.969+0000 7f4773fff700 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06b24440 0x55de06b26860 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80206d22a13a8271 server_cookie=1d8a446f4afd36af in_seq=0 out_seq=0 2023-10-08T13:21:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.969+0000 7f47537fe700 10 client.26777 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f47537fe700 1 -- 172.21.15.5:0/1195287240 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55de06a01ad0 con 0x55de06b24440 2023-10-08T13:21:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f47537fe700 10 client.26777 handle_command_reply: tid=0 2023-10-08T13:21:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 client.26777 shutdown 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 msgr2=0x55de06ac4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ac4c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55de06ab1c70 tx=0x7f47680155d0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 shutdown_connections 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55de06ac00b0 0x55de06ac51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de06ab60b0 0x55de06ac6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x55de06b24440 0x55de06b26860 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 --2- 172.21.15.5:0/1195287240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55de06abb880 0x55de06ac4c60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f47537fe700 0 client.26777 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 >> 172.21.15.5:0/1195287240 conn(0x55de06a2a200 msgr2=0x55de06abaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 shutdown_connections 2023-10-08T13:21:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.988+0000 7f4786854b80 1 -- 172.21.15.5:0/1195287240 wait complete. 2023-10-08T13:21:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.991+0000 7f4786854b80 20 client.26777 trim_cache size 0 max 16384 2023-10-08T13:21:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:21:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:21:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:21:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:21:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.995+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f475c0a1770 msgr2=0x7f475c0a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.995+0000 7f477a66b700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f475c0a1770 0x7f475c0a3c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f476400bb40 tx=0x7f476400bf00 comp rx=0 tx=0).stop 2023-10-08T13:21:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.995+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 msgr2=0x7f4774118320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.995+0000 7f477a66b700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 0x7f4774118320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f476c000f80 tx=0x7f476c007ba0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 shutdown_connections 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f475c0a1770 0x7f475c0a3c30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4774119fd0 0x7f4774111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f477410eea0 0x7f4774118320 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 --2- 172.21.15.5:0/3046529469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477410f310 0x7f47741188a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 >> 172.21.15.5:0/3046529469 conn(0x7f477406b7c0 msgr2=0x7f477406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 shutdown_connections 2023-10-08T13:21:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:19.997+0000 7f477a66b700 1 -- 172.21.15.5:0/3046529469 wait complete. 2023-10-08T13:21:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:progress: 900.0 s, 529.8 tps, lat 191.290 ms stddev 207.630 2023-10-08T13:21:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:21 smithi118 ceph-mon[104234]: pgmap v777: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 418 op/s 2023-10-08T13:21:21.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:21 smithi118 ceph-mon[104234]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T13:21:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:21 smithi060 ceph-mon[103190]: pgmap v777: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 418 op/s 2023-10-08T13:21:21.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:21 smithi060 ceph-mon[103190]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T13:21:21.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:21 smithi005 ceph-mon[99496]: pgmap v777: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 418 op/s 2023-10-08T13:21:21.922 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:21 smithi005 ceph-mon[99496]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:transaction type: 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:scaling factor: 32 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:query mode: simple 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:number of clients: 100 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:number of threads: 4 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:duration: 900 s 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:number of transactions actually processed: 717704 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:latency average = 125.438 ms 2023-10-08T13:21:22.227 INFO:teuthology.orchestra.run.smithi005.stdout:latency stddev = 222.471 ms 2023-10-08T13:21:22.228 INFO:teuthology.orchestra.run.smithi005.stdout:tps = 797.022560 (including connections establishing) 2023-10-08T13:21:22.228 INFO:teuthology.orchestra.run.smithi005.stdout:tps = 797.024733 (excluding connections establishing) 2023-10-08T13:21:22.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-10-08T13:21:23.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:23 smithi118 ceph-mon[104234]: pgmap v779: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.4 MiB/s wr, 460 op/s 2023-10-08T13:21:23.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:21:23.873 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:23 smithi005 ceph-mon[99496]: pgmap v779: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.4 MiB/s wr, 460 op/s 2023-10-08T13:21:23.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:23 smithi060 ceph-mon[103190]: pgmap v779: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.4 MiB/s wr, 460 op/s 2023-10-08T13:21:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 -- 172.21.15.5:0/2729687451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2000ffef0 msgr2=0x7ff20010c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 --2- 172.21.15.5:0/2729687451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2000ffef0 0x7ff20010c3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009f90 tx=0x7ff1f800b330 comp rx=0 tx=0).stop 2023-10-08T13:21:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 -- 172.21.15.5:0/2729687451 shutdown_connections 2023-10-08T13:21:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 --2- 172.21.15.5:0/2729687451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2000ffef0 0x7ff20010c3b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 --2- 172.21.15.5:0/2729687451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2001055f0 0x7ff2001059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 --2- 172.21.15.5:0/2729687451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000ff530 0x7ff2000ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 -- 172.21.15.5:0/2729687451 >> 172.21.15.5:0/2729687451 conn(0x7ff2000fafc0 msgr2=0x7ff2000fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 -- 172.21.15.5:0/2729687451 shutdown_connections 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 -- 172.21.15.5:0/2729687451 wait complete. 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 Processor -- start 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 -- start start 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 0x7ff20019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.989+0000 7ff20588b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000ffef0 0x7ff20019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff20588b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2001055f0 0x7ff2001969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff20588b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff200197170 con 0x7ff2000ff530 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff20588b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2001972e0 con 0x7ff2000ffef0 2023-10-08T13:21:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff20588b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2001974a0 con 0x7ff2001055f0 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 0x7ff20019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 0x7ff20019c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38984/0 (socket says 172.21.15.5:38984) 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 -- 172.21.15.5:0/2847819877 learned_addr learned my addr 172.21.15.5:0/2847819877 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000ffef0 0x7ff20019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1ff7fe700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2001055f0 0x7ff2001969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 -- 172.21.15.5:0/2847819877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2001055f0 msgr2=0x7ff2001969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2001055f0 0x7ff2001969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 -- 172.21.15.5:0/2847819877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000ffef0 msgr2=0x7ff20019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000ffef0 0x7ff20019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 -- 172.21.15.5:0/2847819877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00095f0 con 0x7ff2000ff530 2023-10-08T13:21:23.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff1feffd700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 0x7ff20019c900 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000ec10 tx=0x7ff1f000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff204889700 1 -- 172.21.15.5:0/2847819877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cc90 con 0x7ff2000ff530 2023-10-08T13:21:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f8009c40 con 0x7ff2000ff530 2023-10-08T13:21:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff204889700 1 -- 172.21.15.5:0/2847819877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1f00044e0 con 0x7ff2000ff530 2023-10-08T13:21:23.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff204889700 1 -- 172.21.15.5:0/2847819877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0010430 con 0x7ff2000ff530 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.990+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2001a3880 con 0x7ff2000ff530 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.993+0000 7ff204889700 1 -- 172.21.15.5:0/2847819877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff1f0003fb0 con 0x7ff2000ff530 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.994+0000 7ff204889700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1e80a15f0 0x7ff1e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.994+0000 7ff204889700 1 -- 172.21.15.5:0/2847819877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff1f0014070 con 0x7ff2000ff530 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.994+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1e80a15f0 0x7ff1e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.994+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1e80a15f0 0x7ff1e80a3ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff200198110 tx=0x7ff1f4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.994+0000 7ff211a74b80 1 Processor -- start 2023-10-08T13:21:24.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.994+0000 7ff211a74b80 1 -- start start 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addba7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff211a74b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addb10460 con 0x556addba6e80 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff211a74b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addb01c20 con 0x556addba77a0 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff211a74b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addaff540 con 0x556addbb2650 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addba7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addba7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38992/0 (socket says 172.21.15.5:38992) 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 -- 172.21.15.5:0/2132481892 learned_addr learned my addr 172.21.15.5:0/2132481892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1ff7fe700 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 -- 172.21.15.5:0/2132481892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 msgr2=0x556addbb4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 -- 172.21.15.5:0/2132481892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 msgr2=0x556addbb2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 -- 172.21.15.5:0/2132481892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556add925de0 con 0x556addba6e80 2023-10-08T13:21:24.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1feffd700 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addba7260 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00a2430 tx=0x7ff1f009a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b0c10a81e18c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1e5ffb700 1 -- 172.21.15.5:0/2132481892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0016330 con 0x556addba6e80 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1e5ffb700 1 -- 172.21.15.5:0/2132481892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1f009acd0 con 0x556addba6e80 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.995+0000 7ff1e5ffb700 1 -- 172.21.15.5:0/2132481892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0098a50 con 0x556addba6e80 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 -- 172.21.15.5:0/2132481892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 msgr2=0x556addba7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addba7260 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00a2430 tx=0x7ff1f009a470 comp rx=0 tx=0).stop 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 -- 172.21.15.5:0/2132481892 shutdown_connections 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addba7260 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 --2- 172.21.15.5:0/2132481892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 -- 172.21.15.5:0/2132481892 >> 172.21.15.5:0/2132481892 conn(0x556addb1c260 msgr2=0x556addba32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:24.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 -- 172.21.15.5:0/2132481892 shutdown_connections 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.996+0000 7ff211a74b80 1 -- 172.21.15.5:0/2132481892 wait complete. 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 -- start start 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 Processor -- start 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 0x556addbb2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 0x556addbaf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addbb2650 0x556addbafb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addafae30 con 0x556addba77a0 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adda97710 con 0x556addbb2650 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adda973b0 con 0x556addba6e80 2023-10-08T13:21:24.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff211a74b80 10 client.0 _ll_register_callbacks cb 0x556add8f4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1fe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 0x556addbaf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 0x556addbb2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 0x556addbb2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52202/0 (socket says 172.21.15.5:52202) 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1fe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 0x556addbaf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39000/0 (socket says 172.21.15.5:39000) 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1feffd700 1 -- 172.21.15.5:0/3320229019 learned_addr learned my addr 172.21.15.5:0/3320229019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1ff7fe700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addbb2650 0x556addbafb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1fe7fc700 1 -- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 msgr2=0x556addbb2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 0x556addbb2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1fe7fc700 1 -- 172.21.15.5:0/3320229019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addbb2650 msgr2=0x556addbafb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.997+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addbb2650 0x556addbafb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1fe7fc700 1 -- 172.21.15.5:0/3320229019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f4017070 con 0x556addba77a0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1feffd700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 0x556addbb2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 0x556addbaf400 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097c0 tx=0x7ff1f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d90db4e4c1983f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1deffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1deffd700 1 -- 172.21.15.5:0/3320229019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4022070 con 0x556addba77a0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556addac2eb0 con 0x556addba77a0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1deffd700 1 -- 172.21.15.5:0/3320229019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff1f4003d40 con 0x556addba77a0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1deffd700 1 -- 172.21.15.5:0/3320229019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1f402c640 con 0x556addba77a0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 10 client.17385 fetch_fsmap learned FSMap version 54 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7ff2001a3880 con 0x556addba77a0 2023-10-08T13:21:24.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1deffd700 1 -- 172.21.15.5:0/3320229019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1f4030020 con 0x556addba77a0 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff1deffd700 1 -- 172.21.15.5:0/3320229019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 54) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff1f4027cc0 con 0x556addba77a0 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 10 client.17385 fetch_fsmap finished waiting for FSMap version 54 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 20 client.17385 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addbc2180 0x556addbc45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 4 client.17385 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.998+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556addaf3e10 con 0x556addbc2180 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.999+0000 7ff1feffd700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addbc2180 0x556addbc45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.999+0000 7ff1deffd700 10 client.17385 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:23.999+0000 7ff1feffd700 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addbc2180 0x556addbc45a0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c1c570b20da6b3 server_cookie=b29159d07efc6c20 in_seq=0 out_seq=0 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff1deffd700 1 -- 172.21.15.5:0/3320229019 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556addaf3e10 con 0x556addbc2180 2023-10-08T13:21:24.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff1deffd700 10 client.17385 handle_command_reply: tid=0 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 client.17385 shutdown 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 msgr2=0x556addbaf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 0x556addbaf400 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097c0 tx=0x7ff1f40047c0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 shutdown_connections 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addbc2180 0x556addbc45a0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addbb2650 0x556addbafb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addba6e80 0x556addbb2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff1deffd700 0 client.17385 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3320229019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba77a0 0x556addbaf400 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 >> 172.21.15.5:0/3320229019 conn(0x556addb1c260 msgr2=0x556addba2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:24.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 shutdown_connections 2023-10-08T13:21:24.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 1 -- 172.21.15.5:0/3320229019 wait complete. 2023-10-08T13:21:24.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.000+0000 7ff211a74b80 20 client.17385 trim_cache size 0 max 16384 2023-10-08T13:21:24.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 Processor -- start 2023-10-08T13:21:24.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 -- start start 2023-10-08T13:21:24.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbaf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbaece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556add97b920 con 0x556addba6e80 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addbaf220 con 0x556addba77a0 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff211a74b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addb9d570 con 0x556addbb2650 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.019+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbaf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1ff7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbaf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39006/0 (socket says 172.21.15.5:39006) 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 -- 172.21.15.5:0/1327040793 learned_addr learned my addr 172.21.15.5:0/1327040793 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbaece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 -- 172.21.15.5:0/1327040793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 msgr2=0x556addbb91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 -- 172.21.15.5:0/1327040793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 msgr2=0x556addbaece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbaece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 -- 172.21.15.5:0/1327040793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556add90ec60 con 0x556addba6e80 2023-10-08T13:21:24.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1feffd700 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbaf400 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009b40 tx=0x7ff1f0085180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e044ec7e18f7e41 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:24.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1e67fc700 1 -- 172.21.15.5:0/1327040793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00b5040 con 0x556addba6e80 2023-10-08T13:21:24.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1e67fc700 1 -- 172.21.15.5:0/1327040793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1f00a2960 con 0x556addba6e80 2023-10-08T13:21:24.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.020+0000 7ff1e67fc700 1 -- 172.21.15.5:0/1327040793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f009aa70 con 0x556addba6e80 2023-10-08T13:21:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 -- 172.21.15.5:0/1327040793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 msgr2=0x556addbaf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbaf400 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009b40 tx=0x7ff1f0085180 comp rx=0 tx=0).stop 2023-10-08T13:21:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 -- 172.21.15.5:0/1327040793 shutdown_connections 2023-10-08T13:21:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addbb91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbaf400 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 --2- 172.21.15.5:0/1327040793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbaece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 -- 172.21.15.5:0/1327040793 >> 172.21.15.5:0/1327040793 conn(0x556addb1c260 msgr2=0x556addba24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 -- 172.21.15.5:0/1327040793 shutdown_connections 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 -- 172.21.15.5:0/1327040793 wait complete. 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 -- start start 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.021+0000 7ff211a74b80 1 Processor -- start 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbb7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addc1d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addc1dd20 con 0x556addba6e80 2023-10-08T13:21:24.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addc1de60 con 0x556addba77a0 2023-10-08T13:21:24.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556addc1dfa0 con 0x556addbb2650 2023-10-08T13:21:24.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 10 client.0 _ll_register_callbacks cb 0x7ff1f4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:24.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbb7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1ff7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addc1d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1fe7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbb7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39012/0 (socket says 172.21.15.5:39012) 2023-10-08T13:21:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 -- 172.21.15.5:0/3589476280 learned_addr learned my addr 172.21.15.5:0/3589476280 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 -- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 msgr2=0x556addc1d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addc1d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 -- 172.21.15.5:0/3589476280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 msgr2=0x556addbb78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 -- 172.21.15.5:0/3589476280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556add925de0 con 0x556addba6e80 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1feffd700 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbb7370 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0097040 tx=0x7ff1f0003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0874c0f230a5b30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1deffd700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1deffd700 1 -- 172.21.15.5:0/3589476280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00b5040 con 0x556addba6e80 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff1deffd700 1 -- 172.21.15.5:0/3589476280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff1f009e720 con 0x556addba6e80 2023-10-08T13:21:24.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.022+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1f009acd0 con 0x556addba6e80 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff1deffd700 1 -- 172.21.15.5:0/3589476280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1f007b080 con 0x556addba6e80 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 10 client.17391 fetch_fsmap learned FSMap version 54 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x556add94c250 con 0x556addba6e80 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff1deffd700 1 -- 172.21.15.5:0/3589476280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1f009acd0 con 0x556addba6e80 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff1deffd700 1 -- 172.21.15.5:0/3589476280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 54) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff1f009a830 con 0x556addba6e80 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 10 client.17391 fetch_fsmap finished waiting for FSMap version 54 2023-10-08T13:21:24.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 20 client.17391 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addc1f3a0 0x556addc21790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 4 client.17391 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556addaf3b30 con 0x556addc1f3a0 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.023+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addc1f3a0 0x556addc21790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff1deffd700 10 client.17391 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff1fe7fc700 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addc1f3a0 0x556addc21790 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b110fb0adf689fe server_cookie=3364ab6fded49664 in_seq=0 out_seq=0 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff1deffd700 1 -- 172.21.15.5:0/3589476280 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556addaf3b30 con 0x556addc1f3a0 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff1deffd700 10 client.17391 handle_command_reply: tid=0 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 client.17391 shutdown 2023-10-08T13:21:24.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 msgr2=0x556addbb7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbb7370 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0097040 tx=0x7ff1f0003930 comp rx=0 tx=0).stop 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 shutdown_connections 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556addbb2650 0x556addc1d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556addba6e80 0x556addbb7370 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556addc1f3a0 0x556addc21790 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 --2- 172.21.15.5:0/3589476280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556addba77a0 0x556addbb78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 >> 172.21.15.5:0/3589476280 conn(0x556addb1c260 msgr2=0x556addbaa750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.024+0000 7ff1deffd700 0 client.17391 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 shutdown_connections 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff211a74b80 1 -- 172.21.15.5:0/3589476280 wait complete. 2023-10-08T13:21:24.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff211a74b80 20 client.17391 trim_cache size 0 max 16384 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "c6bbc2aa-3637-48e6-9484-3c158b7f4deb": { 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c6bbc2aa-3637-48e6-9484-3c158b7f4deb", 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:24.036 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:21:24.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1e80a15f0 msgr2=0x7ff1e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:24.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1e80a15f0 0x7ff1e80a3ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff200198110 tx=0x7ff1f4009260 comp rx=0 tx=0).stop 2023-10-08T13:21:24.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 msgr2=0x7ff20019c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 0x7ff20019c900 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000ec10 tx=0x7ff1f000ef20 comp rx=0 tx=0).stop 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 shutdown_connections 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7ff1e80a15f0 0x7ff1e80a3ab0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2001055f0 0x7ff2001969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2000ff530 0x7ff20019c900 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 --2- 172.21.15.5:0/2847819877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000ffef0 0x7ff20019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 >> 172.21.15.5:0/2847819877 conn(0x7ff2000fafc0 msgr2=0x7ff2000fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.025+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 shutdown_connections 2023-10-08T13:21:24.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:24.026+0000 7ff20588b700 1 -- 172.21.15.5:0/2847819877 wait complete. 2023-10-08T13:21:24.040 INFO:tasks.cephfs.filesystem:scrub status for tag:c6bbc2aa-3637-48e6-9484-3c158b7f4deb - {'path': '/', 'tag': 'c6bbc2aa-3637-48e6-9484-3c158b7f4deb', 'options': 'recursive,force'} 2023-10-08T13:21:24.040 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/filesystem.py", line 1730, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T13:21:25.909 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:25 smithi060 ceph-mon[103190]: pgmap v780: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 458 op/s 2023-10-08T13:21:25.928 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:25 smithi005 ceph-mon[99496]: pgmap v780: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 458 op/s 2023-10-08T13:21:26.026 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:25 smithi118 ceph-mon[104234]: pgmap v780: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 458 op/s 2023-10-08T13:21:27.410 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:27 smithi060 ceph-mon[103190]: pgmap v781: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.8 MiB/s wr, 453 op/s 2023-10-08T13:21:27.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:27 smithi005 ceph-mon[99496]: pgmap v781: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.8 MiB/s wr, 453 op/s 2023-10-08T13:21:27.524 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:27 smithi118 ceph-mon[104234]: pgmap v781: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.8 MiB/s wr, 453 op/s 2023-10-08T13:21:29.414 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:29 smithi060 ceph-mon[103190]: pgmap v782: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-08T13:21:29.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:29 smithi005 ceph-mon[99496]: pgmap v782: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-08T13:21:29.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:29 smithi118 ceph-mon[104234]: pgmap v782: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-08T13:21:31.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:31 smithi118 ceph-mon[104234]: pgmap v783: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 7.7 MiB/s wr, 607 op/s 2023-10-08T13:21:31.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:31 smithi060 ceph-mon[103190]: pgmap v783: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 7.7 MiB/s wr, 607 op/s 2023-10-08T13:21:31.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:31 smithi005 ceph-mon[99496]: pgmap v783: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 7.7 MiB/s wr, 607 op/s 2023-10-08T13:21:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.230+0000 7eff6ac73700 1 -- 172.21.15.5:0/3852022273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 msgr2=0x7eff6410cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.230+0000 7eff6ac73700 1 --2- 172.21.15.5:0/3852022273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 0x7eff6410cd40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff54009990 tx=0x7eff54009ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 -- 172.21.15.5:0/3852022273 shutdown_connections 2023-10-08T13:21:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 --2- 172.21.15.5:0/3852022273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64119c80 0x7eff6411c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 --2- 172.21.15.5:0/3852022273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 0x7eff6410cd40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 --2- 172.21.15.5:0/3852022273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff64119740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 -- 172.21.15.5:0/3852022273 >> 172.21.15.5:0/3852022273 conn(0x7eff6406b6b0 msgr2=0x7eff6406bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 -- 172.21.15.5:0/3852022273 shutdown_connections 2023-10-08T13:21:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.237+0000 7eff6ac73700 1 -- 172.21.15.5:0/3852022273 wait complete. 2023-10-08T13:21:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.238+0000 7eff6ac73700 1 Processor -- start 2023-10-08T13:21:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.238+0000 7eff6ac73700 1 -- start start 2023-10-08T13:21:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff6ac73700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 0x7eff64119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff6ac73700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff641132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff6ac73700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64119c80 0x7eff641137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff6ac73700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64113d30 con 0x7eff64119c80 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff6ac73700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64113ea0 con 0x7eff6410c960 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff6ac73700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64114060 con 0x7eff6410d280 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff641132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff641132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52230/0 (socket says 172.21.15.5:52230) 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 -- 172.21.15.5:0/2965569047 learned_addr learned my addr 172.21.15.5:0/2965569047 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff68a0f700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 0x7eff64119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 -- 172.21.15.5:0/2965569047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 msgr2=0x7eff64119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 0x7eff64119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 -- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64119c80 msgr2=0x7eff641137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64119c80 0x7eff641137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.239+0000 7eff63fff700 1 -- 172.21.15.5:0/2965569047 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540095f0 con 0x7eff6410d280 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.240+0000 7eff63fff700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff641132b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff5800b550 tx=0x7eff5800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.240+0000 7eff61ffb700 1 -- 172.21.15.5:0/2965569047 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58011830 con 0x7eff6410d280 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.240+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff641babc0 con 0x7eff6410d280 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.240+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff641bb0f0 con 0x7eff6410d280 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.240+0000 7eff61ffb700 1 -- 172.21.15.5:0/2965569047 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff58011e50 con 0x7eff6410d280 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.240+0000 7eff61ffb700 1 -- 172.21.15.5:0/2965569047 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800f2e0 con 0x7eff6410d280 2023-10-08T13:21:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.247+0000 7eff76e5cb80 1 Processor -- start 2023-10-08T13:21:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.249+0000 7eff61ffb700 1 -- 172.21.15.5:0/2965569047 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7eff58011990 con 0x7eff6410d280 2023-10-08T13:21:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.250+0000 7eff61ffb700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff4c0a16b0 0x7eff4c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.250+0000 7eff61ffb700 1 -- 172.21.15.5:0/2965569047 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7eff580cce20 con 0x7eff6410d280 2023-10-08T13:21:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.251+0000 7eff69210700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff4c0a16b0 0x7eff4c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.252+0000 7eff69210700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff4c0a16b0 0x7eff4c0a3b70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00ab10 tx=0x7eff5c009230 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 -- start start 2023-10-08T13:21:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556140881880 0x556140881c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408821a0 0x55614087bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 0x55614087c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561407e4400 con 0x5561408821a0 2023-10-08T13:21:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561407d5bc0 con 0x55614087c0b0 2023-10-08T13:21:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.258+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561407d34e0 con 0x556140881880 2023-10-08T13:21:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 0x55614087c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 0x55614087c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:33984/0 (socket says 172.21.15.5:33984) 2023-10-08T13:21:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 -- 172.21.15.5:0/1706963188 learned_addr learned my addr 172.21.15.5:0/1706963188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff68a0f700 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556140881880 0x556140881c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 -- 172.21.15.5:0/1706963188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556140881880 msgr2=0x556140881c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556140881880 0x556140881c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 -- 172.21.15.5:0/1706963188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408821a0 msgr2=0x55614087bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408821a0 0x55614087bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 -- 172.21.15.5:0/1706963188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561405f9d80 con 0x55614087c0b0 2023-10-08T13:21:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.270+0000 7eff69210700 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 0x55614087c510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00ce70 tx=0x7eff5c00f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece91306401f56e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.282+0000 7eff4affd700 1 -- 172.21.15.5:0/1706963188 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c01a620 con 0x55614087c0b0 2023-10-08T13:21:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.282+0000 7eff4affd700 1 -- 172.21.15.5:0/1706963188 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff5c011070 con 0x55614087c0b0 2023-10-08T13:21:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.282+0000 7eff4affd700 1 -- 172.21.15.5:0/1706963188 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0229a0 con 0x55614087c0b0 2023-10-08T13:21:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.283+0000 7eff76e5cb80 1 -- 172.21.15.5:0/1706963188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 msgr2=0x55614087c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.283+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 0x55614087c510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00ce70 tx=0x7eff5c00f000 comp rx=0 tx=0).stop 2023-10-08T13:21:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.292+0000 7eff76e5cb80 1 -- 172.21.15.5:0/1706963188 shutdown_connections 2023-10-08T13:21:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.292+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55614087c0b0 0x55614087c510 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.292+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556140881880 0x556140881c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.292+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/1706963188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408821a0 0x55614087bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.292+0000 7eff76e5cb80 1 -- 172.21.15.5:0/1706963188 >> 172.21.15.5:0/1706963188 conn(0x5561407f0200 msgr2=0x556140876b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.304+0000 7eff76e5cb80 1 -- 172.21.15.5:0/1706963188 shutdown_connections 2023-10-08T13:21:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.319+0000 7eff76e5cb80 1 -- 172.21.15.5:0/1706963188 wait complete. 2023-10-08T13:21:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.319+0000 7eff76e5cb80 1 -- start start 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.319+0000 7eff76e5cb80 1 Processor -- start 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x556140885550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 0x556140885a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140885fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561407cedd0 con 0x55614087c0b0 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614076b6b0 con 0x556140881880 2023-10-08T13:21:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614076b350 con 0x5561408821a0 2023-10-08T13:21:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.320+0000 7eff76e5cb80 10 client.0 _ll_register_callbacks cb 0x5561405c87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.321+0000 7eff69210700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140885fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.321+0000 7eff69210700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140885fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52242/0 (socket says 172.21.15.5:52242) 2023-10-08T13:21:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.321+0000 7eff69210700 1 -- 172.21.15.5:0/2384070088 learned_addr learned my addr 172.21.15.5:0/2384070088 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.321+0000 7eff68a0f700 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x556140885550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.322+0000 7eff69210700 1 -- 172.21.15.5:0/2384070088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 msgr2=0x556140885a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:21:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.322+0000 7eff69210700 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 0x556140885a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.322+0000 7eff69210700 1 -- 172.21.15.5:0/2384070088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 msgr2=0x556140885550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.322+0000 7eff69210700 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x556140885550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.322+0000 7eff69210700 1 -- 172.21.15.5:0/2384070088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c00cb20 con 0x5561408821a0 2023-10-08T13:21:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.326+0000 7eff69210700 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140885fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c6b0 tx=0x7eff5c01abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87357fd5760f22b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.326+0000 7eff43fff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:21:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.326+0000 7eff43fff700 1 -- 172.21.15.5:0/2384070088 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c02f070 con 0x5561408821a0 2023-10-08T13:21:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.326+0000 7eff43fff700 1 -- 172.21.15.5:0/2384070088 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7eff5c013070 con 0x5561408821a0 2023-10-08T13:21:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.326+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556140796e50 con 0x5561408821a0 2023-10-08T13:21:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.329+0000 7eff43fff700 1 -- 172.21.15.5:0/2384070088 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff5c026070 con 0x5561408821a0 2023-10-08T13:21:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.332+0000 7eff76e5cb80 10 client.26890 fetch_fsmap learned FSMap version 54 2023-10-08T13:21:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.332+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5561405e2c00 con 0x5561408821a0 2023-10-08T13:21:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff43fff700 1 -- 172.21.15.5:0/2384070088 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556140796e50 con 0x5561408821a0 2023-10-08T13:21:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff43fff700 1 -- 172.21.15.5:0/2384070088 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 54) v1 ==== 7894+0+0 (secure 0 0 0) 0x7eff5c032020 con 0x5561408821a0 2023-10-08T13:21:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff76e5cb80 10 client.26890 fetch_fsmap finished waiting for FSMap version 54 2023-10-08T13:21:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff76e5cb80 10 client.26890 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff76e5cb80 20 client.26890 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556140895c40 0x556140898060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff76e5cb80 4 client.26890 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:21:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.333+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561407c7db0 con 0x556140895c40 2023-10-08T13:21:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.339+0000 7eff68a0f700 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556140895c40 0x556140898060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.353+0000 7eff68a0f700 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556140895c40 0x556140898060 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f033fae209e6b7 server_cookie=48217eaefd837c2c in_seq=0 out_seq=0 2023-10-08T13:21:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.353+0000 7eff43fff700 10 client.26890 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.353+0000 7eff43fff700 1 -- 172.21.15.5:0/2384070088 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561407c7db0 con 0x556140895c40 2023-10-08T13:21:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.353+0000 7eff43fff700 10 client.26890 handle_command_reply: tid=0 2023-10-08T13:21:33.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.353+0000 7eff76e5cb80 1 client.26890 shutdown 2023-10-08T13:21:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.355+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 msgr2=0x556140885fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.355+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140885fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c6b0 tx=0x7eff5c01abe0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.366+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 shutdown_connections 2023-10-08T13:21:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.366+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140885fd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.366+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x556140885550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.366+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x556140895c40 0x556140898060 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.366+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/2384070088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 0x556140885a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.366+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 >> 172.21.15.5:0/2384070088 conn(0x5561407f0200 msgr2=0x556140876010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.370+0000 7eff43fff700 0 client.26890 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.381+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 shutdown_connections 2023-10-08T13:21:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.387+0000 7eff76e5cb80 1 -- 172.21.15.5:0/2384070088 wait complete. 2023-10-08T13:21:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.398+0000 7eff76e5cb80 20 client.26890 trim_cache size 0 max 16384 2023-10-08T13:21:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 Processor -- start 2023-10-08T13:21:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 -- start start 2023-10-08T13:21:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x55614087bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 0x556140876790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140876cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614064f8c0 con 0x55614087c0b0 2023-10-08T13:21:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x556140873830 con 0x556140881880 2023-10-08T13:21:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.437+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561408880e0 con 0x5561408821a0 2023-10-08T13:21:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x55614087bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x55614087bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39044/0 (socket says 172.21.15.5:39044) 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 -- 172.21.15.5:0/3055285119 learned_addr learned my addr 172.21.15.5:0/3055285119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 -- 172.21.15.5:0/3055285119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 msgr2=0x556140876cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140876cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 -- 172.21.15.5:0/3055285119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 msgr2=0x556140876790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 0x556140876790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.438+0000 7eff68a0f700 1 -- 172.21.15.5:0/3055285119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561406201f0 con 0x55614087c0b0 2023-10-08T13:21:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.439+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x55614087bb70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7eff54015000 tx=0x7eff54009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26b869918f7f76e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.439+0000 7eff4b7fe700 1 -- 172.21.15.5:0/3055285119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5401c070 con 0x55614087c0b0 2023-10-08T13:21:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.439+0000 7eff4b7fe700 1 -- 172.21.15.5:0/3055285119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff5401d040 con 0x55614087c0b0 2023-10-08T13:21:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.439+0000 7eff4b7fe700 1 -- 172.21.15.5:0/3055285119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54003aa0 con 0x55614087c0b0 2023-10-08T13:21:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.440+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3055285119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 msgr2=0x55614087bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.440+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x55614087bb70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7eff54015000 tx=0x7eff54009310 comp rx=0 tx=0).stop 2023-10-08T13:21:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.442+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3055285119 shutdown_connections 2023-10-08T13:21:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.442+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561408821a0 0x556140876cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.442+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55614087c0b0 0x55614087bb70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.442+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3055285119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556140881880 0x556140876790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.442+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3055285119 >> 172.21.15.5:0/3055285119 conn(0x5561407f0200 msgr2=0x556140883e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.449+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3055285119 shutdown_connections 2023-10-08T13:21:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.449+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3055285119 wait complete. 2023-10-08T13:21:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.449+0000 7eff76e5cb80 1 -- start start 2023-10-08T13:21:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.449+0000 7eff76e5cb80 1 Processor -- start 2023-10-08T13:21:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55614087c0b0 0x55614088c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561408821a0 0x55614088c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408e6a60 0x5561408e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614088cd80 con 0x5561408e6a60 2023-10-08T13:21:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561408e9390 con 0x5561408821a0 2023-10-08T13:21:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561408e9500 con 0x55614087c0b0 2023-10-08T13:21:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.450+0000 7eff76e5cb80 10 client.0 _ll_register_callbacks cb 0x7eff5c00cd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:21:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.457+0000 7eff69210700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408e6a60 0x5561408e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.457+0000 7eff69210700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408e6a60 0x5561408e8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39048/0 (socket says 172.21.15.5:39048) 2023-10-08T13:21:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.457+0000 7eff69210700 1 -- 172.21.15.5:0/3066664401 learned_addr learned my addr 172.21.15.5:0/3066664401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.457+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55614087c0b0 0x55614088c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.457+0000 7eff63fff700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561408821a0 0x55614088c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.467+0000 7eff68a0f700 1 -- 172.21.15.5:0/3066664401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561408821a0 msgr2=0x55614088c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.467+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561408821a0 0x55614088c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.467+0000 7eff68a0f700 1 -- 172.21.15.5:0/3066664401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408e6a60 msgr2=0x5561408e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:21:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.467+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408e6a60 0x5561408e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.467+0000 7eff68a0f700 1 -- 172.21.15.5:0/3066664401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6411cbf0 con 0x55614087c0b0 2023-10-08T13:21:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.468+0000 7eff68a0f700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55614087c0b0 0x55614088c130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7eff54009990 tx=0x7eff54024490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f61f017502d27ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.468+0000 7eff43fff700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-10-08T13:21:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.468+0000 7eff43fff700 1 -- 172.21.15.5:0/3066664401 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5401c070 con 0x55614087c0b0 2023-10-08T13:21:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.468+0000 7eff43fff700 1 -- 172.21.15.5:0/3066664401 <== mon.1 v2:172.21.15.118:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7eff5400b970 con 0x55614087c0b0 2023-10-08T13:21:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.469+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff5c011070 con 0x55614087c0b0 2023-10-08T13:21:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.469+0000 7eff43fff700 1 -- 172.21.15.5:0/3066664401 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff5400bb30 con 0x55614087c0b0 2023-10-08T13:21:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.469+0000 7eff76e5cb80 10 client.26893 fetch_fsmap learned FSMap version 54 2023-10-08T13:21:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.469+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5561405f8250 con 0x55614087c0b0 2023-10-08T13:21:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.469+0000 7eff43fff700 1 -- 172.21.15.5:0/3066664401 <== mon.1 v2:172.21.15.118:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff5c011070 con 0x55614087c0b0 2023-10-08T13:21:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff43fff700 1 -- 172.21.15.5:0/3066664401 <== mon.1 v2:172.21.15.118:3300/0 5 ==== fsmap(e 54) v1 ==== 7894+0+0 (secure 0 0 0) 0x7eff540054d0 con 0x55614087c0b0 2023-10-08T13:21:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff76e5cb80 10 client.26893 fetch_fsmap finished waiting for FSMap version 54 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff76e5cb80 10 client.26893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff76e5cb80 20 client.26893 populate_metadata read hostname 'smithi005' 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5561408ea800 0x5561408ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff76e5cb80 4 client.26893 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 --> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5561407c7ad0 con 0x5561408ea800 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.470+0000 7eff63fff700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5561408ea800 0x5561408ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.471+0000 7eff43fff700 10 client.26893 ms_handle_connect on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.471+0000 7eff63fff700 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5561408ea800 0x5561408ecbf0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61aa9d7a89e8e156 server_cookie=1362c715a66de240 in_seq=0 out_seq=0 2023-10-08T13:21:33.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:33 smithi118 ceph-mon[104234]: pgmap v784: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2023-10-08T13:21:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.527+0000 7eff43fff700 1 -- 172.21.15.5:0/3066664401 <== mds.0 v2:172.21.15.118:6838/3304365163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5561407c7ad0 con 0x5561408ea800 2023-10-08T13:21:33.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.527+0000 7eff43fff700 10 client.26893 handle_command_reply: tid=0 2023-10-08T13:21:33.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.527+0000 7eff76e5cb80 1 client.26893 shutdown 2023-10-08T13:21:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.540+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55614087c0b0 msgr2=0x55614088c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.540+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55614087c0b0 0x55614088c130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7eff54009990 tx=0x7eff54024490 comp rx=0 tx=0).stop 2023-10-08T13:21:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 shutdown_connections 2023-10-08T13:21:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561408e6a60 0x5561408e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55614087c0b0 0x55614088c130 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7eff54009990 tx=0x7eff54024490 comp rx=0 tx=0).stop 2023-10-08T13:21:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.118:6838/3304365163,v1:172.21.15.118:6839/3304365163] conn(0x5561408ea800 0x5561408ecbf0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff76e5cb80 1 --2- 172.21.15.5:0/3066664401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561408821a0 0x55614088c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 >> 172.21.15.5:0/3066664401 conn(0x5561407f0200 msgr2=0x556140886df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.541+0000 7eff43fff700 0 client.26893 ms_handle_reset on v2:172.21.15.118:6838/3304365163 2023-10-08T13:21:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.549+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 shutdown_connections 2023-10-08T13:21:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.553+0000 7eff76e5cb80 1 -- 172.21.15.5:0/3066664401 wait complete. 2023-10-08T13:21:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.563+0000 7eff76e5cb80 20 client.26893 trim_cache size 0 max 16384 2023-10-08T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2023-10-08T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2023-10-08T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2023-10-08T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2023-10-08T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.573+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff4c0a16b0 msgr2=0x7eff4c0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.573+0000 7eff6ac73700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff4c0a16b0 0x7eff4c0a3b70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00ab10 tx=0x7eff5c009230 comp rx=0 tx=0).stop 2023-10-08T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.573+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 msgr2=0x7eff641132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.573+0000 7eff6ac73700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff641132b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff5800b550 tx=0x7eff5800b910 comp rx=0 tx=0).stop 2023-10-08T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 shutdown_connections 2023-10-08T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7eff4c0a16b0 0x7eff4c0a3b70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64119c80 0x7eff641137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6410c960 0x7eff64119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 --2- 172.21.15.5:0/2965569047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff6410d280 0x7eff641132b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 >> 172.21.15.5:0/2965569047 conn(0x7eff6406b6b0 msgr2=0x7eff6411b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.574+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 shutdown_connections 2023-10-08T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2023-10-08T13:21:33.576+0000 7eff6ac73700 1 -- 172.21.15.5:0/2965569047 wait complete. 2023-10-08T13:21:33.664 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:33 smithi060 ceph-mon[103190]: pgmap v784: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2023-10-08T13:21:33.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:33 smithi005 ceph-mon[99496]: pgmap v784: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2023-10-08T13:21:35.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-08T13:21:35.443 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/: 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 .. 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 data 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data: 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:total 31 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 . 2023-10-08T13:21:35.444 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 .. 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 8 13:06 base 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Oct 8 13:06 current_logfiles 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Oct 8 13:06 global 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 log 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_commit_ts 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_dynshmem 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 8 13:06 pg_hba.conf 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 8 13:06 pg_ident.conf 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:21 pg_logical 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 pg_multixact 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 pg_notify 2023-10-08T13:21:35.445 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_replslot 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_serial 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_snapshots 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:21 pg_stat 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:21 pg_stat_tmp 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:21 pg_subtrans 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_tblspc 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pg_twophase 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 8 13:21 pg_wal 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 pg_xact 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 8 13:06 postgresql.auto.conf 2023-10-08T13:21:35.446 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 8 13:06 postgresql.conf 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Oct 8 13:06 postmaster.opts 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base: 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 8 13:06 . 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 1 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 12346 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Oct 8 13:06 12347 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 pgsql_tmp 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:total 7209 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 . 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 8 13:06 .. 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 112 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 113 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 13:06 12182 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12182_fsm 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12182_vm 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12184 2023-10-08T13:21:35.448 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12186 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12187_fsm 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187_vm 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12189 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12191 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12192_fsm 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192_vm 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12194 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12196 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197 2023-10-08T13:21:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12197_fsm 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197_vm 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12199 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12201 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12202_fsm 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202_vm 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12204 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12206 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12207_fsm 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207_vm 2023-10-08T13:21:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12209 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12211 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12212 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12214 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12216 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 13:06 1247 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1247_fsm 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1247_vm 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 13:06 1249 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1249_fsm 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1249_vm 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 13:06 1255 2023-10-08T13:21:35.451 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1255_fsm 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1255_vm 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 13:06 1259 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1259_fsm 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1259_vm 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417_vm 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418_vm 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 174 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 175 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2187 2023-10-08T13:21:35.452 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224_vm 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328_vm 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336_vm 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2337 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2600 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2600_fsm 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2600_vm 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2601_fsm 2023-10-08T13:21:35.453 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601_vm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2602 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2602_fsm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2602_vm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2603 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2603_fsm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2603_vm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604_vm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2605 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2605_fsm 2023-10-08T13:21:35.454 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2605_vm 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2606_fsm 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606_vm 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607_fsm 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2607_vm 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 13:06 2608 2023-10-08T13:21:35.455 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2608_fsm 2023-10-08T13:21:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2608_vm 2023-10-08T13:21:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 13:06 2609 2023-10-08T13:21:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2609_fsm 2023-10-08T13:21:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2609_vm 2023-10-08T13:21:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610 2023-10-08T13:21:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610_fsm 2023-10-08T13:21:35.457 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2610_vm 2023-10-08T13:21:35.457 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611 2023-10-08T13:21:35.457 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611_vm 2023-10-08T13:21:35.457 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612 2023-10-08T13:21:35.457 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2612_fsm 2023-10-08T13:21:35.457 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612_vm 2023-10-08T13:21:35.458 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613 2023-10-08T13:21:35.458 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613_vm 2023-10-08T13:21:35.458 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615 2023-10-08T13:21:35.458 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2615_fsm 2023-10-08T13:21:35.458 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615_vm 2023-10-08T13:21:35.459 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616 2023-10-08T13:21:35.459 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616_fsm 2023-10-08T13:21:35.459 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2616_vm 2023-10-08T13:21:35.459 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 13:06 2617 2023-10-08T13:21:35.459 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2617_fsm 2023-10-08T13:21:35.459 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2617_vm 2023-10-08T13:21:35.460 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 13:06 2618 2023-10-08T13:21:35.460 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2618_fsm 2023-10-08T13:21:35.460 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2618_vm 2023-10-08T13:21:35.460 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 13:06 2619 2023-10-08T13:21:35.460 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2619_fsm 2023-10-08T13:21:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2619_vm 2023-10-08T13:21:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620 2023-10-08T13:21:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620_vm 2023-10-08T13:21:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2650 2023-10-08T13:21:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2651 2023-10-08T13:21:35.461 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2652 2023-10-08T13:21:35.462 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2653 2023-10-08T13:21:35.462 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2654 2023-10-08T13:21:35.462 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2655 2023-10-08T13:21:35.462 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2656 2023-10-08T13:21:35.462 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2657 2023-10-08T13:21:35.463 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 13:06 2658 2023-10-08T13:21:35.463 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2659 2023-10-08T13:21:35.463 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2660 2023-10-08T13:21:35.463 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2661 2023-10-08T13:21:35.463 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2662 2023-10-08T13:21:35.463 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2663 2023-10-08T13:21:35.464 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2664 2023-10-08T13:21:35.464 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2665 2023-10-08T13:21:35.464 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2666 2023-10-08T13:21:35.464 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2667 2023-10-08T13:21:35.464 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2668 2023-10-08T13:21:35.465 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2669 2023-10-08T13:21:35.465 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2670 2023-10-08T13:21:35.465 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Oct 8 13:06 2673 2023-10-08T13:21:35.465 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Oct 8 13:06 2674 2023-10-08T13:21:35.465 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:06 2675 2023-10-08T13:21:35.465 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2678 2023-10-08T13:21:35.466 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2679 2023-10-08T13:21:35.466 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2680 2023-10-08T13:21:35.466 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2681 2023-10-08T13:21:35.466 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2682 2023-10-08T13:21:35.466 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2683 2023-10-08T13:21:35.467 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2684 2023-10-08T13:21:35.467 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2685 2023-10-08T13:21:35.467 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2686 2023-10-08T13:21:35.467 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2687 2023-10-08T13:21:35.467 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2688 2023-10-08T13:21:35.467 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2689 2023-10-08T13:21:35.468 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2690 2023-10-08T13:21:35.468 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 13:06 2691 2023-10-08T13:21:35.468 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2692 2023-10-08T13:21:35.468 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2693 2023-10-08T13:21:35.468 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2696 2023-10-08T13:21:35.469 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2699 2023-10-08T13:21:35.469 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2701 2023-10-08T13:21:35.469 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2702 2023-10-08T13:21:35.469 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2703 2023-10-08T13:21:35.469 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2704 2023-10-08T13:21:35.469 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2753 2023-10-08T13:21:35.470 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2753_fsm 2023-10-08T13:21:35.470 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2753_vm 2023-10-08T13:21:35.470 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2754 2023-10-08T13:21:35.470 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2755 2023-10-08T13:21:35.470 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2756 2023-10-08T13:21:35.471 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2757 2023-10-08T13:21:35.471 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830 2023-10-08T13:21:35.471 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830_vm 2023-10-08T13:21:35.471 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2831 2023-10-08T13:21:35.471 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832 2023-10-08T13:21:35.472 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832_vm 2023-10-08T13:21:35.472 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2833 2023-10-08T13:21:35.472 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834 2023-10-08T13:21:35.472 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834_vm 2023-10-08T13:21:35.472 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2835 2023-10-08T13:21:35.472 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836 2023-10-08T13:21:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836_vm 2023-10-08T13:21:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2837 2023-10-08T13:21:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 13:06 2838 2023-10-08T13:21:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2838_fsm 2023-10-08T13:21:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2838_vm 2023-10-08T13:21:35.474 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2839 2023-10-08T13:21:35.474 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840 2023-10-08T13:21:35.474 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840_fsm 2023-10-08T13:21:35.474 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2840_vm 2023-10-08T13:21:35.474 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2841 2023-10-08T13:21:35.475 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995 2023-10-08T13:21:35.475 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995_vm 2023-10-08T13:21:35.475 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2996 2023-10-08T13:21:35.475 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079 2023-10-08T13:21:35.475 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3079_fsm 2023-10-08T13:21:35.475 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079_vm 2023-10-08T13:21:35.476 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3080 2023-10-08T13:21:35.476 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3081 2023-10-08T13:21:35.476 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3085 2023-10-08T13:21:35.476 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118 2023-10-08T13:21:35.476 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118_vm 2023-10-08T13:21:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3119 2023-10-08T13:21:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3164 2023-10-08T13:21:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256 2023-10-08T13:21:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256_vm 2023-10-08T13:21:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3257 2023-10-08T13:21:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3258 2023-10-08T13:21:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350 2023-10-08T13:21:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350_vm 2023-10-08T13:21:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3351 2023-10-08T13:21:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3379 2023-10-08T13:21:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3380 2023-10-08T13:21:35.479 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381 2023-10-08T13:21:35.479 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381_vm 2023-10-08T13:21:35.479 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3394 2023-10-08T13:21:35.479 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3394_fsm 2023-10-08T13:21:35.479 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3394_vm 2023-10-08T13:21:35.479 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3395 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439_vm 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3440 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 3455 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3456 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3456_fsm 2023-10-08T13:21:35.480 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3456_vm 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466_vm 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3467 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3468 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501_vm 2023-10-08T13:21:35.481 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3502 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3503 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3534 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3541_fsm 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541_vm 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3542 2023-10-08T13:21:35.482 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3574 2023-10-08T13:21:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3575 2023-10-08T13:21:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576 2023-10-08T13:21:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576_vm 2023-10-08T13:21:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596 2023-10-08T13:21:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596_vm 2023-10-08T13:21:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3597 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598_vm 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3599 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3600_fsm 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600_vm 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3601_fsm 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601_vm 2023-10-08T13:21:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602 2023-10-08T13:21:35.485 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3602_fsm 2023-10-08T13:21:35.485 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602_vm 2023-10-08T13:21:35.485 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3603 2023-10-08T13:21:35.485 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3603_fsm 2023-10-08T13:21:35.485 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3603_vm 2023-10-08T13:21:35.502 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3604 2023-10-08T13:21:35.502 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3605 2023-10-08T13:21:35.503 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3606 2023-10-08T13:21:35.503 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3607 2023-10-08T13:21:35.503 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3608 2023-10-08T13:21:35.503 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 3609 2023-10-08T13:21:35.503 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3712 2023-10-08T13:21:35.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764 2023-10-08T13:21:35.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3764_fsm 2023-10-08T13:21:35.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764_vm 2023-10-08T13:21:35.504 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3766 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3767 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3997 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 5002 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 548 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 549 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102 2023-10-08T13:21:35.505 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102_vm 2023-10-08T13:21:35.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104 2023-10-08T13:21:35.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104_vm 2023-10-08T13:21:35.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106 2023-10-08T13:21:35.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106_vm 2023-10-08T13:21:35.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6110 2023-10-08T13:21:35.506 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6111 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6112 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6113 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6117 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826_vm 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 827 2023-10-08T13:21:35.507 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 828 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout:total 7209 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 8 13:06 . 2023-10-08T13:21:35.508 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 8 13:06 .. 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 112 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 113 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 13:06 12182 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12182_fsm 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12182_vm 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12184 2023-10-08T13:21:35.509 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12186 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12187_fsm 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187_vm 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12189 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12191 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192 2023-10-08T13:21:35.510 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12192_fsm 2023-10-08T13:21:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192_vm 2023-10-08T13:21:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12194 2023-10-08T13:21:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12196 2023-10-08T13:21:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197 2023-10-08T13:21:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12197_fsm 2023-10-08T13:21:35.511 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197_vm 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12199 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12201 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12202_fsm 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202_vm 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12204 2023-10-08T13:21:35.512 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12206 2023-10-08T13:21:35.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207 2023-10-08T13:21:35.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12207_fsm 2023-10-08T13:21:35.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207_vm 2023-10-08T13:21:35.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12209 2023-10-08T13:21:35.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12211 2023-10-08T13:21:35.513 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12212 2023-10-08T13:21:35.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12214 2023-10-08T13:21:35.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12216 2023-10-08T13:21:35.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 13:06 1247 2023-10-08T13:21:35.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1247_fsm 2023-10-08T13:21:35.514 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1247_vm 2023-10-08T13:21:35.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 13:06 1249 2023-10-08T13:21:35.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1249_fsm 2023-10-08T13:21:35.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1249_vm 2023-10-08T13:21:35.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 13:06 1255 2023-10-08T13:21:35.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1255_fsm 2023-10-08T13:21:35.515 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1255_vm 2023-10-08T13:21:35.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 13:06 1259 2023-10-08T13:21:35.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1259_fsm 2023-10-08T13:21:35.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1259_vm 2023-10-08T13:21:35.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417 2023-10-08T13:21:35.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417_vm 2023-10-08T13:21:35.516 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418 2023-10-08T13:21:35.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418_vm 2023-10-08T13:21:35.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 174 2023-10-08T13:21:35.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 175 2023-10-08T13:21:35.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2187 2023-10-08T13:21:35.517 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224 2023-10-08T13:21:35.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224_vm 2023-10-08T13:21:35.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328 2023-10-08T13:21:35.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328_vm 2023-10-08T13:21:35.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336 2023-10-08T13:21:35.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336_vm 2023-10-08T13:21:35.518 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2337 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2600 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2600_fsm 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2600_vm 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2601_fsm 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601_vm 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2602 2023-10-08T13:21:35.519 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2602_fsm 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2602_vm 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2603 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2603_fsm 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2603_vm 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604_vm 2023-10-08T13:21:35.520 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2605 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2605_fsm 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2605_vm 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2606_fsm 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606_vm 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607_fsm 2023-10-08T13:21:35.521 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2607_vm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 13:06 2608 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2608_fsm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2608_vm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 13:06 2609 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2609_fsm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2609_vm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610_fsm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2610_vm 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611 2023-10-08T13:21:35.522 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611_vm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2612_fsm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612_vm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613_vm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2615_fsm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615_vm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616_fsm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2616_vm 2023-10-08T13:21:35.523 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 13:06 2617 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2617_fsm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2617_vm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 13:06 2618 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2618_fsm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2618_vm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 13:06 2619 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2619_fsm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2619_vm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620_vm 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2650 2023-10-08T13:21:35.524 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2651 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2652 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2653 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2654 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2655 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2656 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2657 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 13:06 2658 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2659 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2660 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2661 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2662 2023-10-08T13:21:35.525 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2663 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2664 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2665 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2666 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2667 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2668 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2669 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2670 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Oct 8 13:06 2673 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Oct 8 13:06 2674 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:06 2675 2023-10-08T13:21:35.526 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2678 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2679 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2680 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2681 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2682 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2683 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2684 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2685 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2686 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2687 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2688 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2689 2023-10-08T13:21:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2690 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 13:06 2691 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2692 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2693 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2696 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2699 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2701 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2702 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2703 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2704 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2753 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2753_fsm 2023-10-08T13:21:35.528 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2753_vm 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2754 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2755 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2756 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2757 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830_vm 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2831 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832_vm 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2833 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834 2023-10-08T13:21:35.529 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834_vm 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2835 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836_vm 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2837 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 13:06 2838 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2838_fsm 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2838_vm 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2839 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840_fsm 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2840_vm 2023-10-08T13:21:35.530 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2841 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995_vm 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2996 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3079_fsm 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079_vm 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3080 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3081 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3085 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118_vm 2023-10-08T13:21:35.531 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3119 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3164 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256_vm 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3257 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3258 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350_vm 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3351 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3379 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3380 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381 2023-10-08T13:21:35.532 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381_vm 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3394 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3394_fsm 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3394_vm 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3395 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439_vm 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3440 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 3455 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3456 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3456_fsm 2023-10-08T13:21:35.533 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3456_vm 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466_vm 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3467 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3468 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501_vm 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3502 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3503 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3534 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3541_fsm 2023-10-08T13:21:35.534 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541_vm 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3542 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3574 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3575 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576_vm 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596_vm 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3597 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598_vm 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3599 2023-10-08T13:21:35.535 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3600_fsm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600_vm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3601_fsm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601_vm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3602_fsm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602_vm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3603 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3603_fsm 2023-10-08T13:21:35.536 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3603_vm 2023-10-08T13:21:35.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3604 2023-10-08T13:21:35.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3605 2023-10-08T13:21:35.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3606 2023-10-08T13:21:35.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3607 2023-10-08T13:21:35.537 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3608 2023-10-08T13:21:35.538 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:35 smithi118 ceph-mon[104234]: pgmap v785: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 6.4 MiB/s wr, 668 op/s 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 3609 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3712 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3764_fsm 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764_vm 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3766 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3767 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3997 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 5002 2023-10-08T13:21:35.539 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 548 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 549 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102_vm 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104_vm 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106_vm 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6110 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6111 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6112 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6113 2023-10-08T13:21:35.540 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6117 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826_vm 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 827 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 828 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:total 555480 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Oct 8 13:06 . 2023-10-08T13:21:35.541 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 8 13:06 .. 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 112 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 113 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 13:06 12182 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12182_fsm 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12182_vm 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12184 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12186 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12187_fsm 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12187_vm 2023-10-08T13:21:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12189 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12191 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12192_fsm 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12192_vm 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12194 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12196 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12197_fsm 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12197_vm 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12199 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12201 2023-10-08T13:21:35.543 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12202_fsm 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12202_vm 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12204 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12206 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 12207_fsm 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12207_vm 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12209 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12211 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12212 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 12214 2023-10-08T13:21:35.544 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 12216 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 13:06 1247 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1247_fsm 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1247_vm 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 13:06 1249 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1249_fsm 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1249_vm 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 13:06 1255 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1255_fsm 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1255_vm 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 13:21 1259 2023-10-08T13:21:35.545 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1259_fsm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1259_vm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1417_vm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 1418_vm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3751936 Oct 8 13:21 16387 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:21 16387_fsm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:21 16387_vm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3055616 Oct 8 13:21 16393 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:21 16393_fsm 2023-10-08T13:21:35.546 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:21 16393_vm 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 443269120 Oct 8 13:21 16396 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 13:17 16396_fsm 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:18 16396_vm 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:21 16397 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Oct 8 13:21 16399 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Oct 8 13:21 16401 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 38756352 Oct 8 13:21 16403 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:21 16403_fsm 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 174 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 175 2023-10-08T13:21:35.547 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2187 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2224_vm 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2328_vm 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2336_vm 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2337 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2600 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2600_fsm 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2600_vm 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601 2023-10-08T13:21:35.548 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2601_fsm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2601_vm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2602 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2602_fsm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2602_vm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2603 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2603_fsm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2603_vm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2604_vm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2605 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2605_fsm 2023-10-08T13:21:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2605_vm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2606_fsm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2606_vm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2607_fsm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2607_vm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Oct 8 13:06 2608 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2608_fsm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2608_vm 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 13:06 2609 2023-10-08T13:21:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2609_fsm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2609_vm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2610 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2610_fsm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2610_vm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2611_vm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2612_fsm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2612_vm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2613_vm 2023-10-08T13:21:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2615_fsm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2615_vm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2616_fsm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2616_vm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 13:06 2617 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2617_fsm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2617_vm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 13:06 2618 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2618_fsm 2023-10-08T13:21:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2618_vm 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Oct 8 13:21 2619 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:14 2619_fsm 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2619_vm 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2620_vm 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2650 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2651 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2652 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2653 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2654 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2655 2023-10-08T13:21:35.553 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2656 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2657 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Oct 8 13:06 2658 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2659 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2660 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2661 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2662 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2663 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2664 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2665 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2666 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2667 2023-10-08T13:21:35.554 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2668 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2669 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2670 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 Oct 8 13:06 2673 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Oct 8 13:06 2674 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:06 2675 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2678 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2679 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2680 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2681 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2682 2023-10-08T13:21:35.555 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2683 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2684 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2685 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2686 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2687 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2688 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 13:06 2689 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 13:06 2690 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 13:06 2691 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2692 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2693 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:20 2696 2023-10-08T13:21:35.556 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2699 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2701 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2702 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2703 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 2704 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2753 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2753_fsm 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2753_vm 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2754 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2755 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2756 2023-10-08T13:21:35.557 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 2757 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2830_vm 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2831 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2832_vm 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2833 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2834_vm 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2835 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836 2023-10-08T13:21:35.558 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2836_vm 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2837 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 13:06 2838 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2838_fsm 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2838_vm 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2839 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2840_fsm 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2840_vm 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2841 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2995_vm 2023-10-08T13:21:35.559 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2996 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3079_fsm 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3079_vm 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3080 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3081 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3085 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3118_vm 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3119 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3164 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256 2023-10-08T13:21:35.560 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3256_vm 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3257 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3258 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3350_vm 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3351 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3379 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3380 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3381_vm 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3394 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3394_fsm 2023-10-08T13:21:35.561 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3394_vm 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3395 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3439_vm 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3440 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 13:06 3455 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3456 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3456_fsm 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3456_vm 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3466_vm 2023-10-08T13:21:35.562 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3467 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3468 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3501_vm 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3502 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3503 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3534 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3541_fsm 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3541_vm 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3542 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3574 2023-10-08T13:21:35.563 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3575 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3576_vm 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3596_vm 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3597 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3598_vm 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3599 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3600_fsm 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3600_vm 2023-10-08T13:21:35.564 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3601_fsm 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3601_vm 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3602_fsm 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3602_vm 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3603 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3603_fsm 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3603_vm 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3604 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3605 2023-10-08T13:21:35.565 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3606 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3607 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3608 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 13:06 3609 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3712 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 3764_fsm 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3764_vm 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3766 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 3767 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3997 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 5002 2023-10-08T13:21:35.566 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 548 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 549 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6102_vm 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6104_vm 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6106_vm 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6110 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6111 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6112 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6113 2023-10-08T13:21:35.567 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6117 2023-10-08T13:21:35.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826 2023-10-08T13:21:35.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 826_vm 2023-10-08T13:21:35.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 827 2023-10-08T13:21:35.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 828 2023-10-08T13:21:35.568 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Oct 8 13:06 pg_internal.init 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:06 PG_VERSION 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 8 13:06 .. 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/global: 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:total 574 2023-10-08T13:21:35.569 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Oct 8 13:06 . 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1136 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1136_fsm 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1136_vm 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 1137 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1213 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1213_fsm 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1213_vm 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1214 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1214_fsm 2023-10-08T13:21:35.570 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1214_vm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 1232 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 1233 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1260 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1260_fsm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1260_vm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1261 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1261_fsm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1261_vm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1262 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 1262_fsm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 1262_vm 2023-10-08T13:21:35.571 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2396 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 13:06 2396_fsm 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2396_vm 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2397 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2671 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2672 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2676 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2677 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2694 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2695 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2697 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 13:06 2698 2023-10-08T13:21:35.572 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2846 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2846_vm 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2847 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2964 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2964_vm 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2965 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2966 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 2966_vm 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 2967 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3592 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 3592_vm 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 3593 2023-10-08T13:21:35.573 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 4060 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 4060_vm 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 4061 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6000 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6000_vm 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6001 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6002 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6100 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 6100_vm 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6114 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 6115 2023-10-08T13:21:35.574 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:21 pg_control 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 13:06 pg_filenode.map 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Oct 8 13:06 pg_internal.init 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/log: 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:total 1 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 943 Oct 8 13:21 postgresql-Sun.log 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.575 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:total 1 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:21 . 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 mappings 2023-10-08T13:21:35.576 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 13:21 replorigin_checkpoint 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 snapshots 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:21 .. 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.577 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.579 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:21 .. 2023-10-08T13:21:35.579 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.579 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-08T13:21:35.579 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.579 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 . 2023-10-08T13:21:35.579 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 members 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 offsets 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 .. 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-08T13:21:35.580 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 8 13:06 .. 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:total 8 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 13:06 0000 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-08T13:21:35.581 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.582 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:total 13 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 13:21 . 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Oct 8 13:21 db_0.stat 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Oct 8 13:21 db_12347.stat 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Oct 8 13:21 global.stat 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-08T13:21:35.583 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:21 . 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:total 248 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:21 . 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Oct 8 13:21 000A 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-08T13:21:35.584 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:total 1032192 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 8 13:21 . 2023-10-08T13:21:35.585 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:21 0000000100000000000000E2 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:21 0000000100000000000000E3 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:21 0000000100000000000000E4 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:21 0000000100000000000000E5 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:21 0000000100000000000000E6 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:21 0000000100000000000000E7 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:12 0000000100000000000000E8 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:11 0000000100000000000000E9 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:11 0000000100000000000000EA 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:12 0000000100000000000000EB 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:11 0000000100000000000000EC 2023-10-08T13:21:35.586 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:13 0000000100000000000000ED 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:12 0000000100000000000000EE 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:16 0000000100000000000000EF 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000F0 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 0000000100000000000000F1 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000F2 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000F3 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 0000000100000000000000F4 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000F5 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 0000000100000000000000F6 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000F7 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000F8 2023-10-08T13:21:35.587 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 0000000100000000000000F9 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000FA 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000FB 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 0000000100000000000000FC 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 0000000100000000000000FD 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:16 0000000100000000000000FE 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 0000000100000000000000FF 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:16 000000010000000100000000 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 000000010000000100000001 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 000000010000000100000002 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:16 000000010000000100000003 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 000000010000000100000004 2023-10-08T13:21:35.588 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 000000010000000100000005 2023-10-08T13:21:35.589 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:15 000000010000000100000006 2023-10-08T13:21:35.589 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:14 000000010000000100000007 2023-10-08T13:21:35.589 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:19 000000010000000100000008 2023-10-08T13:21:35.589 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 000000010000000100000009 2023-10-08T13:21:35.589 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:20 00000001000000010000000A 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 00000001000000010000000B 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:19 00000001000000010000000C 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 00000001000000010000000D 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:19 00000001000000010000000E 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:19 00000001000000010000000F 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 000000010000000100000010 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 000000010000000100000011 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 000000010000000100000012 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:20 000000010000000100000013 2023-10-08T13:21:35.590 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 000000010000000100000014 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 000000010000000100000015 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 000000010000000100000016 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 000000010000000100000017 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 000000010000000100000018 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:20 000000010000000100000019 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 00000001000000010000001A 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:20 00000001000000010000001B 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 00000001000000010000001C 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:17 00000001000000010000001D 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 00000001000000010000001E 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:19 00000001000000010000001F 2023-10-08T13:21:35.591 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 13:18 000000010000000100000020 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 archive_status 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:total 0 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 13:06 . 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 8 13:21 .. 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:total 176 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 8 13:06 . 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 8 13:21 .. 2023-10-08T13:21:35.592 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 13:21 0000 2023-10-08T13:21:35.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:35 smithi005 ceph-mon[99496]: pgmap v785: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 6.4 MiB/s wr, 668 op/s 2023-10-08T13:21:35.594 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-08T13:21:35.612 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:21:35.620 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-08T13:21:35.630 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-08T13:21:35.630 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T13:21:35.630 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:21:35.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-08T13:21:35.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:35 smithi060 ceph-mon[103190]: pgmap v785: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 6.4 MiB/s wr, 668 op/s 2023-10-08T13:21:35.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-08T13:21:35.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 -- 172.21.15.5:0/954313295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61680ff570 msgr2=0x7f61680ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 --2- 172.21.15.5:0/954313295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61680ff570 0x7f61680ff9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61580098f0 tx=0x7f6158009c00 comp rx=0 tx=0).stop 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 -- 172.21.15.5:0/954313295 shutdown_connections 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 --2- 172.21.15.5:0/954313295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 --2- 172.21.15.5:0/954313295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6168105630 0x7f6168105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 --2- 172.21.15.5:0/954313295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61680ff570 0x7f61680ff9f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 -- 172.21.15.5:0/954313295 >> 172.21.15.5:0/954313295 conn(0x7f61680fb080 msgr2=0x7f61680fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 -- 172.21.15.5:0/954313295 shutdown_connections 2023-10-08T13:21:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.911+0000 7f616e0a9700 1 -- 172.21.15.5:0/954313295 wait complete. 2023-10-08T13:21:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 Processor -- start 2023-10-08T13:21:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 -- start start 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61680ff570 0x7f616819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6168105630 0x7f6168195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168195e80 con 0x7f61680fff30 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168195ff0 con 0x7f61680ff570 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.912+0000 7f616e0a9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681961b0 con 0x7f6168105630 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616819bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39064/0 (socket says 172.21.15.5:39064) 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 -- 172.21.15.5:0/402493356 learned_addr learned my addr 172.21.15.5:0/402493356 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f61677fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61680ff570 0x7f616819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6167fff700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6168105630 0x7f6168195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 -- 172.21.15.5:0/402493356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6168105630 msgr2=0x7f6168195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6168105630 0x7f6168195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 -- 172.21.15.5:0/402493356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61680ff570 msgr2=0x7f616819b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61680ff570 0x7f616819b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 -- 172.21.15.5:0/402493356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009c40 con 0x7f61680fff30 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6166ffd700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616819bc20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f615800fa00 tx=0x7f615800fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615801c070 con 0x7f61680fff30 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f615800bba0 con 0x7f61680fff30 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61500095f0 con 0x7f61680fff30 2023-10-08T13:21:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004930 con 0x7f61680fff30 2023-10-08T13:21:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.913+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6158009520 con 0x7f61680fff30 2023-10-08T13:21:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.914+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6168100c90 con 0x7f61680fff30 2023-10-08T13:21:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.916+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6158020070 con 0x7f61680fff30 2023-10-08T13:21:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.916+0000 7f6164ff9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f61540a15e0 0x7f61540a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.917+0000 7f61677fe700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f61540a15e0 0x7f61540a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.917+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f61580ce6a0 con 0x7f61680fff30 2023-10-08T13:21:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.917+0000 7f61677fe700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f61540a15e0 0x7f61540a3aa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:35.921+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f61580976c0 con 0x7f61680fff30 2023-10-08T13:21:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.151+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f616810f490 con 0x7f61540a15e0 2023-10-08T13:21:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.159+0000 7f6164ff9700 1 -- 172.21.15.5:0/402493356 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f616810f490 con 0x7f61540a15e0 2023-10-08T13:21:36.161 INFO:teuthology.orchestra.run.smithi005.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T13:06:05", "first": "2023-10-08T13:07:01", "last": "2023-10-08T13:21:00", "last_pruned": "2023-10-08T13:21:00", "created_count": 15, "pruned_count": 9, "active": true} 2023-10-08T13:21:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f61540a15e0 msgr2=0x7f61540a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f61540a15e0 0x7f61540a3aa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150009310 comp rx=0 tx=0).stop 2023-10-08T13:21:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 msgr2=0x7f616819bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616819bc20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f615800fa00 tx=0x7f615800fa30 comp rx=0 tx=0).stop 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 shutdown_connections 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f61540a15e0 0x7f61540a3aa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6168105630 0x7f6168195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61680ff570 0x7f616819b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 --2- 172.21.15.5:0/402493356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61680fff30 0x7f616819bc20 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 >> 172.21.15.5:0/402493356 conn(0x7f61680fb080 msgr2=0x7f61680fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 shutdown_connections 2023-10-08T13:21:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.161+0000 7f616e0a9700 1 -- 172.21.15.5:0/402493356 wait complete. 2023-10-08T13:21:36.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 -- 172.21.15.5:0/2609800870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 msgr2=0x7f31c00ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/2609800870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c00ff9f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f31b00099c0 tx=0x7f31b0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 -- 172.21.15.5:0/2609800870 shutdown_connections 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/2609800870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 0x7f31c010c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/2609800870 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c0105630 0x7f31c0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/2609800870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c00ff9f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.303+0000 7f31c7d2c700 1 -- 172.21.15.5:0/2609800870 >> 172.21.15.5:0/2609800870 conn(0x7f31c00fb080 msgr2=0x7f31c00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 -- 172.21.15.5:0/2609800870 shutdown_connections 2023-10-08T13:21:36.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 -- 172.21.15.5:0/2609800870 wait complete. 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 Processor -- start 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 -- start start 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 0x7f31c0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c0105630 0x7f31c01a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01986c0 con 0x7f31c00ff570 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01a2ed0 con 0x7f31c00fff30 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c7d2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01a3010 con 0x7f31c0105630 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.304+0000 7f31c5ac8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c0197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39076/0 (socket says 172.21.15.5:39076) 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 -- 172.21.15.5:0/1948085920 learned_addr learned my addr 172.21.15.5:0/1948085920 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:36.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c62c9700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c0105630 0x7f31c01a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c52c7700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 0x7f31c0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 -- 172.21.15.5:0/1948085920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c0105630 msgr2=0x7f31c01a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c0105630 0x7f31c01a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 -- 172.21.15.5:0/1948085920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 msgr2=0x7f31c0197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 0x7f31c0197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 -- 172.21.15.5:0/1948085920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00095f0 con 0x7f31c00ff570 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c52c7700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 0x7f31c0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c5ac8700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c0197910 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e9a0 tx=0x7f31bc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009790 con 0x7f31c00ff570 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c01a32a0 con 0x7f31c00ff570 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31bc010430 con 0x7f31c00ff570 2023-10-08T13:21:36.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc018680 con 0x7f31c00ff570 2023-10-08T13:21:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.305+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c01a37d0 con 0x7f31c00ff570 2023-10-08T13:21:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.306+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0107ad0 con 0x7f31c00ff570 2023-10-08T13:21:36.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.307+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f31bc0105a0 con 0x7f31c00ff570 2023-10-08T13:21:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.308+0000 7f31b6ffd700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f31ac0a15e0 0x7f31ac0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.308+0000 7f31c52c7700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f31ac0a15e0 0x7f31ac0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.308+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f31bc014070 con 0x7f31c00ff570 2023-10-08T13:21:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.308+0000 7f31c52c7700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f31ac0a15e0 0x7f31ac0a3aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009fd0 tx=0x7f31b0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.312+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f31bc052100 con 0x7f31c00ff570 2023-10-08T13:21:36.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.544+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 --> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f31c00681f0 con 0x7f31ac0a15e0 2023-10-08T13:21:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.551+0000 7f31b6ffd700 1 -- 172.21.15.5:0/1948085920 <== mgr.14217 v2:172.21.15.5:6800/706171785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f31c00681f0 con 0x7f31ac0a15e0 2023-10-08T13:21:36.553 INFO:teuthology.orchestra.run.smithi005.stdout:/ 1m 6m3h 2023-10-08T13:21:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f31ac0a15e0 msgr2=0x7f31ac0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f31ac0a15e0 0x7f31ac0a3aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009fd0 tx=0x7f31b0005fb0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 msgr2=0x7f31c0197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c0197910 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00e9a0 tx=0x7f31bc00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 shutdown_connections 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f31ac0a15e0 0x7f31ac0a3aa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31c0105630 0x7f31c01a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c00ff570 0x7f31c0197910 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 --2- 172.21.15.5:0/1948085920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c00fff30 0x7f31c0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 >> 172.21.15.5:0/1948085920 conn(0x7f31c00fb080 msgr2=0x7f31c00fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 shutdown_connections 2023-10-08T13:21:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.554+0000 7f31c7d2c700 1 -- 172.21.15.5:0/1948085920 wait complete. 2023-10-08T13:21:36.567 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-08T13:21:36.578 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-08T13:21:36.579 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T13:21:36.580 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-08T13:21:36.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 -- 172.21.15.5:0/3016633284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 msgr2=0x7f77d80ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 --2- 172.21.15.5:0/3016633284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d80ff9d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f77c80099c0 tx=0x7f77c8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 -- 172.21.15.5:0/3016633284 shutdown_connections 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 --2- 172.21.15.5:0/3016633284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d80fff10 0x7f77d810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 --2- 172.21.15.5:0/3016633284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77d8105610 0x7f77d81059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 --2- 172.21.15.5:0/3016633284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d80ff9d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 -- 172.21.15.5:0/3016633284 >> 172.21.15.5:0/3016633284 conn(0x7f77d80fb040 msgr2=0x7f77d80fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 -- 172.21.15.5:0/3016633284 shutdown_connections 2023-10-08T13:21:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.719+0000 7f77df2cb700 1 -- 172.21.15.5:0/3016633284 wait complete. 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 Processor -- start 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 -- start start 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77d80fff10 0x7f77d819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d8105610 0x7f77d8195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8195df0 con 0x7f77d80ff550 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8195f60 con 0x7f77d80fff10 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77df2cb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8196120 con 0x7f77d8105610 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77dd067700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77dd067700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d819b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39090/0 (socket says 172.21.15.5:39090) 2023-10-08T13:21:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.720+0000 7f77dd067700 1 -- 172.21.15.5:0/4128766378 learned_addr learned my addr 172.21.15.5:0/4128766378 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dc866700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77d80fff10 0x7f77d819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd868700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d8105610 0x7f77d8195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd067700 1 -- 172.21.15.5:0/4128766378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d8105610 msgr2=0x7f77d8195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd067700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d8105610 0x7f77d8195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd067700 1 -- 172.21.15.5:0/4128766378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77d80fff10 msgr2=0x7f77d819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd067700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77d80fff10 0x7f77d819bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd067700 1 -- 172.21.15.5:0/4128766378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4009520 con 0x7f77d80ff550 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77dd067700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d819b610 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f77d400eb30 tx=0x7f77d400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4009880 con 0x7f77d80ff550 2023-10-08T13:21:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77d40044e0 con 0x7f77d80ff550 2023-10-08T13:21:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80095f0 con 0x7f77d80ff550 2023-10-08T13:21:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4003d80 con 0x7f77d80ff550 2023-10-08T13:21:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.721+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d80679a0 con 0x7f77d80ff550 2023-10-08T13:21:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.722+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d8100c70 con 0x7f77d80ff550 2023-10-08T13:21:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.723+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f77d4003f00 con 0x7f77d80ff550 2023-10-08T13:21:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.724+0000 7f77ce7fc700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c40a1670 0x7f77c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.724+0000 7f77dc866700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c40a1670 0x7f77c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.724+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f77d4014070 con 0x7f77d80ff550 2023-10-08T13:21:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.724+0000 7f77dc866700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c40a1670 0x7f77c40a3b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009fd0 tx=0x7f77c8019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.727+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f77d4096a30 con 0x7f77d80ff550 2023-10-08T13:21:36.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.939+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77d8067550 con 0x7f77d80ff550 2023-10-08T13:21:36.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.941+0000 7f77ce7fc700 1 -- 172.21.15.5:0/4128766378 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+25071 (secure 0 0 0) 0x7f77d400fe60 con 0x7f77d80ff550 2023-10-08T13:21:36.943 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":109,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:21:21.018783+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:21:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c40a1670 msgr2=0x7f77c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c40a1670 0x7f77c40a3b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009fd0 tx=0x7f77c8019040 comp rx=0 tx=0).stop 2023-10-08T13:21:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 msgr2=0x7f77d819b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d819b610 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f77d400eb30 tx=0x7f77d400ee40 comp rx=0 tx=0).stop 2023-10-08T13:21:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 shutdown_connections 2023-10-08T13:21:36.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f77c40a1670 0x7f77c40a3b30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77d8105610 0x7f77d8195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d80ff550 0x7f77d819b610 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 --2- 172.21.15.5:0/4128766378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77d80fff10 0x7f77d819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 >> 172.21.15.5:0/4128766378 conn(0x7f77d80fb040 msgr2=0x7f77d80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 shutdown_connections 2023-10-08T13:21:36.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:36.943+0000 7f77df2cb700 1 -- 172.21.15.5:0/4128766378 wait complete. 2023-10-08T13:21:36.958 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 108, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 108, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:21:36.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:21:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 -- 172.21.15.5:0/1196435620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac106690 msgr2=0x7fb3ac106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 --2- 172.21.15.5:0/1196435620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac106690 0x7fb3ac106a70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009990 tx=0x7fb3a8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 -- 172.21.15.5:0/1196435620 shutdown_connections 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 --2- 172.21.15.5:0/1196435620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 --2- 172.21.15.5:0/1196435620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac106690 0x7fb3ac106a70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 --2- 172.21.15.5:0/1196435620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3ac1005f0 0x7fb3ac100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 -- 172.21.15.5:0/1196435620 >> 172.21.15.5:0/1196435620 conn(0x7fb3ac0fc120 msgr2=0x7fb3ac0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 -- 172.21.15.5:0/1196435620 shutdown_connections 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.089+0000 7fb3b410b700 1 -- 172.21.15.5:0/1196435620 wait complete. 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 Processor -- start 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 -- start start 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac1005f0 0x7fb3ac19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3ac106690 0x7fb3ac198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac199080 con 0x7fb3ac100fb0 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1991f0 con 0x7fb3ac1005f0 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b410b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac1993b0 con 0x7fb3ac106690 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b16a6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b1ea7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac1005f0 0x7fb3ac19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b16a6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39106/0 (socket says 172.21.15.5:39106) 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b26a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3ac106690 0x7fb3ac198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.090+0000 7fb3b16a6700 1 -- 172.21.15.5:0/3488595128 learned_addr learned my addr 172.21.15.5:0/3488595128 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b16a6700 1 -- 172.21.15.5:0/3488595128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3ac106690 msgr2=0x7fb3ac198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b16a6700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3ac106690 0x7fb3ac198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b16a6700 1 -- 172.21.15.5:0/3488595128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac1005f0 msgr2=0x7fb3ac19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b16a6700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac1005f0 0x7fb3ac19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b16a6700 1 -- 172.21.15.5:0/3488595128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80095f0 con 0x7fb3ac100fb0 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b16a6700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac19ee30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00e9a0 tx=0x7fb39c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c009790 con 0x7fb3ac100fb0 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb39c010430 con 0x7fb3ac100fb0 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac199690 con 0x7fb3ac100fb0 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c018680 con 0x7fb3ac100fb0 2023-10-08T13:21:37.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.091+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac1a58e0 con 0x7fb3ac100fb0 2023-10-08T13:21:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.092+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac101d30 con 0x7fb3ac100fb0 2023-10-08T13:21:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.093+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb39c0105a0 con 0x7fb3ac100fb0 2023-10-08T13:21:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.094+0000 7fb3a2ffd700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3980a1670 0x7fb3980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.094+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fb39c014070 con 0x7fb3ac100fb0 2023-10-08T13:21:37.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.094+0000 7fb3b1ea7700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3980a1670 0x7fb3980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.094+0000 7fb3b1ea7700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3980a1670 0x7fb3980a3b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8006010 tx=0x7fb3a8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:37.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.097+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb39c096820 con 0x7fb3ac100fb0 2023-10-08T13:21:37.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.299+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3ac1104e0 con 0x7fb3ac100fb0 2023-10-08T13:21:37.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.300+0000 7fb3a2ffd700 1 -- 172.21.15.5:0/3488595128 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb39c026020 con 0x7fb3ac100fb0 2023-10-08T13:21:37.301 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3980a1670 msgr2=0x7fb3980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3980a1670 0x7fb3980a3b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8006010 tx=0x7fb3a8005960 comp rx=0 tx=0).stop 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 msgr2=0x7fb3ac19ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac19ee30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00e9a0 tx=0x7fb39c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 shutdown_connections 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fb3980a1670 0x7fb3980a3b30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3ac106690 0x7fb3ac198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac1005f0 0x7fb3ac19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 --2- 172.21.15.5:0/3488595128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3ac100fb0 0x7fb3ac19ee30 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 >> 172.21.15.5:0/3488595128 conn(0x7fb3ac0fc120 msgr2=0x7fb3ac0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 shutdown_connections 2023-10-08T13:21:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.302+0000 7fb3b410b700 1 -- 172.21.15.5:0/3488595128 wait complete. 2023-10-08T13:21:37.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:21:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 -- 172.21.15.5:0/4171129720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c1055f0 msgr2=0x7f8d4c1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 --2- 172.21.15.5:0/4171129720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c1055f0 0x7f8d4c1059d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400b0d0 tx=0x7f8d4400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 -- 172.21.15.5:0/4171129720 shutdown_connections 2023-10-08T13:21:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 --2- 172.21.15.5:0/4171129720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 --2- 172.21.15.5:0/4171129720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c1055f0 0x7f8d4c1059d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 --2- 172.21.15.5:0/4171129720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d4c0ff530 0x7f8d4c0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 -- 172.21.15.5:0/4171129720 >> 172.21.15.5:0/4171129720 conn(0x7f8d4c0fafc0 msgr2=0x7f8d4c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 -- 172.21.15.5:0/4171129720 shutdown_connections 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.445+0000 7f8d53653700 1 -- 172.21.15.5:0/4171129720 wait complete. 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 Processor -- start 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 -- start start 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d4c0ff530 0x7f8d4c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d4c1055f0 0x7f8d4c1a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1987a0 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1a2fb0 con 0x7f8d4c0ff530 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d53653700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1a30f0 con 0x7f8d4c1055f0 2023-10-08T13:21:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39120/0 (socket says 172.21.15.5:39120) 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 -- 172.21.15.5:0/3621130278 learned_addr learned my addr 172.21.15.5:0/3621130278 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d513ef700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d4c0ff530 0x7f8d4c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d51bf0700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d4c1055f0 0x7f8d4c1a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 -- 172.21.15.5:0/3621130278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d4c1055f0 msgr2=0x7f8d4c1a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d4c1055f0 0x7f8d4c1a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 -- 172.21.15.5:0/3621130278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d4c0ff530 msgr2=0x7f8d4c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d4c0ff530 0x7f8d4c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 -- 172.21.15.5:0/3621130278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009d00 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d50bee700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c197f30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000e9a0 tx=0x7f8d4000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.446+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40009790 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.447+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d4000ce80 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.447+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c1a3380 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.447+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40018680 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.447+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c1a3890 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.448+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c107a70 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.449+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8d40010430 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.449+0000 7f8d4a7fc700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8d340a15f0 0x7f8d340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.449+0000 7f8d513ef700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8d340a15f0 0x7f8d340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.449+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f8d40014070 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.450+0000 7f8d513ef700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8d340a15f0 0x7f8d340a3ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009fd0 tx=0x7f8d4400b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:37.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.454+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8d40052100 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:37 smithi118 ceph-mon[104234]: pgmap v786: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 7.2 MiB/s wr, 756 op/s 2023-10-08T13:21:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:37 smithi118 ceph-mon[104234]: from='client.17406 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:37 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:37.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:37 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4128766378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:21:37.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:37 smithi060 ceph-mon[103190]: pgmap v786: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 7.2 MiB/s wr, 756 op/s 2023-10-08T13:21:37.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:37 smithi060 ceph-mon[103190]: from='client.17406 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:37 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:37.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:37 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4128766378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:21:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.659+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d4c067f60 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.659+0000 7f8d4a7fc700 1 -- 172.21.15.5:0/3621130278 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d4009a090 con 0x7f8d4c0ffef0 2023-10-08T13:21:37.661 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:21:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8d340a15f0 msgr2=0x7f8d340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8d340a15f0 0x7f8d340a3ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009fd0 tx=0x7f8d4400b040 comp rx=0 tx=0).stop 2023-10-08T13:21:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 msgr2=0x7f8d4c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c197f30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000e9a0 tx=0x7f8d4000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 shutdown_connections 2023-10-08T13:21:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f8d340a15f0 0x7f8d340a3ab0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d4c1055f0 0x7f8d4c1a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d4c0ff530 0x7f8d4c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 --2- 172.21.15.5:0/3621130278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d4c0ffef0 0x7f8d4c197f30 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 >> 172.21.15.5:0/3621130278 conn(0x7f8d4c0fafc0 msgr2=0x7f8d4c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 shutdown_connections 2023-10-08T13:21:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.662+0000 7f8d53653700 1 -- 172.21.15.5:0/3621130278 wait complete. 2023-10-08T13:21:37.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:37 smithi005 ceph-mon[99496]: pgmap v786: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 7.2 MiB/s wr, 756 op/s 2023-10-08T13:21:37.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:37 smithi005 ceph-mon[99496]: from='client.17406 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:37 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:37.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:37 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4128766378' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:21:37.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:21:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 -- 172.21.15.5:0/3405402998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100630 msgr2=0x7f39a4100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 --2- 172.21.15.5:0/3405402998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100630 0x7f39a4100ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f39900098f0 tx=0x7f3990009c00 comp rx=0 tx=0).stop 2023-10-08T13:21:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 -- 172.21.15.5:0/3405402998 shutdown_connections 2023-10-08T13:21:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 --2- 172.21.15.5:0/3405402998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100ff0 0x7f39a410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 --2- 172.21.15.5:0/3405402998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 --2- 172.21.15.5:0/3405402998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100630 0x7f39a4100ab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 -- 172.21.15.5:0/3405402998 >> 172.21.15.5:0/3405402998 conn(0x7f39a40fc100 msgr2=0x7f39a40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 -- 172.21.15.5:0/3405402998 shutdown_connections 2023-10-08T13:21:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.804+0000 7f39aaf07700 1 -- 172.21.15.5:0/3405402998 wait complete. 2023-10-08T13:21:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 Processor -- start 2023-10-08T13:21:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 -- start start 2023-10-08T13:21:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100630 0x7f39a419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100ff0 0x7f39a419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4197080 con 0x7f39a4106750 2023-10-08T13:21:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41971f0 con 0x7f39a4100630 2023-10-08T13:21:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39aaf07700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41973b0 con 0x7f39a4100ff0 2023-10-08T13:21:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39a94a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39a94a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39136/0 (socket says 172.21.15.5:39136) 2023-10-08T13:21:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39a94a4700 1 -- 172.21.15.5:0/994026200 learned_addr learned my addr 172.21.15.5:0/994026200 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39a8ca3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100630 0x7f39a419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39a3fff700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100ff0 0x7f39a419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.805+0000 7f39a94a4700 1 -- 172.21.15.5:0/994026200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100ff0 msgr2=0x7f39a419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a94a4700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100ff0 0x7f39a419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a94a4700 1 -- 172.21.15.5:0/994026200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100630 msgr2=0x7f39a419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a94a4700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100630 0x7f39a419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a94a4700 1 -- 172.21.15.5:0/994026200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3990009520 con 0x7f39a4106750 2023-10-08T13:21:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a8ca3700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100630 0x7f39a419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a94a4700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4196a20 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f399c00ef30 tx=0x7f399c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c018070 con 0x7f39a4106750 2023-10-08T13:21:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f399c00f040 con 0x7f39a4106750 2023-10-08T13:21:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a4197630 con 0x7f39a4106750 2023-10-08T13:21:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00ccf0 con 0x7f39a4106750 2023-10-08T13:21:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.806+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a41a38e0 con 0x7f39a4106750 2023-10-08T13:21:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.807+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a4108d60 con 0x7f39a4106750 2023-10-08T13:21:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.808+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f399c003a00 con 0x7f39a4106750 2023-10-08T13:21:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.809+0000 7f39a1ffb700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f39940a15f0 0x7f39940a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.809+0000 7f39a8ca3700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f39940a15f0 0x7f39940a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.809+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f399c0cd980 con 0x7f39a4106750 2023-10-08T13:21:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.809+0000 7f39a8ca3700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f39940a15f0 0x7f39940a3ab0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3998005fd0 tx=0x7f3998009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:37.812+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f399c096940 con 0x7f39a4106750 2023-10-08T13:21:38.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.016+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39a4101d70 con 0x7f39a4106750 2023-10-08T13:21:38.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.017+0000 7f39a1ffb700 1 -- 172.21.15.5:0/994026200 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7f399c099f60 con 0x7f39a4106750 2023-10-08T13:21:38.018 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:21:38.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f39940a15f0 msgr2=0x7f39940a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f39940a15f0 0x7f39940a3ab0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3998005fd0 tx=0x7f3998009310 comp rx=0 tx=0).stop 2023-10-08T13:21:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 msgr2=0x7f39a4196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4196a20 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f399c00ef30 tx=0x7f399c00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 shutdown_connections 2023-10-08T13:21:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f39940a15f0 0x7f39940a3ab0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a4106750 0x7f39a4196a20 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4100630 0x7f39a419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 --2- 172.21.15.5:0/994026200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f39a4100ff0 0x7f39a419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.019+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 >> 172.21.15.5:0/994026200 conn(0x7f39a40fc100 msgr2=0x7f39a40fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.020+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 shutdown_connections 2023-10-08T13:21:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.020+0000 7f39aaf07700 1 -- 172.21.15.5:0/994026200 wait complete. 2023-10-08T13:21:38.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 -- 172.21.15.5:0/4264932773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c0ffef0 msgr2=0x7faa5c10c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 --2- 172.21.15.5:0/4264932773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c0ffef0 0x7faa5c10c3b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b0d0 tx=0x7faa5400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 -- 172.21.15.5:0/4264932773 shutdown_connections 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 --2- 172.21.15.5:0/4264932773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c0ffef0 0x7faa5c10c3b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 --2- 172.21.15.5:0/4264932773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa5c1055f0 0x7faa5c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 --2- 172.21.15.5:0/4264932773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 -- 172.21.15.5:0/4264932773 >> 172.21.15.5:0/4264932773 conn(0x7faa5c0fafc0 msgr2=0x7faa5c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:38.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 -- 172.21.15.5:0/4264932773 shutdown_connections 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.163+0000 7faa646cf700 1 -- 172.21.15.5:0/4264932773 wait complete. 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 Processor -- start 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 -- start start 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c1011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa5c0ffef0 0x7faa5c1016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 0x7faa5c101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c1a4e90 con 0x7faa5c1055f0 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c1a5000 con 0x7faa5c0ff530 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa646cf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c1a51c0 con 0x7faa5c0ffef0 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 0x7faa5c101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa6246b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c1011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 0x7faa5c101c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39150/0 (socket says 172.21.15.5:39150) 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa6246b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c1011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:34096/0 (socket says 172.21.15.5:34096) 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 -- 172.21.15.5:0/3899842207 learned_addr learned my addr 172.21.15.5:0/3899842207 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa61c6a700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa5c0ffef0 0x7faa5c1016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 -- 172.21.15.5:0/3899842207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa5c0ffef0 msgr2=0x7faa5c1016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa5c0ffef0 0x7faa5c1016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 -- 172.21.15.5:0/3899842207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 msgr2=0x7faa5c1011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c1011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 -- 172.21.15.5:0/3899842207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009d00 con 0x7faa5c1055f0 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa6246b700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.164+0000 7faa62c6c700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 0x7faa5c101c20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faa5400bd50 tx=0x7faa5400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.165+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400e040 con 0x7faa5c1055f0 2023-10-08T13:21:38.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.165+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa5401b8e0 con 0x7faa5c1055f0 2023-10-08T13:21:38.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.165+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c1a5440 con 0x7faa5c1055f0 2023-10-08T13:21:38.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.165+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54012810 con 0x7faa5c1055f0 2023-10-08T13:21:38.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.165+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c1a58c0 con 0x7faa5c1055f0 2023-10-08T13:21:38.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.166+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c100c50 con 0x7faa5c1055f0 2023-10-08T13:21:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.167+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faa5401ba50 con 0x7faa5c1055f0 2023-10-08T13:21:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.167+0000 7faa4f7fe700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faa480a15f0 0x7faa480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.168+0000 7faa6246b700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faa480a15f0 0x7faa480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.168+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7faa540cec80 con 0x7faa5c1055f0 2023-10-08T13:21:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.168+0000 7faa6246b700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faa480a15f0 0x7faa480a3ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faa58009fd0 tx=0x7faa58009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.171+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faa54097c40 con 0x7faa5c1055f0 2023-10-08T13:21:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.377+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa5c10f480 con 0x7faa5c1055f0 2023-10-08T13:21:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.377+0000 7faa4f7fe700 1 -- 172.21.15.5:0/3899842207 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v109) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa5402c350 con 0x7faa5c1055f0 2023-10-08T13:21:38.379 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.379+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faa480a15f0 msgr2=0x7faa480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.379+0000 7faa646cf700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faa480a15f0 0x7faa480a3ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faa58009fd0 tx=0x7faa58009260 comp rx=0 tx=0).stop 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.379+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 msgr2=0x7faa5c101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.379+0000 7faa646cf700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 0x7faa5c101c20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7faa5400bd50 tx=0x7faa5400bd80 comp rx=0 tx=0).stop 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 shutdown_connections 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7faa480a15f0 0x7faa480a3ab0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c1055f0 0x7faa5c101c20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa5c0ff530 0x7faa5c1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 --2- 172.21.15.5:0/3899842207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa5c0ffef0 0x7faa5c1016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 >> 172.21.15.5:0/3899842207 conn(0x7faa5c0fafc0 msgr2=0x7faa5c0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 shutdown_connections 2023-10-08T13:21:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.380+0000 7faa646cf700 1 -- 172.21.15.5:0/3899842207 wait complete. 2023-10-08T13:21:38.392 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:38 smithi005 ceph-mon[99496]: from='client.17412 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:38.393 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:38 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3488595128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.393 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:38 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3621130278' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.393 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:38 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/994026200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-08T13:21:38.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:38 smithi118 ceph-mon[104234]: from='client.17412 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:38 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3488595128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:38 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3621130278' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:38 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/994026200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 -- 172.21.15.5:0/1487649935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 msgr2=0x7f7354100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 --2- 172.21.15.5:0/1487649935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f7354100ab0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7348009990 tx=0x7f7348009ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 -- 172.21.15.5:0/1487649935 shutdown_connections 2023-10-08T13:21:38.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 --2- 172.21.15.5:0/1487649935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7354100ff0 0x7f735410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 --2- 172.21.15.5:0/1487649935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7354106640 0x7f7354106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 --2- 172.21.15.5:0/1487649935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f7354100ab0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 -- 172.21.15.5:0/1487649935 >> 172.21.15.5:0/1487649935 conn(0x7f73540fc160 msgr2=0x7f73540fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 -- 172.21.15.5:0/1487649935 shutdown_connections 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.519+0000 7f735a03b700 1 -- 172.21.15.5:0/1487649935 wait complete. 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 Processor -- start 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 -- start start 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f735419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7354100ff0 0x7f735419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7354106640 0x7f73541968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354196f40 con 0x7f7354100630 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73541970b0 con 0x7f7354100ff0 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f735a03b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354197270 con 0x7f7354106640 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f735419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f735419c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39160/0 (socket says 172.21.15.5:39160) 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 -- 172.21.15.5:0/1869643781 learned_addr learned my addr 172.21.15.5:0/1869643781 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f7352ffd700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7354100ff0 0x7f735419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f7353fff700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7354106640 0x7f73541968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 -- 172.21.15.5:0/1869643781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7354106640 msgr2=0x7f73541968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7354106640 0x7f73541968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 -- 172.21.15.5:0/1869643781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7354100ff0 msgr2=0x7f735419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7354100ff0 0x7f735419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.520+0000 7f73537fe700 1 -- 172.21.15.5:0/1869643781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480095f0 con 0x7f7354100630 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.521+0000 7f73537fe700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f735419c7b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f734400e9a0 tx=0x7f734400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.521+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344009790 con 0x7f7354100630 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.521+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7344010430 con 0x7f7354100630 2023-10-08T13:21:38.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.521+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7354197550 con 0x7f7354100630 2023-10-08T13:21:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.521+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344018680 con 0x7f7354100630 2023-10-08T13:21:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.521+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73541a37a0 con 0x7f7354100630 2023-10-08T13:21:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.522+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354108c50 con 0x7f7354100630 2023-10-08T13:21:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.523+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f73440105a0 con 0x7f7354100630 2023-10-08T13:21:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.523+0000 7f7350ff9700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f733c0a15f0 0x7f733c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.524+0000 7f7352ffd700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f733c0a15f0 0x7f733c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.524+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f7344014070 con 0x7f7354100630 2023-10-08T13:21:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.524+0000 7f7352ffd700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f733c0a15f0 0x7f733c0a3ab0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f734800b2e0 tx=0x7f7348005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.527+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7344096750 con 0x7f7354100630 2023-10-08T13:21:38.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:38 smithi060 ceph-mon[103190]: from='client.17412 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:38 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3488595128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:38 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3621130278' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:38 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/994026200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:21:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.790+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f7354101d70 con 0x7f7354100630 2023-10-08T13:21:38.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.799+0000 7f7350ff9700 1 -- 172.21.15.5:0/1869643781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+734394 (secure 0 0 0) 0x7f7344026090 con 0x7f7354100630 2023-10-08T13:21:38.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:21:38.809 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:21:38.809 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 24, 2023-10-08T13:21:38.809 INFO:teuthology.orchestra.run.smithi005.stdout: "active_gid": 14217, 2023-10-08T13:21:38.810 INFO:teuthology.orchestra.run.smithi005.stdout: "active_name": "x", 2023-10-08T13:21:38.810 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addrs": { 2023-10-08T13:21:38.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:38.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:38.810 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2023-10-08T13:21:38.811 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 706171785 2023-10-08T13:21:38.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-10-08T13:21:38.811 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2023-10-08T13:21:38.812 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 706171785 2023-10-08T13:21:38.812 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.812 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:38.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.812 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addr": "172.21.15.5:6801/706171785", 2023-10-08T13:21:38.813 INFO:teuthology.orchestra.run.smithi005.stdout: "active_change": "2023-10-08T12:58:37.011294+0000", 2023-10-08T13:21:38.813 INFO:teuthology.orchestra.run.smithi005.stdout: "active_mgr_features": 4540138322906710015, 2023-10-08T13:21:38.813 INFO:teuthology.orchestra.run.smithi005.stdout: "available": true, 2023-10-08T13:21:38.813 INFO:teuthology.orchestra.run.smithi005.stdout: "standbys": [ 2023-10-08T13:21:38.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.814 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24151, 2023-10-08T13:21:38.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2023-10-08T13:21:38.814 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540138322906710015, 2023-10-08T13:21:38.814 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-10-08T13:21:38.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.817 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.818 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.819 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.820 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.821 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.822 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-10-08T13:21:38.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.825 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.826 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-10-08T13:21:38.827 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.829 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-10-08T13:21:38.831 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-10-08T13:21:38.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:21:38.834 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:38.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.837 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-10-08T13:21:38.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.839 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:21:38.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.842 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.845 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.847 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-10-08T13:21:38.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:21:38.852 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:38.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.854 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.856 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-10-08T13:21:38.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:21:38.860 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.861 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-10-08T13:21:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.867 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-10-08T13:21:38.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.872 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.873 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:21:38.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.876 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.877 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:21:38.880 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.881 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-10-08T13:21:38.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.885 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.886 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.890 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-10-08T13:21:38.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-10-08T13:21:38.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.895 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.899 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.903 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.904 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:21:38.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.907 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.909 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.910 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.912 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-10-08T13:21:38.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:21:38.916 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.919 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-10-08T13:21:38.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.922 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.923 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:21:38.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.927 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.929 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.932 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.934 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.935 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:21:38.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:21:38.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.940 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.941 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:21:38.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.944 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.945 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:21:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.951 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:21:38.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.955 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.956 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:21:38.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.963 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:21:38.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.970 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.971 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:21:38.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.975 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.978 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.979 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:21:38.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.984 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.987 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-10-08T13:21:38.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:21:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.993 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.996 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:38.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:38.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.002 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:39.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.005 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.007 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-10-08T13:21:39.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-08T13:21:39.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-10-08T13:21:39.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.013 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.014 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.017 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-10-08T13:21:39.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-10-08T13:21:39.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:21:39.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-10-08T13:21:39.027 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.028 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.031 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-10-08T13:21:39.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-10-08T13:21:39.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.041 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.042 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.046 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.047 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-10-08T13:21:39.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.051 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.057 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.059 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.063 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.066 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2023-10-08T13:21:39.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.072 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.075 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.079 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.083 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-10-08T13:21:39.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-10-08T13:21:39.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.089 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:21:39.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2023-10-08T13:21:39.091 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.094 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.096 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.099 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-10-08T13:21:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.102 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.104 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.105 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.109 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.110 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.111 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.112 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.116 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-10-08T13:21:39.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.123 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.127 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.129 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.130 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.131 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.133 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.139 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.141 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-08T13:21:39.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-10-08T13:21:39.144 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.147 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.152 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.155 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-10-08T13:21:39.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:39.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-10-08T13:21:39.171 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.180 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.190 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.192 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.196 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "drive_group_interval": { 2023-10-08T13:21:39.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "drive_group_interval", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300.0", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.204 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.206 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.207 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.209 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.215 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-10-08T13:21:39.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.220 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-10-08T13:21:39.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.227 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.231 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:21:39.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.235 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.237 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.246 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.247 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.248 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.250 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.255 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.256 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:21:39.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.264 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-10-08T13:21:39.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-10-08T13:21:39.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.271 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-10-08T13:21:39.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.273 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-10-08T13:21:39.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.277 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.278 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.279 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.280 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.284 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.286 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.287 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.290 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.297 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:21:39.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-10-08T13:21:39.304 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.313 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24175, 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "y", 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540138322906710015, 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.318 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.320 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.323 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.325 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.326 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-10-08T13:21:39.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.330 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-10-08T13:21:39.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-10-08T13:21:39.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.334 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.336 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.337 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:21:39.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.340 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-10-08T13:21:39.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:21:39.343 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-08T13:21:39.344 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-10-08T13:21:39.352 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-10-08T13:21:39.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.354 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.355 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.356 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-10-08T13:21:39.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.362 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.364 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.365 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:21:39.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.374 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-10-08T13:21:39.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:21:39.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-10-08T13:21:39.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.382 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-10-08T13:21:39.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.389 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:21:39.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.394 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-10-08T13:21:39.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-10-08T13:21:39.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.399 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-10-08T13:21:39.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.403 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.406 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:21:39.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:21:39.413 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.416 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-10-08T13:21:39.418 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.422 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-10-08T13:21:39.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:21:39.426 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.428 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.429 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.432 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.438 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.440 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.441 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.442 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:21:39.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:21:39.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.450 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.452 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:39.454 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:21:39.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.457 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.458 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.461 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:21:39.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.465 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.466 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.467 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.468 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.470 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:21:39.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.472 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.475 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:21:39.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.480 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.482 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.484 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:21:39.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.487 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.488 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.489 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.490 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-10-08T13:21:39.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.495 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.496 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.497 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.498 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:39.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.504 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-10-08T13:21:39.507 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-08T13:21:39.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.509 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.513 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.514 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.516 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-10-08T13:21:39.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.519 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:21:39.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.527 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.528 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.533 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.535 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-10-08T13:21:39.538 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.541 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.542 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.544 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.545 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.547 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.548 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.549 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-10-08T13:21:39.553 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.554 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.557 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.559 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.561 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.562 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.565 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2023-10-08T13:21:39.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.571 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.574 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.578 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.580 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.581 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.583 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.584 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.585 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-10-08T13:21:39.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-10-08T13:21:39.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:21:39.589 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.591 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.592 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.593 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.595 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.597 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.598 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.599 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.600 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.602 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.604 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.609 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:21:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.611 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.613 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.614 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.615 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-08T13:21:39.617 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-10-08T13:21:39.618 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.619 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.620 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.621 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.623 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.624 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.626 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.627 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.629 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.630 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.631 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.632 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.634 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.635 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.636 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.640 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-08T13:21:39.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.643 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.645 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.646 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.647 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:21:39.649 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.650 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.651 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:21:39.653 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.654 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.657 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.658 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.659 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-10-08T13:21:39.662 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.663 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:39.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-10-08T13:21:39.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.666 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-10-08T13:21:39.667 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-08T13:21:39.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.669 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.670 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.674 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.676 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.677 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.678 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.686 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.688 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.689 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.690 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.691 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.693 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.694 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.695 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "drive_group_interval": { 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "drive_group_interval", 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300.0", 2023-10-08T13:21:39.697 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.698 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.699 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.700 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.701 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.702 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.703 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.704 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.705 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.706 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.707 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.708 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.710 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.712 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.713 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.716 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-10-08T13:21:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.720 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-10-08T13:21:39.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.723 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-10-08T13:21:39.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.728 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.730 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.733 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.734 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.735 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.736 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.737 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.738 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.739 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.740 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.741 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.743 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.744 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.746 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.747 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.748 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.749 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.752 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.753 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.754 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.755 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.756 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.758 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-10-08T13:21:39.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.761 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-10-08T13:21:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.767 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.768 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-10-08T13:21:39.769 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.770 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-10-08T13:21:39.771 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.791 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.791 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.791 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.791 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.791 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-08T13:21:39.792 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.792 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.792 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.792 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.793 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.794 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.794 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.794 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.794 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.794 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.794 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.796 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.798 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.799 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.800 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-10-08T13:21:39.801 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.802 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.803 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-10-08T13:21:39.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.805 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.806 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.807 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.808 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.809 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.810 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.811 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.814 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-10-08T13:21:39.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "modules": [ 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard", 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "iostat", 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "nfs", 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "restful", 2023-10-08T13:21:39.818 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_schedule" 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.819 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.821 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.822 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.828 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.829 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.830 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2023-10-08T13:21:39.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2023-10-08T13:21:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2023-10-08T13:21:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:21:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:21:39.842 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.847 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.850 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2023-10-08T13:21:39.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2023-10-08T13:21:39.854 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap" 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:39.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.857 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:21:39.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.860 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.861 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2023-10-08T13:21:39.862 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2023-10-08T13:21:39.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.867 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2023-10-08T13:21:39.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.875 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.877 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.878 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.880 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.881 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.882 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2023-10-08T13:21:39.883 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2023-10-08T13:21:39.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.890 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:21:39.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.895 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:21:39.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.898 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2023-10-08T13:21:39.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:21:39.905 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.908 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.909 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.911 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.915 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2023-10-08T13:21:39.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:21:39.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.921 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2023-10-08T13:21:39.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.926 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.927 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2023-10-08T13:21:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:21:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.933 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.934 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:39.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:39.936 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2023-10-08T13:21:39.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:21:39.940 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:39.941 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.943 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.946 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:21:39.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:21:39.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.953 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.956 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.957 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:21:39.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.960 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.961 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:21:39.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.965 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.968 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.969 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:21:39.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.971 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.972 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.975 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:21:39.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.981 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:21:39.983 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.986 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.987 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:21:39.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.992 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.993 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.994 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.996 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:39.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:39.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.001 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.002 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.007 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:40.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.010 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.013 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-08T13:21:40.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.018 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.021 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.022 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.023 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2023-10-08T13:21:40.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2023-10-08T13:21:40.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.027 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:40.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.031 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.034 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.037 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.039 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2023-10-08T13:21:40.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.042 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2023-10-08T13:21:40.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.046 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.049 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.050 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.053 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.055 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2023-10-08T13:21:40.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.060 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.065 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.068 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.075 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2023-10-08T13:21:40.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.081 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.082 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2023-10-08T13:21:40.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.089 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.092 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:21:40.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2023-10-08T13:21:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2023-10-08T13:21:40.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.108 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.111 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2023-10-08T13:21:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.127 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2023-10-08T13:21:40.128 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.129 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.148 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2023-10-08T13:21:40.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.153 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.154 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.155 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.158 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2023-10-08T13:21:40.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.161 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2023-10-08T13:21:40.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.164 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:21:40.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.166 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.169 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.170 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:40.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2023-10-08T13:21:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:21:40.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.190 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2023-10-08T13:21:40.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.193 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.195 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2023-10-08T13:21:40.203 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.204 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.205 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.207 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.208 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "drive_group_interval": { 2023-10-08T13:21:40.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "drive_group_interval", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300.0", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.212 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.213 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.214 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.215 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.219 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.220 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.222 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.223 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2023-10-08T13:21:40.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2023-10-08T13:21:40.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.232 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.234 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.243 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.244 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.245 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.246 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.256 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.260 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2023-10-08T13:21:40.261 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.262 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.267 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.268 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.270 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.273 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.274 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2023-10-08T13:21:40.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.277 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2023-10-08T13:21:40.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.282 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.285 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.287 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.288 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.290 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2023-10-08T13:21:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.294 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.300 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2023-10-08T13:21:40.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2023-10-08T13:21:40.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2023-10-08T13:21:40.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2023-10-08T13:21:40.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2023-10-08T13:21:40.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2023-10-08T13:21:40.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.317 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2023-10-08T13:21:40.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2023-10-08T13:21:40.320 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2023-10-08T13:21:40.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2023-10-08T13:21:40.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2023-10-08T13:21:40.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: "services": { 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard": "https://172.21.15.5:8443/" 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.326 INFO:teuthology.orchestra.run.smithi005.stdout: "always_on_modules": { 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus": [ 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-08T13:21:40.327 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific": [ 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-08T13:21:40.328 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy": [ 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2023-10-08T13:21:40.329 INFO:teuthology.orchestra.run.smithi005.stdout: "reef": [ 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "last_failure_osd_epoch": 5, 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "active_clients": [ 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2979951482 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "libcephsqlite", 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1032558415 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2023-10-08T13:21:40.332 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3631922598 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 11565751 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-08T13:21:40.334 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3758194572 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1246176566 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.335 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:40.336 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-10-08T13:21:40.336 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:21:40.338 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:39 smithi060 ceph-mon[103190]: pgmap v787: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 6.6 MiB/s wr, 696 op/s 2023-10-08T13:21:40.338 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3899842207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:21:40.338 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:39 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1869643781' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:21:40.338 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:39 smithi118 ceph-mon[104234]: pgmap v787: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 6.6 MiB/s wr, 696 op/s 2023-10-08T13:21:40.338 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3899842207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:21:40.338 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:39 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1869643781' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f733c0a15f0 msgr2=0x7f733c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f733c0a15f0 0x7f733c0a3ab0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f734800b2e0 tx=0x7f7348005960 comp rx=0 tx=0).stop 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 msgr2=0x7f735419c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f735419c7b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f734400e9a0 tx=0x7f734400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 shutdown_connections 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f733c0a15f0 0x7f733c0a3ab0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7354106640 0x7f73541968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7354100630 0x7f735419c7b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:40.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 --2- 172.21.15.5:0/1869643781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7354100ff0 0x7f735419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 >> 172.21.15.5:0/1869643781 conn(0x7f73540fc160 msgr2=0x7f73540fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 shutdown_connections 2023-10-08T13:21:40.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:21:38.805+0000 7f735a03b700 1 -- 172.21.15.5:0/1869643781 wait complete. 2023-10-08T13:21:40.346 DEBUG:tasks.check_counter:Getting stats from a 2023-10-08T13:21:40.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-08T13:21:40.347 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:39 smithi005 ceph-mon[99496]: pgmap v787: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 6.6 MiB/s wr, 696 op/s 2023-10-08T13:21:40.347 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3899842207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:21:40.347 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:39 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1869643781' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:21:41.161 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:21:41.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:41 smithi118 ceph-mon[104234]: pgmap v788: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 4.5 MiB/s wr, 496 op/s 2023-10-08T13:21:41.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:41 smithi060 ceph-mon[103190]: pgmap v788: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 4.5 MiB/s wr, 496 op/s 2023-10-08T13:21:41.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:41 smithi005 ceph-mon[99496]: pgmap v788: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 4.5 MiB/s wr, 496 op/s 2023-10-08T13:21:42.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:42 smithi005 ceph-mon[99496]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:42.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:42 smithi060 ceph-mon[103190]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:42.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:42 smithi118 ceph-mon[104234]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:21:42.908 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:21:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2069, 2023-10-08T13:21:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2069, 2023-10-08T13:21:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 4810129, 2023-10-08T13:21:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 642664, 2023-10-08T13:21:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.201638361, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.053115594, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.058541548, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.072849525, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2068, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.686323274, 2023-10-08T13:21:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000331877 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:21:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1344, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1310, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3100914, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 485804, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.144422853, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.039314727, 2023-10-08T13:21:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.051790430, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.049643512, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1309, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.502505947, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000383885 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 991840, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 174736 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 153, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 367, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 37574, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 496872, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2023-10-08T13:21:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.031481246, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.015853967, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.005921305, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.006815598, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 365, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.141571541, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000387867 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 449600 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2023-10-08T13:21:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5338, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.161485435, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000030252 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 0, 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 0, 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 1097, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 292, 2023-10-08T13:21:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 345, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 460, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 679, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 5, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 24, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:21:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2023-10-08T13:21:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 0 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2023-10-08T13:21:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2023-10-08T13:21:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 1224, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 3, 2023-10-08T13:21:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 2, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 10248294, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 10242895, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 1224 2023-10-08T13:21:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1030, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 1058, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 28, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 61, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 65, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 4, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 1097, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 1135, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 38, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 0, 2023-10-08T13:21:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 50680, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 207152 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2023-10-08T13:21:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2023-10-08T13:21:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2023-10-08T13:21:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2023-10-08T13:21:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:21:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 2, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 3, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 1, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 2, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2023-10-08T13:21:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 2527, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 238509, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 1144, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-08T13:21:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 9640, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 185, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 3275635, 2023-10-08T13:21:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 35394, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 3217, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 21, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 3, 2023-10-08T13:21:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 3217, 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3217, 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.768652352, 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.005212512 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3217, 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 3218 2023-10-08T13:21:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 3217, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 3217, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 0, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 1961, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 0, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 1254, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 0, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 0, 2023-10-08T13:21:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:21:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2023-10-08T13:21:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2023-10-08T13:21:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 109, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 22, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 6, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 2, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 0, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 2, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 0 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 0, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:21:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 0, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 0, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3562, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 7607706, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3562, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3562, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 7607706, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 3217, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 6053995, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3217, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 6053995, 2023-10-08T13:21:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 3217, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 3217, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3217, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 3217, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:42.962 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x55fd0877a960": { 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-08T13:21:42.963 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:42.964 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:42.965 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.965 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:42.965 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:21:43.338 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-08T13:21:43.338 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-08T13:21:43.338 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-10-08T13:21:43.339 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:21:43.339 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:21:43.339 DEBUG:tasks.check_counter:Getting stats from d 2023-10-08T13:21:43.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-08T13:21:43.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:43 smithi060 ceph-mon[103190]: pgmap v789: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 4.4 MiB/s wr, 484 op/s 2023-10-08T13:21:43.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:43 smithi005 ceph-mon[99496]: pgmap v789: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 4.4 MiB/s wr, 484 op/s 2023-10-08T13:21:43.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:43 smithi118 ceph-mon[104234]: pgmap v789: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 4.4 MiB/s wr, 484 op/s 2023-10-08T13:21:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:21:45.172 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:21:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:45.172 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 293, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 288, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 765568, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 173152, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.046959190, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.016846237, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.022081907, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.008299205, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 287, 2023-10-08T13:21:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.123507518, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000430339 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 765568, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 173152 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 6, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 222, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3264, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 192448, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.016069770, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.011865721, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002347446, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 221, 2023-10-08T13:21:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.115592634, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000523043 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 192448 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:45.176 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.000442049, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000364788, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:45.177 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-08T13:21:45.178 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:45.179 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:45.180 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:45.181 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 147920, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 27, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:45.183 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 295, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 724157, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 295, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 295, 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 724157, 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:45.185 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:21:45.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:45 smithi005 ceph-mon[99496]: pgmap v790: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 2.3 MiB/s wr, 258 op/s 2023-10-08T13:21:45.579 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-08T13:21:45.579 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-08T13:21:45.579 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-08T13:21:45.579 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-08T13:21:45.579 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-08T13:21:45.579 DEBUG:tasks.check_counter:Getting stats from g 2023-10-08T13:21:45.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-08T13:21:45.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:45 smithi060 ceph-mon[103190]: pgmap v790: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 2.3 MiB/s wr, 258 op/s 2023-10-08T13:21:45.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:45 smithi118 ceph-mon[104234]: pgmap v790: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 2.3 MiB/s wr, 258 op/s 2023-10-08T13:21:46.157 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:21:47.515 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:21:47.515 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1347, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1313, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1328720, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 487295, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.173303047, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.061929387, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.056449631, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.049011027, 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:47.516 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1312, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.477324742, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000363814 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 992384, 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 175984 2023-10-08T13:21:47.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2168, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2384, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3344228, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 1125530, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.176366453, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.051352303, 2023-10-08T13:21:47.518 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.045045562, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.067613814, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2382, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.633605514, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000265997 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:21:47.519 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 451536 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 8, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 8, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 4573, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 1704, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 7, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.002869454, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000129642, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002438809, 2023-10-08T13:21:47.520 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000108047, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004221148, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000603021 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-08T13:21:47.521 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 5087, 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.144703222, 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000028445 2023-10-08T13:21:47.522 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 0, 2023-10-08T13:21:47.523 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2023-10-08T13:21:47.524 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 528, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 9, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 443, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 76, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 514, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 0, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 0, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 18, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 0, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 0, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2023-10-08T13:21:47.525 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:21:47.526 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2023-10-08T13:21:47.527 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 0, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 0 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2023-10-08T13:21:47.528 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2023-10-08T13:21:47.529 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2023-10-08T13:21:47.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 1468, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2023-10-08T13:21:47.531 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 3, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 2, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 6989210, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 6985190, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.532 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 1468 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 417, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 447, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 30, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 29, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 30, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 1, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 528, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 528, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 0, 2023-10-08T13:21:47.533 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 47892, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 207152 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 0, 2023-10-08T13:21:47.534 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2023-10-08T13:21:47.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2023-10-08T13:21:47.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.538 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.539 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.540 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2023-10-08T13:21:47.542 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.543 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.544 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.545 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.546 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 2, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 3, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 1, 2023-10-08T13:21:47.547 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 2, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 2534, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:47.548 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:47.549 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:47.550 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 214611, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 518, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:21:47.551 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 9640, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 185, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:47.552 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 1439500, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 22318, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 3172, 2023-10-08T13:21:47.553 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 21, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 3, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 3172, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3172, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 32.474318380, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.010237805 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3172, 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 3173 2023-10-08T13:21:47.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 3172, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 3172, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 1939, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 1231, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2023-10-08T13:21:47.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:21:47.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2023-10-08T13:21:47.557 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 109, 2023-10-08T13:21:47.558 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 22, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 6, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 2, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 0, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 2, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 0 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 0, 2023-10-08T13:21:47.559 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 0, 2023-10-08T13:21:47.560 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 0, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3519, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 4340376, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3519, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:47.561 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3519, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 4340376, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-08T13:21:47.562 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 3172, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 2794911, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3172, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 2794911, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.563 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 3172, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 3172, 2023-10-08T13:21:47.564 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3172, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 3172, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:47.565 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.566 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x562b4ce1e960": { 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:47.568 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:21:47.568 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:47 smithi005 ceph-mon[99496]: pgmap v791: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 1.5 MiB/s wr, 171 op/s 2023-10-08T13:21:47.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:47 smithi060 ceph-mon[103190]: pgmap v791: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 1.5 MiB/s wr, 171 op/s 2023-10-08T13:21:47.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:47 smithi118 ceph-mon[104234]: pgmap v791: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 1.5 MiB/s wr, 171 op/s 2023-10-08T13:21:48.019 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-08T13:21:48.019 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-08T13:21:48.019 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-10-08T13:21:48.019 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:21:48.019 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:21:48.019 DEBUG:tasks.check_counter:Getting stats from j 2023-10-08T13:21:48.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-08T13:21:48.595 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:21:49.421 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:49 smithi005 ceph-mon[99496]: pgmap v792: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 521 KiB/s wr, 63 op/s 2023-10-08T13:21:49.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:49 smithi060 ceph-mon[103190]: pgmap v792: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 521 KiB/s wr, 63 op/s 2023-10-08T13:21:49.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:49 smithi118 ceph-mon[104234]: pgmap v792: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 521 KiB/s wr, 63 op/s 2023-10-08T13:21:49.954 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.001363980, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000327226, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:21:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:21:49.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 296, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 291, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 767008, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 174736, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.045923195, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.016484621, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.022893825, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.008392422, 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:49.957 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 290, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.100065858, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000345054 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 767008, 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 174736 2023-10-08T13:21:49.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 6, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 223, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3264, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 192624, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.015404171, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.011416713, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002184562, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:21:49.959 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 222, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.084706575, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000381561 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 192624 2023-10-08T13:21:49.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:49.961 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:49.962 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:49.963 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 147920, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 27, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:49.964 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:49.965 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 298, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 725184, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 298, 2023-10-08T13:21:49.966 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 298, 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 725184, 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-10-08T13:21:49.967 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-10-08T13:21:50.371 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-08T13:21:50.371 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-08T13:21:50.371 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-08T13:21:50.371 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-08T13:21:50.371 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-08T13:21:50.372 DEBUG:tasks.check_counter:Getting stats from b 2023-10-08T13:21:50.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-08T13:21:51.151 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:21:51.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:51 smithi005 ceph-mon[99496]: pgmap v793: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 360 KiB/s wr, 48 op/s 2023-10-08T13:21:51.678 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:51 smithi060 ceph-mon[103190]: pgmap v793: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 360 KiB/s wr, 48 op/s 2023-10-08T13:21:51.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:51 smithi118 ceph-mon[104234]: pgmap v793: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 360 KiB/s wr, 48 op/s 2023-10-08T13:21:53.137 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 6670, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 7636, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3446284, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 16676337, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 10, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.528490225, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.206244075, 2023-10-08T13:21:53.138 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.295420373, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.065859120, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 7636, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.945191508, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000254739 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 9981, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.002340477, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000234 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.139 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1021488, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 183152 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 6783, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 8853, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 2516623, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 4779683, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 16, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.470926095, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.199355808, 2023-10-08T13:21:53.140 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.349453221, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000611692, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 8851, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.847589783, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000208743 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 13407, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.002928877, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000218 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.141 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1213456, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 3340880 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2320, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2870, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 862153, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 5613047, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 12, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 8, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.162767252, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.060448077, 2023-10-08T13:21:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.097748435, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.015341523, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2868, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.646171256, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000225303 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 4082, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000887080, 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000217 2023-10-08T13:21:53.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3952, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 17120 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3265, 2023-10-08T13:21:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.736095258, 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000531729 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 15, 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000357460, 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000023830 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2023-10-08T13:21:53.145 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 1780, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 1669, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1669, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 59.702679969, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.035771527 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 111, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 4, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2023-10-08T13:21:53.146 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 20, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 1, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 605, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 30, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 297, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 278, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 561, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 492, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 129, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 130, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 15, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 5019, 2023-10-08T13:21:53.147 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 3949, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 100, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 54, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 274, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 13034, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 8, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 344, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 14, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 445, 2023-10-08T13:21:53.148 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 47, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 1021, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 1319459435, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 4, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 47, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 1, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:21:53.149 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 1, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 46, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 35, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 774, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 1262, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 1550, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 526, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 56, 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 827 2023-10-08T13:21:53.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 69, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 111, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 16, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 201, 2023-10-08T13:21:53.151 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 1, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 193, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 21, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 8, 2023-10-08T13:21:53.152 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 1, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 2414, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 2414, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2023-10-08T13:21:53.153 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 7, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 7, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 21744829, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 0, 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2023-10-08T13:21:53.154 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1622, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 31.138289736, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.019197465 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 0 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 283, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 546, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 263, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 55, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 68, 2023-10-08T13:21:53.155 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 13, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 623, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 1178, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 555, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 130, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 454, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 324, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 56692, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 198960 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 4201, 2023-10-08T13:21:53.156 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 733, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 1780, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 432, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 1426, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 45, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.053192832, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001182062 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 237, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.363200936, 2023-10-08T13:21:53.157 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.005751902 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 198, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.409454444, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007118456 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 598, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 16.767606381, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.028039475 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1, 2023-10-08T13:21:53.159 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000145383, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000145383 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2023-10-08T13:21:53.161 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.162 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 99, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.417209933, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.004214241 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 64, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.261356772, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.004083699 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.163 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 227, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 38.697818083, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.170474969 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.165 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.168 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 200, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.732695205, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.003663476 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:21:53.169 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 2, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 2, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 0, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 2, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2023-10-08T13:21:53.170 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 270, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 135, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 916, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:53.171 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:53.172 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 838194, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 700, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:53.174 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 9640, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 185, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 1741301, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 66504, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 1928, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 17775366, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 27, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 1928, 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2023-10-08T13:21:53.176 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1928, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 37.166653079, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.019277309 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1928, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 2156 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 1928, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 52, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 1876, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2023-10-08T13:21:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 0, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 10, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 1623, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 64, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 1, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 18, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2023-10-08T13:21:53.178 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 47, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 20, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2023-10-08T13:21:53.179 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2023-10-08T13:21:53.180 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 109, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 22, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 12, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 13, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 1, 2023-10-08T13:21:53.181 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 267, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 8, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 97 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 1, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2023-10-08T13:21:53.182 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 2, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 1, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 1, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:53.183 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 15769, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 5220813, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 15769, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 15769, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 5220813, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.184 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 1928, 2023-10-08T13:21:53.185 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 17775459, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1928, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 17775459, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2023-10-08T13:21:53.186 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 1928, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 1928, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1928, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1928, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 1, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 157, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 1, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:53.188 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 157, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x55787b5ec640": { 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:53.189 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 2414, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 17550525, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 2414, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1622, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 17550525, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:53.191 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T13:21:53.473 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:53 smithi060 ceph-mon[103190]: pgmap v794: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 20 op/s 2023-10-08T13:21:53.520 INFO:tasks.check_counter:Daemon mds.b mds.exported=8 2023-10-08T13:21:53.520 INFO:tasks.check_counter:Daemon mds.b mds.imported=14 2023-10-08T13:21:53.521 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=4 2023-10-08T13:21:53.521 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:21:53.521 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:21:53.521 DEBUG:tasks.check_counter:Getting stats from e 2023-10-08T13:21:53.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-08T13:21:53.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:53 smithi005 ceph-mon[99496]: pgmap v794: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 20 op/s 2023-10-08T13:21:53.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:53 smithi118 ceph-mon[104234]: pgmap v794: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 20 op/s 2023-10-08T13:21:54.281 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:21:55.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:55 smithi060 ceph-mon[103190]: pgmap v795: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 20 op/s 2023-10-08T13:21:55.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:55 smithi005 ceph-mon[99496]: pgmap v795: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 20 op/s 2023-10-08T13:21:55.677 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T13:21:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:55.677 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 3152, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 3153, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 14274583, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 979968, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.260444234, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.062903530, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.077377677, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.101334780, 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:55.678 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3151, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.568293883, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000180353 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:21:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 187, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 404, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 4242516, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 510760, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.032444202, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.011728666, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.009684706, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.007745590, 2023-10-08T13:21:55.680 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 403, 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.167400758, 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000415386 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.681 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 454096 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 363, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 329, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 997368, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 182861, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2023-10-08T13:21:55.682 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.050744668, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.015553436, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.029140157, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.009209291, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 328, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.099775513, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000304193 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:55.683 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 994640, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 179440 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2023-10-08T13:21:55.684 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5622, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.143988634, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000025611 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.685 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.686 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 647, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 59, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 358, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 230, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 562, 2023-10-08T13:21:55.687 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 13, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2023-10-08T13:21:55.688 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2023-10-08T13:21:55.689 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:21:55.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2023-10-08T13:21:55.691 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2023-10-08T13:21:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2023-10-08T13:21:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:21:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2023-10-08T13:21:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2023-10-08T13:21:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2023-10-08T13:21:55.692 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2023-10-08T13:21:55.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 2414, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2023-10-08T13:21:55.694 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 7, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 21744829, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 21716336, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 2414 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 289, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 526, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 237, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 47, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 55, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 8, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 647, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 1038, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 391, 2023-10-08T13:21:55.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 48744, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 207152 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2023-10-08T13:21:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2023-10-08T13:21:55.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.699 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2023-10-08T13:21:55.701 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.703 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.704 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.706 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.707 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.708 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.709 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:21:55.710 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 2, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 2, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 0, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 2, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2023-10-08T13:21:55.711 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 2519, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:55.712 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:55.713 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 221026, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 653, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:55.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 9640, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 185, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 1519852, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 47160, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:55.716 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3344, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3344, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3344, 2023-10-08T13:21:55.717 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 26.443748905, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007907819 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3344, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3345 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3344, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 3344, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2023-10-08T13:21:55.718 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 1952, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1390, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2023-10-08T13:21:55.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2023-10-08T13:21:55.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2023-10-08T13:21:55.721 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 109, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 22, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 6, 2023-10-08T13:21:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 7, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 1, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2023-10-08T13:21:55.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.724 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 3698, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 19160913, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 3698, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3698, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 19160913, 2023-10-08T13:21:55.725 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:55.726 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3344, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 17583671, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3344, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 17583671, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.727 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3344, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3344, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3344, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3344, 2023-10-08T13:21:55.728 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:55.729 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x5582b8bf2960": { 2023-10-08T13:21:55.730 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:55.731 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:55.732 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T13:21:55.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:55 smithi118 ceph-mon[104234]: pgmap v795: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 20 op/s 2023-10-08T13:21:56.166 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-08T13:21:56.167 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-08T13:21:56.167 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-10-08T13:21:56.167 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:21:56.167 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:21:56.167 DEBUG:tasks.check_counter:Getting stats from h 2023-10-08T13:21:56.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-08T13:21:56.799 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:21:57.378 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:57 smithi060 ceph-mon[103190]: pgmap v796: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 16 op/s 2023-10-08T13:21:57.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:57 smithi005 ceph-mon[99496]: pgmap v796: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 16 op/s 2023-10-08T13:21:57.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:57 smithi118 ceph-mon[104234]: pgmap v796: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 16 op/s 2023-10-08T13:21:58.291 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T13:21:58.291 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2442, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 3008, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 908082, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 4399337, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 15, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.205946085, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.081391902, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.117993897, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.021941306, 2023-10-08T13:21:58.292 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3007, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.603356501, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000200650 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3576, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000799337, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000223 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 388208, 2023-10-08T13:21:58.293 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 1046320 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 221531, 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 221396, 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 36445270, 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 36084207, 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 16, 2023-10-08T13:21:58.294 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 7, 2023-10-08T13:21:58.295 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 9.622248215, 2023-10-08T13:21:58.295 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 3.456500787, 2023-10-08T13:21:58.295 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 7.204793622, 2023-10-08T13:21:58.295 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.006269318, 2023-10-08T13:21:58.295 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:58.295 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 221394, 2023-10-08T13:21:58.296 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 6.178969396, 2023-10-08T13:21:58.296 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000027909 2023-10-08T13:21:58.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.296 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:58.296 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 442370, 2023-10-08T13:21:58.296 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.060303506, 2023-10-08T13:21:58.297 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000136 2023-10-08T13:21:58.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.297 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:21:58.297 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 547104 2023-10-08T13:21:58.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.297 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:21:58.298 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1869304, 2023-10-08T13:21:58.298 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1868655, 2023-10-08T13:21:58.298 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 305028111, 2023-10-08T13:21:58.298 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 296284482, 2023-10-08T13:21:58.298 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 8, 2023-10-08T13:21:58.298 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 7, 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 75.144036978, 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 27.267648273, 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 55.263790921, 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.013399871, 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1868654, 2023-10-08T13:21:58.299 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 79.665359581, 2023-10-08T13:21:58.300 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000042632 2023-10-08T13:21:58.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.300 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:21:58.300 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3736513, 2023-10-08T13:21:58.300 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.463334386, 2023-10-08T13:21:58.300 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000124 2023-10-08T13:21:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1007872, 2023-10-08T13:21:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 191968 2023-10-08T13:21:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-08T13:21:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1256, 2023-10-08T13:21:58.302 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.403924274, 2023-10-08T13:21:58.303 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000321595 2023-10-08T13:21:58.303 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.303 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2023-10-08T13:21:58.303 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:21:58.303 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:21:58.304 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 106, 2023-10-08T13:21:58.304 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.005570177, 2023-10-08T13:21:58.304 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000052548 2023-10-08T13:21:58.304 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.304 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 466, 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 448, 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 448, 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 11.485991555, 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.025638374 2023-10-08T13:21:58.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.306 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2023-10-08T13:21:58.306 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 18, 2023-10-08T13:21:58.306 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 2, 2023-10-08T13:21:58.306 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2023-10-08T13:21:58.306 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 19, 2023-10-08T13:21:58.306 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 1, 2023-10-08T13:21:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2023-10-08T13:21:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 549, 2023-10-08T13:21:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 63, 2023-10-08T13:21:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 486, 2023-10-08T13:21:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2023-10-08T13:21:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 459, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 54, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 175, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 175, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 27, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 1328, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 1092, 2023-10-08T13:21:58.308 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 17, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 56, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 1, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 23, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 10497, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 1, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2023-10-08T13:21:58.309 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 9, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 193, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 64, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 1021, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 1319459435, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 4, 2023-10-08T13:21:58.310 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 64, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 64, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 26, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 229, 2023-10-08T13:21:58.311 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 418, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 1, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 540, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 262, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 39, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 134 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2023-10-08T13:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 61, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 34, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 5, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 38, 2023-10-08T13:21:58.313 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 15, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 15, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 15, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2023-10-08T13:21:58.314 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2023-10-08T13:21:58.315 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 1, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2023-10-08T13:21:58.316 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 1474, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 1474, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 3, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 3, 2023-10-08T13:21:58.317 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 6993784, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 0, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 534, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 9.376550203, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.017559082 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 0 2023-10-08T13:21:58.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.319 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2023-10-08T13:21:58.319 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 460, 2023-10-08T13:21:58.319 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 479, 2023-10-08T13:21:58.319 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 19, 2023-10-08T13:21:58.319 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 58, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 60, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 2, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 558, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 631, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 73, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 175, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 411, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 236, 2023-10-08T13:21:58.321 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 54728, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 198960 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 946, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 479, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 466, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 80, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 648, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 17, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.061885538, 2023-10-08T13:21:58.322 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.003640325 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 23, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.017099321, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000743448 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 24, 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.422867082, 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.017619461 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 263, 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3.563412087, 2023-10-08T13:21:58.325 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.013549095 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.326 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.327 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2023-10-08T13:21:58.329 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 28, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.041537786, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001483492 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 28, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.022650010, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000808928 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 34, 2023-10-08T13:21:58.330 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 7.128673890, 2023-10-08T13:21:58.331 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.209666879 2023-10-08T13:21:58.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.331 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.333 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.335 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 31, 2023-10-08T13:21:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.227865841, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007350511 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2023-10-08T13:21:58.337 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 2, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 1, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 2, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 95, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 47, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 1708, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-08T13:21:58.338 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:21:58.339 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:21:58.340 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:21:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 656783, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 571, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 264, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 3, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 9640, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 185, 2023-10-08T13:21:58.342 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 1792906, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 37273, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2023-10-08T13:21:58.343 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 866, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 2907665, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 27, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 866, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 866, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 19.043821089, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.021990555 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.344 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 866, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1005 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 866, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 80, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 786, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 0, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 10, 2023-10-08T13:21:58.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 14, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 548, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 76, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 43, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2023-10-08T13:21:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 65, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 20, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:21:58.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2023-10-08T13:21:58.348 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 109, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 22, 2023-10-08T13:21:58.349 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 12, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 12, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 168, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 4, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 57 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 1, 2023-10-08T13:21:58.350 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 1 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 4, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2023-10-08T13:21:58.351 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 2, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 15, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 2093275, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 153913536, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:58.352 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 2093275, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2093275, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 153913536, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:58.354 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 866, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 2909540, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 866, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2909540, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:58.356 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 866, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 866, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 866, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 866, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 15, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1907, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 15, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:58.358 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 14, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1907, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x56352f8de640": { 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:21:58.359 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 1474, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 2799480, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 1474, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 534, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2799480, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:21:58.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:21:58.361 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T13:21:58.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:58 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:58.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:58 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:58.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:58 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:58.362 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:58 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:21:58.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:58 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:58.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:58 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:58.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:58 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:58.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:58 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:21:58.697 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-08T13:21:58.697 INFO:tasks.check_counter:Daemon mds.h mds.imported=9 2023-10-08T13:21:58.697 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=4 2023-10-08T13:21:58.697 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:21:58.697 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:21:58.697 DEBUG:tasks.check_counter:Getting stats from k 2023-10-08T13:21:58.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-08T13:21:58.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:58 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:58.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:58 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:58.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:58 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:58.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:58 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' 2023-10-08T13:21:59.278 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:21:59.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:21:59 smithi060 ceph-mon[103190]: pgmap v797: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 KiB/s wr, 17 op/s 2023-10-08T13:21:59.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:21:59 smithi005 ceph-mon[99496]: pgmap v797: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 KiB/s wr, 17 op/s 2023-10-08T13:21:59.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:21:59 smithi118 ceph-mon[104234]: pgmap v797: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 KiB/s wr, 17 op/s 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 968, 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 968, 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 4447511, 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 300316, 2023-10-08T13:22:00.644 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.085160657, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.025656925, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.023612958, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.028134535, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 967, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.177767133, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000183833 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.645 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1042, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1264, 2023-10-08T13:22:00.646 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1544623, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 865189, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.100302432, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.028157414, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.024705767, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.038062086, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1262, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.305074749, 2023-10-08T13:22:00.647 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000241739 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 541744 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1644, 2023-10-08T13:22:00.648 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1610, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1405520, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 582191, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.168711271, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.046649561, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.057574061, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.057981813, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1609, 2023-10-08T13:22:00.649 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.451540938, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000280634 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 995456, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 181312 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2023-10-08T13:22:00.650 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5542, 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.153865845, 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000027763 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.651 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2023-10-08T13:22:00.652 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 875, 2023-10-08T13:22:00.653 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 4, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 818, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 53, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 869, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 10, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2023-10-08T13:22:00.654 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2023-10-08T13:22:00.655 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2023-10-08T13:22:00.656 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:22:00.657 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2023-10-08T13:22:00.658 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:22:00.659 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2023-10-08T13:22:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 2201, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 4, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2023-10-08T13:22:00.661 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 9672713, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 9664476, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 2201 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 654, 2023-10-08T13:22:00.662 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 1059, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 405, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 20, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 31, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 11, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 875, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 1131, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 256, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 50820, 2023-10-08T13:22:00.663 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 207152 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2023-10-08T13:22:00.665 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2023-10-08T13:22:00.668 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.669 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2023-10-08T13:22:00.671 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.672 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2023-10-08T13:22:00.674 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.675 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 2, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2023-10-08T13:22:00.677 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 1, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 2, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 2523, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:22:00.678 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:22:00.679 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2023-10-08T13:22:00.680 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 222939, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 704, 2023-10-08T13:22:00.681 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 9640, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 185, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:22:00.682 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 2159730, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 18968, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2023-10-08T13:22:00.683 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3293, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3293, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3293, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 14.182866140, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.004306974 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2023-10-08T13:22:00.684 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3293, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3294 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3293, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 3293, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 2003, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1288, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2023-10-08T13:22:00.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2023-10-08T13:22:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2023-10-08T13:22:00.687 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2023-10-08T13:22:00.688 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 109, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 22, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 6, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 7, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 1, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2023-10-08T13:22:00.689 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2023-10-08T13:22:00.690 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 3650, 2023-10-08T13:22:00.691 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 7048221, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 3650, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3650, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 7048221, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3293, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 5478414, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3293, 2023-10-08T13:22:00.693 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 5478414, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:22:00.694 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3293, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3293, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3293, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3293, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:22:00.696 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x560a9fee0960": { 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2023-10-08T13:22:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2023-10-08T13:22:00.698 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2023-10-08T13:22:00.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-08T13:22:00.699 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-08T13:22:01.056 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-08T13:22:01.056 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-08T13:22:01.056 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-10-08T13:22:01.056 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:22:01.056 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:22:01.056 DEBUG:tasks.check_counter:Getting stats from c 2023-10-08T13:22:01.057 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-08T13:22:01.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:01 smithi060 ceph-mon[103190]: pgmap v798: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T13:22:01.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:01 smithi005 ceph-mon[99496]: pgmap v798: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T13:22:01.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:01 smithi118 ceph-mon[104234]: pgmap v798: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 15 op/s 2023-10-08T13:22:02.659 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:22:03.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:03 smithi060 ceph-mon[103190]: pgmap v799: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T13:22:03.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:03 smithi005 ceph-mon[99496]: pgmap v799: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T13:22:03.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:03 smithi118 ceph-mon[104234]: pgmap v799: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-10-08T13:22:05.419 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:05 smithi118 ceph-mon[104234]: pgmap v800: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 63 KiB/s wr, 29 op/s 2023-10-08T13:22:05.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:05 smithi060 ceph-mon[103190]: pgmap v800: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 63 KiB/s wr, 29 op/s 2023-10-08T13:22:05.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:05 smithi005 ceph-mon[99496]: pgmap v800: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 63 KiB/s wr, 29 op/s 2023-10-08T13:22:06.788 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-08T13:22:06.788 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 509341, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 508979, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 85557647, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 85323802, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 10, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 2, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 23.137292485, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 11.108027800, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 14.835256172, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.029613143, 2023-10-08T13:22:06.789 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 508983, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 10.579864983, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000020786 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 842105, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.134425582, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000159 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1021232, 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 187296 2023-10-08T13:22:06.790 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 2830, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 4608, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 949164, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 4311828, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 15, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 10, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.228853295, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.102296093, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.138459596, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.015198229, 2023-10-08T13:22:06.791 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 4602, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.950177501, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000206470 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 4666, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.001247155, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000267 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 797664, 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 2736688 2023-10-08T13:22:06.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 4976716, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 4976282, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 819721229, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 787562829, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 13, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 9, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 202.642527972, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 93.791255179, 2023-10-08T13:22:06.793 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 135.678920626, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.009738889, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 4976280, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 90.033016505, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000018092 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 8791562, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.138034555, 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000129 2023-10-08T13:22:06.794 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 9696 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1360, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.865092253, 2023-10-08T13:22:06.795 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000636097 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 612, 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.040303479, 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000065855 2023-10-08T13:22:06.796 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 1171, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 1077, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1077, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 24.858606894, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.023081343 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 94, 2023-10-08T13:22:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 20, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 1, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 695, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 6, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 343, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 346, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 686, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 343, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 312, 2023-10-08T13:22:06.798 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 312, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 19, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 2531, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 2135, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 91, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 57, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 96, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 2217, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 1, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 10, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 253, 2023-10-08T13:22:06.799 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 11, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 399, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 138, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 1, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 1021, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 1319459435, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 4, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 138, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:22:06.800 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 138, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 20, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 335, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 993, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 854, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 326, 2023-10-08T13:22:06.801 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 113, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 845 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 63, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 43, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-08T13:22:06.802 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 217, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 195, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 17, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 19, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 10, 2023-10-08T13:22:06.803 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 1, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 2201, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 2201, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-08T13:22:06.804 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 4, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 4, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 2, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 4194304, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 9672713, 2023-10-08T13:22:06.805 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 0, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 563, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 9.430965378, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.016751270 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 0 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 677, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 1082, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 405, 2023-10-08T13:22:06.806 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 53, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 63, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 10, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 695, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 1233, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 538, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 312, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 936, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 624, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 58688, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 198960 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-08T13:22:06.807 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 1783, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 634, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 1171, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 71, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 894, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 192, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.274541544, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001429903 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 14, 2023-10-08T13:22:06.808 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.021409911, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001529279 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 19, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.192092168, 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.010110114 2023-10-08T13:22:06.809 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 449, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 8.729795877, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.019442752 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-08T13:22:06.810 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.811 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-08T13:22:06.812 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.813 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 142, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.100379606, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000706898 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 13, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.012030257, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000925404 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.814 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 223, 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 15.408732117, 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.069097453 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-08T13:22:06.815 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.816 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.817 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.818 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.819 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 25, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.119625414, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.004785016 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.820 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 2, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 3, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 1, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 2, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 95, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 47, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 929, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.821 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:22:06.822 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:22:06.823 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:22:06.824 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 410676, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 476, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 440, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 5, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 9640, 2023-10-08T13:22:06.825 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 185, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 2249231, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 17856, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.826 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 1511, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 5719840, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 33, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 1511, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1511, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 22.973494683, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.015204165 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.827 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1511, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1674 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 1511, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 208, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 1303, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 0, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 10, 2023-10-08T13:22:06.828 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 70, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 633, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 132, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 1, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 403, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 138, 2023-10-08T13:22:06.829 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 20, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-08T13:22:06.830 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-08T13:22:06.831 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 109, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 22, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 12, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 12, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 196, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 0, 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 71 2023-10-08T13:22:06.832 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 1, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-08T13:22:06.833 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 10, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 5, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 195, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 76, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 5488888, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 412102067, 2023-10-08T13:22:06.834 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 5488888, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 5488888, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 412102067, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-08T13:22:06.835 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 1511, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 5741455, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1511, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 5741455, 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:06.836 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:06.837 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 1511, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 1511, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1511, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 1511, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:22:06.838 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 195, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 21615, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 195, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 70, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 21615, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.839 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x56145a20a640": { 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 2201, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 5478409, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:06.840 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 2201, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 563, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 5478409, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:06.841 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-08T13:22:07.266 INFO:tasks.check_counter:Daemon mds.c mds.exported=10 2023-10-08T13:22:07.266 INFO:tasks.check_counter:Daemon mds.c mds.imported=11 2023-10-08T13:22:07.267 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=4 2023-10-08T13:22:07.267 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:22:07.267 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:22:07.267 DEBUG:tasks.check_counter:Getting stats from f 2023-10-08T13:22:07.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-08T13:22:07.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:07 smithi118 ceph-mon[104234]: pgmap v801: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 62 KiB/s wr, 25 op/s 2023-10-08T13:22:07.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:07 smithi060 ceph-mon[103190]: pgmap v801: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 62 KiB/s wr, 25 op/s 2023-10-08T13:22:07.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:07 smithi005 ceph-mon[99496]: pgmap v801: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 62 KiB/s wr, 25 op/s 2023-10-08T13:22:08.006 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:22:09.521 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:09 smithi118 ceph-mon[104234]: pgmap v802: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 66 KiB/s wr, 27 op/s 2023-10-08T13:22:09.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:09 smithi060 ceph-mon[103190]: pgmap v802: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 66 KiB/s wr, 27 op/s 2023-10-08T13:22:09.676 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:09 smithi005 ceph-mon[99496]: pgmap v802: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 66 KiB/s wr, 27 op/s 2023-10-08T13:22:09.745 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-08T13:22:09.745 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:22:09.745 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 1927635, 2023-10-08T13:22:09.745 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 1927714, 2023-10-08T13:22:09.745 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 305854372, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 317276503, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 16, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 9, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 69.929206457, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 26.488449840, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 50.793772731, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.115436618, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1927709, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 83.559684324, 2023-10-08T13:22:09.746 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000043346 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3853120, 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.461534843, 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000119 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1015808, 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 188448 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.747 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 224019, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 223520, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 38094220, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 38874165, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 9, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 5, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 12.497043906, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 5.263172226, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 9.125700898, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.015474957, 2023-10-08T13:22:09.748 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 223523, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 4.718393324, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000021109 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 446548, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.066636959, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000149 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-08T13:22:09.749 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 466912 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 5004270, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 5004970, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 791309057, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 824706126, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 13, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 8, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 189.739039617, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 82.621472307, 2023-10-08T13:22:09.750 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 136.771469396, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.043890957, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 5004968, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 144.734959026, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000028918 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 9777056, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.703844927, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000174 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.751 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 527424, 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 1436352 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1418, 2023-10-08T13:22:09.752 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.500320986, 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000352835 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 17, 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000454971, 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000026763 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.753 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 673, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 596, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 596, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 2.521777837, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.004231170 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 77, 2023-10-08T13:22:09.754 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 1, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 27, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 2, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 1120, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 241, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 723, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 156, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 774, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 90, 2023-10-08T13:22:09.755 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 458, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 458, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 31, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 1573, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 1332, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 59, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 47, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 21, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 3297, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 1, 2023-10-08T13:22:09.756 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 1, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 33, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 12, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 702, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 232, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 3, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 1021, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 1319459435, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 4, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 232, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-08T13:22:09.757 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 232, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 23, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 274, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 407, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 2, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:22:09.758 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 695, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 327, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 26, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 109 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 81, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 30, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 3, 2023-10-08T13:22:09.759 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 20, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 2, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 16, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 8, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 1, 2023-10-08T13:22:09.760 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 2, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 1226, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2023-10-08T13:22:09.761 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 1226, 2023-10-08T13:22:09.762 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-08T13:22:09.762 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2023-10-08T13:22:09.762 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 3, 2023-10-08T13:22:09.762 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2023-10-08T13:22:09.762 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 3, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 2, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 4194304, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 10249442, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 0, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 566, 2023-10-08T13:22:09.763 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 8.466156951, 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.014957874 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 0 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 1059, 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 1089, 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 30, 2023-10-08T13:22:09.764 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 87, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 91, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 4, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 1128, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 1222, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 94, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 458, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 748, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 290, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 59860, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 198960 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-08T13:22:09.765 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 1039, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 298, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 673, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 63, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 493, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 14, 2023-10-08T13:22:09.766 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.040220571, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002872897 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 24, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.265750191, 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.011072924 2023-10-08T13:22:09.767 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 446, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.216615894, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002727838 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.768 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.769 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.770 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.771 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-08T13:22:09.772 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 30, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.041080185, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001369339 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 37, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.066360239, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001793519 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 25, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.824062603, 2023-10-08T13:22:09.773 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.032962504 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.774 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-08T13:22:09.775 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.776 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.777 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-08T13:22:09.778 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 20, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.067688154, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.003384407 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.779 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 2, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 3, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 1, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 2, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 116, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 58, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 937, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-08T13:22:09.780 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:22:09.781 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:22:09.782 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:22:09.783 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 554213, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 950, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:22:09.784 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 9640, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 185, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 3658375, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 46482, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-08T13:22:09.785 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 994, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 6230441, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 33, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 994, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 994, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 13.259706984, 2023-10-08T13:22:09.786 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.013339745 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 994, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1120 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 994, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 234, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 760, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-08T13:22:09.787 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 10, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 1, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 567, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 63, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 19, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-08T13:22:09.788 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 232, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 20, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-08T13:22:09.789 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-08T13:22:09.790 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 110, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 23, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 12, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 12, 2023-10-08T13:22:09.791 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 167, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 2, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 39 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 1, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.792 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 4, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 2, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 2, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.793 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 7155922, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 491132744, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 7155922, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 7155922, 2023-10-08T13:22:09.794 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 491132744, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:09.795 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 994, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 6230643, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 994, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 6230643, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.796 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 994, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 994, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 994, 2023-10-08T13:22:09.797 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 994, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:09.798 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 2, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 218, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 2, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 218, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.799 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x555e1aa96640": { 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 1226, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 6055138, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 1226, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:09.800 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 566, 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 6055138, 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:09.801 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-08T13:22:10.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:10 smithi060 ceph-mon[103190]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T13:22:10.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:10 smithi005 ceph-mon[99496]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T13:22:10.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:10 smithi118 ceph-mon[104234]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T13:22:11.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:11 smithi060 ceph-mon[103190]: pgmap v804: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 64 KiB/s wr, 29 op/s 2023-10-08T13:22:11.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:11 smithi005 ceph-mon[99496]: pgmap v804: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 64 KiB/s wr, 29 op/s 2023-10-08T13:22:11.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:11 smithi118 ceph-mon[104234]: pgmap v804: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 64 KiB/s wr, 29 op/s 2023-10-08T13:22:12.782 INFO:tasks.check_counter:Daemon mds.f mds.exported=1 2023-10-08T13:22:12.782 INFO:tasks.check_counter:Daemon mds.f mds.imported=12 2023-10-08T13:22:12.782 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=4 2023-10-08T13:22:12.782 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:22:12.782 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:22:12.782 DEBUG:tasks.check_counter:Getting stats from i 2023-10-08T13:22:12.782 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-08T13:22:13.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:13 smithi060 ceph-mon[103190]: pgmap v805: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 37 KiB/s wr, 14 op/s 2023-10-08T13:22:13.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:13 smithi005 ceph-mon[99496]: pgmap v805: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 37 KiB/s wr, 14 op/s 2023-10-08T13:22:13.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:13 smithi118 ceph-mon[104234]: pgmap v805: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 37 KiB/s wr, 14 op/s 2023-10-08T13:22:15.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:15 smithi060 ceph-mon[103190]: pgmap v806: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2023-10-08T13:22:15.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:15 smithi005 ceph-mon[99496]: pgmap v806: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2023-10-08T13:22:15.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:15 smithi118 ceph-mon[104234]: pgmap v806: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2023-10-08T13:22:16.695 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:22:17.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:17 smithi060 ceph-mon[103190]: pgmap v807: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-10-08T13:22:17.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:17 smithi005 ceph-mon[99496]: pgmap v807: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-10-08T13:22:17.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:17 smithi118 ceph-mon[104234]: pgmap v807: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-10-08T13:22:19.617 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:19 smithi118 ceph-mon[104234]: pgmap v808: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-10-08T13:22:19.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:19 smithi060 ceph-mon[103190]: pgmap v808: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-10-08T13:22:19.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:19 smithi005 ceph-mon[99496]: pgmap v808: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-10-08T13:22:21.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:21 smithi060 ceph-mon[103190]: pgmap v809: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 67 KiB/s wr, 11 op/s 2023-10-08T13:22:21.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:21 smithi060 ceph-mon[103190]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T13:22:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:21 smithi005 ceph-mon[99496]: pgmap v809: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 67 KiB/s wr, 11 op/s 2023-10-08T13:22:21.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:21 smithi005 ceph-mon[99496]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T13:22:21.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:21 smithi118 ceph-mon[104234]: pgmap v809: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 67 KiB/s wr, 11 op/s 2023-10-08T13:22:21.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:21 smithi118 ceph-mon[104234]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T13:22:23.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:23 smithi060 ceph-mon[103190]: pgmap v811: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 KiB/s wr, 13 op/s 2023-10-08T13:22:23.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:23 smithi005 ceph-mon[99496]: pgmap v811: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 KiB/s wr, 13 op/s 2023-10-08T13:22:23.696 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:23 smithi118 ceph-mon[104234]: pgmap v811: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 KiB/s wr, 13 op/s 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 509389, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 509725, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 82222258, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 91558535, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 205, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 9, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 21.607696134, 2023-10-08T13:22:25.002 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 9.160815278, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 16.158813557, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.059853752, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 509721, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 16.775316712, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000032910 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 980605, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.236443537, 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000241 2023-10-08T13:22:25.003 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1040640, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 197728 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 443687, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 444478, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 71617471, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 79742317, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 10, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 5, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 18.201240992, 2023-10-08T13:22:25.004 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 7.854607868, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 12.893958478, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.084594987, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 444478, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 12.252774077, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000027566 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 884761, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.119874426, 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000135 2023-10-08T13:22:25.005 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 484624 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 10721, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 11456, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 4091704, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 10130330, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 32, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 5, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.788090955, 2023-10-08T13:22:25.006 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.240132968, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.480278701, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.192672624, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 11456, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 2.146145544, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000187338 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 17305, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.002918445, 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000168 2023-10-08T13:22:25.007 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 2102288, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 3765664 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3065, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.778417057, 2023-10-08T13:22:25.008 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000580233 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 139, 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.007149136, 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000051432 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-08T13:22:25.009 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 2318, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 2077, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2077, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 5.825739571, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002804881 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 241, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 5, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 2, 2023-10-08T13:22:25.010 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 512, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 3, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 175, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 16, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 141, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 18, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 153, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 1318, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 5, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 5, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 11, 2023-10-08T13:22:25.011 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 2790, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 1905, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 235, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 10, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 1, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 45, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 407, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 30, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 1285, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 3, 2023-10-08T13:22:25.012 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 176, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 268, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 1, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 1013, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 1238973259, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 6, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 268, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 40, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 2, 2023-10-08T13:22:25.013 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 38, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 228, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 20, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 194, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 1346, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 1212, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 973, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 24, 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 199 2023-10-08T13:22:25.014 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 15, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 71, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 61, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 35, 2023-10-08T13:22:25.015 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 23, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 4, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 2, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 30, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 3, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-08T13:22:25.016 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 3153, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 3120, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 3120, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 33, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 2, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 75, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 73, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 73, 2023-10-08T13:22:25.017 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 2, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 1, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 1, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 16519298, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 16834099, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 0, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1295, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 12.548028043, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.009689596 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.018 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 0 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 69, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 1355, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 1286, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 54, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 115, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 61, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 175, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 1874, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 1699, 2023-10-08T13:22:25.019 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 5, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 1104, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 1099, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 71072, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207152 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 2638, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 141, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 2318, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 274, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 193, 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-08T13:22:25.020 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1033, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 3.189579042, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.003087685 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 216, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.212591777, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000984221 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.021 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 23, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.126184640, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.005486288 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 62, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.150564023, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002428451 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.022 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1, 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000340073, 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000340073 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-08T13:22:25.023 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.024 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 16, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.003625127, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000226570 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 35, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.272192028, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.007776915 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-08T13:22:25.025 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 16, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 1.126939361, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.070433710 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 516, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.139660004, 2023-10-08T13:22:25.026 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000270658 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 44, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.104318669, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002370878 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 50, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.299097070, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.005981941 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.027 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.028 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 10, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.075979222, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.007597922 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.029 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.002314454, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.001157227 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-08T13:22:25.030 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 7, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.021247315, 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.003035330 2023-10-08T13:22:25.031 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 46, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.101106766, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.002197973 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:22:25.032 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 2, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 4, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 2, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 2, 2023-10-08T13:22:25.033 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 31, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 15, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 954, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 360, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 360, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:22:25.034 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-08T13:22:25.035 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-08T13:22:25.036 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 522739, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 289, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 616, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 7, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:22:25.037 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 9640, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 185, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 545718, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 19494, 2023-10-08T13:22:25.038 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 4479, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 15952746, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 31, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 4479, 2023-10-08T13:22:25.039 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 4479, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 408.432709958, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.091188370 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 4479, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 8305 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 4479, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 293, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 4186, 2023-10-08T13:22:25.040 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 444, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 1853, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 16, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 1309, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 266, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 3, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 102, 2023-10-08T13:22:25.041 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 277, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 2810, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:22:25.042 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-08T13:22:25.043 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 111, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 29, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 12, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 12, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-08T13:22:25.044 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 1149, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 14, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 62 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 1, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-08T13:22:25.045 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 25, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 5, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 35, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:22:25.046 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 963793, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 70897298, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 963793, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 963793, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 70897298, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.047 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:25.048 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 4479, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 15956497, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 4479, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 15956497, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:25.049 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 4479, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 4479, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 4479, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 4479, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.050 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 35, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 3839, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 35, 2023-10-08T13:22:25.051 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 14, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 3839, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x55c3e451c640": { 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:25.052 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 3153, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 12639795, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 3153, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 1295, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 12639795, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:25.053 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.054 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:25.054 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-08T13:22:25.450 INFO:tasks.check_counter:Daemon mds.i mds.exported=30 2023-10-08T13:22:25.450 INFO:tasks.check_counter:Daemon mds.i mds.imported=3 2023-10-08T13:22:25.450 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-10-08T13:22:25.450 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=16 2023-10-08T13:22:25.451 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=10 2023-10-08T13:22:25.451 DEBUG:tasks.check_counter:Getting stats from l 2023-10-08T13:22:25.451 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-08T13:22:25.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:25 smithi060 ceph-mon[103190]: pgmap v812: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 14 op/s 2023-10-08T13:22:25.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:25 smithi005 ceph-mon[99496]: pgmap v812: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 14 op/s 2023-10-08T13:22:25.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:25 smithi118 ceph-mon[104234]: pgmap v812: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 14 op/s 2023-10-08T13:22:26.107 INFO:teuthology.orchestra.run.smithi118.stderr:Inferring config /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:22:27.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:27 smithi060 ceph-mon[103190]: pgmap v813: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-10-08T13:22:27.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:27 smithi005 ceph-mon[99496]: pgmap v813: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-10-08T13:22:27.677 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-10-08T13:22:27.677 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:22:27.677 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 1172, 2023-10-08T13:22:27.677 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 1174, 2023-10-08T13:22:27.677 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 4578967, 2023-10-08T13:22:27.677 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 364502, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 6, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 2, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.099975075, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.025043013, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.026289150, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.039519475, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 1172, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.223489560, 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000190690 2023-10-08T13:22:27.678 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 2198, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 2162, 2023-10-08T13:22:27.679 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 5738019, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 755525, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 4, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.176506510, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.047429132, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.057871573, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.066058014, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 2162, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.345924460, 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000160002 2023-10-08T13:22:27.680 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 1003088, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 186640 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_messages": 451, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages": 678, 2023-10-08T13:22:27.681 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_bytes": 4309511, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_bytes": 691633, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_created_connections": 5, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_active_connections": 3, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_total_time": 0.048265906, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_send_time": 0.018763025, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_recv_time": 0.012080753, 2023-10-08T13:22:27.682 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_running_fast_dispatch_time": 0.013008171, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 676, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.118718110, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000175618 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T13:22:27.683 INFO:teuthology.orchestra.run.smithi118.stdout: "msgr_send_encrypted_bytes": 552304 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "cct": { 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "total_workers": 1, 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "unhealthy_workers": 0 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-MDSRank": { 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 5778, 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.165921984, 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000028716 2023-10-08T13:22:27.684 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "finisher-PurgeQueue": { 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "queue_len": 0, 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "complete_latency": { 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.685 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": { 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "request": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "reply": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "reply_latency": { 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_reply": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "forward": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_complete": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_fetch_keys": 0, 2023-10-08T13:22:27.686 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_commit": 0, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_split": 0, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_merge": 0, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes": 188, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_top": 30, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_bottom": 151, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pin_tail": 7, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_pinned": 145, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_expired": 38, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "inodes_with_caps": 0, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": 0, 2023-10-08T13:22:27.687 INFO:teuthology.orchestra.run.smithi118.stdout: "subtrees": 5, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_hit": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_forward": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_discover": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_remote_ino": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "traverse_lock": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "load_cent": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "q": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "exported": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "exported_inodes": 0, 2023-10-08T13:22:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: "imported": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "imported_inodes": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_dir_fetch": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "openino_peer_discover": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rfiles": 1013, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rbytes": 1238973259, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "root_rsnaps": 6, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_set_tag": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:22:27.689 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "scrub_file_inodes": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:22:27.690 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_cap_release": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "process_request_cap_release": 0 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_cache": { 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_update_receipt": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_try_discover": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_send_discover": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "dir_handle_discover": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays": 0, 2023-10-08T13:22:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_delayed": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_created": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_enqueued": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_reintegrated": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "strays_migrated": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_processing": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_started": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "recovery_completed": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:22:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_exportdir": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_flush": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_fragstats": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ireq_inodestats": 0 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_log": { 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "evlrg": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "evadd": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "evex": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "evtrm": 0, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "ev": 3154, 2023-10-08T13:22:27.693 INFO:teuthology.orchestra.run.smithi118.stdout: "evexg": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "evexd": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "segadd": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "segex": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "segtrm": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "seg": 2, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "segmjr": 71, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "segexg": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "segexd": 0, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "expos": 16519298, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "wrpos": 16855006, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "rdpos": 16834099, 2023-10-08T13:22:27.694 INFO:teuthology.orchestra.run.smithi118.stdout: "jlat": { 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "replayed": 3154 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_mem": { 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "ino": 53, 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "ino+": 1339, 2023-10-08T13:22:27.695 INFO:teuthology.orchestra.run.smithi118.stdout: "ino-": 1286, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "dir": 18, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "dir+": 87, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "dir-": 69, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "dn": 188, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "dn+": 1520, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "dn-": 1332, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "cap": 0, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "cap+": 0, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "cap-": 0, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "rss": 51076, 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: "heap": 207152 2023-10-08T13:22:27.696 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_server": { 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_client_request": 0, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "dispatch_server_request": 0, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_request": 0, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_client_session": 0, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "handle_peer_request": 0, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "req_create_latency": { 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.697 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getattr_latency": { 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getfilelock_latency": { 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "req_link_latency": { 2023-10-08T13:22:27.698 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookup_latency": { 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookuphash_latency": { 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.699 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupino_latency": { 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupname_latency": { 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.700 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupparent_latency": { 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lookupsnap_latency": { 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.701 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "req_lssnap_latency": { 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mkdir_latency": { 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.702 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mknod_latency": { 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "req_mksnap_latency": { 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.703 INFO:teuthology.orchestra.run.smithi118.stdout: "req_open_latency": { 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "req_readdir_latency": { 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rename_latency": { 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.704 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "req_renamesnap_latency": { 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "req_snapdiff_latency": { 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.705 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmdir_latency": { 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmsnap_latency": { 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.706 INFO:teuthology.orchestra.run.smithi118.stdout: "req_rmxattr_latency": { 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setattr_latency": { 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.709 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setdirlayout_latency": { 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setfilelock_latency": { 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setlayout_latency": { 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.710 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "req_setxattr_latency": { 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "req_symlink_latency": { 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.711 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "req_unlink_latency": { 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "req_getvxattr_latency": { 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.712 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_sessions": { 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "session_count": 2, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "session_add": 4, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "session_remove": 2, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_open": 2, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "sessions_stale": 0, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "total_load": 0, 2023-10-08T13:22:27.713 INFO:teuthology.orchestra.run.smithi118.stdout: "average_load": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "avg_session_uptime": 2514, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "mdthresh_evicted": 0 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "mempool": { 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bloom_filter_items": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:22:27.714 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_extent_items": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_blob_items": 0, 2023-10-08T13:22:27.715 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_txc_items": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluestore_writing_items": 0, 2023-10-08T13:22:27.716 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_bytes": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_items": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_bytes": 194665, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_anon_items": 173, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "buffer_meta_items": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_bytes": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_items": 0, 2023-10-08T13:22:27.717 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_mapbl_items": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_pglog_items": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_bytes": 9640, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_items": 185, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_bytes": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "pgmap_items": 0, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_bytes": 396515, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_co_items": 17623, 2023-10-08T13:22:27.718 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_bytes": 0, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_1_items": 0, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_bytes": 0, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "unittest_2_items": 0 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "objecter": { 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_active": 0, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_laggy": 0, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send": 3449, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_send_bytes": 26, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_resend": 4, 2023-10-08T13:22:27.719 INFO:teuthology.orchestra.run.smithi118.stdout: "op_reply": 3449, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "op_latency": { 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3449, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 29.002359326, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.008408918 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "op_inflight": 0, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "oplen_avg": { 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 3449, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 3450 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "op": 3449, 2023-10-08T13:22:27.720 INFO:teuthology.orchestra.run.smithi118.stdout: "op_r": 3449, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "op_w": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "op_rmw": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "op_pg": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_stat": 2090, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_create": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_read": 1356, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_write": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writefull": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_writesame": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_append": 0, 2023-10-08T13:22:27.721 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_zero": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_truncate": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_delete": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_mapext": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_sparse_read": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_clonerange": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_getxattr": 2, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_setxattr": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_rmxattr": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_call": 0, 2023-10-08T13:22:27.722 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_watch": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_notify": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "osdop_other": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_active": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_send": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_resend": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "linger_ping": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_active": 0, 2023-10-08T13:22:27.723 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_send": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "poolop_resend": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_active": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_send": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "poolstat_resend": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_active": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_send": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "statfs_resend": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "command_active": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "command_send": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "command_resend": 0, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "map_epoch": 111, 2023-10-08T13:22:27.724 INFO:teuthology.orchestra.run.smithi118.stdout: "map_full": 0, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "map_inc": 24, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_sessions": 5, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_open": 5, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_session_close": 0, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_laggy": 0, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_wr": 0, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_rd": 2, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_del": 0 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "oft": { 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_objs": 0, 2023-10-08T13:22:27.725 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_updates": 0, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "omap_total_removes": 0 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "osd-slow-ops": { 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "slow_ops_count": 0 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "purge_queue": { 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops": 0, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing": 0, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executing_high_water": 0, 2023-10-08T13:22:27.726 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_executed": 0, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "pq_item_in_journal": 0 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 3817, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 14261540, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 3817, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:27.727 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 3817, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 14261540, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_bytes": { 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 104857600, 2023-10-08T13:22:27.728 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 3449, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 12661295, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 3449, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 12661295, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.729 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-objecter_ops": { 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 1024, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 3449, 2023-10-08T13:22:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 3449, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 3449, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 3449, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:27.731 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.732 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "throttle-write_buf_throttle-0x556cbbf7e960": { 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "val": 0, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "max": 3758096384, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "get_started": 0, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "get": 0, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "get_sum": 0, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_fail": 0, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "get_or_fail_success": 0, 2023-10-08T13:22:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: "take": 0, 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "take_sum": 0, 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "put": 0, 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "put_sum": 0, 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "wait": { 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "avgcount": 0, 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "sum": 0.000000000, 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: "avgtime": 0.000000000 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-10-08T13:22:27.734 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-10-08T13:22:27.735 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:27 smithi118 ceph-mon[104234]: pgmap v813: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-10-08T13:22:28.102 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-08T13:22:28.103 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-08T13:22:28.103 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2023-10-08T13:22:28.103 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:22:28.103 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:22:28.104 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T13:22:28.116 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T13:22:28.116 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:22:28.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:22:28.151 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:22:28.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:22:28.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:22:28.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 -- 172.21.15.5:0/406033992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c101800 msgr2=0x7f144c101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 --2- 172.21.15.5:0/406033992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c101800 0x7f144c101be0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1440009990 tx=0x7f1440009ca0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 -- 172.21.15.5:0/406033992 shutdown_connections 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 --2- 172.21.15.5:0/406033992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c10ac20 0x7f144c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 --2- 172.21.15.5:0/406033992 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c101800 0x7f144c101be0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 --2- 172.21.15.5:0/406033992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144c102120 0x7f144c10a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 -- 172.21.15.5:0/406033992 >> 172.21.15.5:0/406033992 conn(0x7f144c0fb040 msgr2=0x7f144c0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 -- 172.21.15.5:0/406033992 shutdown_connections 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 -- 172.21.15.5:0/406033992 wait complete. 2023-10-08T13:22:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 Processor -- start 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.402+0000 7f1452a6c700 1 -- start start 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 0x7f144c0ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144c102120 0x7f144c0ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c10ac20 0x7f144c0ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1a4ea0 con 0x7f144c101800 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1a5010 con 0x7f144c102120 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1a51d0 con 0x7f144c10ac20 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 0x7f144c0ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 0x7f144c0ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39174/0 (socket says 172.21.15.5:39174) 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 -- 172.21.15.5:0/2183285199 learned_addr learned my addr 172.21.15.5:0/2183285199 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f144bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144c102120 0x7f144c0ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1451009700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c10ac20 0x7f144c0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 -- 172.21.15.5:0/2183285199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c10ac20 msgr2=0x7f144c0ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c10ac20 0x7f144c0ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 -- 172.21.15.5:0/2183285199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144c102120 msgr2=0x7f144c0ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144c102120 0x7f144c0ff990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 -- 172.21.15.5:0/2183285199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400095f0 con 0x7f144c101800 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1450808700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 0x7f144c0ff450 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1440005770 tx=0x7f14400057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144001d070 con 0x7f144c101800 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c1a5450 con 0x7f144c101800 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1440021410 con 0x7f144c101800 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440017650 con 0x7f144c101800 2023-10-08T13:22:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.403+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c1a5950 con 0x7f144c101800 2023-10-08T13:22:28.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.404+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144c105d50 con 0x7f144c101800 2023-10-08T13:22:28.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.406+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f144000fb00 con 0x7f144c101800 2023-10-08T13:22:28.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.406+0000 7f1449ffb700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f143c0a15f0 0x7f143c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.407+0000 7f144bfff700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f143c0a15f0 0x7f143c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.407+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f14400cee80 con 0x7f144c101800 2023-10-08T13:22:28.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.407+0000 7f144bfff700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f143c0a15f0 0x7f143c0a3ab0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f144c100b80 tx=0x7f1438009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:28.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.410+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1440097ea0 con 0x7f144c101800 2023-10-08T13:22:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.617+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f144c100930 con 0x7f144c101800 2023-10-08T13:22:28.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.618+0000 7f1449ffb700 1 -- 172.21.15.5:0/2183285199 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+25071 (secure 0 0 0) 0x7f144009b4c0 con 0x7f144c101800 2023-10-08T13:22:28.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:22:28.620 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":111,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:22:21.047553+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:22:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f143c0a15f0 msgr2=0x7f143c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f143c0a15f0 0x7f143c0a3ab0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f144c100b80 tx=0x7f1438009260 comp rx=0 tx=0).stop 2023-10-08T13:22:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 msgr2=0x7f144c0ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 0x7f144c0ff450 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1440005770 tx=0x7f14400057a0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 shutdown_connections 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f143c0a15f0 0x7f143c0a3ab0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f144c10ac20 0x7f144c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f144c101800 0x7f144c0ff450 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 --2- 172.21.15.5:0/2183285199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f144c102120 0x7f144c0ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 >> 172.21.15.5:0/2183285199 conn(0x7f144c0fb040 msgr2=0x7f144c0fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 shutdown_connections 2023-10-08T13:22:28.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.621+0000 7f1452a6c700 1 -- 172.21.15.5:0/2183285199 wait complete. 2023-10-08T13:22:28.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:00:15.547337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:04:08.468296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:04:09.557834+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 110, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:04:13.552644+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 110, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:22:28.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:22:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 -- 172.21.15.5:0/1688968098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 msgr2=0x7f66d810c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/1688968098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d810c3b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f66d000b0d0 tx=0x7f66d000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 -- 172.21.15.5:0/1688968098 shutdown_connections 2023-10-08T13:22:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/1688968098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d810c3b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/1688968098 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d81055f0 0x7f66d81059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/1688968098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d80ff530 0x7f66d80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 -- 172.21.15.5:0/1688968098 >> 172.21.15.5:0/1688968098 conn(0x7f66d80fafc0 msgr2=0x7f66d80fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 -- 172.21.15.5:0/1688968098 shutdown_connections 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.764+0000 7f66dfd8b700 1 -- 172.21.15.5:0/1688968098 wait complete. 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 Processor -- start 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 -- start start 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d80ff530 0x7f66d8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d81055f0 0x7f66d81a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81986e0 con 0x7f66d80ffef0 2023-10-08T13:22:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81a2ef0 con 0x7f66d80ff530 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dfd8b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81a3030 con 0x7f66d81055f0 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d8197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39190/0 (socket says 172.21.15.5:39190) 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 -- 172.21.15.5:0/666512854 learned_addr learned my addr 172.21.15.5:0/666512854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66ddb27700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d80ff530 0x7f66d8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66de328700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d81055f0 0x7f66d81a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 -- 172.21.15.5:0/666512854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d81055f0 msgr2=0x7f66d81a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d81055f0 0x7f66d81a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 -- 172.21.15.5:0/666512854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d80ff530 msgr2=0x7f66d8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d80ff530 0x7f66d8197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.765+0000 7f66dd326700 1 -- 172.21.15.5:0/666512854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0009d00 con 0x7f66d80ffef0 2023-10-08T13:22:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.766+0000 7f66dd326700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d8197e70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e9a0 tx=0x7f66c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.766+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8009790 con 0x7f66d80ffef0 2023-10-08T13:22:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.766+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c8010430 con 0x7f66d80ffef0 2023-10-08T13:22:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.766+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8018680 con 0x7f66d80ffef0 2023-10-08T13:22:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.766+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d81a32c0 con 0x7f66d80ffef0 2023-10-08T13:22:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.766+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d81a37d0 con 0x7f66d80ffef0 2023-10-08T13:22:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.767+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8107a90 con 0x7f66d80ffef0 2023-10-08T13:22:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.768+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f66c80105a0 con 0x7f66d80ffef0 2023-10-08T13:22:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.768+0000 7f66ceffd700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f66c40a1670 0x7f66c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.769+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f66c8014070 con 0x7f66d80ffef0 2023-10-08T13:22:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.769+0000 7f66ddb27700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f66c40a1670 0x7f66c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.769+0000 7f66ddb27700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f66c40a1670 0x7f66c40a3b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009c60 tx=0x7f66d4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.772+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f66c8096820 con 0x7f66d80ffef0 2023-10-08T13:22:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.973+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66d8067f60 con 0x7f66d80ffef0 2023-10-08T13:22:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.974+0000 7f66ceffd700 1 -- 172.21.15.5:0/666512854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66c8026020 con 0x7f66d80ffef0 2023-10-08T13:22:28.975 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-10-08T13:22:28.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f66c40a1670 msgr2=0x7f66c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f66c40a1670 0x7f66c40a3b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009c60 tx=0x7f66d4009260 comp rx=0 tx=0).stop 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 msgr2=0x7f66d8197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d8197e70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e9a0 tx=0x7f66c800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 shutdown_connections 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f66c40a1670 0x7f66c40a3b30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66d81055f0 0x7f66d81a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d80ff530 0x7f66d8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 --2- 172.21.15.5:0/666512854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66d80ffef0 0x7f66d8197e70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 >> 172.21.15.5:0/666512854 conn(0x7f66d80fafc0 msgr2=0x7f66d80fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 shutdown_connections 2023-10-08T13:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:28.976+0000 7f66dfd8b700 1 -- 172.21.15.5:0/666512854 wait complete. 2023-10-08T13:22:28.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 -- 172.21.15.5:0/3433148778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd808105620 msgr2=0x7fd808105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 --2- 172.21.15.5:0/3433148778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd808105620 0x7fd808105a00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009920 tx=0x7fd7fc009c30 comp rx=0 tx=0).stop 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 -- 172.21.15.5:0/3433148778 shutdown_connections 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 --2- 172.21.15.5:0/3433148778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8080fff20 0x7fd80810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 --2- 172.21.15.5:0/3433148778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd808105620 0x7fd808105a00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 --2- 172.21.15.5:0/3433148778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8080ff560 0x7fd8080ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 -- 172.21.15.5:0/3433148778 >> 172.21.15.5:0/3433148778 conn(0x7fd8080fb030 msgr2=0x7fd8080fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 -- 172.21.15.5:0/3433148778 shutdown_connections 2023-10-08T13:22:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 -- 172.21.15.5:0/3433148778 wait complete. 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 Processor -- start 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.117+0000 7fd80f144700 1 -- start start 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 0x7fd8081011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8080fff20 0x7fd808101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808105620 0x7fd808101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081a4f90 con 0x7fd8080ff560 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081a5100 con 0x7fd808105620 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081a52c0 con 0x7fd8080fff20 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 0x7fd8081011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 0x7fd8081011d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39202/0 (socket says 172.21.15.5:39202) 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 -- 172.21.15.5:0/595623147 learned_addr learned my addr 172.21.15.5:0/595623147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd807fff700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8080fff20 0x7fd808101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80d6e1700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808105620 0x7fd808101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 -- 172.21.15.5:0/595623147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8080fff20 msgr2=0x7fd808101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8080fff20 0x7fd808101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 -- 172.21.15.5:0/595623147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808105620 msgr2=0x7fd808101c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808105620 0x7fd808101c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 -- 172.21.15.5:0/595623147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8009520 con 0x7fd8080ff560 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80cee0700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 0x7fd8081011d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009230 tx=0x7fd7fc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc01c070 con 0x7fd8080ff560 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd800009d00 con 0x7fd8080ff560 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7fc00ba20 con 0x7fd8080ff560 2023-10-08T13:22:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.118+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc004930 con 0x7fd8080ff560 2023-10-08T13:22:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.119+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc009520 con 0x7fd8080ff560 2023-10-08T13:22:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.119+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd808100c80 con 0x7fd8080ff560 2023-10-08T13:22:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.121+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd7fc020070 con 0x7fd8080ff560 2023-10-08T13:22:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.121+0000 7fd805ffb700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7f00a15f0 0x7fd7f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.121+0000 7fd807fff700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7f00a15f0 0x7fd7f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.122+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd7fc0cdfe0 con 0x7fd8080ff560 2023-10-08T13:22:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.122+0000 7fd807fff700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7f00a15f0 0x7fd7f00a3ab0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd808102900 tx=0x7fd7f8009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.126+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7fc096fe0 con 0x7fd8080ff560 2023-10-08T13:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.325+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd80810f5e0 con 0x7fd8080ff560 2023-10-08T13:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.325+0000 7fd805ffb700 1 -- 172.21.15.5:0/595623147 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7fc09a600 con 0x7fd8080ff560 2023-10-08T13:22:29.326 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:22:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7f00a15f0 msgr2=0x7fd7f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7f00a15f0 0x7fd7f00a3ab0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd808102900 tx=0x7fd7f8009260 comp rx=0 tx=0).stop 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 msgr2=0x7fd8081011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 0x7fd8081011d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009230 tx=0x7fd7fc00fa00 comp rx=0 tx=0).stop 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 shutdown_connections 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fd7f00a15f0 0x7fd7f00a3ab0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd808105620 0x7fd808101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8080ff560 0x7fd8081011d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 --2- 172.21.15.5:0/595623147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8080fff20 0x7fd808101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 >> 172.21.15.5:0/595623147 conn(0x7fd8080fb030 msgr2=0x7fd808068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 shutdown_connections 2023-10-08T13:22:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.327+0000 7fd80f144700 1 -- 172.21.15.5:0/595623147 wait complete. 2023-10-08T13:22:29.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:22:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 -- 172.21.15.5:0/824191198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b0105600 msgr2=0x7f14b01059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 --2- 172.21.15.5:0/824191198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b0105600 0x7f14b01059e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f14a00099c0 tx=0x7f14a0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 -- 172.21.15.5:0/824191198 shutdown_connections 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 --2- 172.21.15.5:0/824191198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00fff00 0x7f14b010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 --2- 172.21.15.5:0/824191198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b0105600 0x7f14b01059e0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 --2- 172.21.15.5:0/824191198 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b00ff540 0x7f14b00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 -- 172.21.15.5:0/824191198 >> 172.21.15.5:0/824191198 conn(0x7f14b00fafb0 msgr2=0x7f14b00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 -- 172.21.15.5:0/824191198 shutdown_connections 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.469+0000 7f14b56f4700 1 -- 172.21.15.5:0/824191198 wait complete. 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 Processor -- start 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 -- start start 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00ff540 0x7f14b0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 0x7f14b0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b0105600 0x7f14b01a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0198620 con 0x7f14b00fff00 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b01a2e30 con 0x7f14b00ff540 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14b56f4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b01a2f70 con 0x7f14b0105600 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14ae7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 0x7f14b0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14ae7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 0x7f14b0197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39218/0 (socket says 172.21.15.5:39218) 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14ae7fc700 1 -- 172.21.15.5:0/293401931 learned_addr learned my addr 172.21.15.5:0/293401931 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14aeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00ff540 0x7f14b0197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.470+0000 7f14af7fe700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b0105600 0x7f14b01a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14ae7fc700 1 -- 172.21.15.5:0/293401931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b0105600 msgr2=0x7f14b01a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14ae7fc700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b0105600 0x7f14b01a28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14ae7fc700 1 -- 172.21.15.5:0/293401931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00ff540 msgr2=0x7f14b0197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14ae7fc700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00ff540 0x7f14b0197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14ae7fc700 1 -- 172.21.15.5:0/293401931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00095f0 con 0x7f14b00fff00 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14aeffd700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00ff540 0x7f14b0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14ae7fc700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 0x7f14b0197db0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f149800e9a0 tx=0x7f149800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498009790 con 0x7f14b00fff00 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1498010430 con 0x7f14b00fff00 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b01a3200 con 0x7f14b00fff00 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498018680 con 0x7f14b00fff00 2023-10-08T13:22:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.471+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b01a3710 con 0x7f14b00fff00 2023-10-08T13:22:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.472+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b0107a80 con 0x7f14b00fff00 2023-10-08T13:22:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.474+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f14980105a0 con 0x7f14b00fff00 2023-10-08T13:22:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.474+0000 7f14a7fff700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f149c0a15f0 0x7f149c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.474+0000 7f14aeffd700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f149c0a15f0 0x7f149c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.474+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1498014070 con 0x7f14b00fff00 2023-10-08T13:22:29.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.475+0000 7f14aeffd700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f149c0a15f0 0x7f149c0a3ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009990 tx=0x7f14a0005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:29.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.478+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f14980967d0 con 0x7f14b00fff00 2023-10-08T13:22:29.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:29 smithi060 ceph-mon[103190]: pgmap v814: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 KiB/s wr, 13 op/s 2023-10-08T13:22:29.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:29 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2183285199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:22:29.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:29 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/666512854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:22:29.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:29 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/595623147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:22:29.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:29 smithi005 ceph-mon[99496]: pgmap v814: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 KiB/s wr, 13 op/s 2023-10-08T13:22:29.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:29 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2183285199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:22:29.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:29 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/666512854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:22:29.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:29 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/595623147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.681+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14b0069270 con 0x7f14b00fff00 2023-10-08T13:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.681+0000 7f14a7fff700 1 -- 172.21.15.5:0/293401931 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14980260a0 con 0x7f14b00fff00 2023-10-08T13:22:29.682 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.683+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f149c0a15f0 msgr2=0x7f149c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.683+0000 7f14b56f4700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f149c0a15f0 0x7f149c0a3ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009990 tx=0x7f14a0005fb0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.683+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 msgr2=0x7f14b0197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.683+0000 7f14b56f4700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 0x7f14b0197db0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f149800e9a0 tx=0x7f149800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.683+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 shutdown_connections 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f149c0a15f0 0x7f149c0a3ab0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14b0105600 0x7f14b01a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b00ff540 0x7f14b0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 --2- 172.21.15.5:0/293401931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14b00fff00 0x7f14b0197db0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 >> 172.21.15.5:0/293401931 conn(0x7f14b00fafb0 msgr2=0x7f14b00fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 shutdown_connections 2023-10-08T13:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.684+0000 7f14b56f4700 1 -- 172.21.15.5:0/293401931 wait complete. 2023-10-08T13:22:29.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:22:29.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:29 smithi118 ceph-mon[104234]: pgmap v814: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 KiB/s wr, 13 op/s 2023-10-08T13:22:29.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:29 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2183285199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:22:29.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:29 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/666512854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:22:29.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:29 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/595623147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:22:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 -- 172.21.15.5:0/50121389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 msgr2=0x7fc610100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 --2- 172.21.15.5:0/50121389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc610100ab0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009990 tx=0x7fc5f8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 -- 172.21.15.5:0/50121389 shutdown_connections 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 --2- 172.21.15.5:0/50121389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc610100ff0 0x7fc61010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 --2- 172.21.15.5:0/50121389 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc610106640 0x7fc610106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 --2- 172.21.15.5:0/50121389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc610100ab0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 -- 172.21.15.5:0/50121389 >> 172.21.15.5:0/50121389 conn(0x7fc6100fc100 msgr2=0x7fc6100fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 -- 172.21.15.5:0/50121389 shutdown_connections 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.825+0000 7fc616955700 1 -- 172.21.15.5:0/50121389 wait complete. 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 Processor -- start 2023-10-08T13:22:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 -- start start 2023-10-08T13:22:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc61019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc610100ff0 0x7fc61019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc610106640 0x7fc6101968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc610196f40 con 0x7fc610100630 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6101970b0 con 0x7fc610106640 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc616955700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc610197270 con 0x7fc610100ff0 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc61019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc61019c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39230/0 (socket says 172.21.15.5:39230) 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 -- 172.21.15.5:0/3663033905 learned_addr learned my addr 172.21.15.5:0/3663033905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc6077fe700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc610100ff0 0x7fc61019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc614ef2700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc610106640 0x7fc6101968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 -- 172.21.15.5:0/3663033905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc610100ff0 msgr2=0x7fc61019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc610100ff0 0x7fc61019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 -- 172.21.15.5:0/3663033905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc610106640 msgr2=0x7fc6101968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc610106640 0x7fc6101968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 -- 172.21.15.5:0/3663033905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80095f0 con 0x7fc610100630 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.826+0000 7fc60ffff700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc61019c7b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc60000e9a0 tx=0x7fc60000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.827+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600009790 con 0x7fc610100630 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.827+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc600010430 con 0x7fc610100630 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.827+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600018680 con 0x7fc610100630 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.827+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc610197550 con 0x7fc610100630 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.827+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6101a37a0 con 0x7fc610100630 2023-10-08T13:22:29.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.828+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc610108c50 con 0x7fc610100630 2023-10-08T13:22:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.829+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc6000105a0 con 0x7fc610100630 2023-10-08T13:22:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.830+0000 7fc60dffb700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc5fc0a15f0 0x7fc5fc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.830+0000 7fc6077fe700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc5fc0a15f0 0x7fc5fc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.830+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fc600014070 con 0x7fc610100630 2023-10-08T13:22:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.831+0000 7fc6077fe700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc5fc0a15f0 0x7fc5fc0a3ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800b2e0 tx=0x7fc5f8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:29.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:29.834+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc600096750 con 0x7fc610100630 2023-10-08T13:22:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.037+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc610110520 con 0x7fc610100630 2023-10-08T13:22:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.037+0000 7fc60dffb700 1 -- 172.21.15.5:0/3663033905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v111) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc6000260a0 con 0x7fc610100630 2023-10-08T13:22:30.039 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-10-08T13:22:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc5fc0a15f0 msgr2=0x7fc5fc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc5fc0a15f0 0x7fc5fc0a3ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800b2e0 tx=0x7fc5f8005960 comp rx=0 tx=0).stop 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 msgr2=0x7fc61019c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc61019c7b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc60000e9a0 tx=0x7fc60000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 shutdown_connections 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fc5fc0a15f0 0x7fc5fc0a3ab0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc610106640 0x7fc6101968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc610100630 0x7fc61019c7b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 --2- 172.21.15.5:0/3663033905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc610100ff0 0x7fc61019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 >> 172.21.15.5:0/3663033905 conn(0x7fc6100fc100 msgr2=0x7fc6100fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:30.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 shutdown_connections 2023-10-08T13:22:30.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.039+0000 7fc616955700 1 -- 172.21.15.5:0/3663033905 wait complete. 2023-10-08T13:22:30.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:22:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.178+0000 7f99b9915700 1 -- 172.21.15.5:0/1781569845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b4105600 msgr2=0x7f99b41059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.178+0000 7f99b9915700 1 --2- 172.21.15.5:0/1781569845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b4105600 0x7f99b41059e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f99a40099c0 tx=0x7f99a4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.178+0000 7f99b9915700 1 -- 172.21.15.5:0/1781569845 shutdown_connections 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.178+0000 7f99b9915700 1 --2- 172.21.15.5:0/1781569845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b40fff00 0x7f99b410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 --2- 172.21.15.5:0/1781569845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b4105600 0x7f99b41059e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 --2- 172.21.15.5:0/1781569845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 0x7f99b40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- 172.21.15.5:0/1781569845 >> 172.21.15.5:0/1781569845 conn(0x7f99b40fafb0 msgr2=0x7f99b40fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- 172.21.15.5:0/1781569845 shutdown_connections 2023-10-08T13:22:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- 172.21.15.5:0/1781569845 wait complete. 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 Processor -- start 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- start start 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 0x7f99b41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b40fff00 0x7f99b4197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 0x7f99b41a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4198710 con 0x7f99b40fff00 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41a2ea0 con 0x7f99b40ff540 2023-10-08T13:22:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.179+0000 7f99b9915700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41a3010 con 0x7f99b4105600 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b40fff00 0x7f99b4197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 0x7f99b41a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 0x7f99b41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 0x7f99b41a2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52452/0 (socket says 172.21.15.5:52452) 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 0x7f99b41978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:34194/0 (socket says 172.21.15.5:34194) 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b37fe700 1 -- 172.21.15.5:0/2503334350 learned_addr learned my addr 172.21.15.5:0/2503334350 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 -- 172.21.15.5:0/2503334350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 msgr2=0x7f99b41a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 0x7f99b41a2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 -- 172.21.15.5:0/2503334350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 msgr2=0x7f99b41978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 0x7f99b41978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 -- 172.21.15.5:0/2503334350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40095f0 con 0x7f99b40fff00 2023-10-08T13:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b37fe700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 0x7f99b41a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b27fc700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b40fff00 0x7f99b4197e20 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f99a800e9f0 tx=0x7f99a800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800c9c0 con 0x7f99b40fff00 2023-10-08T13:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99a8010430 con 0x7f99b40fff00 2023-10-08T13:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b41a32f0 con 0x7f99b40fff00 2023-10-08T13:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8018680 con 0x7f99b40fff00 2023-10-08T13:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.180+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b41a3800 con 0x7f99b40fff00 2023-10-08T13:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.181+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b4107a80 con 0x7f99b40fff00 2023-10-08T13:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.182+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f99a8010860 con 0x7f99b40fff00 2023-10-08T13:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.183+0000 7f99b8913700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f999c0a15f0 0x7f999c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.183+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f99a8014070 con 0x7f99b40fff00 2023-10-08T13:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.183+0000 7f99b2ffd700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f999c0a15f0 0x7f999c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.183+0000 7f99b2ffd700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f999c0a15f0 0x7f999c0a3ab0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009fd0 tx=0x7f99a4019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.186+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99a8096710 con 0x7f99b40fff00 2023-10-08T13:22:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.403+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f99b4100c60 con 0x7f99b40fff00 2023-10-08T13:22:30.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.403+0000 7f99b8913700 1 -- 172.21.15.5:0/2503334350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v111) v1 ==== 81+0+864 (secure 0 0 0) 0x7f99a8099d30 con 0x7f99b40fff00 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1305686479 2023-10-09T12:58:37.011176+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3348591021 2023-10-09T12:57:28.615187+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/13143194 2023-10-09T12:57:28.615187+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/13143194 2023-10-09T12:57:28.615187+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1012844185 2023-10-09T12:57:28.615187+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3669045265 2023-10-09T12:58:37.011176+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/734152753 2023-10-09T12:57:01.763270+0000 2023-10-08T13:22:30.405 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1953950903 2023-10-09T12:57:01.763270+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1305686479 2023-10-09T12:58:37.011176+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3309153845 2023-10-09T12:58:37.011176+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/735752727 2023-10-09T12:57:01.763270+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/632293354 2023-10-09T12:57:01.763270+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4243429015 2023-10-09T12:58:37.011176+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/632293354 2023-10-09T12:57:01.763270+0000 2023-10-08T13:22:30.406 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/363889719 2023-10-09T12:57:28.615187+0000 2023-10-08T13:22:30.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f999c0a15f0 msgr2=0x7f999c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f999c0a15f0 0x7f999c0a3ab0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009fd0 tx=0x7f99a4019040 comp rx=0 tx=0).stop 2023-10-08T13:22:30.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b40fff00 msgr2=0x7f99b4197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:30.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b40fff00 0x7f99b4197e20 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f99a800e9f0 tx=0x7f99a800ed00 comp rx=0 tx=0).stop 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 shutdown_connections 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f999c0a15f0 0x7f999c0a3ab0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4105600 0x7f99b41a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99b40ff540 0x7f99b41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 --2- 172.21.15.5:0/2503334350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99b40fff00 0x7f99b4197e20 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.405+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 >> 172.21.15.5:0/2503334350 conn(0x7f99b40fafb0 msgr2=0x7f99b40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.406+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 shutdown_connections 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:30.406+0000 7f99b9915700 1 -- 172.21.15.5:0/2503334350 wait complete. 2023-10-08T13:22:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:listed 15 entries 2023-10-08T13:22:30.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T13:22:30.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /tmp/cephfs 2023-10-08T13:22:30.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:22:30.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.532 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-10-08T13:22:30.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.584 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-08T13:22:30.623 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-10-08T13:22:30.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-10-08T13:22:30.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:30 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/293401931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:22:30.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:30 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3663033905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:22:30.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:30 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/293401931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:22:30.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:30 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3663033905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:22:30.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-08T13:22:30.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:30 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/293401931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:22:30.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:30 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3663033905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:22:30.822 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T13:22:30.822 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-10-08T13:22:30.822 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:22:30.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17942 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/89ea50559ba3f00a84bc64a9475b0a29c0ec66105cb53ca57f4c2c877416d603/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/89ea50559ba3f00a84bc64a9475b0a29c0ec66105cb53ca57f4c2c877416d603/diff,workdir=/var/lib/containers/storage/overlay/89ea50559ba3f00a84bc64a9475b0a29c0ec66105cb53ca57f4c2c877416d603/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/4650ba622401249fbc016748fd635c6b0f6ba701182afb3962d7b69c16d56a3d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/4650ba622401249fbc016748fd635c6b0f6ba701182afb3962d7b69c16d56a3d/diff,workdir=/var/lib/containers/storage/overlay/4650ba622401249fbc016748fd635c6b0f6ba701182afb3962d7b69c16d56a3d/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/6768a6eafb7925e36bab467b47423a8cf089cabac8571490072c726f6573f493/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/6768a6eafb7925e36bab467b47423a8cf089cabac8571490072c726f6573f493/diff,workdir=/var/lib/containers/storage/overlay/6768a6eafb7925e36bab467b47423a8cf089cabac8571490072c726f6573f493/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8b838192c46ed45a2418458ff02459f181da6ab6a37a93f068d529dce71b613f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/8b838192c46ed45a2418458ff02459f181da6ab6a37a93f068d529dce71b613f/diff,workdir=/var/lib/containers/storage/overlay/8b838192c46ed45a2418458ff02459f181da6ab6a37a93f068d529dce71b613f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c880f1073cb945c54572db7601ee1f5ab85a7c67e00dcd36a37121201effb976/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/c880f1073cb945c54572db7601ee1f5ab85a7c67e00dcd36a37121201effb976/diff,workdir=/var/lib/containers/storage/overlay/c880f1073cb945c54572db7601ee1f5ab85a7c67e00dcd36a37121201effb976/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/eefc85f07e9afd8a932ae0ea55ae91b05d7f0ce4c722f6e38e62ef6be8abe648/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/eefc85f07e9afd8a932ae0ea55ae91b05d7f0ce4c722f6e38e62ef6be8abe648/diff,workdir=/var/lib/containers/storage/overlay/eefc85f07e9afd8a932ae0ea55ae91b05d7f0ce4c722f6e38e62ef6be8abe648/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/eabd3e9374507eba9e5e8882c0664186fa2d7c4718d1b0a6936c7c73e7f12733/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/eabd3e9374507eba9e5e8882c0664186fa2d7c4718d1b0a6936c7c73e7f12733/diff,workdir=/var/lib/containers/storage/overlay/eabd3e9374507eba9e5e8882c0664186fa2d7c4718d1b0a6936c7c73e7f12733/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c2cac870d40f3604db5fe4d5db68390cdec261a06f9118b75302ad2d1c14a448/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/c2cac870d40f3604db5fe4d5db68390cdec261a06f9118b75302ad2d1c14a448/diff,workdir=/var/lib/containers/storage/overlay/c2cac870d40f3604db5fe4d5db68390cdec261a06f9118b75302ad2d1c14a448/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2e3f221ff0ebe3585efe5fb3a2df657829a65cbbc7ab3864802a97d479ab5c9e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/2e3f221ff0ebe3585efe5fb3a2df657829a65cbbc7ab3864802a97d479ab5c9e/diff,workdir=/var/lib/containers/storage/overlay/2e3f221ff0ebe3585efe5fb3a2df657829a65cbbc7ab3864802a97d479ab5c9e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c22c70321e826387a78f57e978118a94b8c041dd0c0c68c97ffb44dd1ef7bf06/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ALAGHS6XVYHULH4BDX5OJAAN2T:/var/lib/containers/storage/overlay/l/AYH5LB63B5CWDAFWQJWC77XAJ6,upperdir=/var/lib/containers/storage/overlay/c22c70321e826387a78f57e978118a94b8c041dd0c0c68c97ffb44dd1ef7bf06/diff,workdir=/var/lib/containers/storage/overlay/c22c70321e826387a78f57e978118a94b8c041dd0c0c68c97ffb44dd1ef7bf06/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-08T13:22:30.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.841 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-10-08T13:22:30.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:22:30.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-10-08T13:22:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-10-08T13:22:31.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:22:31.053 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-08T13:22:31.063 INFO:tasks.cephadm:Teardown begin 2023-10-08T13:22:31.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T13:22:31.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:22:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 -- 172.21.15.5:0/4271962640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1810106650 msgr2=0x7f1810106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 --2- 172.21.15.5:0/4271962640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1810106650 0x7f1810106a30 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f18040099c0 tx=0x7f1804009cd0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 -- 172.21.15.5:0/4271962640 shutdown_connections 2023-10-08T13:22:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 --2- 172.21.15.5:0/4271962640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18100ff550 0x7f181010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 --2- 172.21.15.5:0/4271962640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1810106650 0x7f1810106a30 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 --2- 172.21.15.5:0/4271962640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 -- 172.21.15.5:0/4271962640 >> 172.21.15.5:0/4271962640 conn(0x7f1810075b20 msgr2=0x7f18100fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 -- 172.21.15.5:0/4271962640 shutdown_connections 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 -- 172.21.15.5:0/4271962640 wait complete. 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 Processor -- start 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 -- start start 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.190+0000 7f1816de9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18100ff550 0x7f18101002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1816de9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1810106650 0x7f18101007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1816de9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18101a4ea0 con 0x7f18100ff550 2023-10-08T13:22:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1816de9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18101a5010 con 0x7f18100feb90 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1816de9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18101a51d0 con 0x7f1810106650 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f180ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18100ff550 0x7f18101002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ffd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.5:34208/0 (socket says 172.21.15.5:34208) 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 -- 172.21.15.5:0/3678870320 learned_addr learned my addr 172.21.15.5:0/3678870320 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1815386700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1810106650 0x7f18101007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 -- 172.21.15.5:0/3678870320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1810106650 msgr2=0x7f18101007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1810106650 0x7f18101007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 -- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18100ff550 msgr2=0x7f18101002b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18100ff550 0x7f18101002b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 -- 172.21.15.5:0/3678870320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040095f0 con 0x7f18100feb90 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1815386700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1810106650 0x7f18101007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f180ffff700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18100ff550 0x7f18101002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1814b85700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ffd70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f180400b580 tx=0x7f180400bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180401c070 con 0x7f18100feb90 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f180400fdf0 con 0x7f18100feb90 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804022c40 con 0x7f18100feb90 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.191+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18101a5450 con 0x7f18100feb90 2023-10-08T13:22:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.192+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18101a5870 con 0x7f18100feb90 2023-10-08T13:22:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.193+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1810108c40 con 0x7f18100feb90 2023-10-08T13:22:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.194+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1804020070 con 0x7f18100feb90 2023-10-08T13:22:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.194+0000 7f180dffb700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18000a1670 0x7f18000a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.194+0000 7f180ffff700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18000a1670 0x7f18000a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.194+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f18040ce2d0 con 0x7f18100feb90 2023-10-08T13:22:31.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.195+0000 7f180ffff700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18000a1670 0x7f18000a3b30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f18101014a0 tx=0x7f17fc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:31.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.198+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f18040972f0 con 0x7f18100feb90 2023-10-08T13:22:31.352 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:31 smithi005 ceph-mon[99496]: pgmap v815: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 KiB/s wr, 13 op/s 2023-10-08T13:22:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.451+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18101012f0 con 0x7f18100feb90 2023-10-08T13:22:31.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.451+0000 7f180dffb700 1 -- 172.21.15.5:0/3678870320 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f180409a910 con 0x7f18100feb90 2023-10-08T13:22:31.453 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:22:31.453 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:21:40.740127+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:22:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18000a1670 msgr2=0x7f18000a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18000a1670 0x7f18000a3b30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f18101014a0 tx=0x7f17fc009260 comp rx=0 tx=0).stop 2023-10-08T13:22:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 msgr2=0x7f18100ffd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ffd70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f180400b580 tx=0x7f180400bfd0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 shutdown_connections 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f18000a1670 0x7f18000a3b30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1810106650 0x7f18101007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18100feb90 0x7f18100ffd70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 --2- 172.21.15.5:0/3678870320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18100ff550 0x7f18101002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 >> 172.21.15.5:0/3678870320 conn(0x7f1810075b20 msgr2=0x7f18100fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 shutdown_connections 2023-10-08T13:22:31.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.454+0000 7f1816de9700 1 -- 172.21.15.5:0/3678870320 wait complete. 2023-10-08T13:22:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 56 2023-10-08T13:22:31.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:22:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 -- 172.21.15.5:0/3926952001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 msgr2=0x7f020810c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 --2- 172.21.15.5:0/3926952001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020810c3d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f020000b0d0 tx=0x7f020000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 -- 172.21.15.5:0/3926952001 shutdown_connections 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 --2- 172.21.15.5:0/3926952001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020810c3d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 --2- 172.21.15.5:0/3926952001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0208105610 0x7f02081059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 --2- 172.21.15.5:0/3926952001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080ff550 0x7f02080ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 -- 172.21.15.5:0/3926952001 >> 172.21.15.5:0/3926952001 conn(0x7f02080fb020 msgr2=0x7f02080fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 -- 172.21.15.5:0/3926952001 shutdown_connections 2023-10-08T13:22:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.593+0000 7f020f574700 1 -- 172.21.15.5:0/3926952001 wait complete. 2023-10-08T13:22:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 Processor -- start 2023-10-08T13:22:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 -- start start 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 0x7f020819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0208105610 0x7f02081958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208195f50 con 0x7f02080fff10 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02081960c0 con 0x7f0208105610 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020f574700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208196280 con 0x7f02080ff550 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020d310700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 0x7f020819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020cb0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020db11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0208105610 0x7f02081958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020d310700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 0x7f020819b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52476/0 (socket says 172.21.15.5:52476) 2023-10-08T13:22:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020d310700 1 -- 172.21.15.5:0/3015028874 learned_addr learned my addr 172.21.15.5:0/3015028874 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.594+0000 7f020cb0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020819bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39274/0 (socket says 172.21.15.5:39274) 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020d310700 1 -- 172.21.15.5:0/3015028874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0208105610 msgr2=0x7f02081958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020d310700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0208105610 0x7f02081958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020d310700 1 -- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 msgr2=0x7f020819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020d310700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020d310700 1 -- 172.21.15.5:0/3015028874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009d00 con 0x7f02080ff550 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020cb0f700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020db11700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0208105610 0x7f02081958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020d310700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 0x7f020819b7c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00eab0 tx=0x7f01fc00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc013070 con 0x7f02080ff550 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0208196560 con 0x7f02080ff550 2023-10-08T13:22:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01fc00be80 con 0x7f02080ff550 2023-10-08T13:22:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0163b0 con 0x7f02080ff550 2023-10-08T13:22:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.595+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0208068a30 con 0x7f02080ff550 2023-10-08T13:22:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.596+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0208100c70 con 0x7f02080ff550 2023-10-08T13:22:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.598+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f01fc0175a0 con 0x7f02080ff550 2023-10-08T13:22:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.598+0000 7f01fa7fc700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01f40a15f0 0x7f01f40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.598+0000 7f020cb0f700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01f40a15f0 0x7f01f40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.598+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f01fc0cec20 con 0x7f02080ff550 2023-10-08T13:22:31.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.599+0000 7f020cb0f700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01f40a15f0 0x7f01f40a3ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0208196ab0 tx=0x7f0204009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:31.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.655+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f01fc097bb0 con 0x7f02080ff550 2023-10-08T13:22:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:31 smithi060 ceph-mon[103190]: pgmap v815: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 KiB/s wr, 13 op/s 2023-10-08T13:22:31.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:31 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/2503334350' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:22:31.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:31 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/2503334350' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:22:31.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:31 smithi118 ceph-mon[104234]: pgmap v815: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 KiB/s wr, 13 op/s 2023-10-08T13:22:31.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:31 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/2503334350' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:22:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.906+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0208066cc0 con 0x7f02080ff550 2023-10-08T13:22:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.907+0000 7f01fa7fc700 1 -- 172.21.15.5:0/3015028874 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f01fc09b1d0 con 0x7f02080ff550 2023-10-08T13:22:31.908 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:22:31.908 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/164464134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":164464134},{"type":"v1","addr":"172.21.15.5:6835","nonce":164464134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1597717069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1597717069},{"type":"v1","addr":"172.21.15.5:6837","nonce":1597717069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:04:10.182813+0000","modified":"2023-10-08T13:21:40.740127+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24667,"mds_1":24650,"mds_2":24649,"mds_3":24643,"mds_4":24611},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/1016601603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1016601603},{"type":"v1","addr":"172.21.15.5:6839","nonce":1016601603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/3855657162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3855657162},{"type":"v1","addr":"172.21.15.5:6841","nonce":3855657162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2732299433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2732299433},{"type":"v1","addr":"172.21.15.60:6833","nonce":2732299433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24587":{"gid":24587,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2434035326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2434035326},{"type":"v1","addr":"172.21.15.60:6835","nonce":2434035326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24601":{"gid":24601,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.118:6833/2301164453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2301164453},{"type":"v1","addr":"172.21.15.118:6833","nonce":2301164453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24611":{"gid":24611,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.60:6837/529609492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":529609492},{"type":"v1","addr":"172.21.15.60:6837","nonce":529609492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.118:6835/1209433325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1209433325},{"type":"v1","addr":"172.21.15.118:6835","nonce":1209433325}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24649":{"gid":24649,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.118:6837/1772997298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":1772997298},{"type":"v1","addr":"172.21.15.118:6837","nonce":1772997298}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24650":{"gid":24650,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.60:6839/2598964762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2598964762},{"type":"v1","addr":"172.21.15.60:6839","nonce":2598964762}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24667":{"gid":24667,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.118:6839/3304365163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3304365163},{"type":"v1","addr":"172.21.15.118:6839","nonce":3304365163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:22:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01f40a15f0 msgr2=0x7f01f40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01f40a15f0 0x7f01f40a3ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0208196ab0 tx=0x7f0204009260 comp rx=0 tx=0).stop 2023-10-08T13:22:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 msgr2=0x7f020819b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 0x7f020819b7c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00eab0 tx=0x7f01fc00edc0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 shutdown_connections 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f01f40a15f0 0x7f01f40a3ab0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0208105610 0x7f02081958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02080ff550 0x7f020819b7c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 --2- 172.21.15.5:0/3015028874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02080fff10 0x7f020819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 >> 172.21.15.5:0/3015028874 conn(0x7f02080fb020 msgr2=0x7f02080fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 shutdown_connections 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:31.909+0000 7f020f574700 1 -- 172.21.15.5:0/3015028874 wait complete. 2023-10-08T13:22:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 56 2023-10-08T13:22:31.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:22:32.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 -- 172.21.15.5:0/2703488354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 msgr2=0x7fdc201059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 --2- 172.21.15.5:0/2703488354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201059f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fdc080099c0 tx=0x7fdc08009cd0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 -- 172.21.15.5:0/2703488354 shutdown_connections 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 --2- 172.21.15.5:0/2703488354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc200fff10 0x7fdc2010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 --2- 172.21.15.5:0/2703488354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201059f0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 --2- 172.21.15.5:0/2703488354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 0x7fdc200ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 -- 172.21.15.5:0/2703488354 >> 172.21.15.5:0/2703488354 conn(0x7fdc200fb040 msgr2=0x7fdc200fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 -- 172.21.15.5:0/2703488354 shutdown_connections 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 -- 172.21.15.5:0/2703488354 wait complete. 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.048+0000 7fdc259aa700 1 Processor -- start 2023-10-08T13:22:32.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 -- start start 2023-10-08T13:22:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 0x7fdc2019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc200fff10 0x7fdc2019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20195e10 con 0x7fdc20105610 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20195f80 con 0x7fdc200ff550 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc259aa700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20196140 con 0x7fdc200fff10 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39288/0 (socket says 172.21.15.5:39288) 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 -- 172.21.15.5:0/469519019 learned_addr learned my addr 172.21.15.5:0/469519019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 0x7fdc2019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1e7fc700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc200fff10 0x7fdc2019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 -- 172.21.15.5:0/469519019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc200fff10 msgr2=0x7fdc2019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc200fff10 0x7fdc2019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 -- 172.21.15.5:0/469519019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 msgr2=0x7fdc2019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 0x7fdc2019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1f7fe700 1 -- 172.21.15.5:0/469519019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080095f0 con 0x7fdc20105610 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.049+0000 7fdc1effd700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 0x7fdc2019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.050+0000 7fdc1f7fe700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201957a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800ef30 tx=0x7fdc1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.050+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18018070 con 0x7fdc20105610 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.050+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc1800f040 con 0x7fdc20105610 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.050+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800cd00 con 0x7fdc20105610 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.050+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc201963c0 con 0x7fdc20105610 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.050+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc201a2660 con 0x7fdc20105610 2023-10-08T13:22:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.051+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc20107a90 con 0x7fdc20105610 2023-10-08T13:22:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.052+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fdc18003a00 con 0x7fdc20105610 2023-10-08T13:22:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.052+0000 7fdc249a8700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc0c0a15f0 0x7fdc0c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.053+0000 7fdc1effd700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc0c0a15f0 0x7fdc0c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.053+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fdc180cd010 con 0x7fdc20105610 2023-10-08T13:22:32.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.053+0000 7fdc1effd700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc0c0a15f0 0x7fdc0c0a3ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009990 tx=0x7fdc08005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:32.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.057+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdc18096030 con 0x7fdc20105610 2023-10-08T13:22:32.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.263+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc20100c70 con 0x7fdc20105610 2023-10-08T13:22:32.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.264+0000 7fdc249a8700 1 -- 172.21.15.5:0/469519019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+25071 (secure 0 0 0) 0x7fdc18099650 con 0x7fdc20105610 2023-10-08T13:22:32.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-10-08T13:22:32.266 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":111,"fsid":"f92d23c2-65d9-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:56:30.006790+0000","modified":"2023-10-08T13:22:21.047553+0000","last_up_change":"2023-10-08T13:03:28.109990+0000","last_in_change":"2023-10-08T13:03:10.836011+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:00:15.547337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:04:08.468296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:04:09.557834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:04:13.552644+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":110,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c71842-5a9c-458b-ae21-0a86b2d745b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6803","nonce":2048074026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6805","nonce":2048074026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6809","nonce":2048074026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2048074026},{"type":"v1","addr":"172.21.15.5:6807","nonce":2048074026}]},"public_addr":"172.21.15.5:6803/2048074026","cluster_addr":"172.21.15.5:6805/2048074026","heartbeat_back_addr":"172.21.15.5:6809/2048074026","heartbeat_front_addr":"172.21.15.5:6807/2048074026","state":["exists","up"]},{"osd":1,"uuid":"0fccf574-a553-42c0-b7d8-1a606c9afa40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6801","nonce":1932201040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6803","nonce":1932201040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6807","nonce":1932201040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1932201040},{"type":"v1","addr":"172.21.15.60:6805","nonce":1932201040}]},"public_addr":"172.21.15.60:6801/1932201040","cluster_addr":"172.21.15.60:6803/1932201040","heartbeat_back_addr":"172.21.15.60:6807/1932201040","heartbeat_front_addr":"172.21.15.60:6805/1932201040","state":["exists","up"]},{"osd":2,"uuid":"7c012ac5-5677-47b6-8f91-a6146c53d52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6801","nonce":1550334849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6803","nonce":1550334849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6807","nonce":1550334849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1550334849},{"type":"v1","addr":"172.21.15.118:6805","nonce":1550334849}]},"public_addr":"172.21.15.118:6801/1550334849","cluster_addr":"172.21.15.118:6803/1550334849","heartbeat_back_addr":"172.21.15.118:6807/1550334849","heartbeat_front_addr":"172.21.15.118:6805/1550334849","state":["exists","up"]},{"osd":3,"uuid":"bcc8a556-63b4-44c7-92e7-0ab83f45b580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6811","nonce":731890565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6813","nonce":731890565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6817","nonce":731890565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":731890565},{"type":"v1","addr":"172.21.15.5:6815","nonce":731890565}]},"public_addr":"172.21.15.5:6811/731890565","cluster_addr":"172.21.15.5:6813/731890565","heartbeat_back_addr":"172.21.15.5:6817/731890565","heartbeat_front_addr":"172.21.15.5:6815/731890565","state":["exists","up"]},{"osd":4,"uuid":"dd5a0f8e-6be8-490d-b202-a85853020088","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6809","nonce":3771970201}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6811","nonce":3771970201}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6815","nonce":3771970201}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3771970201},{"type":"v1","addr":"172.21.15.60:6813","nonce":3771970201}]},"public_addr":"172.21.15.60:6809/3771970201","cluster_addr":"172.21.15.60:6811/3771970201","heartbeat_back_addr":"172.21.15.60:6815/3771970201","heartbeat_front_addr":"172.21.15.60:6813/3771970201","state":["exists","up"]},{"osd":5,"uuid":"2895b033-b0cd-4ef9-b418-d7d88abf919d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6809","nonce":389070865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6811","nonce":389070865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6815","nonce":389070865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":389070865},{"type":"v1","addr":"172.21.15.118:6813","nonce":389070865}]},"public_addr":"172.21.15.118:6809/389070865","cluster_addr":"172.21.15.118:6811/389070865","heartbeat_back_addr":"172.21.15.118:6815/389070865","heartbeat_front_addr":"172.21.15.118:6813/389070865","state":["exists","up"]},{"osd":6,"uuid":"70aac32e-a230-4d6f-b65d-1d390ccd9d5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6819","nonce":1379902239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6821","nonce":1379902239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6825","nonce":1379902239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1379902239},{"type":"v1","addr":"172.21.15.5:6823","nonce":1379902239}]},"public_addr":"172.21.15.5:6819/1379902239","cluster_addr":"172.21.15.5:6821/1379902239","heartbeat_back_addr":"172.21.15.5:6825/1379902239","heartbeat_front_addr":"172.21.15.5:6823/1379902239","state":["exists","up"]},{"osd":7,"uuid":"ef2634ca-f063-4030-91dd-69d8d3e5216f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6817","nonce":2435076534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6819","nonce":2435076534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6823","nonce":2435076534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2435076534},{"type":"v1","addr":"172.21.15.60:6821","nonce":2435076534}]},"public_addr":"172.21.15.60:6817/2435076534","cluster_addr":"172.21.15.60:6819/2435076534","heartbeat_back_addr":"172.21.15.60:6823/2435076534","heartbeat_front_addr":"172.21.15.60:6821/2435076534","state":["exists","up"]},{"osd":8,"uuid":"5296573e-315f-4f81-8519-aa97734c73da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6817","nonce":4053101254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6819","nonce":4053101254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6823","nonce":4053101254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":4053101254},{"type":"v1","addr":"172.21.15.118:6821","nonce":4053101254}]},"public_addr":"172.21.15.118:6817/4053101254","cluster_addr":"172.21.15.118:6819/4053101254","heartbeat_back_addr":"172.21.15.118:6823/4053101254","heartbeat_front_addr":"172.21.15.118:6821/4053101254","state":["exists","up"]},{"osd":9,"uuid":"2a7f6068-38ca-4855-85bf-4f8369179767","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6827","nonce":2685763933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6829","nonce":2685763933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6833","nonce":2685763933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2685763933},{"type":"v1","addr":"172.21.15.5:6831","nonce":2685763933}]},"public_addr":"172.21.15.5:6827/2685763933","cluster_addr":"172.21.15.5:6829/2685763933","heartbeat_back_addr":"172.21.15.5:6833/2685763933","heartbeat_front_addr":"172.21.15.5:6831/2685763933","state":["exists","up"]},{"osd":10,"uuid":"f2ca2394-71e1-489e-b517-492641d774bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6825","nonce":2643673100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6827","nonce":2643673100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6831","nonce":2643673100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2643673100},{"type":"v1","addr":"172.21.15.60:6829","nonce":2643673100}]},"public_addr":"172.21.15.60:6825/2643673100","cluster_addr":"172.21.15.60:6827/2643673100","heartbeat_back_addr":"172.21.15.60:6831/2643673100","heartbeat_front_addr":"172.21.15.60:6829/2643673100","state":["exists","up"]},{"osd":11,"uuid":"15ba66fb-f768-4c8c-8364-b578f94d5543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6825","nonce":1490826203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6827","nonce":1490826203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6831","nonce":1490826203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1490826203},{"type":"v1","addr":"172.21.15.118:6829","nonce":1490826203}]},"public_addr":"172.21.15.118:6825/1490826203","cluster_addr":"172.21.15.118:6827/1490826203","heartbeat_back_addr":"172.21.15.118:6831/1490826203","heartbeat_front_addr":"172.21.15.118:6829/1490826203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:30.446602+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:59:51.932059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:13.181213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:35.320145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:00:57.113334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:19.047179+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:01:40.035936+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:01.670579+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:22.881506+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:02:44.040222+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:05.769313+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:03:26.867133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3348591021":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6801/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:6800/13143194":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/1012844185":"2023-10-09T12:57:28.615187+0000","172.21.15.5:0/3669045265":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/734152753":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/1953950903":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/1305686479":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/3309153845":"2023-10-09T12:58:37.011176+0000","172.21.15.5:0/735752727":"2023-10-09T12:57:01.763270+0000","172.21.15.5:6800/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/4243429015":"2023-10-09T12:58:37.011176+0000","172.21.15.5:6801/632293354":"2023-10-09T12:57:01.763270+0000","172.21.15.5:0/363889719":"2023-10-09T12:57:28.615187+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:22:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.266+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc0c0a15f0 msgr2=0x7fdc0c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.266+0000 7fdc259aa700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc0c0a15f0 0x7fdc0c0a3ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009990 tx=0x7fdc08005fb0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.266+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 msgr2=0x7fdc201957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201957a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800ef30 tx=0x7fdc1800c3a0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 shutdown_connections 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fdc0c0a15f0 0x7fdc0c0a3ab0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc20105610 0x7fdc201957a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc200ff550 0x7fdc2019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 --2- 172.21.15.5:0/469519019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc200fff10 0x7fdc2019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 >> 172.21.15.5:0/469519019 conn(0x7fdc200fb040 msgr2=0x7fdc200fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 shutdown_connections 2023-10-08T13:22:32.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.267+0000 7fdc259aa700 1 -- 172.21.15.5:0/469519019 wait complete. 2023-10-08T13:22:32.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T13:22:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 -- 172.21.15.5:0/1751743499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec072ba0 msgr2=0x7f95ec072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 --2- 172.21.15.5:0/1751743499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec072ba0 0x7f95ec072f80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0098f0 tx=0x7f95dc009c00 comp rx=0 tx=0).stop 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 -- 172.21.15.5:0/1751743499 shutdown_connections 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 --2- 172.21.15.5:0/1751743499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 0x7f95ec10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 --2- 172.21.15.5:0/1751743499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec072ba0 0x7f95ec072f80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 --2- 172.21.15.5:0/1751743499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec0734c0 0x7f95ec10c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 -- 172.21.15.5:0/1751743499 >> 172.21.15.5:0/1751743499 conn(0x7f95ec0fc140 msgr2=0x7f95ec0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 -- 172.21.15.5:0/1751743499 shutdown_connections 2023-10-08T13:22:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 -- 172.21.15.5:0/1751743499 wait complete. 2023-10-08T13:22:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 Processor -- start 2023-10-08T13:22:32.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.429+0000 7f95f26e2700 1 -- start start 2023-10-08T13:22:32.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f26e2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 0x7f95ec19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f26e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec0734c0 0x7f95ec19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f26e2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 0x7f95ec198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f26e2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec199210 con 0x7f95ec10cf30 2023-10-08T13:22:32.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f26e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec199380 con 0x7f95ec0734c0 2023-10-08T13:22:32.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f26e2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec199540 con 0x7f95ec072ba0 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 0x7f95ec19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 0x7f95ec198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 0x7f95ec19ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.5:52502/0 (socket says 172.21.15.5:52502) 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95ebfff700 1 -- 172.21.15.5:0/3025582510 learned_addr learned my addr 172.21.15.5:0/3025582510 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95eb7fe700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec0734c0 0x7f95ec19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 -- 172.21.15.5:0/3025582510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 msgr2=0x7f95ec19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 0x7f95ec19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 -- 172.21.15.5:0/3025582510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec0734c0 msgr2=0x7f95ec19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec0734c0 0x7f95ec19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 -- 172.21.15.5:0/3025582510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00095f0 con 0x7f95ec10cf30 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95ebfff700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 0x7f95ec19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.430+0000 7f95f0c7f700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 0x7f95ec198ba0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f95e400efb0 tx=0x7f95e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.431+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4003a00 con 0x7f95ec10cf30 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.431+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e4009c40 con 0x7f95ec10cf30 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.431+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f95e400f040 con 0x7f95ec10cf30 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.431+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4004540 con 0x7f95ec10cf30 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.431+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc009520 con 0x7f95ec10cf30 2023-10-08T13:22:32.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.432+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec108140 con 0x7f95ec10cf30 2023-10-08T13:22:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.433+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f95e4003bf0 con 0x7f95ec10cf30 2023-10-08T13:22:32.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.434+0000 7f95e97fa700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f95d40a15f0 0x7f95d40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.434+0000 7f95ebfff700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f95d40a15f0 0x7f95d40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.434+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f95e40cd290 con 0x7f95ec10cf30 2023-10-08T13:22:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.434+0000 7f95ebfff700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f95d40a15f0 0x7f95d40a3ab0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0094f0 tx=0x7f95dc019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:32.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.437+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95e40962b0 con 0x7f95ec10cf30 2023-10-08T13:22:32.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:32 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3678870320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:32 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3015028874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:32 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/469519019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3678870320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.671 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3015028874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/469519019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.709+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f95ec19a090 con 0x7f95ec10cf30 2023-10-08T13:22:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.711+0000 7f95e97fa700 1 -- 172.21.15.5:0/3025582510 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f95e40998d0 con 0x7f95ec10cf30 2023-10-08T13:22:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f95d40a15f0 msgr2=0x7f95d40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f95d40a15f0 0x7f95d40a3ab0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0094f0 tx=0x7f95dc019040 comp rx=0 tx=0).stop 2023-10-08T13:22:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 msgr2=0x7f95ec198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 0x7f95ec198ba0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f95e400efb0 tx=0x7f95e400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 shutdown_connections 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f95d40a15f0 0x7f95d40a3ab0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95ec10cf30 0x7f95ec198ba0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95ec072ba0 0x7f95ec19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 --2- 172.21.15.5:0/3025582510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95ec0734c0 0x7f95ec19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 >> 172.21.15.5:0/3025582510 conn(0x7f95ec0fc140 msgr2=0x7f95ec0fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 shutdown_connections 2023-10-08T13:22:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.715+0000 7f95f26e2700 1 -- 172.21.15.5:0/3025582510 wait complete. 2023-10-08T13:22:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T13:22:32.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T13:22:32.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3678870320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3015028874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/469519019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 -- 172.21.15.5:0/4289676123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6050106640 msgr2=0x7f6050106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 --2- 172.21.15.5:0/4289676123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6050106640 0x7f6050106a20 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f60400099c0 tx=0x7f6040009cd0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 -- 172.21.15.5:0/4289676123 shutdown_connections 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 --2- 172.21.15.5:0/4289676123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60500ff540 0x7f605010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 --2- 172.21.15.5:0/4289676123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6050106640 0x7f6050106a20 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 --2- 172.21.15.5:0/4289676123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500feb80 0x7f60500ff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 -- 172.21.15.5:0/4289676123 >> 172.21.15.5:0/4289676123 conn(0x7f6050075b10 msgr2=0x7f60500fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:32.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 -- 172.21.15.5:0/4289676123 shutdown_connections 2023-10-08T13:22:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.899+0000 7f6055844700 1 -- 172.21.15.5:0/4289676123 wait complete. 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.900+0000 7f6055844700 1 Processor -- start 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.900+0000 7f6055844700 1 -- start start 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f6055844700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 0x7f605019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f6055844700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500ff540 0x7f605019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f6055844700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6050106640 0x7f6050198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f6055844700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501992d0 con 0x7f60500feb80 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f6055844700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050199440 con 0x7f60500ff540 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f6055844700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050199600 con 0x7f6050106640 2023-10-08T13:22:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 0x7f605019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 0x7f605019ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39336/0 (socket says 172.21.15.5:39336) 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 -- 172.21.15.5:0/4121834632 learned_addr learned my addr 172.21.15.5:0/4121834632 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604f7fe700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6050106640 0x7f6050198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604e7fc700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500ff540 0x7f605019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 -- 172.21.15.5:0/4121834632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6050106640 msgr2=0x7f6050198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6050106640 0x7f6050198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 -- 172.21.15.5:0/4121834632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500ff540 msgr2=0x7f605019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500ff540 0x7f605019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 -- 172.21.15.5:0/4121834632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400095f0 con 0x7f60500feb80 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604f7fe700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6050106640 0x7f6050198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:22:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604e7fc700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500ff540 0x7f605019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:22:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.901+0000 7f604effd700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 0x7f605019ea60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f604000c010 tx=0x7f604000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.902+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604001c070 con 0x7f60500feb80 2023-10-08T13:22:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.902+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6040022420 con 0x7f60500feb80 2023-10-08T13:22:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.902+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6050199880 con 0x7f60500feb80 2023-10-08T13:22:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.902+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040017650 con 0x7f60500feb80 2023-10-08T13:22:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.902+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60501a59e0 con 0x7f60500feb80 2023-10-08T13:22:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.903+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6050101ea0 con 0x7f60500feb80 2023-10-08T13:22:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.904+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6040020070 con 0x7f60500feb80 2023-10-08T13:22:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.905+0000 7f6054842700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60380a1670 0x7f60380a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.905+0000 7f604e7fc700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60380a1670 0x7f60380a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.905+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 9781+0+0 (secure 0 0 0) 0x7f60400ce580 con 0x7f60500feb80 2023-10-08T13:22:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.905+0000 7f604e7fc700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60380a1670 0x7f60380a3b30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6044005950 tx=0x7f60440058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:32.909+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6040097560 con 0x7f60500feb80 2023-10-08T13:22:33.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.159+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6050199fe0 con 0x7f60500feb80 2023-10-08T13:22:33.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a[99472]: 2023-10-08T13:22:32.710+0000 7fa7dd2a3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:22:33.174 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a[159028]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a[159028]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-mds[159052]: -- 172.21.15.5:0/2189002239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bbfa6db1e0 con 0x55bbfa6b1000 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a[159028]: starting mds.a at 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g[158642]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g[158642]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-mds[158666]: -- 172.21.15.5:0/3141246880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5654c2e171e0 con 0x5654c2dec800 2023-10-08T13:22:33.175 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:22:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g[158642]: starting mds.g at 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f[141955]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f[141955]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mds[141979]: -- 172.21.15.118:0/1466151973 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556dcfbbd1e0 con 0x556dcfb92c00 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f[141955]: starting mds.f at 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l[141604]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l[141604]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.270 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mds[141628]: -- 172.21.15.118:0/265722835 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556a430391e0 con 0x556a4300e800 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l[141604]: starting mds.l at 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-c[142296]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-c[142296]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mds[142320]: -- 172.21.15.118:0/100881006 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5634ea3f71e0 con 0x5634ea3cc800 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-c[142296]: starting mds.c at 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.271 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.272 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-mds[142661]: -- 172.21.15.118:0/802440126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x565001db11e0 con 0x565001d87000 2023-10-08T13:22:33.272 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:22:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: starting mds.i at 2023-10-08T13:22:33.359 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b[141074]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.359 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b[141074]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.359 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mds[141098]: -- 172.21.15.60:0/3500598698 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558baeacd1e0 con 0x558baeaa3000 2023-10-08T13:22:33.360 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b[141074]: starting mds.b at 2023-10-08T13:22:33.360 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e[140389]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.360 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e[140389]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.360 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mds[140413]: -- 172.21.15.60:0/426048575 <== mon.1 v2:172.21.15.118:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558a24bc31e0 con 0x558a24b98c00 2023-10-08T13:22:33.360 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e[140389]: starting mds.e at 2023-10-08T13:22:33.360 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h[140728]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h[140728]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mds[140752]: -- 172.21.15.60:0/3927423461 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f5ca6491e0 con 0x55f5ca61ec00 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h[140728]: starting mds.h at 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k[140049]: ignoring --setuser ceph since I am not root 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k[140049]: ignoring --setgroup ceph since I am not root 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mds[140073]: -- 172.21.15.60:0/3442713425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564132ed31e0 con 0x564132ea8800 2023-10-08T13:22:33.361 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k[140049]: starting mds.k at 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: pgmap v816: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3025582510' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/3025582510' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T13:22:33.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:33 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4121834632' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: pgmap v816: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3025582510' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/3025582510' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T13:22:33.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:33 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4121834632' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:22:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.712+0000 7f6054842700 1 -- 172.21.15.5:0/4121834632 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6040022590 con 0x7f60500feb80 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.716+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60380a1670 msgr2=0x7f60380a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.716+0000 7f6055844700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60380a1670 0x7f60380a3b30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6044005950 tx=0x7f60440058e0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 msgr2=0x7f605019ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 0x7f605019ea60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f604000c010 tx=0x7f604000f740 comp rx=0 tx=0).stop 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 shutdown_connections 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f60380a1670 0x7f60380a3b30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6050106640 0x7f6050198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60500feb80 0x7f605019ea60 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 --2- 172.21.15.5:0/4121834632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60500ff540 0x7f605019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 >> 172.21.15.5:0/4121834632 conn(0x7f6050075b10 msgr2=0x7f60500fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 shutdown_connections 2023-10-08T13:22:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.717+0000 7f6055844700 1 -- 172.21.15.5:0/4121834632 wait complete. 2023-10-08T13:22:33.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T13:22:33.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: pgmap v816: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T13:22:33.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3025582510' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:22:33.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:22:33.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:22:33.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/3025582510' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:22:33.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T13:22:33.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T13:22:33.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:33 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4121834632' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:22:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 -- 172.21.15.5:0/1406761104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a010ac50 msgr2=0x7fa1a010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1406761104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a010ac50 0x7fa1a010d0c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa19800b0a0 tx=0x7fa19800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 -- 172.21.15.5:0/1406761104 shutdown_connections 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1406761104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a010ac50 0x7fa1a010d0c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1406761104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0101880 0x7fa1a0101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1406761104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a01021a0 0x7fa1a010a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 -- 172.21.15.5:0/1406761104 >> 172.21.15.5:0/1406761104 conn(0x7fa1a00fafc0 msgr2=0x7fa1a00fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 -- 172.21.15.5:0/1406761104 shutdown_connections 2023-10-08T13:22:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.878+0000 7fa1a4934700 1 -- 172.21.15.5:0/1406761104 wait complete. 2023-10-08T13:22:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 Processor -- start 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 -- start start 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0101880 0x7fa1a00ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 0x7fa1a00ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a010ac50 0x7fa1a00fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01a4f80 con 0x7fa1a01021a0 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01a50f0 con 0x7fa1a0101880 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa1a4934700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01a52b0 con 0x7fa1a010ac50 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 0x7fa1a00ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 0x7fa1a00ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39356/0 (socket says 172.21.15.5:39356) 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 -- 172.21.15.5:0/1944075752 learned_addr learned my addr 172.21.15.5:0/1944075752 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19e59c700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0101880 0x7fa1a00ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19ed9d700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a010ac50 0x7fa1a00fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 -- 172.21.15.5:0/1944075752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a010ac50 msgr2=0x7fa1a00fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a010ac50 0x7fa1a00fff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 -- 172.21.15.5:0/1944075752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0101880 msgr2=0x7fa1a00ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0101880 0x7fa1a00ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.879+0000 7fa19dd9b700 1 -- 172.21.15.5:0/1944075752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198009d00 con 0x7fa1a01021a0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.880+0000 7fa19dd9b700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 0x7fa1a00ffa10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa19400d950 tx=0x7fa19400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.880+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400f890 con 0x7fa1a01021a0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.880+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa194010460 con 0x7fa1a01021a0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.880+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a01a5590 con 0x7fa1a01021a0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.880+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400e610 con 0x7fa1a01021a0 2023-10-08T13:22:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.880+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a01a5af0 con 0x7fa1a01021a0 2023-10-08T13:22:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.881+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0105dd0 con 0x7fa1a01021a0 2023-10-08T13:22:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.882+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa1940108d0 con 0x7fa1a01021a0 2023-10-08T13:22:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.883+0000 7fa18f7fe700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa1880a1670 0x7fa1880a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.883+0000 7fa19e59c700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa1880a1670 0x7fa1880a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.883+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 9781+0+0 (secure 0 0 0) 0x7fa1940cd2b0 con 0x7fa1a01021a0 2023-10-08T13:22:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.884+0000 7fa19e59c700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa1880a1670 0x7fa1880a3b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa190009c60 tx=0x7fa190009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:33.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:33.887+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa1940960e0 con 0x7fa1a01021a0 2023-10-08T13:22:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.092+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1a00681e0 con 0x7fa1a01021a0 2023-10-08T13:22:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:22:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:22:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: Cluster is now healthy 2023-10-08T13:22:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/4121834632' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:22:34.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.5:6838/607968745,v1:172.21.15.5:6839/607968745] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.5:6840/3938746131,v1:172.21.15.5:6841/3938746131] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6836/3272069829,v1:172.21.15.118:6838/3272069829] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6837/3032068077,v1:172.21.15.118:6839/3032068077] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6832/995389963,v1:172.21.15.118:6834/995389963] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.118:6833/2513471664,v1:172.21.15.118:6835/2513471664] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6832/2686606568,v1:172.21.15.60:6834/2686606568] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6836/3340523255,v1:172.21.15.60:6838/3340523255] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6833/3744618745,v1:172.21.15.60:6835/3744618745] up:boot 2023-10-08T13:22:34.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: mds.? [v2:172.21.15.60:6837/2588008295,v1:172.21.15.60:6839/2588008295] up:boot 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: fsmap 12 up:standby 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:22:34.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:22:34.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:22:34.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:34 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1944075752' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:34.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:22:34.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:22:34.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: Cluster is now healthy 2023-10-08T13:22:34.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/4121834632' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.5:6838/607968745,v1:172.21.15.5:6839/607968745] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.5:6840/3938746131,v1:172.21.15.5:6841/3938746131] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6836/3272069829,v1:172.21.15.118:6838/3272069829] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6837/3032068077,v1:172.21.15.118:6839/3032068077] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6832/995389963,v1:172.21.15.118:6834/995389963] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.118:6833/2513471664,v1:172.21.15.118:6835/2513471664] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6832/2686606568,v1:172.21.15.60:6834/2686606568] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6836/3340523255,v1:172.21.15.60:6838/3340523255] up:boot 2023-10-08T13:22:34.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6833/3744618745,v1:172.21.15.60:6835/3744618745] up:boot 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: mds.? [v2:172.21.15.60:6837/2588008295,v1:172.21.15.60:6839/2588008295] up:boot 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: fsmap 12 up:standby 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:22:34.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:22:34.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:22:34.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:22:34.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:22:34.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:22:34.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:22:34.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:34 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1944075752' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.718+0000 7fa18f7fe700 1 -- 172.21.15.5:0/1944075752 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa1940200d0 con 0x7fa1a01021a0 2023-10-08T13:22:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa1880a1670 msgr2=0x7fa1880a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa1880a1670 0x7fa1880a3b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa190009c60 tx=0x7fa190009260 comp rx=0 tx=0).stop 2023-10-08T13:22:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 msgr2=0x7fa1a00ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 0x7fa1a00ffa10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa19400d950 tx=0x7fa19400dc60 comp rx=0 tx=0).stop 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 shutdown_connections 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7fa1880a1670 0x7fa1880a3b30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1a010ac50 0x7fa1a00fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0101880 0x7fa1a00ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 --2- 172.21.15.5:0/1944075752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a01021a0 0x7fa1a00ffa10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 >> 172.21.15.5:0/1944075752 conn(0x7fa1a00fafc0 msgr2=0x7fa1a00fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 shutdown_connections 2023-10-08T13:22:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.722+0000 7fa1a4934700 1 -- 172.21.15.5:0/1944075752 wait complete. 2023-10-08T13:22:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-10-08T13:22:34.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T13:22:34.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:22:34.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:22:34.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: Cluster is now healthy 2023-10-08T13:22:34.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/4121834632' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:22:34.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.5:6838/607968745,v1:172.21.15.5:6839/607968745] up:boot 2023-10-08T13:22:34.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.5:6840/3938746131,v1:172.21.15.5:6841/3938746131] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6836/3272069829,v1:172.21.15.118:6838/3272069829] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6837/3032068077,v1:172.21.15.118:6839/3032068077] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6832/995389963,v1:172.21.15.118:6834/995389963] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.118:6833/2513471664,v1:172.21.15.118:6835/2513471664] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6832/2686606568,v1:172.21.15.60:6834/2686606568] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6836/3340523255,v1:172.21.15.60:6838/3340523255] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6833/3744618745,v1:172.21.15.60:6835/3744618745] up:boot 2023-10-08T13:22:34.771 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: mds.? [v2:172.21.15.60:6837/2588008295,v1:172.21.15.60:6839/2588008295] up:boot 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: fsmap 12 up:standby 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:22:34.772 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:22:34.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:22:34.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:22:34.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:22:34.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='mgr.14217 172.21.15.5:0/638070541' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:22:34.773 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:34 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1944075752' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 -- 172.21.15.5:0/3235197495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 msgr2=0x7f459410a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 --2- 172.21.15.5:0/3235197495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f459410a640 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f4584009990 tx=0x7f4584009ca0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 -- 172.21.15.5:0/3235197495 shutdown_connections 2023-10-08T13:22:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 --2- 172.21.15.5:0/3235197495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459410ac10 0x7f459410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 --2- 172.21.15.5:0/3235197495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4594101840 0x7f4594101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 --2- 172.21.15.5:0/3235197495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f459410a640 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 -- 172.21.15.5:0/3235197495 >> 172.21.15.5:0/3235197495 conn(0x7f45940fafc0 msgr2=0x7f45940fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 -- 172.21.15.5:0/3235197495 shutdown_connections 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 -- 172.21.15.5:0/3235197495 wait complete. 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 Processor -- start 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.869+0000 7f459c381700 1 -- start start 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459c381700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4594101840 0x7f45940ff490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459c381700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f45940ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459c381700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459410ac10 0x7f45940fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459c381700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a4f40 con 0x7f4594102160 2023-10-08T13:22:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459c381700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a50b0 con 0x7f4594101840 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459c381700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a5270 con 0x7f459410ac10 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f45940ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f45940ff9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39370/0 (socket says 172.21.15.5:39370) 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 -- 172.21.15.5:0/38625024 learned_addr learned my addr 172.21.15.5:0/38625024 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459a11d700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4594101840 0x7f45940ff490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459a91e700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459410ac10 0x7f45940fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 -- 172.21.15.5:0/38625024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459410ac10 msgr2=0x7f45940fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459410ac10 0x7f45940fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 -- 172.21.15.5:0/38625024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4594101840 msgr2=0x7f45940ff490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4594101840 0x7f45940ff490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 -- 172.21.15.5:0/38625024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840095f0 con 0x7f4594102160 2023-10-08T13:22:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f459991c700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f45940ff9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f458400f6a0 tx=0x7f458400f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.870+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458401d070 con 0x7f4594102160 2023-10-08T13:22:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.871+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f458400fca0 con 0x7f4594102160 2023-10-08T13:22:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.871+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45941a54f0 con 0x7f4594102160 2023-10-08T13:22:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.871+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584017650 con 0x7f4594102160 2023-10-08T13:22:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.871+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45941a59f0 con 0x7f4594102160 2023-10-08T13:22:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.872+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4594105d30 con 0x7f4594102160 2023-10-08T13:22:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.873+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4584017870 con 0x7f4594102160 2023-10-08T13:22:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.873+0000 7f458b7fe700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45800a1670 0x7f45800a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.873+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 9227+0+0 (secure 0 0 0) 0x7f45840ce7a0 con 0x7f4594102160 2023-10-08T13:22:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.873+0000 7f459a11d700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45800a1670 0x7f45800a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.874+0000 7f459a11d700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45800a1670 0x7f45800a3b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:34.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:34.878+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4584097890 con 0x7f4594102160 2023-10-08T13:22:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.084+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4594068220 con 0x7f4594102160 2023-10-08T13:22:35.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:35 smithi060 ceph-mon[103190]: pgmap v818: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 12 op/s 2023-10-08T13:22:35.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:35 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1944075752' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:35.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:35 smithi060 ceph-mon[103190]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T13:22:35.659 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:35 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/38625024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:35.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:35 smithi005 ceph-mon[99496]: pgmap v818: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 12 op/s 2023-10-08T13:22:35.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:35 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1944075752' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:35.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:35 smithi005 ceph-mon[99496]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T13:22:35.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:35 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/38625024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:35.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.721+0000 7f458b7fe700 1 -- 172.21.15.5:0/38625024 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7f458409aeb0 con 0x7f4594102160 2023-10-08T13:22:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45800a1670 msgr2=0x7f45800a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45800a1670 0x7f45800a3b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).stop 2023-10-08T13:22:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 msgr2=0x7f45940ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f45940ff9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f458400f6a0 tx=0x7f458400f780 comp rx=0 tx=0).stop 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 shutdown_connections 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f45800a1670 0x7f45800a3b30 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).stop 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f459410ac10 0x7f45940fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4594101840 0x7f45940ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 --2- 172.21.15.5:0/38625024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4594102160 0x7f45940ff9d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.728+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 >> 172.21.15.5:0/38625024 conn(0x7f45940fafc0 msgr2=0x7f45940fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.729+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 shutdown_connections 2023-10-08T13:22:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.729+0000 7f459c381700 1 -- 172.21.15.5:0/38625024 wait complete. 2023-10-08T13:22:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-10-08T13:22:35.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-08T13:22:35.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:35 smithi118 ceph-mon[104234]: pgmap v818: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 12 op/s 2023-10-08T13:22:35.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:35 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1944075752' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:35.769 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:35 smithi118 ceph-mon[104234]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T13:22:35.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:35 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/38625024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 -- 172.21.15.5:0/3468435421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 msgr2=0x7f5a140ff000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 --2- 172.21.15.5:0/3468435421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ff000 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5a100099c0 tx=0x7f5a10009cd0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 -- 172.21.15.5:0/3468435421 shutdown_connections 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 --2- 172.21.15.5:0/3468435421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a140ff540 0x7f5a1410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 --2- 172.21.15.5:0/3468435421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a14106640 0x7f5a14106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 --2- 172.21.15.5:0/3468435421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ff000 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 -- 172.21.15.5:0/3468435421 >> 172.21.15.5:0/3468435421 conn(0x7f5a14075b10 msgr2=0x7f5a140fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.888+0000 7f5a1c793700 1 -- 172.21.15.5:0/3468435421 shutdown_connections 2023-10-08T13:22:35.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 -- 172.21.15.5:0/3468435421 wait complete. 2023-10-08T13:22:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 Processor -- start 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 -- start start 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a140ff540 0x7f5a141002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a14106640 0x7f5a141007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141a4f10 con 0x7f5a140feb80 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141a5080 con 0x7f5a14106640 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.889+0000 7f5a1c793700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141a5240 con 0x7f5a140ff540 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39382/0 (socket says 172.21.15.5:39382) 2023-10-08T13:22:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 -- 172.21.15.5:0/1616041873 learned_addr learned my addr 172.21.15.5:0/1616041873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a19d2e700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a140ff540 0x7f5a141002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1ad30700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a14106640 0x7f5a141007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 -- 172.21.15.5:0/1616041873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a140ff540 msgr2=0x7f5a141002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a140ff540 0x7f5a141002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 -- 172.21.15.5:0/1616041873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a14106640 msgr2=0x7f5a141007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a14106640 0x7f5a141007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 -- 172.21.15.5:0/1616041873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100095f0 con 0x7f5a140feb80 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1a52f700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ffd60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b530 tx=0x7f5a0400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04011830 con 0x7f5a140feb80 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a04011e50 con 0x7f5a140feb80 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a141a5520 con 0x7f5a140feb80 2023-10-08T13:22:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400f2e0 con 0x7f5a140feb80 2023-10-08T13:22:35.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.890+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a141a5a50 con 0x7f5a140feb80 2023-10-08T13:22:35.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.891+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14108c30 con 0x7f5a140feb80 2023-10-08T13:22:35.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.892+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5a040105a0 con 0x7f5a140feb80 2023-10-08T13:22:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.893+0000 7f5a0b7fe700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5a000a16f0 0x7f5a000a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.893+0000 7f5a19d2e700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5a000a16f0 0x7f5a000a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.893+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8639+0+0 (secure 0 0 0) 0x7f5a040cca40 con 0x7f5a140feb80 2023-10-08T13:22:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.893+0000 7f5a19d2e700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5a000a16f0 0x7f5a000a3bb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009990 tx=0x7f5a10003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:35.897+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5a04095da0 con 0x7f5a140feb80 2023-10-08T13:22:36.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:36.104+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a14101240 con 0x7f5a140feb80 2023-10-08T13:22:37.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/38625024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:37.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:36 smithi118 ceph-mon[104234]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T13:22:37.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:36 smithi118 ceph-mon[104234]: pgmap v821: 33 pgs: 33 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:22:37.020 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:36 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1616041873' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.054+0000 7f5a0b7fe700 1 -- 172.21.15.5:0/1616041873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v115) v1 ==== 178+0+0 (secure 0 0 0) 0x7f5a040993c0 con 0x7f5a140feb80 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5a000a16f0 msgr2=0x7f5a000a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5a000a16f0 0x7f5a000a3bb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009990 tx=0x7f5a10003680 comp rx=0 tx=0).stop 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 msgr2=0x7f5a140ffd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ffd60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b530 tx=0x7f5a0400b840 comp rx=0 tx=0).stop 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 shutdown_connections 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:6800/706171785,v1:172.21.15.5:6801/706171785] conn(0x7f5a000a16f0 0x7f5a000a3bb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a14106640 0x7f5a141007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a140feb80 0x7f5a140ffd60 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 --2- 172.21.15.5:0/1616041873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a140ff540 0x7f5a141002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.060+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 >> 172.21.15.5:0/1616041873 conn(0x7f5a14075b10 msgr2=0x7f5a140fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.061+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 shutdown_connections 2023-10-08T13:22:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-10-08T13:22:37.061+0000 7f5a1c793700 1 -- 172.21.15.5:0/1616041873 wait complete. 2023-10-08T13:22:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2023-10-08T13:22:37.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:22:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/38625024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:36 smithi005 ceph-mon[99496]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T13:22:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:36 smithi005 ceph-mon[99496]: pgmap v821: 33 pgs: 33 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:22:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:36 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1616041873' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:37.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:22:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/38625024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:36 smithi060 ceph-mon[103190]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T13:22:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:36 smithi060 ceph-mon[103190]: pgmap v821: 33 pgs: 33 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:22:37.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:36 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1616041873' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:22:37.371 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:22:37.452 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-08T13:22:37.452 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:22:37.506 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:22:37.707 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:22:37.748 INFO:tasks.cephadm:Stopping all daemons... 2023-10-08T13:22:37.748 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-08T13:22:37.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T13:22:38.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:37 smithi005 systemd[1]: Stopping Ceph mon.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:38.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:38 smithi005 ceph-mon[99496]: from='client.? 172.21.15.5:0/1616041873' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:38.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:38 smithi005 ceph-mon[99496]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T13:22:38.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:38 smithi060 ceph-mon[103190]: from='client.? 172.21.15.5:0/1616041873' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:38.409 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:38 smithi060 ceph-mon[103190]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T13:22:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a[99472]: 2023-10-08T13:22:38.225+0000 7fa7e2aae700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:22:38.422 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a[99472]: 2023-10-08T13:22:38.225+0000 7fa7e2aae700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-08T13:22:38.519 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:38 smithi118 ceph-mon[104234]: from='client.? 172.21.15.5:0/1616041873' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:22:38.520 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:38 smithi118 ceph-mon[104234]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T13:22:38.923 INFO:journalctl@ceph.mon.a.smithi005.stdout:Oct 08 13:22:38 smithi005 bash[188405]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T13:22:39.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-08T13:22:39.166 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:22:39.166 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-08T13:22:39.167 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-08T13:22:39.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.b 2023-10-08T13:22:39.658 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:39 smithi060 systemd[1]: Stopping Ceph mon.b for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:39 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-b[103165]: 2023-10-08T13:22:39.851+0000 7fae783a0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:22:40.159 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:39 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-b[103165]: 2023-10-08T13:22:39.851+0000 7fae783a0700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-08T13:22:40.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Oct 08 13:22:40 smithi060 bash[147142]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-b 2023-10-08T13:22:40.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-08T13:22:40.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:22:40.965 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-08T13:22:40.965 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-08T13:22:40.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.c 2023-10-08T13:22:41.522 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:41 smithi118 systemd[1]: Stopping Ceph mon.c for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:43.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-c[104208]: 2023-10-08T13:22:43.373+0000 7fdc1cf1d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:22:43.770 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-c[104208]: 2023-10-08T13:22:43.373+0000 7fdc1cf1d700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-08T13:22:45.270 INFO:journalctl@ceph.mon.c.smithi118.stdout:Oct 08 13:22:44 smithi118 bash[148352]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mon-c 2023-10-08T13:22:46.650 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-08T13:22:46.973 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:22:46.973 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-08T13:22:46.974 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-08T13:22:46.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T13:22:47.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:22:47 smithi005 systemd[1]: Stopping Ceph mgr.x for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:48.422 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:22:48 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x[99738]: 2023-10-08T13:22:48.142+0000 7f1d2d88e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:22:49.171 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Oct 08 13:22:48 smithi005 bash[188554]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-x 2023-10-08T13:22:49.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-08T13:22:49.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:22:49.256 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-08T13:22:49.256 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-08T13:22:49.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.y 2023-10-08T13:22:49.658 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 13:22:49 smithi060 systemd[1]: Stopping Ceph mgr.y for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:51.408 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 13:22:51 smithi060 bash[147282]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-y 2023-10-08T13:22:52.719 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Oct 08 13:22:52 smithi060 systemd[1]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-08T13:22:52.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-08T13:22:52.765 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:22:52.765 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-08T13:22:52.765 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-08T13:22:52.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.z 2023-10-08T13:22:53.205 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 13:22:52 smithi118 systemd[1]: Stopping Ceph mgr.z for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:53.760 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 13:22:53 smithi118 bash[148505]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mgr-z 2023-10-08T13:22:53.760 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 13:22:53 smithi118 systemd[1]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-08T13:22:53.762 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 13:22:53 smithi118 systemd[1]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.z.service: Failed with result 'exit-code'. 2023-10-08T13:22:53.762 INFO:journalctl@ceph.mgr.z.smithi118.stdout:Oct 08 13:22:53 smithi118 systemd[1]: Stopped Ceph mgr.z for f92d23c2-65d9-11ee-8db5-212e2dc638e7. 2023-10-08T13:22:53.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-08T13:22:53.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:22:53.801 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-08T13:22:53.801 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-08T13:22:53.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.0 2023-10-08T13:22:54.171 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:22:53 smithi005 systemd[1]: Stopping Ceph osd.0 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:22:54.671 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:22:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0[125668]: 2023-10-08T13:22:54.172+0000 7fa93ce78700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:22:54.672 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:22:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0[125668]: 2023-10-08T13:22:54.172+0000 7fa93ce78700 -1 osd.0 115 *** Got signal Terminated *** 2023-10-08T13:22:54.672 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:22:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0[125668]: 2023-10-08T13:22:54.172+0000 7fa93ce78700 -1 osd.0 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:00.153 INFO:journalctl@ceph.osd.0.smithi005.stdout:Oct 08 13:23:00 smithi005 bash[188701]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-0 2023-10-08T13:23:01.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-08T13:23:01.973 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:01.974 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-08T13:23:01.974 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-08T13:23:01.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.1 2023-10-08T13:23:02.267 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:23:02 smithi060 systemd[1]: Stopping Ceph osd.1 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:02.659 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:23:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1[109411]: 2023-10-08T13:23:02.385+0000 7f608468e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:02.659 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:23:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1[109411]: 2023-10-08T13:23:02.385+0000 7f608468e700 -1 osd.1 115 *** Got signal Terminated *** 2023-10-08T13:23:02.659 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:23:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1[109411]: 2023-10-08T13:23:02.385+0000 7f608468e700 -1 osd.1 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:08.909 INFO:journalctl@ceph.osd.1.smithi060.stdout:Oct 08 13:23:08 smithi060 bash[147460]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-1 2023-10-08T13:23:10.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-08T13:23:10.158 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:10.158 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-08T13:23:10.158 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-08T13:23:10.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.2 2023-10-08T13:23:10.519 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:23:10 smithi118 systemd[1]: Stopping Ceph osd.2 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:11.019 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:23:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2[111295]: 2023-10-08T13:23:10.544+0000 7f4d23107700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:11.020 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:23:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2[111295]: 2023-10-08T13:23:10.544+0000 7f4d23107700 -1 osd.2 115 *** Got signal Terminated *** 2023-10-08T13:23:11.020 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:23:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2[111295]: 2023-10-08T13:23:10.544+0000 7f4d23107700 -1 osd.2 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:17.269 INFO:journalctl@ceph.osd.2.smithi118.stdout:Oct 08 13:23:16 smithi118 bash[148653]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-2 2023-10-08T13:23:18.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-08T13:23:18.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:18.611 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-08T13:23:18.611 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-08T13:23:18.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.3 2023-10-08T13:23:18.921 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:18 smithi005 systemd[1]: Stopping Ceph osd.3 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:19.421 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:19 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:23:19.002+0000 7f28a911b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:19.422 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:19 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:23:19.002+0000 7f28a911b700 -1 osd.3 115 *** Got signal Terminated *** 2023-10-08T13:23:19.422 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:19 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:23:19.002+0000 7f28a911b700 -1 osd.3 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:21.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:20.856+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:21.271 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:20.941+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:22.269 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:21.854+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:22.270 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:21.904+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:22.270 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:21.800+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:22.422 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:22 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:23:22.156+0000 7f28a370d700 -1 osd.3 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:58.389236+0000 front 2023-10-08T13:22:58.389273+0000 (oldest deadline 2023-10-08T13:23:21.289345+0000) 2023-10-08T13:23:23.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:22.867+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:23.270 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:22.837+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:23.270 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:22.942+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:23.545 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:23 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3[133760]: 2023-10-08T13:23:23.194+0000 7f28a370d700 -1 osd.3 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:58.389236+0000 front 2023-10-08T13:22:58.389273+0000 (oldest deadline 2023-10-08T13:23:21.289345+0000) 2023-10-08T13:23:23.921 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:23 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:23.544+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:24.269 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:23.833+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:24.270 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:23.854+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:24.270 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:23.913+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:24.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:24 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:24.522+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:25.269 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:24.874+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:25.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:24.874+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:25.270 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:24.879+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:25.422 INFO:journalctl@ceph.osd.3.smithi005.stdout:Oct 08 13:23:25 smithi005 bash[188968]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-3 2023-10-08T13:23:25.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:25 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:25.499+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:26.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:25 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:25.672+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:26.271 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:25.921+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:26.271 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:25.884+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:26.271 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:25.867+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:26.651 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:26 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:26.541+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:26.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-08T13:23:26.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:26.702 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-08T13:23:26.702 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-08T13:23:26.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.4 2023-10-08T13:23:27.075 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:26 smithi060 systemd[1]: Stopping Ceph osd.4 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:27.076 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:26 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:26.709+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:27.269 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:26.846+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:27.270 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:26.966+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:27.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:26.845+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:27.408 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:27 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:23:27.074+0000 7f5684ccc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:27.409 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:27 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:23:27.074+0000 7f5684ccc700 -1 osd.4 115 *** Got signal Terminated *** 2023-10-08T13:23:27.409 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:27 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:23:27.074+0000 7f5684ccc700 -1 osd.4 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:27.921 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:27 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:27.496+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:28.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:27 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:27.697+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:28.270 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:28 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:28.002+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:28.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:27.800+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:28.270 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:27.796+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:28.908 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:28 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:28.692+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:28.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:28 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:28.562+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:28.921 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:28 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:28.507+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:29.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:28 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:28.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:29.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:28 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:28.763+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:29.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:28 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:28.763+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:29.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:29 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:29.036+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:29.908 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:29 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:23:29.621+0000 7f5680ac1700 -1 osd.4 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:05.990263+0000 front 2023-10-08T13:23:05.990411+0000 (oldest deadline 2023-10-08T13:23:29.490390+0000) 2023-10-08T13:23:29.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:29 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:29.588+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:29.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:29 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:29.645+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:29.921 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:29 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:29.470+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:30.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:29 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:29.749+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:30.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:29 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:29.749+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:30.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:29 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:29.763+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:30.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:29 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:29.763+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:30.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:30 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:30.051+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:30.908 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:30 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:23:30.636+0000 7f5680ac1700 -1 osd.4 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:05.990263+0000 front 2023-10-08T13:23:05.990411+0000 (oldest deadline 2023-10-08T13:23:29.490390+0000) 2023-10-08T13:23:30.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:30 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:30.556+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:30.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:30 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:30.630+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:30.921 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:30.507+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:30.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:30.507+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:30.922 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:30.703+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:31.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:30 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:30.780+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:31.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:30 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:30.780+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:31.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:30 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:30.737+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:31.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:30 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:30.737+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:31.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:31 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:31.086+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:31.908 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:31 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4[117276]: 2023-10-08T13:23:31.663+0000 7f5680ac1700 -1 osd.4 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:05.990263+0000 front 2023-10-08T13:23:05.990411+0000 (oldest deadline 2023-10-08T13:23:29.490390+0000) 2023-10-08T13:23:31.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:31 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:31.528+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:31.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:31 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:31.642+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:31.921 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:31 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:31.685+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:31.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:31 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:31.554+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:31.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:31 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:31.554+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:32.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:31 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:31.734+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:32.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:31 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:31.734+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:32.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:31 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:31.825+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:32.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:31 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:31.825+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:32.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:32.111+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:32.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:32 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:32.578+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:32.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:32 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:32.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:32.921 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:32.694+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:32.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:32.581+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:32.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:32 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:32.581+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:33.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:32.741+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:33.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:32.741+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:33.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:32.850+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:33.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:32 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:32.850+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:33.408 INFO:journalctl@ceph.osd.4.smithi060.stdout:Oct 08 13:23:33 smithi060 bash[147755]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-4 2023-10-08T13:23:33.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:33 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:33.131+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:33.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:33 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:33.131+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:33.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:33.552+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:33.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:33 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:33.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:33.921 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:33.738+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:33.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:33.561+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:33.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:33.561+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:34.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:33 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:33.700+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:34.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:33 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:33.700+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:34.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:33 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:33.870+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:34.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:33 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:33.870+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:34.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:34.085+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:34.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:34.085+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:34.658 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:34 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:34.591+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:34.736 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-08T13:23:34.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:34.778 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-08T13:23:34.778 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-08T13:23:34.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.5 2023-10-08T13:23:34.922 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:34 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:34.728+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:34.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:34 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:34.522+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:34.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:34 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:34.522+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:35.019 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:34 smithi118 systemd[1]: Stopping Ceph osd.5 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:35.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:34.678+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:35.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:34.678+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:35.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:34.882+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:35.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:34 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:34.882+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:35.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:34 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:34.729+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:35.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:35.121+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:35.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:35.121+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:35.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:35.139+0000 7f4b6d44b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:35.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:35.139+0000 7f4b6d44b700 -1 osd.5 115 *** Got signal Terminated *** 2023-10-08T13:23:35.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:35.139+0000 7f4b6d44b700 -1 osd.5 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:35.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:35 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:35.639+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:35.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:35 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:35.744+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:35.921 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:35.709+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:35.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:35.495+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:35.922 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:35 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:35.495+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:36.021 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:35.904+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:36.022 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:35.904+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:36.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:35.680+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:36.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:35 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:35.680+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:36.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:36.074+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:36.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:36.074+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:36.727 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:36.464+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:36.727 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:36.464+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:36.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:36 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:36.603+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:36.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:36 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:36.711+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:37.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:36.893+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:37.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:36.894+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:37.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:36.894+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:37.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:36.689+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:37.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:36 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:36.689+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:37.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:36.726+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:37.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:36.726+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:37.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:37.117+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:37.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:37.117+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:37.743 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:37.425+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:37.743 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:37.425+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:37.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:37 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:37.630+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:37.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:37 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:37.630+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:37.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:37 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:37.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:37.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:37 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:37.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:37.929 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:37.657+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:37.929 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:37.657+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:37.930 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:37.657+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:38.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:37.742+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:38.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:37 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:37.742+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:38.269 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:38.112+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:38.270 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:38.112+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:38.273 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:37.928+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:38.274 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:37.928+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:38.274 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:37 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:37.928+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:38.758 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:38.423+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:38.758 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:38.423+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:38.758 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:38.423+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:38.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:38 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:38.589+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:38.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:38 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:38.589+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:38.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:38 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:38.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:38.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:38 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:38.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:39.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:38.690+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:39.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:38.690+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:39.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:38.690+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:39.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:38.906+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:39.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:38.906+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:39.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:38 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:38.906+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:39.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:38.757+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:39.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:38 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:38.757+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:39.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:39.098+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:39.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:39.098+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:39.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:39.387+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:39.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:39.387+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:39.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:39.387+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:39.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:39 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:39.551+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:39.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:39 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:39.551+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:39.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:39 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:39.696+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:39.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:39 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:39.696+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:40.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:39.694+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:40.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:39.694+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:40.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:39.694+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:40.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:39.893+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:40.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:39.893+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:40.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:39 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:39.893+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:40.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:39.734+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:40.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:39 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:39.734+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:40.519 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:40.058+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:56.350210+0000 front 2023-10-08T13:22:56.350238+0000 (oldest deadline 2023-10-08T13:23:21.050353+0000) 2023-10-08T13:23:40.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:40.058+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:06.351425+0000 front 2023-10-08T13:23:06.351661+0000 (oldest deadline 2023-10-08T13:23:32.251632+0000) 2023-10-08T13:23:40.520 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5[119375]: 2023-10-08T13:23:40.058+0000 7f4b67a3d700 -1 osd.5 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.952890+0000 front 2023-10-08T13:23:13.952772+0000 (oldest deadline 2023-10-08T13:23:39.252935+0000) 2023-10-08T13:23:40.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:40.413+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:40.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:40.413+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:40.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:40.413+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:40.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:40 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:40.545+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:40.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:40 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:40.545+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:40.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:40 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:40.684+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:40.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:40 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:40.684+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:41.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:40.670+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:41.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:40.670+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:41.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:40.670+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:41.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:40.870+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:41.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:40.870+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:41.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:40 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:40.870+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:41.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:40.749+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:41.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:40 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:40.749+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:41.708 INFO:journalctl@ceph.osd.5.smithi118.stdout:Oct 08 13:23:41 smithi118 bash[148914]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-5 2023-10-08T13:23:41.790 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:41.436+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:41.790 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:41.437+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:41.790 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:41.437+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:41.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:41 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:41.515+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:41.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:41 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:41.515+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:41.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:41 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:41.715+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:41.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:41 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:41.715+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:42.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:41 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:41.848+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:42.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:41 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:41.848+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:42.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:41 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:41.848+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:42.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:41 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:41.707+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:42.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:41 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:41.707+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:42.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:41 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:41.707+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:42.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:41.789+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:42.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:41.789+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:42.770 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:42 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:42.659+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:42.770 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:42 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:42.659+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:42.770 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:42 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:42.659+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:42.829 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:42.477+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:42.829 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:42.477+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:42.829 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:42.477+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:42.874 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-08T13:23:42.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:42 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:42.470+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:42.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:42 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:42.470+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:42.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:42 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:42.706+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:42.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:42 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:42.706+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:42.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:42.913 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-08T13:23:42.914 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-08T13:23:42.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.6 2023-10-08T13:23:43.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:42.828+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:43.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:42 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:42.828+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:43.173 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:42 smithi005 systemd[1]: Stopping Ceph osd.6 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:43.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:42 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:42.801+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:43.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:42 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:42.801+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:43.270 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:42 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:42.801+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:43.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:43.449+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:43.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:43.449+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:43.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:43.449+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:43.672 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:43.273+0000 7f365d79d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:43.672 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:43.273+0000 7f365d79d700 -1 osd.6 115 *** Got signal Terminated *** 2023-10-08T13:23:43.672 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:43.273+0000 7f365d79d700 -1 osd.6 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:43.717 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:43 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:43.432+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:43.717 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:43 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:43.432+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:44.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:43.826+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:44.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:43.826+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:44.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:43.826+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:44.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:43.615+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:44.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:43.615+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:44.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:43 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:43.615+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:44.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:43 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:43.716+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:44.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:43 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:43.716+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:44.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:43.817+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:44.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:43 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:43.817+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:44.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:44.417+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:44.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:44.417+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:44.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:44.417+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:44.714 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:44 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:44.455+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:44.714 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:44 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:44.455+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:45.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:44 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:44.784+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:45.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:44 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:44.784+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:45.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:44 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:44.784+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:45.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:44 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:44.634+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:45.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:44 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:44.634+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:45.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:44 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:44.634+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:45.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:44 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:44.713+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:45.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:44 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:44.713+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:45.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:44.790+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:45.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:44 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:44.790+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:45.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:45.370+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:45.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:45.370+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:45.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:45.370+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:45.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:45.370+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:45.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:45 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:45.452+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:45.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:45 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:45.452+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:45.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:45 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:45.668+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:45.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:45 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:45.668+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:45.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:45 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:45.668+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:46.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:45.813+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:46.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:45.813+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:46.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:45.813+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:46.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:45.667+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:46.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:45.667+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:46.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:45 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:45.667+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:46.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:45.785+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:46.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:45 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:45.785+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:46.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:46.356+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:46.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:46.356+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:46.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:46.356+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:46.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:46.356+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:46.687 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:46.433+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:46.687 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:46.433+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:47.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:46.781+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:47.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:46.781+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:47.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:46.781+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:47.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:46.702+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:47.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:46.702+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:47.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:46 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:46.702+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:47.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:46.686+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:47.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:46.686+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:47.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:46.686+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:47.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:46.780+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:47.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:46.780+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:47.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:46 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:46.780+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:22.470142+0000 front 2023-10-08T13:23:22.470234+0000 (oldest deadline 2023-10-08T13:23:45.970376+0000) 2023-10-08T13:23:47.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:47.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:47.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:47.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:47.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:47.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:47.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:47.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:47.720 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:47.458+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:47.721 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:47.458+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:47.721 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:47.458+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:48.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:47.810+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:48.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:47.810+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:48.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:47.810+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:48.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:47.810+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:48.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:47.714+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:48.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:47.714+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:48.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:47 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:47.714+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:48.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:47.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:48.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:47.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:48.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:47 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:47.720+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:48.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:47.798+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.367265+0000 front 2023-10-08T13:23:04.367243+0000 (oldest deadline 2023-10-08T13:23:30.267426+0000) 2023-10-08T13:23:48.171 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:47.798+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.368622+0000 front 2023-10-08T13:23:14.368672+0000 (oldest deadline 2023-10-08T13:23:36.668657+0000) 2023-10-08T13:23:48.172 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:47 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6[142480]: 2023-10-08T13:23:47.798+0000 7f365658c700 -1 osd.6 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:22.470142+0000 front 2023-10-08T13:23:22.470234+0000 (oldest deadline 2023-10-08T13:23:45.970376+0000) 2023-10-08T13:23:48.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:48 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:48.328+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:48.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:48 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:48.328+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:48.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:48 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:48.328+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:48.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:48 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:48.328+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:48.758 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:48.424+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:48.758 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:48.424+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:48.758 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:48.424+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:49.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:48.770+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:49.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:48.770+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:49.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:48.770+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:49.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:48.770+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:49.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:48.754+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:49.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:48.754+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:49.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:48 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:48.754+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:49.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:48.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:49.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:48.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:49.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:48 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:48.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:49.349 INFO:journalctl@ceph.osd.6.smithi005.stdout:Oct 08 13:23:49 smithi005 bash[189240]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-6 2023-10-08T13:23:49.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:49 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:49.347+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:49.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:49 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:49.347+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:49.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:49 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:49.347+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:49.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:49 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:49.347+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:49.801 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:49.456+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:49.801 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:49.456+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:49.801 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:49.456+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:50.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:49.795+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:50.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:49.795+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:50.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:49.795+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:50.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:49.795+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:50.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:49.768+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:50.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:49.768+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:50.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:49 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:49.768+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:50.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:49.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:50.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:49.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:50.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:49.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:50.623 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:50 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:50.358+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:50.624 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:50 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:50.358+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:50.624 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:50 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:50.358+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:50.624 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:50 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:50.358+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:50.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-08T13:23:50.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:50.672 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-08T13:23:50.672 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-08T13:23:50.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.7 2023-10-08T13:23:50.816 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:50.470+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:50.817 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:50.470+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:50.817 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:50.470+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:50.817 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:50 smithi060 systemd[1]: Stopping Ceph osd.7 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:51.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:50.746+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:51.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:50.746+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:51.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:50.746+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:51.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:50.746+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:51.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:50.785+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:51.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:50.785+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:51.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:50 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:50.785+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:51.158 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:51.038+0000 7f683a288700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:51.159 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:51.038+0000 7f683a288700 -1 osd.7 115 *** Got signal Terminated *** 2023-10-08T13:23:51.159 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:51.038+0000 7f683a288700 -1 osd.7 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:51.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:50.815+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:51.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:50.815+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:51.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:50 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:50.815+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:51.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:51 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:51.318+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:51.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:51 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:51.318+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:51.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:51 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:51.318+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:51.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:51 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:51.318+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:51.822 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:51.503+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:51.822 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:51.503+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:51.822 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:51.503+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:52.021 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:51.737+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:52.021 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:51.737+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:52.021 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:51.737+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:52.021 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:51.737+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:52.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:51.742+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:52.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:51.742+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:52.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:51 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:51.742+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:52.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:51.821+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:52.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:51.821+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:52.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:51 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:51.821+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:52.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:52 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:52.285+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:52.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:52 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:52.285+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:52.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:52 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:52.285+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:52.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:52 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:52.285+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:52.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:52.541+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:52.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:52.541+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:52.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:52.541+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:52.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:52.784+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:52.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:52.784+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:52.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:52 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:52.784+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:53.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:52.741+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:53.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:52.741+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:53.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:52.741+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:53.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:52.741+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:53.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:52.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:53.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:52.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:53.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:52 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:52.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:53.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:53.267+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:53.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:53.267+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:53.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:53.267+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:53.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:53 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:53.267+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:53.782 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:53.518+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:53.783 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:53.518+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:53.783 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:53.518+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:54.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:53.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:54.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:53.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:54.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:53.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:54.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:53.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:54.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:53.741+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:54.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:53.741+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:54.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:53 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:53.741+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:54.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:53.782+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:54.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:53.782+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:54.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:53 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:53.782+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:54.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:54.287+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:54.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:54.287+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:54.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:54.287+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:54.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:54 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:54.287+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:54.908 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:54.566+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:54.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:54.566+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:54.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:54.566+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:54.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:54.789+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:54.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:54.789+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:54.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:54.789+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:54.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:54.789+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:23:55.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:54.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:54.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:54.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:54.732+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:54.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:54.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:54.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:55.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:54 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:54.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:23:55.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:55.271+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:55.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:55.271+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:55.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:55.271+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:55.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:55 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:55.271+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:55.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:55.591+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.428483+0000 front 2023-10-08T13:23:04.428578+0000 (oldest deadline 2023-10-08T13:23:28.528651+0000) 2023-10-08T13:23:55.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:55.591+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:11.330737+0000 front 2023-10-08T13:23:11.330690+0000 (oldest deadline 2023-10-08T13:23:37.230487+0000) 2023-10-08T13:23:55.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:55.591+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.131622+0000 front 2023-10-08T13:23:23.131813+0000 (oldest deadline 2023-10-08T13:23:47.231799+0000) 2023-10-08T13:23:55.909 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7[125991]: 2023-10-08T13:23:55.591+0000 7f6834079700 -1 osd.7 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.732651+0000 front 2023-10-08T13:23:30.732686+0000 (oldest deadline 2023-10-08T13:23:54.832897+0000) 2023-10-08T13:23:55.910 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:55.835+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:55.910 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:55.835+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:55.910 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:55.835+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:55.910 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:55 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:55.835+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:23:56.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:55.780+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:55.780+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:55.780+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:55.780+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:55.757+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:55.757+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:55.757+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:56.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:55 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:55.757+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:23:56.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:56.312+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:56.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:56.312+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:56.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:56.312+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:56.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:56.312+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:56.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:56 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:56.312+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:23:57.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:56.829+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:57.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:56.829+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:57.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:56.829+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:57.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:56.829+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:57.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:56.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:57.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:56.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:57.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:56.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:57.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:56 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:56.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:23:57.144 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:56 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:56.861+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:57.145 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:56 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:56.861+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:57.145 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:56 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:56.861+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:57.145 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:56 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:56.861+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:23:57.408 INFO:journalctl@ceph.osd.7.smithi060.stdout:Oct 08 13:23:57 smithi060 bash[148025]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-7 2023-10-08T13:23:57.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:57.294+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:57.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:57.294+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:57.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:57.294+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:57.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:57.294+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:57.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:57 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:57.294+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:23:58.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:57.849+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:58.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:57.849+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:58.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:57.849+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:58.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:57.849+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:58.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:57.767+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:58.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:57.767+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:58.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:57.767+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:58.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:57 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:57.767+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:23:58.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:57 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:57.836+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:58.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:57 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:57.836+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:58.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:57 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:57.836+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:58.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:57 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:57.836+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:23:58.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:58.289+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:58.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:58.289+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:58.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:58.289+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:58.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:58.289+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:58.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:58 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:58.289+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:23:58.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-08T13:23:58.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:23:58.750 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-08T13:23:58.751 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-08T13:23:58.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.8 2023-10-08T13:23:59.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:58 smithi118 systemd[1]: Stopping Ceph osd.8 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:23:59.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:58.899+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:23:59.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:58.899+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:23:59.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:58.899+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:23:59.021 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:58.899+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:23:59.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:58.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:23:59.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:58.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:23:59.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:58.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:23:59.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:58 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:58.729+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:23:59.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:58 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:58.841+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:23:59.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:58 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:58.841+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:23:59.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:58 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:58.841+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:23:59.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:58 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:58.841+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:23:59.520 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.128+0000 7fc800dac700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:23:59.520 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.128+0000 7fc800dac700 -1 osd.8 115 *** Got signal Terminated *** 2023-10-08T13:23:59.520 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.128+0000 7fc800dac700 -1 osd.8 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:23:59.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:59.311+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:23:59.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:59.311+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:23:59.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:59.311+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:23:59.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:59.311+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:23:59.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:23:59 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:23:59.311+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.875+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.875+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.875+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:23:59.875+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:59.761+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:59.761+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:59.761+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:00.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:23:59 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:23:59.761+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:00.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:59 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:59.858+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:00.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:59 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:59.858+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:00.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:59 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:59.858+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:00.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:23:59 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:23:59.858+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:00.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:00.297+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:00.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:00.297+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:00.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:00.297+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:00.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:00.297+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:00.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:00 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:00.297+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:00.831+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:00.831+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:00.831+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:00.831+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:00.716+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:00.716+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:00.716+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:01.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:00 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:00.716+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:01.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:00 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:00.842+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:01.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:00 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:00.842+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:01.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:00 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:00.842+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:01.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:00 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:00.842+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:01.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:01.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:01.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:01.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:01.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:01.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:01.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:01.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:01.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:01 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:01.322+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:02.019 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:01.838+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:01.838+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:01.838+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:01.838+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:01.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:01.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:01.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:02.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:01.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:02.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:01 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:01.805+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:02.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:01 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:01.805+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:02.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:01 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:01.805+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:02.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:01 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:01.805+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:02.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:01 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:01.805+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:02.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:02 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:02.301+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:02.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:02 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:02.301+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:02.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:02 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:02.301+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:02.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:02 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:02.301+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:02.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:02 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:02.301+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:02.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:02 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:02.301+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:03.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:02.862+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:24:03.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:02.862+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:24:03.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:02.862+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:24:03.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:02.862+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:24:03.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:02.862+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:36.781594+0000 front 2023-10-08T13:23:36.781650+0000 (oldest deadline 2023-10-08T13:24:02.081709+0000) 2023-10-08T13:24:03.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:02.752+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:03.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:02.752+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:03.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:02.752+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:03.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:02.752+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:03.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:02 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:02.752+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:03.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:02.760+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:03.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:02.760+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:03.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:02.760+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:03.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:02.760+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:03.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:02 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:02.760+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:03.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:03.324+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:03.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:03.324+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:03.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:03.324+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:03.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:03.324+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:03.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:03.324+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:03.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:03 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:03.324+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:03.877+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.274490+0000 front 2023-10-08T13:22:54.274583+0000 (oldest deadline 2023-10-08T13:23:20.174478+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:03.877+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:03.075728+0000 front 2023-10-08T13:23:03.075693+0000 (oldest deadline 2023-10-08T13:23:28.375655+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:03.877+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:12.977249+0000 front 2023-10-08T13:23:12.977237+0000 (oldest deadline 2023-10-08T13:23:36.477253+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:03.877+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:23.379562+0000 front 2023-10-08T13:23:23.379450+0000 (oldest deadline 2023-10-08T13:23:46.879319+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8[127307]: 2023-10-08T13:24:03.877+0000 7fc7fd3a2700 -1 osd.8 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:36.781594+0000 front 2023-10-08T13:23:36.781650+0000 (oldest deadline 2023-10-08T13:24:02.081709+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:03.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:03.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:04.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:03.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:04.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:03.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:04.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:03 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:03.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:04.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:03 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:03.751+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:04.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:03 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:03.751+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:04.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:03 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:03.751+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:04.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:03 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:03.751+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:04.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:03 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:03.751+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:04.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:04 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:04.319+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:04.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:04 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:04.319+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:04.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:04 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:04.319+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:04.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:04 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:04.319+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:04.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:04 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:04.319+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:04.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:04 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:04.319+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:05.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:04 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:04.709+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:05.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:04 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:04.709+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:05.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:04 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:04.709+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:05.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:04 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:04.709+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:05.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:04 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:04.709+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:05.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:04 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:04.758+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:05.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:04 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:04.758+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:05.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:04 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:04.758+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:05.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:04 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:04.758+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:05.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:04 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:04.758+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:05.519 INFO:journalctl@ceph.osd.8.smithi118.stdout:Oct 08 13:24:05 smithi118 bash[149181]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-8 2023-10-08T13:24:05.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:05 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:05.292+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:05.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:05 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:05.292+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:05.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:05 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:05.292+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:05.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:05 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:05.292+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:05.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:05 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:05.292+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:05.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:05 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:05.292+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:06.002 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:05.728+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:06.003 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:05.728+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:06.003 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:05.728+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:06.003 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:05.728+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:06.003 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:05.728+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:06.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:05 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:05.754+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:06.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:05 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:05.754+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:06.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:05 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:05.754+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:06.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:05 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:05.754+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:06.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:05 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:05.754+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:06.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:06.326+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:06.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:06.326+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:06.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:06.326+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:06.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:06.326+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:06.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:06.326+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:06.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:06.326+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:06.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-08T13:24:06.765 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:06.765 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-08T13:24:06.765 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-08T13:24:06.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.9 2023-10-08T13:24:07.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:06 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:06.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:07.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:06 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:06.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:07.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:06 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:06.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:07.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:06 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:06.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:07.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:06 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:06.744+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:07.137 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:06 smithi005 systemd[1]: Stopping Ceph osd.9 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:07.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:06.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:07.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:06.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:07.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:06.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:07.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:06.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:07.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:06 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:06.800+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.136+0000 7f04268f8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.136+0000 7f04268f8700 -1 osd.9 115 *** Got signal Terminated *** 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.136+0000 7f04268f8700 -1 osd.9 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.321+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.321+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.321+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.321+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:07.422 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.321+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:07.423 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:07 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:07.321+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:08.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:07 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:07.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:08.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:07 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:07.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:08.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:07 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:07.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:08.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:07 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:07.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:08.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:07 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:07.710+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:08.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:07 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:07.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:08.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:07 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:07.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:08.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:07 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:07.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:08.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:07 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:07.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:08.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:07 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:07.757+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:08.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:08 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:08.337+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:08.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:08 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:08.337+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:08.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:08 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:08.337+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:08.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:08 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:08.337+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:08.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:08 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:08.337+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:08.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:08 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:08.337+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:09.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:08 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:08.708+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:09.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:08 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:08.708+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:09.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:08 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:08.708+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:09.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:08 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:08.708+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:09.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:08 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:08.708+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:09.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:08 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:08.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:09.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:08 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:08.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:09.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:08 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:08.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:09.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:08 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:08.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:09.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:08 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:08.733+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:09.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:09 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:09.317+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:09.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:09 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:09.317+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:09.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:09 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:09.317+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:09.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:09 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:09.317+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:09.673 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:09 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:09.317+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:09.673 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:09 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:09.317+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:10.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:09 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:09.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:10.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:09 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:09.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:10.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:09 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:09.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:10.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:09 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:09.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:10.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:09 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:09.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:10.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:09 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:09.694+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:10.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:09 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:09.694+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:10.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:09 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:09.694+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:10.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:09 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:09.694+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:10.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:09 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:09.694+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:10.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:10 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:10.349+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:10.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:10 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:10.349+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:10.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:10 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:10.349+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:10.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:10 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:10.349+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:10.673 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:10 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:10.349+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:10.673 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:10 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:10.349+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:11.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:10.730+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:11.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:10.730+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:11.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:10.730+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:11.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:10.730+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:11.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:10.730+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:11.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:10 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:10.675+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:11.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:10 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:10.675+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:11.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:10 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:10.675+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:11.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:10 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:10.675+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:11.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:10 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:10.675+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:11.671 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:11 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:11.353+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:59.022365+0000 front 2023-10-08T13:22:59.022474+0000 (oldest deadline 2023-10-08T13:23:22.522541+0000) 2023-10-08T13:24:11.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:11 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:11.353+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:07.224230+0000 front 2023-10-08T13:23:07.224142+0000 (oldest deadline 2023-10-08T13:23:30.124073+0000) 2023-10-08T13:24:11.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:11 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:11.353+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:14.825524+0000 front 2023-10-08T13:23:14.825356+0000 (oldest deadline 2023-10-08T13:23:37.725292+0000) 2023-10-08T13:24:11.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:11 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:11.353+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:18.226378+0000 front 2023-10-08T13:23:18.226402+0000 (oldest deadline 2023-10-08T13:23:45.227214+0000) 2023-10-08T13:24:11.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:11 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:11.353+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.528259+0000 front 2023-10-08T13:23:30.528140+0000 (oldest deadline 2023-10-08T13:23:55.828259+0000) 2023-10-08T13:24:11.672 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:11 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9[150443]: 2023-10-08T13:24:11.353+0000 7f041f6e7700 -1 osd.9 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:35.829058+0000 front 2023-10-08T13:23:35.828938+0000 (oldest deadline 2023-10-08T13:24:01.728810+0000) 2023-10-08T13:24:12.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:11 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:11.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:12.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:11 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:11.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:12.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:11 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:11.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:12.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:11 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:11.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:12.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:11 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:11.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:12.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:11 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:11.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:12.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:11 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:11.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:12.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:11 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:11.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:12.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:11 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:11.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:12.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:11 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:11.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:12.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:11 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:11.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:12.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:11 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:11.719+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:13.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:12.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:13.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:12.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:13.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:12.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:13.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:12.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:13.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:12.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:13.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:12 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:12.681+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:13.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:12 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:12.678+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:13.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:12 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:12.678+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:13.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:12 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:12.678+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:13.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:12 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:12.678+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:13.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:12 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:12.678+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:13.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:12 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:12.678+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:13.414 INFO:journalctl@ceph.osd.9.smithi005.stdout:Oct 08 13:24:13 smithi005 bash[189511]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-9 2023-10-08T13:24:14.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:13.662+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:14.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:13.662+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:14.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:13.662+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:14.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:13.662+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:14.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:13.662+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:14.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:13.662+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:14.158 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:13 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:13.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:14.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:13 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:13.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:14.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:13 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:13.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:14.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:13 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:13.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:14.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:13 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:13.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:14.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:13 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:13.698+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:14.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-08T13:24:14.825 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:14.826 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-08T13:24:14.826 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-08T13:24:14.826 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.10 2023-10-08T13:24:15.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:14.668+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:15.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:14.668+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:15.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:14.668+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:15.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:14.668+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:15.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:14.668+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:15.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:14 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:14.668+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:15.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:14.682+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:15.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:14.682+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:15.159 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:14.682+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:15.160 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:14.682+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:15.160 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:14.682+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:15.160 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:14.682+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:15.160 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:14 smithi060 systemd[1]: Stopping Ceph osd.10 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:15.659 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.193+0000 7faa649f3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:15.659 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.193+0000 7faa649f3700 -1 osd.10 115 *** Got signal Terminated *** 2023-10-08T13:24:15.659 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.193+0000 7faa649f3700 -1 osd.10 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:24:16.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:15 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:15.712+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:16.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:15 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:15.712+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:16.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:15 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:15.712+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:16.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:15 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:15.712+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:16.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:15 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:15.712+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:16.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:15 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:15.712+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:16.161 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:16.161 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:16.161 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:16.161 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:16.161 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:16.162 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:15 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:15.680+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:16.908 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:16 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:16.638+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:16.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:16 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:16.638+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:16.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:16 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:16.638+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:16.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:16 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:16.638+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:16.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:16 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:16.638+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:16.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:16 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:16.638+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:17.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:16 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:16.725+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:17.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:16 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:16.725+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:17.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:16 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:16.725+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:17.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:16 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:16.725+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:17.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:16 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:16.725+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:17.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:16 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:16.725+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:17.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:17.910 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:17.910 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:17.911 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:17.911 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:17.911 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:17.912 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:17 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:17.592+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.988623+0000 front 2023-10-08T13:23:55.988673+0000 (oldest deadline 2023-10-08T13:24:17.088771+0000) 2023-10-08T13:24:18.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:17 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:17.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:18.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:17 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:17.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:18.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:17 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:17.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:18.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:17 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:17.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:18.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:17 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:17.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:18.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:17 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:17.746+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:18.908 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.596+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:18.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.596+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:18.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.596+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:18.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.596+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:18.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.596+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:18.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.596+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:18.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:18 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:18.597+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.988623+0000 front 2023-10-08T13:23:55.988673+0000 (oldest deadline 2023-10-08T13:24:17.088771+0000) 2023-10-08T13:24:19.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:18.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:19.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:18.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:19.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:18.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:19.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:18.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:19.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:18.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:19.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:18 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:18.721+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:54.877125+0000 front 2023-10-08T13:22:54.877181+0000 (oldest deadline 2023-10-08T13:23:25.477762+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.981341+0000 front 2023-10-08T13:23:13.981423+0000 (oldest deadline 2023-10-08T13:23:36.881569+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2023-10-08T13:23:19.183145+0000 front 2023-10-08T13:23:19.183272+0000 (oldest deadline 2023-10-08T13:23:45.083183+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:30.384384+0000 front 2023-10-08T13:23:30.384360+0000 (oldest deadline 2023-10-08T13:23:54.484512+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:38.486310+0000 front 2023-10-08T13:23:38.486285+0000 (oldest deadline 2023-10-08T13:24:01.386162+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.687368+0000 front 2023-10-08T13:23:46.687427+0000 (oldest deadline 2023-10-08T13:24:10.787378+0000) 2023-10-08T13:24:19.909 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:19 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10[134734]: 2023-10-08T13:24:19.579+0000 7faa5e7e4700 -1 osd.10 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.988623+0000 front 2023-10-08T13:23:55.988673+0000 (oldest deadline 2023-10-08T13:24:17.088771+0000) 2023-10-08T13:24:20.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:19.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:20.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:19.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:20.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:19.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:20.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:19.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:20.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:19.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:20.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:19 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:19.750+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:21.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:20.732+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:21.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:20.732+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:21.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:20.732+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:21.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:20.732+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:21.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:20.732+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:21.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:20 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:20.732+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:21.409 INFO:journalctl@ceph.osd.10.smithi060.stdout:Oct 08 13:24:21 smithi060 bash[148299]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-10 2023-10-08T13:24:22.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:22.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:22.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:22.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:22.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:22.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:22.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:21 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:21.685+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:22.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-08T13:24:22.690 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:22.690 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-08T13:24:22.690 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-08T13:24:22.690 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.11 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:22.650+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:23.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:22 smithi118 systemd[1]: Stopping Ceph osd.11 for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:23.520 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.065+0000 7f8a2f587700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:23.520 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.065+0000 7f8a2f587700 -1 osd.11 115 *** Got signal Terminated *** 2023-10-08T13:24:23.520 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.065+0000 7f8a2f587700 -1 osd.11 115 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:24:24.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:24.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:24.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:24.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:24.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:24.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:24.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:23 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:23.665+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:25.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:24 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:24.671+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:26.019 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:26.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:25 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:25.639+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6820 osd.8 since back 2023-10-08T13:24:00.958789+0000 front 2023-10-08T13:24:00.958824+0000 (oldest deadline 2023-10-08T13:24:25.058908+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:27.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:26 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:26.632+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6820 osd.8 since back 2023-10-08T13:24:00.958789+0000 front 2023-10-08T13:24:00.958824+0000 (oldest deadline 2023-10-08T13:24:25.058908+0000) 2023-10-08T13:24:28.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2023-10-08T13:22:55.048480+0000 front 2023-10-08T13:22:55.048415+0000 (oldest deadline 2023-10-08T13:23:20.348468+0000) 2023-10-08T13:24:28.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2023-10-08T13:23:04.950207+0000 front 2023-10-08T13:23:04.950234+0000 (oldest deadline 2023-10-08T13:23:29.650406+0000) 2023-10-08T13:24:28.020 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6804 osd.2 since back 2023-10-08T13:23:13.151431+0000 front 2023-10-08T13:23:13.151457+0000 (oldest deadline 2023-10-08T13:23:37.251545+0000) 2023-10-08T13:24:28.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2023-10-08T13:23:27.654347+0000 front 2023-10-08T13:23:27.654458+0000 (oldest deadline 2023-10-08T13:23:54.654849+0000) 2023-10-08T13:24:28.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6812 osd.5 since back 2023-10-08T13:23:39.955835+0000 front 2023-10-08T13:23:39.955875+0000 (oldest deadline 2023-10-08T13:24:02.255889+0000) 2023-10-08T13:24:28.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2023-10-08T13:23:46.956890+0000 front 2023-10-08T13:23:46.956927+0000 (oldest deadline 2023-10-08T13:24:11.056850+0000) 2023-10-08T13:24:28.021 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2023-10-08T13:23:55.658404+0000 front 2023-10-08T13:23:55.658444+0000 (oldest deadline 2023-10-08T13:24:20.958270+0000) 2023-10-08T13:24:28.022 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:27 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11[136083]: 2023-10-08T13:24:27.672+0000 7f8a29b79700 -1 osd.11 115 heartbeat_check: no reply from 172.21.15.118:6820 osd.8 since back 2023-10-08T13:24:00.958789+0000 front 2023-10-08T13:24:00.958824+0000 (oldest deadline 2023-10-08T13:24:25.058908+0000) 2023-10-08T13:24:29.269 INFO:journalctl@ceph.osd.11.smithi118.stdout:Oct 08 13:24:29 smithi118 bash[149456]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-osd-11 2023-10-08T13:24:30.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-08T13:24:30.539 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:30.539 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-08T13:24:30.539 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-08T13:24:30.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.a 2023-10-08T13:24:30.922 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:24:30 smithi005 systemd[1]: Stopping Ceph mds.a for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:31.421 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:24:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a[159028]: 2023-10-08T13:24:30.933+0000 7fda8b815700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:31.422 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:24:30 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a[159028]: 2023-10-08T13:24:30.933+0000 7fda8b815700 -1 mds.a *** got signal Terminated *** 2023-10-08T13:24:33.421 INFO:journalctl@ceph.mds.a.smithi005.stdout:Oct 08 13:24:33 smithi005 bash[189776]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-a 2023-10-08T13:24:33.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-08T13:24:33.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:33.501 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-08T13:24:33.501 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-08T13:24:33.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.d 2023-10-08T13:24:33.892 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:24:33 smithi005 systemd[1]: Stopping Ceph mds.d for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:34.171 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:24:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-d[158078]: 2023-10-08T13:24:33.891+0000 7fafe34a7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:34.172 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:24:33 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-d[158078]: 2023-10-08T13:24:33.891+0000 7fafe34a7700 -1 mds.d *** got signal Terminated *** 2023-10-08T13:24:36.053 INFO:journalctl@ceph.mds.d.smithi005.stdout:Oct 08 13:24:35 smithi005 bash[189922]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-d 2023-10-08T13:24:36.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-08T13:24:36.285 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:36.285 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-08T13:24:36.286 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-08T13:24:36.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.g 2023-10-08T13:24:36.672 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:24:36 smithi005 systemd[1]: Stopping Ceph mds.g for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:37.172 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:24:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g[158642]: 2023-10-08T13:24:36.698+0000 7fa1ce962700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:37.172 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:24:36 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g[158642]: 2023-10-08T13:24:36.698+0000 7fa1ce962700 -1 mds.g *** got signal Terminated *** 2023-10-08T13:24:41.171 INFO:journalctl@ceph.mds.g.smithi005.stdout:Oct 08 13:24:40 smithi005 bash[190064]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-g 2023-10-08T13:24:41.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-08T13:24:41.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:41.324 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-08T13:24:41.324 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-08T13:24:41.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.j 2023-10-08T13:24:41.671 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:24:41 smithi005 systemd[1]: Stopping Ceph mds.j for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:42.171 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:24:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-j[157695]: 2023-10-08T13:24:41.708+0000 7f4f9c63b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:42.172 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:24:41 smithi005 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-j[157695]: 2023-10-08T13:24:41.708+0000 7f4f9c63b700 -1 mds.j *** got signal Terminated *** 2023-10-08T13:24:46.068 INFO:journalctl@ceph.mds.j.smithi005.stdout:Oct 08 13:24:45 smithi005 bash[190210]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-j 2023-10-08T13:24:46.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-08T13:24:46.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:46.202 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-08T13:24:46.202 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-08T13:24:46.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.b 2023-10-08T13:24:46.574 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:24:46 smithi060 systemd[1]: Stopping Ceph mds.b for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:46.909 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:24:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b[141074]: 2023-10-08T13:24:46.571+0000 7f36a4bca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:46.909 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:24:46 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b[141074]: 2023-10-08T13:24:46.571+0000 7f36a4bca700 -1 mds.b *** got signal Terminated *** 2023-10-08T13:24:49.413 INFO:journalctl@ceph.mds.b.smithi060.stdout:Oct 08 13:24:49 smithi060 bash[148568]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-b 2023-10-08T13:24:49.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-08T13:24:49.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:49.568 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-08T13:24:49.568 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-08T13:24:49.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.e 2023-10-08T13:24:49.908 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:24:49 smithi060 systemd[1]: Stopping Ceph mds.e for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:50.408 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:24:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e[140389]: 2023-10-08T13:24:49.962+0000 7f1ecc0cc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:50.409 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:24:49 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e[140389]: 2023-10-08T13:24:49.962+0000 7f1ecc0cc700 -1 mds.e *** got signal Terminated *** 2023-10-08T13:24:53.658 INFO:journalctl@ceph.mds.e.smithi060.stdout:Oct 08 13:24:53 smithi060 bash[148710]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-e 2023-10-08T13:24:53.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-08T13:24:53.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:53.818 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-08T13:24:53.818 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-08T13:24:53.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.h 2023-10-08T13:24:54.158 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:24:53 smithi060 systemd[1]: Stopping Ceph mds.h for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:54.658 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:24:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h[140728]: 2023-10-08T13:24:54.203+0000 7f1d65b11700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:54.659 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:24:54 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h[140728]: 2023-10-08T13:24:54.203+0000 7f1d65b11700 -1 mds.h *** got signal Terminated *** 2023-10-08T13:24:57.370 INFO:journalctl@ceph.mds.h.smithi060.stdout:Oct 08 13:24:57 smithi060 bash[148854]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-h 2023-10-08T13:24:57.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-08T13:24:57.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:24:57.605 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-08T13:24:57.605 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-08T13:24:57.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.k 2023-10-08T13:24:57.908 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:24:57 smithi060 systemd[1]: Stopping Ceph mds.k for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:24:58.408 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:24:57 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k[140049]: 2023-10-08T13:24:57.977+0000 7f51d2fe6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:24:58.409 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:24:57 smithi060 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k[140049]: 2023-10-08T13:24:57.977+0000 7f51d2fe6700 -1 mds.k *** got signal Terminated *** 2023-10-08T13:25:01.358 INFO:journalctl@ceph.mds.k.smithi060.stdout:Oct 08 13:25:01 smithi060 bash[148999]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-k 2023-10-08T13:25:01.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-08T13:25:01.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:25:01.602 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-08T13:25:01.602 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-08T13:25:01.602 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.c 2023-10-08T13:25:01.977 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:25:01 smithi118 systemd[1]: Stopping Ceph mds.c for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:02.269 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:25:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-c[142296]: 2023-10-08T13:25:01.975+0000 7fe81f3ce700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:25:02.270 INFO:journalctl@ceph.mds.c.smithi118.stdout:Oct 08 13:25:01 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-c[142296]: 2023-10-08T13:25:01.975+0000 7fe81f3ce700 -1 mds.c *** got signal Terminated *** 2023-10-08T13:25:05.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-08T13:25:05.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:25:05.457 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-08T13:25:05.457 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-08T13:25:05.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.f 2023-10-08T13:25:05.769 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:25:05 smithi118 systemd[1]: Stopping Ceph mds.f for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:06.269 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:25:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f[141955]: 2023-10-08T13:25:05.833+0000 7f74c0664700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:25:06.270 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:25:05 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f[141955]: 2023-10-08T13:25:05.833+0000 7f74c0664700 -1 mds.f *** got signal Terminated *** 2023-10-08T13:25:09.519 INFO:journalctl@ceph.mds.f.smithi118.stdout:Oct 08 13:25:09 smithi118 bash[149866]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-f 2023-10-08T13:25:09.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-08T13:25:09.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:25:09.673 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-08T13:25:09.673 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-08T13:25:09.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.i 2023-10-08T13:25:10.019 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:25:09 smithi118 systemd[1]: Stopping Ceph mds.i for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:10.520 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:25:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: 2023-10-08T13:25:10.067+0000 7f115f8e6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:25:10.520 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:25:10 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i[142637]: 2023-10-08T13:25:10.067+0000 7f115f8e6700 -1 mds.i *** got signal Terminated *** 2023-10-08T13:25:13.269 INFO:journalctl@ceph.mds.i.smithi118.stdout:Oct 08 13:25:13 smithi118 bash[150019]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-i 2023-10-08T13:25:13.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-08T13:25:13.425 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:25:13.426 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-08T13:25:13.426 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-08T13:25:13.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.l 2023-10-08T13:25:13.770 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:25:13 smithi118 systemd[1]: Stopping Ceph mds.l for f92d23c2-65d9-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:14.269 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:25:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l[141604]: 2023-10-08T13:25:13.832+0000 7f0b8d337700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:25:14.270 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:25:13 smithi118 ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l[141604]: 2023-10-08T13:25:13.832+0000 7f0b8d337700 -1 mds.l *** got signal Terminated *** 2023-10-08T13:25:17.244 INFO:journalctl@ceph.mds.l.smithi118.stdout:Oct 08 13:25:17 smithi118 bash[150172]: ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7-mds-l 2023-10-08T13:25:17.366 DEBUG:teuthology.orchestra.run.smithi118:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f92d23c2-65d9-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-08T13:25:17.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:25:17.400 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-08T13:25:17.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:25:17.716 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:25:19.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:25:19.699 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:25:21.560 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:25:21.980 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:25:23.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:25:23.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:25:23.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:25:23.697 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-08T13:25:23.699 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi005/crash 2023-10-08T13:25:23.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:25:23.766 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:25:23.766 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:25:23.768 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi060/crash 2023-10-08T13:25:23.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:25:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:25:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:25:23.820 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi118/crash 2023-10-08T13:25:23.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:25:23.884 INFO:teuthology.orchestra.run.smithi118.stderr:tar: /var/lib/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:25:23.884 INFO:teuthology.orchestra.run.smithi118.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:25:23.885 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-08T13:25:23.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-08T13:25:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:grep: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-08T13:25:23.933 INFO:tasks.cephadm:Compressing logs... 2023-10-08T13:25:23.933 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:25:23.935 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:25:23.937 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:25:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:25:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:: No such file or directory 2023-10-08T13:25:23.973 INFO:teuthology.orchestra.run.smithi118.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:25:23.973 INFO:teuthology.orchestra.run.smithi118.stderr:: No such file or directory 2023-10-08T13:25:23.974 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:25:23.974 INFO:teuthology.orchestra.run.smithi060.stderr:: No such file or directory 2023-10-08T13:25:23.975 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-08T13:25:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-08T13:25:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-08T13:25:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-08T13:25:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-08T13:25:23.976 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-08T13:25:23.978 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:25:23.978 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.1.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-08T13:25:23.978 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-08T13:25:23.978 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-08T13:25:23.978 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.7.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-08T13:25:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-08T13:25:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-08T13:25:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-08T13:25:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-08T13:25:23.984 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.c.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:25:23.985 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-08T13:25:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.b.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 93.0% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-08T13:25:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.j.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.a.log: 94.2% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-08T13:25:23.986 INFO:teuthology.orchestra.run.smithi005.stderr: 94.2% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-08T13:25:23.986 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 93.1% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-08T13:25:23.991 INFO:teuthology.orchestra.run.smithi005.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-10-08T13:25:24.197 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:25:24.244 INFO:teuthology.orchestra.run.smithi118.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:25:24.260 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-08T13:25:24.263 INFO:teuthology.orchestra.run.smithi005.stderr: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:25:24.346 INFO:teuthology.orchestra.run.smithi060.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:25:24.515 INFO:teuthology.orchestra.run.smithi005.stderr: 93.1% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-08T13:25:24.989 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:25:25.090 INFO:teuthology.orchestra.run.smithi118.stderr: 91.0% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:25:25.381 INFO:teuthology.orchestra.run.smithi060.stderr: 93.4% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-08T13:25:26.425 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-08T13:25:26.697 INFO:teuthology.orchestra.run.smithi060.stderr: 93.8% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-08T13:25:26.805 INFO:teuthology.orchestra.run.smithi118.stderr: 94.2% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-08T13:25:26.898 INFO:teuthology.orchestra.run.smithi060.stderr: 92.1% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-08T13:25:27.853 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-08T13:25:28.141 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi060.stderr: 93.5% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-08T13:26:30.504 INFO:teuthology.orchestra.run.smithi060.stderr: 97.7% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-08T13:27:14.629 INFO:teuthology.orchestra.run.smithi118.stderr: 97.0% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-08T13:28:18.296 INFO:teuthology.orchestra.run.smithi060.stderr: 90.3% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-08T13:29:26.703 INFO:teuthology.orchestra.run.smithi060.stderr: 90.3% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-08T13:29:41.225 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-08T13:29:44.684 INFO:teuthology.orchestra.run.smithi060.stderr: 90.3% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-08T13:30:11.210 INFO:teuthology.orchestra.run.smithi118.stderr: 90.6% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-08T13:30:16.363 INFO:teuthology.orchestra.run.smithi118.stderr: 97.5% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-08T13:30:19.944 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-08T13:30:26.583 INFO:teuthology.orchestra.run.smithi118.stderr: 90.3% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-08T13:30:27.189 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-08T13:30:53.474 INFO:teuthology.orchestra.run.smithi118.stderr: 90.8% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-08T13:30:54.914 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-08T13:30:54.916 INFO:teuthology.orchestra.run.smithi060.stderr: 2023-10-08T13:30:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:real 5m30.965s 2023-10-08T13:30:54.917 INFO:teuthology.orchestra.run.smithi060.stderr:user 8m9.234s 2023-10-08T13:30:54.917 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m16.246s 2023-10-08T13:31:19.378 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-08T13:31:19.380 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-10-08T13:31:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:real 5m55.429s 2023-10-08T13:31:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:user 8m58.037s 2023-10-08T13:31:19.381 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m17.127s 2023-10-08T13:32:01.463 INFO:teuthology.orchestra.run.smithi118.stderr: 97.7% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-08T13:33:24.793 INFO:teuthology.orchestra.run.smithi118.stderr: 90.5% -- replaced with /var/log/ceph/f92d23c2-65d9-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-08T13:33:24.795 INFO:teuthology.orchestra.run.smithi118.stderr: 2023-10-08T13:33:24.795 INFO:teuthology.orchestra.run.smithi118.stderr:real 8m0.842s 2023-10-08T13:33:24.795 INFO:teuthology.orchestra.run.smithi118.stderr:user 9m22.452s 2023-10-08T13:33:24.796 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m23.382s 2023-10-08T13:33:24.796 INFO:tasks.cephadm:Archiving logs... 2023-10-08T13:33:24.796 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi005/log 2023-10-08T13:33:24.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:34:54.487 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi060/log 2023-10-08T13:34:54.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:36:14.174 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi118/log 2023-10-08T13:36:14.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:37:40.281 INFO:tasks.cephadm:Removing cluster... 2023-10-08T13:37:40.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:37:40.896 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:37:42.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:37:42.885 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:37:43.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f92d23c2-65d9-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:37:44.483 INFO:teuthology.orchestra.run.smithi118.stdout:Deleting cluster with fsid: f92d23c2-65d9-11ee-8db5-212e2dc638e7 2023-10-08T13:37:45.589 INFO:tasks.cephadm:Removing cephadm ... 2023-10-08T13:37:45.589 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:37:45.611 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:37:45.651 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:37:45.699 INFO:tasks.cephadm:Teardown complete 2023-10-08T13:37:45.699 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T13:37:45.710 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T13:37:45.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:37:45.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:37:45.715 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:37:45.828 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T13:37:45.839 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T13:37:45.839 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:37:45.842 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:37:45.845 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:37:45.859 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-10-08T13:37:45.861 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-08T13:37:45.861 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-10-08T13:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-10-08T13:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 +358us[ +358us] +/- 74ms 2023-10-08T13:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 +106us[ +146us] +/- 73ms 2023-10-08T13:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -399us[ -399us] +/- 75ms 2023-10-08T13:37:45.879 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:37:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:37:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-10-08T13:37:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +366us[ +366us] +/- 74ms 2023-10-08T13:37:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 +100us[ +122us] +/- 73ms 2023-10-08T13:37:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -402us[ -402us] +/- 75ms 2023-10-08T13:37:45.892 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:37:45.917 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:37:45.917 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-08T13:37:45.918 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +358us[ +358us] +/- 74ms 2023-10-08T13:37:45.918 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 +114us[ +146us] +/- 73ms 2023-10-08T13:37:45.918 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -413us[ -413us] +/- 75ms 2023-10-08T13:37:45.918 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:37:45.919 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T13:37:45.930 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T13:37:45.931 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T13:37:45.942 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:37:46.177 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:37:46.408 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:37:46.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:37:46.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:37:46.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:37:46.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:37:46.731 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:37:46.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:37:46.763 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T13:37:46.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T13:37:46.785 INFO:teuthology.task.internal:Duration was 3369.243324 seconds 2023-10-08T13:37:46.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T13:37:46.796 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T13:37:46.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:37:46.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:37:46.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:37:46.877 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:37:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:37:46.919 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:37:47.202 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T13:37:47.202 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2023-10-08T13:37:47.202 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:37:47.232 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2023-10-08T13:37:47.232 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:37:47.263 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-10-08T13:37:47.263 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:37:47.336 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T13:37:47.336 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:37:47.339 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:37:47.341 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:37:47.424 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T13:37:47.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:37:47.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:37:47.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:37:47.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T13:37:47.601 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T13:37:47.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:37:47.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:37:47.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:37:47.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T13:37:47.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:37:47.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:37:47.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:37:47.759 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2023-10-08T13:37:47.759 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2023-10-08T13:37:47.769 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-10-08T13:37:47.788 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:37:47.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:37:47.804 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:37:47.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:37:47.820 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:37:47.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:37:47.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T13:37:47.857 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T13:37:47.859 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi005 2023-10-08T13:37:47.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:37:47.905 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi060 2023-10-08T13:37:47.906 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:37:47.945 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960/remote/smithi118 2023-10-08T13:37:47.945 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:37:47.985 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T13:37:47.985 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:37:47.988 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:37:47.990 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:37:48.036 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T13:37:48.051 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T13:37:48.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T13:37:48.064 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T13:37:48.064 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:37:48.066 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:37:48.068 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:37:48.080 INFO:teuthology.orchestra.run.smithi005.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:37 /home/ubuntu/cephtest 2023-10-08T13:37:48.083 INFO:teuthology.orchestra.run.smithi060.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:37 /home/ubuntu/cephtest 2023-10-08T13:37:48.092 INFO:teuthology.orchestra.run.smithi118.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:37 /home/ubuntu/cephtest 2023-10-08T13:37:48.094 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T13:37:48.111 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T13:37:48.136 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T13:37:48.163 DEBUG:teuthology.nuke:shortname: smithi005 2023-10-08T13:37:48.163 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:37:48.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:35:30.818106', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:37:48.192 DEBUG:teuthology.nuke:shortname: smithi060 2023-10-08T13:37:48.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:37:48.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:35:30.816818', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:37:48.216 DEBUG:teuthology.nuke:shortname: smithi118 2023-10-08T13:37:48.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:37:48.244 INFO:teuthology.orchestra.console.smithi005:Power off 2023-10-08T13:37:48.245 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:37:48.253 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417960', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:35:30.814754', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:37:48.268 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-10-08T13:37:48.268 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:48.286 INFO:teuthology.orchestra.console.smithi060:Power off 2023-10-08T13:37:48.286 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:37:48.296 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-08T13:37:48.311 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-10-08T13:37:48.311 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:48.326 INFO:teuthology.orchestra.console.smithi118:Power off 2023-10-08T13:37:48.326 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:37:48.334 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-08T13:37:48.349 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-10-08T13:37:48.349 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:48.371 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-08T13:37:52.297 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:52.336 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:52.373 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:52.411 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-08T13:37:52.446 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-08T13:37:52.482 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-08T13:37:56.414 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:56.447 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:56.484 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:37:56.524 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-10-08T13:37:56.555 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-10-08T13:37:56.593 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-08T13:37:56.626 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-10-08T13:37:56.656 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-10-08T13:37:56.694 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-10-08T13:37:56.800 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} duration: 3369.243324279785 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2023-10-08T13:37:56.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T13:37:56.886 INFO:teuthology.run:FAIL